ModelOps, SchemaOps, MLOps - statnett/Talk2PowerSystem GitHub Wiki

CIM ModelOps vs SchemaOps vs MLOps – A Power System Digital Twin Perspective

ModelOps

In our work with Talk2PowerSystem, we use the term ModelOps to describe the lifecycle of changes to the electrical CIM instance data: the operational model of the power system represented in the Knowledge Graph. For example:

  • A new transmission line is built and energized.
  • That line must now be reflected in the operational model used for simulations, market calculations, and planning studies.

This is about managing the evolving state of the grid to maintain an up-to-date digital twin for system studies.

SchemaOps

Parallel to that, we have SchemaOps, focused on changes to the schema (CIM/CGMES ontology) itself:

  • Extending CIM to support new equipment types or concepts.
  • Aligning the schema with other standards or adding new details driven by regulatory changes or market design updates.

Both processes are critical — but distinct — in the lifecycle of power system models.

MLOps

Interestingly, when looking at the MLOps community (https://ml-ops.org/), we see many similar challenges:

  • Managing model versions
  • Ensuring data consistency
  • Validating operational correctness
  • Integrating reasoning or rule-based logic
  • Monitoring "model drift", i.e. long-term degradation of performance due to slow-changing instance data, enumerations and ontologies

The project includes a similar-named task, described as follows:

T2.3 ML Operations This task deals with the technical aspects of ML and LLM deployment.

  • Deploy open (locally deployable) LLMs. This is the foundation of reaching TRL 7 since Statnett data cannot leave the operational environment. But we can use more powerful LLMs to generate training datasets for less powerful LLMs.
  • Deployment (inference) architectures (GPU vs CPU e.g. Llama.cpp or Ollama) and optimizations (e.g. quantization). Experimentation with various LLM models and sizes (variants), taking into account required features and tradeoffs (e.g. between memory/speed and NLQ performance)
  • LLM fine tuning and adaptation (e.g. Low Rank Adaptation, LoRA). This increases LLM performance without requiring a full retraining.
  • ML ops: ML server configuration (we expect that Statnett will provision the servers). LLM deployments. Monitor server performance. Selection and optimization of LLM size and parameters. Training and retraining.

Conclusion

There is a lot we can leverage from MLOps best practices when defining our own ModelOps and SchemaOps: especially as we start adding reasoning rules and automated analyses into the Knowledge Graph.

The key differences:

  • CIM ModelOps: Managing the state of the power system, not a machine learning / statistical model.
  • SchemaOps: Maintaining semantic integrity as the underlying CIM schema evolves.
  • MLOps: Managing machine learning models that adapt, learn, and drift over time.

Yet, in the end: they all face the same core DevOps challenges:

  • Lifecycle management
  • Validation
  • Production deployment

This perspective strengthens the bridge between traditional power system modeling and modern DevOps-driven approaches.