Skip to content
ioc-projectPublic

About

System for Cognitive Observability, Provenance and Explainability

Resources

Code of conduct

Contributing

Security policy

Stars

15 stars

Watchers

0 watching

Forks

System for Cognitive Observability Provenance and Explainability (SCOPE)

SCOPE is a modular platform for observing, analyzing, and explaining the executions of Multi-Agent Systems (MAS) from OpenTelemetry traces. It ingests raw OTel spans, maps them onto a shared MAS ontology, and enriches each session with analysis such as semantic grouping, anomaly detection, consistency checking, and stateful trajectory evaluation — surfaced through a web dashboard.

How it works

  1. A MAS sends OTel spans to an OTel collector, which stores them (ClickHouse by default, swappable for another backend).
  2. Once a trace is complete, the SCOPE ingestion pipeline maps the raw spans onto the MAS ontology, producing a structured execution model.
  3. The session representation is enriched by the analysis workers (semantic grouping, anomaly detection, consistency checking, stateful evaluation, metrics).
  4. The enriched knowledge graph is served through the API and visualized in the UI, giving explainability and insight into the MAS's inner workings.

Repository structure

Path Description
backend/ Python libraries and workers implementing ingestion, normalization, analysis, and the data API. See backend/README.md.
backend/api Unified DB access layer and REST API over the raw OTel spans and the knowledge graph.
backend/norm Normalizes raw OTel traces into structured MAS execution models.
backend/mce Metric computation engine for sessions.
backend/stateful-evals Cost-effective evaluation of a session's trajectory.
backend/workers Standalone workers built on top of the backend libraries.
ui/ React/TypeScript web dashboard for browsing applications, sessions, execution graphs, and live topology. See ui/README.md.
ontology/ The MAS telemetry ontology (Turtle/OWL) and the scope-ontology Python package. See ontology/README.md.
docs/ Documentation site sources (MkDocs), built with mkdocs.yml.
deploy/ Deployment: Helm charts for Kubernetes (deploy/k8s) and a Docker Compose stack (deploy/docker-compose) running the API, UI, workers and supporting infra.

Getting started

Each component has its own setup instructions:

For a fully local stack, see the Docker Compose deployment, which runs the same components as the Helm chart: OTel collector, ClickHouse, RabbitMQ, Neo4j, the ingestion pipeline, the API and the UI.

Documentation

The documentation site is built from docs/ with mkdocs.yml and published at ioc-project.github.io/scope:

The ontology reference documentation (Widoco and WebVOWL) is generated separately:

Contributing

Contributions are welcome — see CONTRIBUTING.md for guidelines, CODE_OF_CONDUCT.md for community standards, and SECURITY.md for reporting vulnerabilities. Maintainers are listed in MAINTAINERS.md.

License

Licensed under the Apache License 2.0 — see LICENSE for the full text.

About

System for Cognitive Observability, Provenance and Explainability

Resources

Code of conduct

Contributing

Security policy

Stars

15 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages