Skip to content

Repository files navigation

AIR Blackbox

AIR Platform

One command to run the AIR Blackbox compliance stack

Tamper-evident audit. Runtime guardrails. Full trace observability. Local-first.

AIR Blackbox Platform demo

License CI air-blackbox on PyPI air-gate on PyPI

🎯 Live Demo · 🌐 airblackbox.ai · 📦 Main Repo


What This Is

air-platform is the Docker Compose orchestration for the AIR Blackbox stack. One command starts the gateway, the GenAI-aware OTel collector, Jaeger tracing, and a MinIO prompt vault — a self-contained, local sandbox for recording, replaying, and auditing AI agent behavior.

The gateway ships as a prebuilt, signed image from GHCR (with SLSA build provenance). Nothing here phones home: the default collector pipeline exports to your local Jaeger only.

The Problem

The EU AI Act enforcement date for high-risk AI systems is August 2, 2026. Companies deploying AI agents — tool-calling LLMs that act autonomously — face mandatory requirements around logging, transparency, human oversight, and data governance. Penalties reach €35M or 7% of global turnover.

Most compliance platforms target CISOs with top-down dashboards. AIR Blackbox gives developers the building blocks to make agents audit-ready by default.

Quick Start

git clone https://github.com/airblackbox/air-platform.git
cd air-platform
cp .env.example .env    # optional: set OPENAI_API_KEY, GATEWAY_KEY
make up                 # gateway + collector + Jaeger + MinIO
make status             # check health

Point your agent at the gateway instead of the provider — everything else in your code stays identical:

client = OpenAI(base_url="http://localhost:8080/v1")

Every LLM call now produces an HMAC-SHA256 chained, replayable audit record in ./runs/, plus an OpenTelemetry trace you can inspect in Jaeger at localhost:16686.

Ports

Port Service
8080 AIR Gateway — OpenAI-compatible proxy (/v1/chat/completions, /v1/responses, /v1/audit, /v1/analytics, /health)
4317 / 4318 OTel Collector (gRPC / HTTP OTLP)
16686 Jaeger UI
9000 / 9001 MinIO S3 API / Console (prompt vault)

Architecture

┌─────────────────────────────────────────────────────────────┐
│                       YOUR AI AGENTS                         │
│   (OpenAI SDK · LangChain · CrewAI · AutoGen · any client)  │
└──────────────────────────┬──────────────────────────────────┘
                           │ base_url swap
                           ▼
┌─────────────────────────────────────────────────────────────┐
│                    AIR GATEWAY  :8080                        │
│   OpenAI-compatible proxy · HMAC-SHA256 audit chain          │
│   guardrails (budgets, loop & retry protection, tool         │
│   allowlists) · PII / injection scanning · replay records    │
└───────┬──────────────────────────────┬──────────────────────┘
        │ OTLP traces                  │ .air.json records
        ▼                              ▼
┌───────────────────────────┐   ┌─────────────────────────────┐
│   OTEL COLLECTOR :4317    │   │   ./runs/  +  MinIO vault   │
│   normalize → prompt      │   │   (signed, replayable,      │
│   vault → redact/metrics  │   │    tamper-evident)          │
└───────────┬───────────────┘   └─────────────────────────────┘
            ▼
┌───────────────────────────┐
│      JAEGER UI :16686     │
└───────────────────────────┘

The collector pipeline (collector.yaml, editable) runs three AIR processors in order: genai_semantic_normalizer (vendor attrs → gen_ai.* conventions), promptvault (offload prompt/response bodies to encrypted storage, replace with refs), and genaisafe (PII redaction, token metrics, loop detection).

EU AI Act Mapping

EU AI Act Article Requirement Where it's handled
Art. 9 Risk management Gateway guardrails — budgets, loop/retry protection, tool blocklists; air-gate risk-tiered approval policies
Art. 10 Data governance Collector genaisafe PII redaction + prompt vault offload
Art. 11 Technical documentation Full OTel trace of every call, normalized to gen_ai.* semantics
Art. 12 Record-keeping HMAC-SHA256 chained .air.json records, ML-DSA-65 signed checkpoints
Art. 14 Human oversight air-gate — human-in-the-loop tool gating with Slack approvals
Art. 15 Robustness & security Injection detection (20 weighted patterns, 5 attack categories), guardrail enforcement

See the full compliance mapping for article-by-article details. AIR Blackbox checks technical requirements — it is a linter for AI governance, not a legal tool.

The AIR Blackbox Ecosystem

Repository What it does Install
airblackbox The flight recorder: gateway proxy, audit chain, replay, evidence bundles, EU AI Act gap analysis (51+ checks), framework trust layers pip install air-blackbox
air-gate Human-in-the-loop tool gating + policy engine (Art. 14) pip install air-gate
air-blackbox-mcp MCP server — audit, replay, scan, and compliance tools in Claude Desktop, Claude Code, Cursor via MCP config
compliance-action GitHub Action — EU AI Act compliance checks on every PR via workflow
air-platform This repo — one-command full stack make up
tombstone Provable, crypto-shredded erasure on a tamper-evident ledger (GDPR Art. 17)

Framework trust layers for LangChain, CrewAI, OpenAI Agents SDK, Claude Agent SDK, AutoGen, Google ADK, and Haystack ship inside the main airblackbox repo (air_blackbox.trust.*).

Running the Compliance Scanner

The scanner runs against any Python AI project — no stack required:

pip install air-blackbox
air-blackbox comply --scan . -v     # gap analysis: Articles 9–15
air-blackbox replay                 # replay recorded episodes
air-blackbox evidence               # signed evidence bundle for auditors

Testing

Integration tests run against the live stack:

make up
make test    # 6 health/audit tests; +1 live LLM round-trip when OPENAI_API_KEY is set

If the stack isn't running, the suite skips with instructions instead of failing. CI boots the full compose stack and runs the same tests on every push.

Threat Model

Threat Risk Mitigation
Prompt data leakage PII or proprietary data exposed in traces genaisafe hash-and-preview redaction; prompt vault offload
Secret exposure API keys, bearer tokens in span attributes Denylist regex detection, automatic redaction
Runaway loops Infinite tool-calling burning budget Gateway loop detection + session budgets; collector repeat-threshold flagging
Audit tampering Logs edited after an incident HMAC-SHA256 chain — modifying one record breaks every record after it

License

All AIR Blackbox components are released under the Apache License 2.0.

Contributing

We welcome contributions. See CONTRIBUTING.md for guidelines.


Support the Project

If AIR Blackbox is useful to you, a star helps others find it.

Star on GitHub

Questions or feedback? Start a Discussion.


AIR Blackbox — Agent Infrastructure Runtime
Compliance infrastructure for autonomous AI agents

About

One command to run the full AI audit stack: Gateway + Policy Engine + Episode Store + Jaeger + Prometheus. Make up. 8 seconds.

Topics

Resources

Contributing

Security policy

Stars

10 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages