ZERO-EGRESS GATEWAY
AI Data Protection & Governance Gateway

Bring AI to sensitive work.
Keep control of your data.

The self-hosted Zero-Trust LLM Security Gateway that keeps MNPI, PHI, and PII inside your perimeter. Tokenize sensitive data before external model egress, enforce AI usage policies, and generate cryptographic audit trails without vendor lock-in.

Use Cases & Benefits

Designed for Instant Engineering Impact

Discover who Metriota is built for, the critical problems it solves, and the immediate benefits of deploying it into your AI pipeline.

What is Metriota?

Metriota is an Inline Zero-Trust LLM Security & Observability Gateway. It sits directly between your autonomous AI agents, web frontends, or backend services and upstream model providers (OpenAI, Anthropic, or self-hosted GPU nodes) to intercept, scrub, route, and log token telemetry in real time.

Who should use it?

  • AI & Software Engineers: Building multi-tenant LLM applications.
  • DevSecOps & Compliance Leads: Enforcing HIPAA, GDPR, & SOC2.
  • FinOps & CTOs: Eliminating LLM bill shocks and tracking token unit economics.

Why deploy a dedicated Gateway?

The Problem

Critical Risk Mitigation

Point-to-point API integrations leave engineering teams vulnerable to data leaks, regulatory fines, and runaway API spend.

  • ✖ Unprotected SSN/PHI leakage to cloud
  • ✖ Vulnerability to prompt injections
  • ✖ Blind spots in token unit economics
The Solution

Zero Friction Integration

A proxy architecture means you secure your entire application layer without rewriting existing chatbot or backend code.

  • ✔ Drop-in SDK baseURL override
  • ✔ 100% Self-Hosted Docker stack
  • ✔ Universal frontend loader script
The Outcome

Actionable Observability

Clear, real-time triggers that empower engineers and security systems to take immediate operational control.

  • ⚡ Automated 403 Blocked threat alerts
  • ⚡ One-click PDF compliance exports
  • ⚡ Native OpenTelemetry & PromQL

Quantifiable Value Realization

The direct operational impact of adopting Metriota Gateway.

100%
Data Residency

PII is tokenized in local Redis before cloud egress.

~40%
LLM Cost Reduction

Smart caching, model fallbacks, and tenant spend caps.

< 5ms
Proxy Latency

High-throughput FastAPI/Uvicorn runtime.

0 Code
SDK Refactoring

Drop-in replacement for OpenAI standard SDKs.

Ready to secure your pipeline? docker compose up -d
Connects to any endpoint:
Public LLMs (OpenAI / Anthropic)
Local vLLM / Ollama
Custom ML Deployments

Built on open standards & sovereign infrastructure

OpenTelemetry OTLP
vLLM & Ollama
PostgreSQL + pgvector
Redis Ephemeral Vault
Presidio NER
Docker & Kubernetes

Slash spend. Neutralize risk. Trigger action.

Deep observability primitives combined with zero-trust security infrastructure.

Reversible MNPI & PII Vaulting

Zero data egress architecture. Intercept Material Non-Public Information (MNPI), proprietary deal terms, and client PII before they ever reach an upstream AI provider. Replace sensitive data with synthetic <MNPI_0> tokens, and re-hydrate seamlessly on the egress path back to the user or trading algorithm.

Read Vault Documentation
presidio-analyzer-v2
01
>> Ingress: "My SSN is 000-11-2222"
02
Detecting entity: US_SSN (Score: 0.99)
03
<< Redis: Vaulting token _hash_9f8a...
04
>> Upstream: "My SSN is <SSN_0>"
FinOps Telemetry Stream
Gateway Overhead (P95)14ms
Token Cost / 1k$0.0042
Active Routevllm-local / gpt-4o-mini

Cut costs. Track every token.

Stop flying blind. Metriota's embedded unit economics engine tracks exact dollar spend across providers, routing payloads dynamically based on data classification, live API health, and tenant RPM limits.

Configure Dynamic Routing

Inline Prompt Injection Defense

Protect your agents from adversarial attacks. Hot-reload custom heuristic regex patterns that intercept jailbreaks with a 403 Forbidden before GPU compute is wasted.

Deploy Guardrails

Threat Mitigated

Pattern Match: "Ignore previous instructions"

HTTP 403 / BLOCKED

Auditor Evidence Center
WORM Bundle Compiled Successfully
metriota-sec17a4-audit-Q3.zip41.2 MB
├── pii_mnpi_vault_events.csv
├── rag_context_retrieval_logs.csv
└── OCC_SR11-7_Traceability.pdf
SHA-256: 8f4e9a...
Inspect Governance

Solve the AI "Black Box" Problem.

Provide cryptographic proof of system behavior to internal risk teams and auditors. Generate one-click, SHA-256 verified evidence bundles containing exact traces of raw inputs, vaulted MNPI, retrieved RAG context, and AI outputs to support SEC 17a-4 (WORM) and OCC Model Risk Management (SR 11-7) programs.

Explore Trust & Shared Responsibility

Built for Regulated Audits.

Self-hosted VPC technical controls mapped to support your organization's compliance programs.

View Shared-Responsibility Matrix
SOC 2 & ISO 27001 Aligned
HIPAA / PHI Safeguards
GDPR Data Localization
EU AI Act Traceability
SEC 17a-4 (WORM Export)
OCC SR 11-7 (MRM Lineage)
New in v2.4

Advanced ML Engineering Suite

Metriota is no longer just a proxy. It is an active, self-healing infrastructure layer designed for ML deployment and fine-tuning.

Vault-Aware Semantic Caching

Achieve near-instant cache hits and eliminate redundant upstream API spend. Metriota caches responses based on sanitized templates, allowing User A and User B to safely share the exact same cached LLM completion, re-hydrated dynamically with their own PII.

Hardware-Aware Automated Failover

Never drop a production request. Active circuit breakers monitor your local GPU nodes (vLLM, Ollama) via OTLP metrics. If latency spikes or KV cache saturates, traffic instantly reroutes to a policy-approved secondary node or sanitized cloud fallback.

Silent Shadow Routing

Evaluate experimental models safely in production. Metriota forks live traffic payloads to a secondary shadow model asynchronously, capturing side-by-side latency and quality metrics with zero impact on the end-user experience.

Data Flywheel Dataset Studio

Transform compliance logs into an ML data pipeline. Mine PostgreSQL WORM traces for high-quality, non-toxic interactions and instantly export them as sanitized, PII-free JSONL files for fine-tuning open-source models.

Track every metric. Secure every iota.

A modular, API-first architecture designed to integrate natively with your existing OTLP infrastructure.

Point Tools vs. Unified Self-Hosted Control Plane • v2.4 (2026)

Extensive Ecosystem Comparison

How Metriota's unified zero-egress gateway compares against deploying separate LLM routers, prompt firewalls, and post-hoc observability tools.

Feature / CapabilityMetriota GatewayLiteLLM / PortkeyLangfuseLakera / PillarPostHog AIVictoriaMetrics / GrafanaDatadog APM
Primary CategoryInline AI Security & Observability ProxyLLM Router & Key ProxyLLM Engineering & EvalsAI Guardrail & ScannerProduct & User AnalyticsTime-Series & MonitoringEnterprise APM & Logs
Supports Custom ML & Public LLMsYES (Unified Proxy)YESYES (SDK)GUARDRAIL API ONLYSDK EVENTS ONLYNO (Metrics Only)NO (APM Only)
Reversible PII / MNPI VaultingYES (Dual-Route)ONE-WAY MASKINGNO (Post-Hoc)DETECT / BLOCK ONLYNONOLOG SCRUB ONLY
Inline Injection DefenseYES (Inline 403)BASIC / PLUGINNOYES (ML Threat)NONONO
Egress Content SafetyYES (Fallback)NONOYES (Egress Scans)NONONO
Hot-Reloadable UI GuardrailsYES (PII + Firewall)CONFIG / YAMLNOYESNONONO
Client Auth & Rate LimitsYES (Keys + RPM)YES (Keys + Budgets)NONONONONO
Agent Session TracingYES (DAG Parents)BASIC SPANSYES (Trees)NOUSER LINKINGNOYES (APM Spans)
Native OTLP SupportYES (gRPC Exporter)YESYESNONOYES (OTLP Collector)YES (Datadog Agent)
Compliance Report EngineYES (WORM + PDF)NONOYES (Audit Logs)NONONO
Vault-Aware CachingYES (PII-Scrubbed)RAW PROMPTS ONLYNONONONONO
Hardware-Aware FailoverYES (Latency Ping)HTTP ERRORS ONLYNONONONONO
Silent Shadow RoutingYES (Async)A/B SPLITS ONLYOFFLINE EVALSNONO (A/B UI Only)NONO
PII-Free Dataset ExportsYES (JSONL)NOINCLUDES RAW PIINONONONO
Time-Series RetentionINTEGRATED (PG / OTLP)EXTERNAL DBCLICKHOUSESAAS ONLYCLICKHOUSENATIVE TSDBSAAS METRICS
Deployment ModelSELF-HOSTED VPCOSS / CLOUDOSS / CLOUDSAASCLOUD / OSSOSS / CLOUDSAAS

Comparison reflects native out-of-the-box capabilities in self-hosted gateway deployments vs. standard configurations of specialized point tools.

Scroll horizontally to view full matrix

Ready for Production

The Open Zero-Trust Gateway

Built on OpenTelemetry. Compatible with LangChain and standard OpenAI SDKs. Deploy in minutes inside your own VPC.