MirevoxGitHub (opens in a new tab)

Module 02 · Evaluation and policy

runnable

Evals & English Governance

Write the rule in English, then test the route.

View on GitHub (opens in a new tab)

Runnable v0.1 slice available on GitHub — architecture and scope below.

Problem

Each model platform has its own eval screens, scoring terms, and policy controls. Teams end up comparing results by hand, while governance rules live in documents that do not map cleanly to provider settings.

Where it sits

Sits across model onboarding and routed model traffic. It is meant to bring hyperscaler evaluation results together and translate plain-English rules into the provider toolsets that enforce them.

This module is designed for teams that already use evaluation features in Foundry, Bedrock, Vertex, or other platforms. It does not replace those systems; it is meant to collect their results into a readable comparison.

A rule such as where a workload may run or what content checks it needs can be written in English, reviewed by a human, and mapped to the relevant provider toolsets. Scores are intended to run when a model is onboarded and again against traffic passing through Smart Router.

How it fits

Evals observes the Smart Router path rather than becoming another gateway. Portable evaluation evidence can join Data Lineage egress records on the same request/trace id.

Capabilities