Reusable goals and evals, with a harness to run them.
Use the mnmx standard library to connect short-term work to long-term goals. The harness checks each implementation against those goals. Use your own Codex or Claude subscription, or run Pi with a provider such as OpenRouter.
regexparamLong-term goal
Keep existing routes working as the parser changes.
Short-term goals
Example eval For /users/:id?, check that both /users and /users/42 match.
Inside the standard library
Import a goal from @mnmx/engine/stdlib, assign an owner, and supply evidence from your project. You can reuse the same definition across projects.
build.typecheck- The eval passes when the compiler reports zero errors for a strict TypeScript build.
build.tests- The eval checks that the test run succeeded with zero failures.
tests.faithful- Your reviewer uses a shared rubric to assess whether the tests cover the behavior users rely on and to identify gaps.
How the harness runs the evals
Choose an agent for each role. Codex can plan, Claude Code can build, and Pi can review through OpenRouter. The harness calls your authenticated CLIs and checks each build against the same goals. In the regexparam example, a check caught an extra trailing slash when an optional parameter was missing.
The harness sends the failure to the builder for repair. After the repair rounds, it runs held-out cases and saves the results alongside each attempt.
Run the regexparam exampleInside the testbed
See which checks cover optional routes in regexparam, or explore editing and undo in the task app.
Browse testbed projects