Axiom AI engineering workflow
Axiom provides a structured, iterative workflow—the Axiom AI engineering method—for developing AI capabilities. The workflow is designed to build statistical confidence in systems that aren’t entirely predictable, and is grounded in systematic evaluation and continuous improvement, from initial prototype to production monitoring. The core stages are:- Create: Define a new AI capability, prototype it with various models, and gather reference examples to establish ground truth.
- Measure: Systematically evaluate the capability’s performance against reference data using custom graders to score for accuracy, quality, and cost.
- Observe: Cultivate the capability in production by collecting rich telemetry on every LLM call and tool execution. Use online evaluations to monitor for performance degradation and discover edge cases.
- Iterate: Use insights from production to refine prompts, augment reference datasets, and improve the capability over time.
What’s next?
- To understand the key terms used in AI engineering, see the Concepts page.
- To start building, follow the Quickstart page.