Skip to content

Production requirements and runtime capabilities

The table below records a production-requirements-to-runtime-capabilities mapping used as a working checklist. Wording follows a common industry framing; treat labels as hypotheses until adapted to your environment.

Production requirement Runtime capability Notes for later design
Reliability Durable execution Checkpointed runs, retries, resume after crash or deploy, background work without holding a client connection open.
Memory Checkpoints (short-term), store (long-term) Thread-scoped conversation state versus cross-thread user or org memory; query and retention policies.
Guardrails Middleware Deterministic hooks around model and tool calls: redaction, limits, moderation, fallbacks.
Multi-tenancy Authentication, authorization, Agent Auth, RBAC Data isolation, acting on behalf of users with OAuth, and operator access to deploy and observe.
Human oversight Human-in-the-loop (interrupt/resume) Pause for approval, edit, reject, or clarifying answers; resume with structured payloads.
Real-time interaction Streaming, concurrency control (double-texting) Partial output to clients; policies when users send overlapping messages mid-run.
Observability Tracing, time travel Execution trees for debugging; fork from historical checkpoints to explore alternatives.
Code execution Sandboxes Isolated execute with provider-specific backends and credential proxy patterns.
Integrations MCP, A2A, webhooks Inbound discovery and outbound tool/data access; event delivery on run completion.
Scheduled jobs Cron Stateful versus stateless scheduled runs with the same durability and auth as interactive runs.