Content by prateekwrites (1)

prateekwrites explains why “cost per token” is a misleading metric for agentic systems, and proposes “cost per accepted task” as the unit that matters. The post maps this idea to an Azure reference architecture using APIM’s GenAI gateway, Azure AI Foundry evaluations, and a policy loop driven by telemetry and alerts.