LLMs are evolving into AgenticOS platforms

Horizontal LLM providers like Anthropic and vertical AI companies like Harvey are moving beyond standalone AI models and building broader enterprise platforms. These platforms combine AI models with workflows, playbooks, integrations and governance tools inside a single environment, which are beginning to be described as an “AgenticOS.” As a result, the market is beginning to consolidate around a smaller number of platform providers that can simplify procurement, integration, spend management and data privacy compliance.

Context windows have expanded by orders of magnitude

Leading AI models can now process dramatically more information at once than they could just a few years ago, with the amount of information they can analyze in a single interaction expanding roughly 125× since 2023. That shift is making more complex, enterprise-scale work, like large-scale contract review, codebase-wide analysis and multi-document research synthesis, possible. Such capabilities, which once felt cutting-edge, are becoming standard expectations.

Figure 1: Flagship LLM context window evolution, OpenAI and Anthropic, March 2023 – May 2026.
Figure 1: Flagship LLM context window evolution, OpenAI and Anthropic, March 2023 – May 2026.

John Wei

Token pricing has stabilized at the production tier

After dropping rapidly between 2023 and 2025, the cost of using mainstream AI models has started to stabilize. Today, many enterprise-grade models fall within a relatively predictable range of roughly $2–$3 per million input tokens and about $15 per million output tokens, making costs easier to anticipate and manage.