Eighteen months ago, "context window" was a spec sheet detail most business owners skipped past. Now it's the reason a contract review that used to take a paralegal two days can happen in one AI conversation.

In the last four months, every major AI lab crossed the same threshold: a working, generally available 1-million-token context window, on models businesses can actually use, not just research previews. That changes what kind of work you can hand an AI model in a single pass. Here's what's actually different, what it means for your operations, and where the marketing gets ahead of the reality.

Context Windows, Plain English

A context window is the total amount of text an AI model can "see" at once — your instructions, any documents you attach, and everything it has generated so far, all counted in tokens (roughly ¾ of a word each). Exceed that limit and the model starts losing track of the earliest parts of the conversation, the same way a person forgets the start of a very long meeting.

A 200,000-token window — the standard through most of 2025 — holds roughly 150,000 words, or about a 500-page book. That sounds like plenty until you try to feed it a full year of financial statements or a 400-page vendor contract with three amendments. A 1-million-token window holds roughly five times that — around 750,000 words, or 1,500 pages, in one pass.

What's Live Right Now

This isn't a "coming soon" story. As of this month, here's the actual state of play:

  • Claude Sonnet 5 (Anthropic, released June 30, 2026) ships with a 1-million-token context window as both the default and the maximum — there's no smaller variant to opt into. It's now Anthropic's default model for both free and paid Claude.ai users, and it's available via the Claude API, AWS, Google Cloud, and Microsoft Foundry.
  • Claude Opus 4.6 and Sonnet 4.6 got the 1-million-token window as a generally available feature back in March 2026 — the first time Anthropic made it standard rather than a limited beta.
  • GPT-5.5 (OpenAI, released April 23, 2026) doubled its API context window from 512,000 to 1,000,000 tokens. Inside OpenAI's Codex coding tool specifically, the usable window is capped lower, around 400,000 tokens — a reminder that the advertised number and the number you actually get in a given product aren't always the same thing.
  • Gemini has offered 1-million-token (and, for some model tiers, up to 2-million-token) context windows since well before this year, and Google continues to ship most current Gemini models with 1M+ as the default rather than a premium add-on.

If you want the fuller picture on how these three model families stack up beyond context length — pricing, integration depth, task-by-task strengths — we broke that down in our mid-2026 AI model showdown.

Abstract editorial illustration of an AI beam reading an entire glowing document stack in one pass, dark navy background with orange accent light
A 1-million-token context window lets a model read an entire large document in one pass instead of piecing it together from chunks.

What 1 Million Tokens Actually Unlocks

The honest answer: fewer things than the marketing implies, but the things it does unlock are genuinely useful for day-to-day business operations.

Whole-Document Contract Review

A 1M-token window can hold an entire master services agreement, all of its amendments, the vendor's standard terms, and your own playbook of acceptable clauses in one conversation — with the model cross-referencing all of it at once instead of you feeding it in chunks. That's the difference between "summarize this section" and "tell me everywhere this contract contradicts our standard terms." We cover the broader workflow in our guide to AI for legal teams.

Full-Year Financial Analysis

Instead of summarizing quarter by quarter and hoping the model remembers what it said three summaries ago, you can load twelve months of P&L statements and expense reports at once and ask for trend analysis, anomaly detection, or a plain-English narrative of where the money actually went.

Support Ticket Archaeology

If you're trying to figure out why churn spiked, a long-context model can ingest thousands of support transcripts in one or two passes and surface patterns a keyword search would miss.

Codebase-Wide Changes

For businesses with in-house software, a large context window lets an AI coding assistant hold much more of your actual codebase in view at once — reducing the "it broke something in a file it couldn't see" problem that plagued shorter-context tools.

The Catch Nobody Advertises

Here's the part that gets buried under the "1 million tokens!" headline: a bigger context window does not mean perfect recall across all of it. Anthropic's own reported figure for its 1M-token rollout is roughly 90% retrieval accuracy on single-fact "needle in a haystack" tests at the full 1M-token length — meaning the model correctly finds a specific fact buried in the middle of a massive document about 9 times out of 10, not 10 out of 10. Third-party testing on more demanding multi-fact retrieval at the same length has found accuracy dropping further, into the high-70s percent. That's genuinely impressive relative to earlier long-context attempts, but it's not the same as guaranteed accuracy on every fact in every document, every time.

In practice: for casual research or first-pass summarization, dumping everything into the context window works great. For anything with legal, financial, or compliance consequences, you still verify the specific answer against the source document before acting on it. Long context makes AI a faster first-pass reviewer, not an infallible one.

The Cost Math Nobody Explains

Bigger context windows also change your bill in ways that aren't always obvious upfront. OpenAI's GPT-5.5 pricing, for example, applies a surge multiplier once a single prompt exceeds 272,000 input tokens — that portion of the request is billed at 2x the standard input rate and 1.5x the output rate for the entire session. Anthropic's Claude Sonnet 5, by contrast, is priced at a flat introductory rate of $2 per million input tokens and $10 per million output tokens through August 31, 2026 (moving to $3/$15 standard pricing after), with no separate long-context surcharge, and up to 90% savings available through prompt caching for repeated large documents.

The takeaway: before you build a workflow that habitually stuffs 500,000+ tokens into every request, check your model's pricing structure. "The window is bigger" and "it's free to use all of it, every time" are different claims — and providers don't price it identically.

Long Context vs. RAG: When You Actually Need the Big Window

Retrieval-augmented generation (RAG) — where a system searches a smaller, indexed slice of your documents and feeds only the relevant chunks to the model — isn't obsolete just because context windows got bigger. It's still the more cost-efficient and often more accurate approach when:

  • You have a large, stable document library (a knowledge base, a policy library) and most questions only need a small slice of it.
  • You need consistent, repeatable answers rather than one-off deep analysis.
  • Cost per query matters more than convenience, and your document library is too large to fit in any context window regardless (millions of pages, not thousands).

A 1M-token context window earns its keep when the task genuinely requires the model to reason across an entire document simultaneously — cross-referencing clauses, tracking a narrative across a full year of data, catching a pattern that only shows up when you can see everything at once. If a smaller, targeted search would answer the question just as well, that's usually the cheaper and faster path. For teams building this kind of infrastructure inside Google Workspace specifically, our Google Workspace + Gemini guide covers how that fits together in tools you're likely already paying for.

Not sure which model — or which context strategy — fits your business?

We help businesses pick the right AI stack for the actual work they do, not the headline spec sheet. Book a free call and we'll map it out.

Book a Free Strategy Call →

What to Do This Week

You don't need a research team to start using this. Here's the practical starting point:

  1. Find your longest recurring document task — the contract you re-review every renewal, the annual report you summarize every quarter, the support export you dread opening.
  2. Run it through a current 1M-token model in one pass instead of splitting it into chunks, and compare the output quality and time saved against however you do it today.
  3. Spot-check the output against the source for anything with financial or legal weight — the 90% retrieval accuracy figure is your reminder to verify, not blindly trust.
  4. Check the pricing model before you make this a daily habit; surge pricing on long prompts can get expensive fast if you're not watching it.
  5. Automate the repeatable parts. If you're routing documents into an AI review step regularly, a tool like Make.com can handle intake and routing automatically.

The headline number — 1 million tokens — is real, live across all three major model families, and it genuinely changes what document work you can hand to AI in a single pass. Just don't mistake "bigger window" for "perfect memory" or "free to use." Used deliberately, it's one of the more practically useful upgrades AI has shipped this year. Used carelessly, it's just an expensive way to get a summary a smaller model and a smarter workflow could've handled.