
Groq Token Rates, Speed & the Real Bill 2026 Guide
Groq runs open models fast and cheap on its LPU hardware, from $0.05 per million input, with no subscription. The pitch is inference speed, and the bill is whatever the model and volume add up to.
Typical token rate
$0.05-$3/1M
cheapest open model input to priciest output; usage-based, no subscription
Hidden fees
Yes
web search and Whisper billed apart, rate limits throttle spikes, no auto-scale
Free tier
Yes
a rate-limited free plan for building and testing on the Groq APIs
Cost transparency
Medium
scores 4 of 6 on our transparency checklist
Groq true cost, fast and cheap
High· Verified July 15, 2026Groq bills pure pay-as-you-go token rates with no subscription as of July 15, 2026, plus a free plan for testing. The model sets the rate across a wide spread: input runs $0.05 to $0.60 per million and output $0.08 to $3.00. GPT-OSS 120B, for example, is $0.15 in and $0.60 out. The Batch API takes 50 percent off delay-tolerant jobs, and prompt caching another 50 percent off cached input. Web search and Whisper bill separately. So the model you pick and the volume you move decide the bill.
- Cheapest model in /1M$0.05
- Priciest model out /1M$3.00
- GPT-OSS 120B in /1M$0.15
- GPT-OSS 120B out /1M$0.60
- Batch API50% off
- Web search /1k$5-$8
- Monthly floor$0
Groq has no monthly seat, so it sidesteps the $7.99 median across the 20 llm tools we track. Its open models start at $0.05 per million input, and the pitch is raw inference speed.
The free Groq tier and where it caps out
The free plan is built for development. It gives rate-limited access to the Groq APIs for building and testing, with community support and zero-data-retention available, all at $0. For prototyping and low-traffic apps, it is enough to prove the model and the speed before you pay anything.
The cap is throughput. Free carries the lowest rate limits, so any serious evaluation or production load hits the ceiling fast. That is where the Developer tier lifts the limits roughly tenfold on the same usage-based pricing. Before you scale, weigh Groq's speed against a cheaper or a frontier rival on the Groq alternatives page. It shows where the tradeoffs land when raw speed is not the deciding factor.
Groq savings on a pure usage API
Groq runs without seats or coupons, so nothing exists to discount in the usual sense, and there is no student or nonprofit rate in July 2026. The savings live in the platform itself and in your own engineering, and together they run larger than the headline rate implies.
Push bulk work to the smaller models, since the spread runs from a fraction of a cent up to $3 per million. Route delay-tolerant jobs through the Batch API for half off, and cache repeated input for roughly another half. Keep an eye on token volume weekly, because with no burst-bypass a spike hits the ceiling instead of auto-scaling into surprise cost. The tactics below fold those levers into a plan.
Route bulk work to small models
The rate spread runs from a fraction of a cent to $3 per million, so sending volume to a small model like Llama 4 Scout and reserving larger ones for hard tasks is the biggest lever on a Groq bill.
Batch delay-tolerant jobs
Any job that can wait 24 hours to 7 days runs at 50 percent off through the Batch API. For overnight or bulk work, that halving needs nothing beyond sending it to the batch endpoint.
Cache repeated input
Prompt caching takes roughly 50 percent off cached input on a hit, with no fee to enable. Apps that resend a stable system prompt every call pay a fraction on that repeated portion, which compounds at volume.
Mind the web search and Whisper lines
The web search tool at $5 to $8 per 1,000 and Whisper at $0.04 to $0.111 an hour sit outside token cost. Using them only where they earn their keep stops them quietly inflating the bill.
Committed volume at Enterprise
The Enterprise tier adds dedicated capacity and custom rate limits, priced by quote. At steady, high volume a committed agreement prices below the public card and removes the throttling ceiling that free and Developer carry.
Negotiating Groq at Enterprise scale
There is nothing to bargain on the published rate, so every lever is engineering: model choice, batch, caching. A genuine conversation opens only at Enterprise, where dedicated capacity and custom rate limits turn quote-based, and that is also where the throttling ceiling finally lifts.
Two levers do the real lifting, and each rests on speed being Groq's edge rather than price on its own.
Commit volume for dedicated capacity
- Target
- Enterprise contract
- Argument
- Guarantee a monthly token volume for dedicated capacity, custom rate limits and a rate below the public card. That removes the burst ceiling free and Developer carry, which for a latency-sensitive app is worth as much as the price cut.
Anchor on price when speed is not the point
- Target
- Any high-volume deal
- Argument
- Amazon Nova near $0.035 per million undercuts Groq's cheapest models. If your workload does not need Groq's speed, make it price against that, or concede the deal to a cheaper host for the delay-tolerant work.
Reserve dedicated capacity for peaks
- Target
- Latency-sensitive workloads
- Argument
- Because Groq throttles rather than auto-scales, a dedicated-capacity agreement is worth negotiating precisely when your peaks hurt. Bring peak-load data, since removing the burst ceiling is worth as much as the rate cut for a spiky app.
Timing a Groq Enterprise contract
A per-token bill has no clock to game, because the rate card ignores the calendar entirely. The one thing worth timing is an Enterprise talk about dedicated capacity, which moves on the normal sales cycle. Groq's team chases quarterly targets, so a deal you commit near a quarter close often lands cheaper than one raised at its opening. The larger question, though, is whether your traffic stays steady enough to justify reserving capacity at all.
Jan
Feb
Mar
Q-END
Apr
May
Jun
Q-END
Jul
Aug
Sep
Q-END
Oct
Nov
Dec
Q-END
Pro tip: Profile your peak, not your average. Because Groq throttles rather than auto-scales, a dedicated-capacity deal is worth timing precisely when your spikes are hurting, so bring peak-load data, not a monthly average, to the table.
Groq costs: what moves at scale
Send your asks where Groq genuinely has give. The published token rate stays fixed below Enterprise; the room to move is in dedicated capacity, custom rate limits and a committed rate.
Usually negotiable
- Committed token rate at volumeHIGH
- Dedicated capacity and custom limitsHIGH
- Removal of the burst ceilingMEDIUM
- Zero-data-retention termsMEDIUM
- Payment terms (Net 30/60)LOW
Rarely negotiable
- The published per-model token rates
- The batch and caching discount levels
- Web search and Whisper tool pricing below volume
- The fixed open-model catalog with no fine-tuning
Groq negotiation email generator
Fill the fields and the draft assembles the copy, citing current competitor token rates drawn from our catalog. Route it through your Groq account contact or the Enterprise sales form. Lead with speed and volume. Give your monthly token volume and latency needs, set a cheaper rival rate next to it, request dedicated capacity and a committed rate, and name a decision date.
dedicated capacity, custom rate limits, committed rate
Hi Groq team, I lead tooling decisions at [Your company], and we are evaluating an enterprise credit pool for our team of 10-50 people. As part of this evaluation we are also looking at Amazon Nova, which comes in at $0.035 per 1M input, and Google Gemini at $1.25 per 1M input. Can you help us understand the value difference at your current rates? We are ready to commit to an annual term. What is the best rate you can offer on annual billing, and can you cap the renewal price in the contract? We are aiming to sign before the end of this quarter, and budget sign-off is already in place. Could you share a proposal covering the per-seat or per-credit rate, the renewal terms, and any programs we qualify for? Best regards, [Your name] [Your company]
Send it Tuesday to Thursday, and follow up once after 3 business days.
Before you send
- Have your monthly token volume and latency requirement ready, since both shape a dedicated-capacity quote.
- Send midweek, because a note arriving Tuesday through Thursday clears faster than a Monday or Friday one.
- Do not lead with your budget. Let Groq quote the committed rate and capacity first, then push on it.
- Name a cheaper rival by rate. The generator inserts its current token price into the copy for you.
- Ask for the committed rate and the removal of the burst ceiling in writing, since throttling is the real risk.
- Follow up once after a few business days, then read continued quiet as a read on your position.
Groq cost mistakes to steer clear of
Each of these comes from how a pure usage API meets speed-sensitive workloads, and all are avoidable early.
Running everything on a big model. The rate spans a fraction of a cent to $3, so route volume to small models.
Skipping batch and caching. Each halves the rate, so delay-tolerant and repeat-context work should use them.
Forgetting the tool lines. Web search at $5 to $8 per 1,000 and Whisper bill on top of token cost.
Ignoring the throttle ceiling. There is no burst-bypass, so a spike drops requests rather than auto-scaling.
Assuming fine-tuning is available. The standard tiers serve fixed open weights, so plan around the shipped models.
Groq rivals when speed is not the priority
Groq's whole case is inference speed, so the alternatives count most when speed is not the deciding factor. The three below carry prices from our verified catalog. No switch is forced on you. What you want is a rival rate measured against your own workload, so a dedicated-capacity talk with Groq is anchored on numbers rather than a promise of low latency.
Amazon Nova
Nova Micro input, managed on AWS
$0.035/1M
The price floor. Nova Micro undercuts Groq's cheapest models, so it is the anchor for delay-tolerant, high-volume work where speed does not justify a premium.
Google Gemini
input rate, proprietary frontier
$1.25/1M
A proprietary frontier model Groq cannot offer. The card when your task needs frontier quality rather than the fast open models Groq specializes in.
Mistral Large
input, gentle output ratio, EU-hosted
$2/1M
A capable open-friendly model with EU hosting. The alternative when data residency or a specific model matters more than raw inference speed.
Script“For our delay-tolerant work, speed is not critical and Amazon Nova is $0.035 per million. What committed rate or dedicated capacity does Groq offer to keep the latency-sensitive traffic here?”
Is Groq worth it? A speed-versus-cost read
Groq is a strong buy for one specific thing: fast inference on open models at a low per-token rate. If latency is your priority and the open-weight catalog covers your task, the LPU hardware delivers speed that is genuinely hard to match, and there is no subscription to carry. For agentic workloads that make many fast calls, that combination is efficient.
The costs to watch are not the headline rate. Web search and Whisper bill on top. The rate limits throttle a spike rather than auto-scaling. And the catalog is a fixed set of open weights with no fine-tuning or proprietary frontier option. So the honest question is whether raw speed on open models is what you actually need, or whether a cheaper or a frontier rival fits better.
So route volume to small models, batch and cache aggressively, watch the throttle ceiling, and at scale negotiate dedicated capacity. The full rates sit on the Groq pricing page, and Groq earns its place precisely when speed, not price or frontier quality, is the priority.
Groq pricing and discount FAQ
How is Groq billed?
+
Groq bills pure pay-as-you-go with no subscription. The model fixes the rate across a wide spread: input runs $0.05 to $0.60 per million tokens and output $0.08 to $3.00, from the cheapest open model to the priciest. GPT-OSS 120B, for instance, is $0.15 in and $0.60 out. There is a free plan for testing, a Developer tier with roughly 10x higher rate limits, and a custom Enterprise tier. The Batch API and prompt caching each shave about 50 percent, so the effective rate can land well below the headline.
Why does Groq have a free plan if it bills per token?
+
The free plan is for building and testing, not production. It gives rate-limited access to the Groq APIs at no cost, with community support and zero-data-retention available, so you can prove the model and the inference speed before paying. The catch is throughput: the free tier carries the lowest rate limits, so any serious evaluation or live traffic hits the ceiling quickly. The Developer tier lifts those limits roughly tenfold on the same usage-based pricing, and Enterprise adds dedicated capacity that removes the ceiling entirely.
What makes Groq cheaper or more expensive than expected?
+
The model choice and the extra tools. The per-token rate spans a fraction of a cent to $3 per million. Running everything on a large model instead of routing volume to a small one is the main way to overspend. On the other side, the Batch API and prompt caching each halve the rate, which many users miss. And the web search tool at $5 to $8 per 1,000 requests and Whisper transcription bill on top of tokens. Those extra lines are the usual reason a Groq bill runs higher than a naive token estimate.
Does Groq run any discounts?
+
No published scheme in July 2026, since a pure usage API with no subscription leaves a discount nothing to hook onto. The savings are engineering. Push volume to smaller models, batch delay-tolerant jobs for half off, and cache repeated input for roughly another half. Reach for the web search and Whisper tools only where they earn their keep. At steady, high volume, the Enterprise tier sets a committed rate below the public card and adds dedicated capacity, which is where a real rate reduction is negotiated.
Will Groq throttle my app under load?
+
It can, and that is a real cost to plan for. There is no burst-bypass beyond the free and paid rate limits, so a traffic spike hits the ceiling rather than auto-scaling. A high-throughput app can throttle under load, showing up as latency or dropped requests rather than a line on the invoice. The Developer tier lifts the limits about tenfold, and the Enterprise tier adds dedicated capacity that removes the ceiling. If your traffic is spiky and latency-sensitive, that dedicated capacity is worth negotiating.
Can you fine-tune models on Groq?
+
Not on the standard tiers. Groq serves a fixed set of open-weight models with no fine-tuning or custom-weight hosting on the free and Developer plans, so you take the models as shipped. That keeps the platform simple and fast. But it means a task that genuinely needs a fine-tuned or proprietary frontier model has a cost elsewhere, on a platform that supports customization. Factor that in: Groq is optimized for fast inference on standard open models, not for adapting them to your own data.
How do you cut a Groq bill?
+
Focus on model choice and the platform discounts. Route volume and simple work to a small model, since the rate spans a fraction of a cent to $3 per million. Send delay-tolerant jobs through the Batch API for half off, and cache repeated input for roughly another half. Use the web search and Whisper tools sparingly, since they bill on top. At scale, negotiate a committed Enterprise rate with dedicated capacity, which also removes the throttling ceiling. Those moves target the exact parts of the bill that add up.
Is Groq cheaper than other inference providers?
+
On raw price, not always, but that is not its main pitch. Groq's cheapest models start around $0.05 per million input, competitive but not the outright floor, since Amazon Nova starts near $0.035. What Groq sells is speed: its LPU hardware delivers low-latency inference on open models that general providers struggle to match. So the honest comparison weighs the token rate against how much your workload values speed. For latency-critical agentic work, Groq often wins; for delay-tolerant bulk work, a cheaper provider may.
Explore Groq
Every page on Groq in one place, you are on cost guide.
Snapshot, score and verdict
How to get API access, limits, SDKs and what it costs
Latency, throughput, uptime and behaviour under scale
Every tier and the entry price
You are here
Compared and ranked vs peers
Price and feature change history
Browse the full Large Language Models category
Sources & verification
| Source | What was checked | Last checked |
|---|---|---|
| Groq official pricing | Verified plan prices, renewal rates and credit allowances | July 15, 2026 |
| Groq website | Official vendor website | July 15, 2026 |
| Groq pricing on ComparEdge | Current prices for every plan, with the cost calculator | July 15, 2026 |
Every fact on this Groq pricing page is tied to a named source and a verification date. Freshness-sensitive figures trace to the sources above; verify against the vendor before relying on them.