Groq cost guide
★★★★★ 4.5 CE

Groq Token Rates, Speed & the Real Bill 2026 Guide

Groq runs open models fast and cheap on its LPU hardware, from $0.05 per million input, with no subscription. The pitch is inference speed, and the bill is whatever the model and volume add up to.

Typical token rate

$0.05-$3/1M

cheapest open model input to priciest output; usage-based, no subscription

Hidden fees

Yes

web search and Whisper billed apart, rate limits throttle spikes, no auto-scale

Free tier

Yes

a rate-limited free plan for building and testing on the Groq APIs

Cost transparency

Medium

scores 4 of 6 on our transparency checklist

Groq true cost, fast and cheap

High· Verified July 15, 2026

Groq bills pure pay-as-you-go token rates with no subscription as of July 15, 2026, plus a free plan for testing. The model sets the rate across a wide spread: input runs $0.05 to $0.60 per million and output $0.08 to $3.00. GPT-OSS 120B, for example, is $0.15 in and $0.60 out. The Batch API takes 50 percent off delay-tolerant jobs, and prompt caching another 50 percent off cached input. Web search and Whisper bill separately. So the model you pick and the volume you move decide the bill.

  • Cheapest model in /1M$0.05
  • Priciest model out /1M$3.00
  • GPT-OSS 120B in /1M$0.15
  • GPT-OSS 120B out /1M$0.60
  • Batch API50% off
  • Web search /1k$5-$8
  • Monthly floor$0
Scaling fast inference to production? The negotiation email generator below drafts the ask with live competitor token rates from our catalog.
Free tier
Yes
Cheapest model in
$0.05/1M
No burst-bypass
Throttles
Negotiable
Enterprise

Groq has no monthly seat, so it sidesteps the $7.99 median across the 20 llm tools we track. Its open models start at $0.05 per million input, and the pitch is raw inference speed.

What a Groq bill adds up to beyond speed

Groq sells inference speed, and prices it as pure usage with no subscription. The bill is tokens, and the model you call sets the rate across a wide spread. Input runs $0.05 to $0.60 per million and output $0.08 to $3.00, from the cheapest open model to the priciest. A tiny model like Llama 4 Scout costs a fraction of a cent per million, while a larger one climbs toward the top of that band.

Two engineering discounts quietly cut the rate, and each one is simple to overlook. The Batch API knocks 50 percent off any job that can wait a 24-hour to 7-day window. Prompt caching trims roughly another 50 percent from cached input, and enabling it costs nothing. Stack the pair and the effective rate falls well under the headline on repeatable, delay-tolerant work.

The costs off the token rate are the ones people forget. The built-in web search tool bills $5 to $8 per 1,000 requests, and Whisper transcription runs $0.04 to $0.111 an hour with a 10-second per-request minimum. And the model catalog is a fixed set of open weights with no fine-tuning on the standard tiers, so you take the models as shipped. The full rate card sits on the Groq pricing page.

The model sets a wide rate spread

Input runs $0.05 to $0.60 per million and output $0.08 to $3.00, from the cheapest open model to the priciest. Routing volume to a smaller model like Llama 4 Scout keeps the bill near the floor of that band.

Batch and caching each halve the rate

The Batch API takes 50 percent off for delay-tolerant jobs on a 24-hour to 7-day window, and prompt caching takes another 50 percent off cached input with no fee to enable. Stacking both drops the effective rate sharply.

Web search and Whisper bill apart

The built-in web search tool costs $5 to $8 per 1,000 requests, and Whisper transcription runs $0.04 to $0.111 an hour with a 10-second per-request minimum. Both sit on top of token cost, so budget them as separate lines.

Rate limits throttle a spike

There is no burst-bypass beyond the free and paid rate limits, so a traffic spike hits the ceiling rather than auto-scaling. A high-throughput app can throttle under load, which is a hidden cost in latency and dropped requests.

A fixed open-model catalog

Groq serves a fixed set of open-weight models with no proprietary frontier option and no fine-tuning on the standard tiers. You take the models as shipped, so a task needing a custom or frontier model has a cost elsewhere.

The free Groq tier and where it caps out

The free plan is built for development. It gives rate-limited access to the Groq APIs for building and testing, with community support and zero-data-retention available, all at $0. For prototyping and low-traffic apps, it is enough to prove the model and the speed before you pay anything.

The cap is throughput. Free carries the lowest rate limits, so any serious evaluation or production load hits the ceiling fast. That is where the Developer tier lifts the limits roughly tenfold on the same usage-based pricing. Before you scale, weigh Groq's speed against a cheaper or a frontier rival on the Groq alternatives page. It shows where the tradeoffs land when raw speed is not the deciding factor.

Groq savings on a pure usage API

Groq runs without seats or coupons, so nothing exists to discount in the usual sense, and there is no student or nonprofit rate in July 2026. The savings live in the platform itself and in your own engineering, and together they run larger than the headline rate implies.

Push bulk work to the smaller models, since the spread runs from a fraction of a cent up to $3 per million. Route delay-tolerant jobs through the Batch API for half off, and cache repeated input for roughly another half. Keep an eye on token volume weekly, because with no burst-bypass a spike hits the ceiling instead of auto-scaling into surprise cost. The tactics below fold those levers into a plan.

Route bulk work to small models

The rate spread runs from a fraction of a cent to $3 per million, so sending volume to a small model like Llama 4 Scout and reserving larger ones for hard tasks is the biggest lever on a Groq bill.

Batch delay-tolerant jobs

Any job that can wait 24 hours to 7 days runs at 50 percent off through the Batch API. For overnight or bulk work, that halving needs nothing beyond sending it to the batch endpoint.

Cache repeated input

Prompt caching takes roughly 50 percent off cached input on a hit, with no fee to enable. Apps that resend a stable system prompt every call pay a fraction on that repeated portion, which compounds at volume.

Mind the web search and Whisper lines

The web search tool at $5 to $8 per 1,000 and Whisper at $0.04 to $0.111 an hour sit outside token cost. Using them only where they earn their keep stops them quietly inflating the bill.

Committed volume at Enterprise

The Enterprise tier adds dedicated capacity and custom rate limits, priced by quote. At steady, high volume a committed agreement prices below the public card and removes the throttling ceiling that free and Developer carry.

Negotiating Groq at Enterprise scale

There is nothing to bargain on the published rate, so every lever is engineering: model choice, batch, caching. A genuine conversation opens only at Enterprise, where dedicated capacity and custom rate limits turn quote-based, and that is also where the throttling ceiling finally lifts.

Two levers do the real lifting, and each rests on speed being Groq's edge rather than price on its own.

Commit volume for dedicated capacity

Target
Enterprise contract
Argument
Guarantee a monthly token volume for dedicated capacity, custom rate limits and a rate below the public card. That removes the burst ceiling free and Developer carry, which for a latency-sensitive app is worth as much as the price cut.
Expected discount10-25%

Anchor on price when speed is not the point

Target
Any high-volume deal
Argument
Amazon Nova near $0.035 per million undercuts Groq's cheapest models. If your workload does not need Groq's speed, make it price against that, or concede the deal to a cheaper host for the delay-tolerant work.
Expected discount10-20%

Reserve dedicated capacity for peaks

Target
Latency-sensitive workloads
Argument
Because Groq throttles rather than auto-scales, a dedicated-capacity agreement is worth negotiating precisely when your peaks hurt. Bring peak-load data, since removing the burst ceiling is worth as much as the rate cut for a spiky app.
Expected discountvalue, not headline

Timing a Groq Enterprise contract

A per-token bill has no clock to game, because the rate card ignores the calendar entirely. The one thing worth timing is an Enterprise talk about dedicated capacity, which moves on the normal sales cycle. Groq's team chases quarterly targets, so a deal you commit near a quarter close often lands cheaper than one raised at its opening. The larger question, though, is whether your traffic stays steady enough to justify reserving capacity at all.

Jan

 

Feb

 

Mar

Q-END

Apr

 

May

 

Jun

Q-END

Jul

 

Aug

 

Sep

Q-END

Oct

 

Nov

 

Dec

Q-END

Pro tip: Profile your peak, not your average. Because Groq throttles rather than auto-scales, a dedicated-capacity deal is worth timing precisely when your spikes are hurting, so bring peak-load data, not a monthly average, to the table.

Groq costs: what moves at scale

Send your asks where Groq genuinely has give. The published token rate stays fixed below Enterprise; the room to move is in dedicated capacity, custom rate limits and a committed rate.

Usually negotiable

  • Committed token rate at volumeHIGH
  • Dedicated capacity and custom limitsHIGH
  • Removal of the burst ceilingMEDIUM
  • Zero-data-retention termsMEDIUM
  • Payment terms (Net 30/60)LOW

Rarely negotiable

  • The published per-model token rates
  • The batch and caching discount levels
  • Web search and Whisper tool pricing below volume
  • The fixed open-model catalog with no fine-tuning

Groq negotiation email generator

Fill the fields and the draft assembles the copy, citing current competitor token rates drawn from our catalog. Route it through your Groq account contact or the Enterprise sales form. Lead with speed and volume. Give your monthly token volume and latency needs, set a cheaper rival rate next to it, request dedicated capacity and a committed rate, and name a decision date.

What you are buying

dedicated capacity, custom rate limits, committed rate

Team size
Decision deadline
Contract length
SubjectGroq Pricing Discussion - [Your company]
Hi Groq team,

I lead tooling decisions at [Your company], and we are evaluating an enterprise credit pool for our team of 10-50 people.

As part of this evaluation we are also looking at Amazon Nova, which comes in at $0.035 per 1M input, and Google Gemini at $1.25 per 1M input. Can you help us understand the value difference at your current rates?

We are ready to commit to an annual term. What is the best rate you can offer on annual billing, and can you cap the renewal price in the contract?

We are aiming to sign before the end of this quarter, and budget sign-off is already in place.

Could you share a proposal covering the per-seat or per-credit rate, the renewal terms, and any programs we qualify for?

Best regards,
[Your name]
[Your company]

Send it Tuesday to Thursday, and follow up once after 3 business days.

Before you send

  • Have your monthly token volume and latency requirement ready, since both shape a dedicated-capacity quote.
  • Send midweek, because a note arriving Tuesday through Thursday clears faster than a Monday or Friday one.
  • Do not lead with your budget. Let Groq quote the committed rate and capacity first, then push on it.
  • Name a cheaper rival by rate. The generator inserts its current token price into the copy for you.
  • Ask for the committed rate and the removal of the burst ceiling in writing, since throttling is the real risk.
  • Follow up once after a few business days, then read continued quiet as a read on your position.

Groq cost mistakes to steer clear of

Each of these comes from how a pure usage API meets speed-sensitive workloads, and all are avoidable early.

Running everything on a big model. The rate spans a fraction of a cent to $3, so route volume to small models.

Skipping batch and caching. Each halves the rate, so delay-tolerant and repeat-context work should use them.

Forgetting the tool lines. Web search at $5 to $8 per 1,000 and Whisper bill on top of token cost.

Ignoring the throttle ceiling. There is no burst-bypass, so a spike drops requests rather than auto-scaling.

Assuming fine-tuning is available. The standard tiers serve fixed open weights, so plan around the shipped models.

Groq rivals when speed is not the priority

Groq's whole case is inference speed, so the alternatives count most when speed is not the deciding factor. The three below carry prices from our verified catalog. No switch is forced on you. What you want is a rival rate measured against your own workload, so a dedicated-capacity talk with Groq is anchored on numbers rather than a promise of low latency.

Is Groq worth it? A speed-versus-cost read

Groq is a strong buy for one specific thing: fast inference on open models at a low per-token rate. If latency is your priority and the open-weight catalog covers your task, the LPU hardware delivers speed that is genuinely hard to match, and there is no subscription to carry. For agentic workloads that make many fast calls, that combination is efficient.

The costs to watch are not the headline rate. Web search and Whisper bill on top. The rate limits throttle a spike rather than auto-scaling. And the catalog is a fixed set of open weights with no fine-tuning or proprietary frontier option. So the honest question is whether raw speed on open models is what you actually need, or whether a cheaper or a frontier rival fits better.

So route volume to small models, batch and cache aggressively, watch the throttle ceiling, and at scale negotiate dedicated capacity. The full rates sit on the Groq pricing page, and Groq earns its place precisely when speed, not price or frontier quality, is the priority.

Groq pricing and discount FAQ

How is Groq billed?

+

Groq bills pure pay-as-you-go with no subscription. The model fixes the rate across a wide spread: input runs $0.05 to $0.60 per million tokens and output $0.08 to $3.00, from the cheapest open model to the priciest. GPT-OSS 120B, for instance, is $0.15 in and $0.60 out. There is a free plan for testing, a Developer tier with roughly 10x higher rate limits, and a custom Enterprise tier. The Batch API and prompt caching each shave about 50 percent, so the effective rate can land well below the headline.

Why does Groq have a free plan if it bills per token?

+

The free plan is for building and testing, not production. It gives rate-limited access to the Groq APIs at no cost, with community support and zero-data-retention available, so you can prove the model and the inference speed before paying. The catch is throughput: the free tier carries the lowest rate limits, so any serious evaluation or live traffic hits the ceiling quickly. The Developer tier lifts those limits roughly tenfold on the same usage-based pricing, and Enterprise adds dedicated capacity that removes the ceiling entirely.

What makes Groq cheaper or more expensive than expected?

+

The model choice and the extra tools. The per-token rate spans a fraction of a cent to $3 per million. Running everything on a large model instead of routing volume to a small one is the main way to overspend. On the other side, the Batch API and prompt caching each halve the rate, which many users miss. And the web search tool at $5 to $8 per 1,000 requests and Whisper transcription bill on top of tokens. Those extra lines are the usual reason a Groq bill runs higher than a naive token estimate.

Does Groq run any discounts?

+

No published scheme in July 2026, since a pure usage API with no subscription leaves a discount nothing to hook onto. The savings are engineering. Push volume to smaller models, batch delay-tolerant jobs for half off, and cache repeated input for roughly another half. Reach for the web search and Whisper tools only where they earn their keep. At steady, high volume, the Enterprise tier sets a committed rate below the public card and adds dedicated capacity, which is where a real rate reduction is negotiated.

Will Groq throttle my app under load?

+

It can, and that is a real cost to plan for. There is no burst-bypass beyond the free and paid rate limits, so a traffic spike hits the ceiling rather than auto-scaling. A high-throughput app can throttle under load, showing up as latency or dropped requests rather than a line on the invoice. The Developer tier lifts the limits about tenfold, and the Enterprise tier adds dedicated capacity that removes the ceiling. If your traffic is spiky and latency-sensitive, that dedicated capacity is worth negotiating.

Can you fine-tune models on Groq?

+

Not on the standard tiers. Groq serves a fixed set of open-weight models with no fine-tuning or custom-weight hosting on the free and Developer plans, so you take the models as shipped. That keeps the platform simple and fast. But it means a task that genuinely needs a fine-tuned or proprietary frontier model has a cost elsewhere, on a platform that supports customization. Factor that in: Groq is optimized for fast inference on standard open models, not for adapting them to your own data.

How do you cut a Groq bill?

+

Focus on model choice and the platform discounts. Route volume and simple work to a small model, since the rate spans a fraction of a cent to $3 per million. Send delay-tolerant jobs through the Batch API for half off, and cache repeated input for roughly another half. Use the web search and Whisper tools sparingly, since they bill on top. At scale, negotiate a committed Enterprise rate with dedicated capacity, which also removes the throttling ceiling. Those moves target the exact parts of the bill that add up.

Is Groq cheaper than other inference providers?

+

On raw price, not always, but that is not its main pitch. Groq's cheapest models start around $0.05 per million input, competitive but not the outright floor, since Amazon Nova starts near $0.035. What Groq sells is speed: its LPU hardware delivers low-latency inference on open models that general providers struggle to match. So the honest comparison weighs the token rate against how much your workload values speed. For latency-critical agentic work, Groq often wins; for delay-tolerant bulk work, a cheaper provider may.

Sources & verification

Verified by ComparEdgeMethod: Vendor docs and official pages
SourceWhat was checkedLast checked
Groq official pricingVerified plan prices, renewal rates and credit allowancesJuly 15, 2026
Groq websiteOfficial vendor websiteJuly 15, 2026
Groq pricing on ComparEdgeCurrent prices for every plan, with the cost calculatorJuly 15, 2026

Every fact on this Groq pricing page is tied to a named source and a verification date. Freshness-sensitive figures trace to the sources above; verify against the vendor before relying on them.