homeservicesworkaboutblogfree templatescontactFree Tools →Free AI ModelsResearch LibraryROI CalculatorSavings CalculatorAI Readiness ScoreHire vs. AutomateAutomation Quote
book a 30-min call
home / free-models / gpt-oss-120b

gpt-oss-120b

OpenAI · United States · Apache 2.0

Commercial use: Yes — free for commercial use

Apache 2.0. Still current, still OpenAI's open-weight flagship, and still one of the few frontier-adjacent US models under a fully permissive licence.

What this means for your business

A large, capable model under Apache 2.0 that only activates a small fraction of itself for each word, so it runs far faster than its size suggests.

Why it should matter to you

The catch is memory rather than speed: you must hold all of it in RAM even though only a slice is used per word. Around 65 GB, so a serious workstation or an Ultra-class Mac. Cheap to run, expensive to house — a trade worth understanding before you budget hardware.

How it connects to our work

This shape is now standard at the frontier, and it changes buying advice: for local inference, prioritise memory capacity over raw compute. A machine with a fast processor and 32 GB will not run this; a slower one with 96 GB will.

Parameters117B total
Active per token5.1B per token
Context128K
Modalitytext, code
Memory @ Q4_K_M~65 GB
Memory @ Q8_0~63 GB
LicenceApache 2.0
Last verified2026-09

Ships natively in MXFP4, so the footprint stays around 60-65 GB regardless of further quantisation.

Advantages

  • Only 5.1B active parameters per token — very fast for its capability
  • Apache 2.0 from a US lab, which matters where Chinese-origin weights face procurement resistance
  • Reasoning effort is a per-request setting (low/medium/high) rather than a separate model

Disadvantages

  • Needs ~65 GB, so an 80 GB GPU or 96 GB+ Mac
  • Heavily safety-tuned and refuses more than most open models, which is a real friction in legitimate domains like security research and clinical text
  • World knowledge is thinner than its total size suggests

Reach for it when

US-jurisdiction self-hosting where an Apache 2.0 licence and a Western lab are both requirements, and for agent loops where the reasoning dial saves real money.

Where it falls down

Domains that trip its safety tuning — medical, legal and security text all draw refusals that a less-tuned model handles. Test on your actual content before committing.

Running it

80 GB GPU, or 96 GB+ unified memory. See the hardware sizing tables for how that maps to specific chips and cards, and the quantisation guide for what you give up at each bit width.

will it fitgpt-oss-120b against common GPUs
gpt-oss-120b at Q4_K_M
0 GB
gpt-oss-120b at Q8_0
0 GB
RTX 3060 12GB
0 GB
RTX 4060 Ti 16GB
0 GB
RTX 4090
0 GB
RTX 5090
0 GB
RTX 6000 Ada
0 GB
A100 80GB
0 GB
H100 80GB
0 GB
Weight sizes for gpt-oss-120b as recorded in this directory; GPU memory from the hardware table on the directory hub. Weights only: context adds KV cache.
where the weights fitGPU and Mac memory, checked
Q4_K_MQ8_0
RTX 3060 12GB (12 GB)
RTX 4060 Ti 16GB (16 GB)
RTX 4090 (24 GB)
RTX 5090 (32 GB)
RTX 6000 Ada (48 GB)
A100 80GB (80 GB)
H100 80GB (80 GB)
Mac, 16 GB unified
Mac, 24 GB unified
Mac, 32 GB unified
Mac, 36 GB unified
Mac, 64 GB unified~
Mac, 96 GB unified
Mac, 128 GB unified
Mac, 192 GB unified
Mac, 512 GB unified
✓ fits with room for context, ~ fits with under 15% headroom, ✕ does not fit. Weights only, computed from the figures on this page.

Free tiers carrying this model

ProviderTypeThe catchLive limits
GroqInference hostFree-plan limits are per-model and vary widely across the catalogue. Token-per-day caps bite before request caps on long prompts.check →
OpenRouterAggregatorFree-pool membership changes without notice — a model you built on can stop being free, and the list above will drift. Data passes through OpenRouter and then the upstream provider, so check the privacy and routing settings before sending anything sensitive.check →
Cerebras InferenceInference hostSmall model catalogue compared with the aggregators. You are choosing it for speed, not selection.check →
NVIDIA NIMInference hostIt is a credit grant, not a permanent free tier. When the credits run out you are on a paid plan or self-hosting the container.check →
Cloudflare Workers AIEdge inferenceThe Neuron accounting makes it hard to predict how many actual requests you get, because different models consume at very different rates.check →

Jurisdiction: United States

Best raw capability and the deepest tooling ecosystem. For EU personal data you are relying on a transfer framework rather than on data never leaving the bloc, so check whether your DPA and your customers accept that.

Watch for: Enterprise API tiers usually promise no training on your data; consumer tiers and free tiers frequently do not. The free tier is where this bites.

Frequently asked

Can I use gpt-oss-120b commercially?

Apache 2.0. Still current, still OpenAI's open-weight flagship, and still one of the few frontier-adjacent US models under a fully permissive licence.

What hardware do I need to run gpt-oss-120b?

80 GB GPU, or 96 GB+ unified memory. Weights alone are roughly 65 GB at Q4_K_M and 63 GB at Q8_0. Ships natively in MXFP4, so the footprint stays around 60-65 GB regardless of further quantisation.. Add KV cache on top of that, which grows with your context length.

What licence is gpt-oss-120b released under?

Apache 2.0. Full commercial use, modification and redistribution. Patent grant included. The most permissive licence in common use for open-weight models.

Where can I use gpt-oss-120b for free?

Free tiers carrying it include Groq, OpenRouter, Cerebras Inference, NVIDIA NIM, Cloudflare Workers AI. Limits differ per provider and change often, so check each provider's own limits page. You can also self-host the weights, which has no rate limit at all.

Similar models

Wiring gpt-oss-120b into something real?

We build the evaluation harness, the failover and the cost ceilings around a model like this, so it survives contact with production.

Maps to AI agent development, AI automation development and AI strategy and consulting. Or see it working: our case studies.