DeepInfra
InferenceCheap serverless inference — Llama, Mistral, FLUX at low cost
Operational
All systems responding normally
Last checked 30/08/2026, 9:08:51 am
546ms response
Uptime History100.00% uptime
2026-08-26Today
Uptime
100.00%
Avg Latency
757ms
P95 Latency
1367ms
Fastest
498ms
Checks
150
Response Time
Last 60 checks498ms min757ms avg2059ms max
💰 Pricing
llama-3.3-70b
Input: $0.23/1MOutput: $0.4/1M
Cheapest 70B inference. meta-llama-3.1-8b: $0.06/$0.06
⚡ Rate Limits
free
RPM: 30TPM: 120,000
Free: 30 RPM, 120K TPM. Paid: up to 1000 RPM.
🤖 Models (1)
| Model | Task | Context | Vision | Tools | JSON |
|---|---|---|---|---|---|
| Llama 3.3 70B Cheap inference. $0.23/$0.40 per 1M tokens. | llm | 128k | — | ✅ | ✅ |
Recent Checks
Showing last 15Operational
546ms30 Aug, 09:08 am
Operational
544ms30 Aug, 08:52 am
Operational
649ms30 Aug, 08:42 am
Operational
709ms30 Aug, 08:34 am
Operational
1381ms30 Aug, 08:20 am
Operational
685ms30 Aug, 08:09 am
Operational
542ms30 Aug, 07:52 am
Operational
615ms30 Aug, 07:45 am
Operational
2059ms30 Aug, 07:37 am
Operational
521ms30 Aug, 07:26 am
Operational
715ms30 Aug, 07:19 am
Operational
619ms30 Aug, 07:08 am
Operational
721ms30 Aug, 06:52 am
Operational
1054ms30 Aug, 06:42 am
Operational
585ms30 Aug, 06:34 am
Other Inference Providers
Groq
LPU inference — fastest tokens per second on the market
Cerebras
Wafer-scale chip inference — 1,000+ tokens/sec
Together AI
Open-source model inference — Llama, Mixtral, FLUX
Fireworks AI
Fast open-model inference — FireFunction, Llama, Mixtral
OpenRouter
Unified API across 200+ models — route by price or speed
Hugging Face
Serverless inference API — 100k+ open models on demand