Baseten
InferenceProduction ML model deployment — custom + open models
Operational
All systems responding normally
Last checked 30/08/2026, 4:54:16 am
377ms response
Uptime History100.00% uptime
2026-08-26Today
Uptime
100.00%
Avg Latency
462ms
P95 Latency
614ms
Fastest
238ms
Checks
150
Response Time
Last 60 checks238ms min462ms avg5878ms max
💰 Pricing
custom
A10G: $0.31/hr. A100: $2.87/hr. Dedicated deployment.
⚡ Rate Limits
free
RPM: 10TPM: 1,000
Free plan: 10 RPM, 1K TPM. Paid: up to 1000 RPM.
🤖 Models (1)
| Model | Task | Context | Vision | Tools | JSON |
|---|---|---|---|---|---|
| Custom Deployment Deploy any model. A10G/A100 GPUs. | llm | — | — | — | — |
Recent Checks
Showing last 15Operational
377ms30 Aug, 04:54 am
Operational
353ms30 Aug, 04:46 am
Operational
422ms30 Aug, 04:39 am
Operational
407ms30 Aug, 04:28 am
Operational
482ms30 Aug, 04:12 am
Operational
530ms30 Aug, 03:52 am
Operational
455ms30 Aug, 03:43 am
Operational
687ms30 Aug, 03:36 am
Operational
682ms30 Aug, 03:26 am
Operational
396ms30 Aug, 03:18 am
Operational
327ms30 Aug, 03:08 am
Operational
304ms30 Aug, 02:52 am
Operational
472ms30 Aug, 02:42 am
Operational
5878ms30 Aug, 02:35 am
Operational
341ms30 Aug, 02:25 am
Other Inference Providers
Groq
LPU inference — fastest tokens per second on the market
Cerebras
Wafer-scale chip inference — 1,000+ tokens/sec
Together AI
Open-source model inference — Llama, Mixtral, FLUX
Fireworks AI
Fast open-model inference — FireFunction, Llama, Mixtral
OpenRouter
Unified API across 200+ models — route by price or speed
Hugging Face
Serverless inference API — 100k+ open models on demand