Baseten
InferenceProduction ML model deployment — custom + open models
Operational
All systems responding normally
Last checked 21/05/2026, 9:48:28 am
529ms response
Uptime History95.33% uptime
2026-05-16Today
Uptime
95.33%
Avg Latency
512ms
P95 Latency
677ms
Fastest
295ms
Checks
150
Response Time
Last 60 checks295ms min512ms avg845ms max
💰 Pricing
custom
A10G: $0.31/hr. A100: $2.87/hr. Dedicated deployment.
⚡ Rate Limits
free
RPM: 10TPM: 1,000
Free plan: 10 RPM, 1K TPM. Paid: up to 1000 RPM.
🤖 Models (1)
| Model | Task | Context | Vision | Tools | JSON |
|---|---|---|---|---|---|
| Custom Deployment Deploy any model. A10G/A100 GPUs. | llm | — | — | — | — |
Recent Checks
Showing last 15Operational
529ms21 May, 09:48 am
Operational
468ms21 May, 09:16 am
Operational
451ms21 May, 08:42 am
Operational
578ms21 May, 08:00 am
Operational
405ms21 May, 07:13 am
Operational
427ms21 May, 06:28 am
Operational
423ms21 May, 05:31 am
Operational
477ms21 May, 04:36 am
Operational
374ms21 May, 03:44 am
Operational
476ms21 May, 02:42 am
Operational
616ms21 May, 01:34 am
Operational
409ms21 May, 12:16 am
Operational
295ms20 May, 11:19 pm
Operational
543ms20 May, 10:12 pm
Operational
463ms20 May, 09:18 pm
Other Inference Providers
Groq
LPU inference — fastest tokens per second on the market
Cerebras
Wafer-scale chip inference — 1,000+ tokens/sec
Together AI
Open-source model inference — Llama, Mixtral, FLUX
Fireworks AI
Fast open-model inference — FireFunction, Llama, Mixtral
OpenRouter
Unified API across 200+ models — route by price or speed
Hugging Face
Serverless inference API — 100k+ open models on demand