Baseten
InferenceProduction ML model deployment — custom + open models
Operational
All systems responding normally
Last checked 30/06/2026, 4:28:36 pm
371ms response
Uptime History99.33% uptime
2026-06-24Today
Uptime
99.33%
Avg Latency
576ms
P95 Latency
724ms
Fastest
274ms
Checks
150
Response Time
Last 60 checks274ms min576ms avg6715ms max
💰 Pricing
custom
A10G: $0.31/hr. A100: $2.87/hr. Dedicated deployment.
⚡ Rate Limits
free
RPM: 10TPM: 1,000
Free plan: 10 RPM, 1K TPM. Paid: up to 1000 RPM.
🤖 Models (1)
| Model | Task | Context | Vision | Tools | JSON |
|---|---|---|---|---|---|
| Custom Deployment Deploy any model. A10G/A100 GPUs. | llm | — | — | — | — |
Recent Checks
Showing last 15Operational
371ms30 June, 04:28 pm
Operational
462ms30 June, 02:52 pm
Operational
453ms30 June, 01:22 pm
Operational
521ms30 June, 12:06 pm
Operational
645ms30 June, 11:16 am
Operational
596ms30 June, 10:08 am
Operational
401ms30 June, 09:39 am
Operational
579ms30 June, 09:12 am
Operational
618ms30 June, 08:41 am
Operational
415ms30 June, 08:18 am
Operational
448ms30 June, 07:48 am
Operational
656ms30 June, 07:11 am
Operational
428ms30 June, 06:30 am
Operational
492ms30 June, 05:48 am
Operational
494ms30 June, 05:02 am
Other Inference Providers
Groq
LPU inference — fastest tokens per second on the market
Cerebras
Wafer-scale chip inference — 1,000+ tokens/sec
Together AI
Open-source model inference — Llama, Mixtral, FLUX
Fireworks AI
Fast open-model inference — FireFunction, Llama, Mixtral
OpenRouter
Unified API across 200+ models — route by price or speed
Hugging Face
Serverless inference API — 100k+ open models on demand