FreeInference Model Status

Each model is probed with a synthetic request every 20 minutes (Cloudflare cron) · monitoring staging.freeinference.org. Click a model to zoom in on its latency and throughput history.
7 up 3 down 10 models
bge-m3
StatusUP Latency414 ms TTFT— Throughput— Uptime100% Checked2026-10-17T12:41:29
Latency trend (100)414 ms · 226–928 ms
click to zoom ↗
deepseek-v4-flash
StatusUP Latency1804 ms TTFT482 ms Throughput462.18 tok/s Uptime100% Checked2026-10-17T12:41:28
TTFT trend (100)482 ms · 277–29352 ms
click to zoom ↗
diffusiongemma
StatusUP Latency3969 ms TTFT3063 ms Throughput250.19 tok/s Uptime100% Checked2026-10-17T12:41:24
TTFT trend (100)3063 ms · 2692–7523 ms
click to zoom ↗
glm-5.2
StatusUP Latency15249 ms TTFT3414 ms Throughput86.44 tok/s Uptime100% Checked2026-10-17T12:40:33
TTFT trend (100)3414 ms · 2248–16314 ms
click to zoom ↗
glm-5.3
StatusUP Latency13543 ms TTFT2261 ms Throughput90.68 tok/s Uptime100% Checked2026-10-17T12:40:48
TTFT trend (100)2261 ms · 1993–30560 ms
click to zoom ↗
glm-5.3-flash
StatusDOWN Latency6204 ms TTFT— Throughput— Uptime44% Checked2026-10-17T12:41:02
TTFT trend (44)581 ms · 252–1161 ms
click to zoom ↗
stream error: empty completion (no content generated)
kimi-k2.7-code
StatusDOWN Latency1613 ms TTFT— Throughput— Uptime66% Checked2026-10-17T12:41:19
TTFT trend (66)2068 ms · 1272–4868 ms
click to zoom ↗
HTTP 403: You've reached your concurrent request limit. Please wait for your ongoing requests to finish and try again. (request_id: req_ab7a8bde43fc4f2c8afb122069e67c50)
kimi-k3
StatusDOWN Latency1097 ms TTFT— Throughput— Uptime68% Checked2026-10-17T12:41:21
TTFT trend (68)2525 ms · 1701–7243 ms
click to zoom ↗
HTTP 403: You've reached your concurrent request limit. Please wait for your ongoing requests to finish and try again. (request_id: req_4eb67aa887c1437399235911f6d13fba)
minimax-m3
StatusUP Latency11107 ms TTFT1053 ms Throughput101.75 tok/s Uptime100% Checked2026-10-17T12:41:08
TTFT trend (100)1053 ms · 664–21519 ms
click to zoom ↗
qwen3.6-35b
StatusUP Latency1922 ms TTFT1165 ms Throughput357.99 tok/s Uptime100% Checked2026-10-17T12:41:22
TTFT trend (100)1165 ms · 204–1165 ms
click to zoom ↗