All is back to normal
Back to normal propagation delay
Steady throughput for the last 30 minutes. Delay < 5min.
We incurred a temporary delay on the legacy ingestion path for v4. This delay has been resolved.OTEL ingestion has not been impacted.
The issue is resolved now
This issue is resolved and we're back to regular processing times.
We resolved the performance bottleneck. All APIs are responding as expected as of now.
The issue has been resolved.
The incident has been resolved.
All latencies are back to normal
We scaled our ingestion and are processing data in time.
Upgrade successfully resolved.
We scaled our infrastructure and are processing media uploads without errors.
This issue has been resolved.
The underlying incident with our infrastructure (https://statuspage.incident.io/clickhousecloud/incidents/01KT1G25S9PBKM7VJEB146680G) has been resolved.
We've fully caught up and process LLM as a judge in realtime again.
We have scaled our infra to drain the queue backlog. Evals are executed without delay again.
The queue backlog has been fully processed for legacy trace and dataset targeted evals. There is no longer a delay for eval executions.
·