We have scaled our services to address latency issues. The p90 latency is now reduced from 10 seconds to 30 milliseconds.

We experience higher than usual Prompt API latencies. We are investigating the root cause.