Previous incidents

The system is fully operational again.

We were to find the root cause and fix the issue. Video generations, the Creator along with the API are now fully functional again.

After the deployed fixes, we can see the failure rates relaxing, marking the incident as resolved.

We deployed fixes to mitigate the issues and we are seeing the error rates normalizing. The video generation subsystem is now functional.

We deployed fixes to mitigate the degradation. According to our monitoring data and tests, video generation is in normal state on both Creator and API side.

Pronounciation is not working

Operation is back to normal. Shapes should work as expected.

The error rates have been returned to normal levels, the editor is in healthy state.
Resolving the incident.

We managed to solve the problem.

Queue times are back in normal threshold.

We have successfully mitigated the issue, but have seen multiple spikes in error rates after that, so we were monitoring the issue for the past several hours.

According to our metrics the system has been healthy in the past 1 hour, so we the system is stable now.

Thank you for your patience!