The incident is now resolved and the system is full operational.
During this incident the system experienced a backlog in scheduling new runs and event data ingestion for the Inngest dashboard was delayed.
The root cause was due to an issue with our internal event streams brokers which power internal event ingestion, run trace data ingestion and metrics ingestion. This caused delays in other data in the dashboard as well.
Resolved
The incident is now resolved and the system is full operational.
During this incident the system experienced a backlog in scheduling new runs and event data ingestion for the Inngest dashboard was delayed.
The root cause was due to an issue with our internal event streams brokers which power internal event ingestion, run trace data ingestion and metrics ingestion. This caused delays in other data in the dashboard as well.
Monitoring
A fix has been deployed and we're monitoring the system to ensure the system is fully operational.
Investigating
We are actively investigating an issue with delayed execution. We will provider further updates as we identify the cause and resolve the issue.
