We experienced an issue with up- and downloads for hybrid customers using their own S3 storage on 29.02.2024 after updating one of our backend components the night before . Our team has worked diligently to identify the root cause and implement a resolution. In this post-mortem, we want to share the details of what happened, why it happened, what we did to resolve it, and what we will do to prevent similar incidents in the future.
What happened? After our latest update during our maintenance window, up- and downloads for customers with own S3 storages were not possible
Why did this happen? One of our automated quality checks introduced a too restrictive policy without context, leading to a software change which resulted in non-working up- and downloads for hybrid customers.
What did we do? Our incident response team quickly identified the underlying issue and provided an updated version of the affected component.
What can we do to improve? We will extend our automated test cases covering hybrid setups to identify such issues before a production rollout.
We apologize for any inconvenience this incident may have caused. We are committed to ensuring the stability and reliability of our services and will continue to take proactive measures to prevent similar incidents from happening in the future.
If you have any questions or concerns, please don't hesitate to reach out to our support team for assistance.