Exchange Online gestört (22.4.2021)?

Es gibt wohl Probleme mit Microsofts Exchange Online, wo Benutzer Probleme mit der Zustellung von Mails in Nordamerika haben. Gleich die Frage: Tangiert das auch Nutzer unter den Blog-Lesern (zumindest habe ich einzelne Meldungen gefunden)?

Auf Twitter gibt es Statusinformationen von Microsoft vom 22. April 2021, die die Nutzer über diesen Cloud-Ausfall bzw. die Probleme informieren.

Die letzte Meldung besagt, dass die Ursache behoben sei:

We've recovered the underlying database infrastructure and confirmed new emails are now unaffected. We're monitoring the service whilst previously queued emails are processed. For further information, please check EX252124 in the admin center.

Auch in Deutschland konnte ich auf allestoerungen.de kleinere Meldungen über einen großen Ausfall erkennen.

War jemand von euch hier in Europa betroffen? (via)

Ergänzung: Andreas P. hat mir nun die nachfolgenden Statusmeldungen von Microsoft zu diesem Vorfall geschickt (danke dafür).

Published Time: 22.04.2021 19:09:27

Title: Some users are unable to send or receive email messages within Exchange Online

User Impact: Users may have experienced delays or been unable to send or receive email messages within the Exchange Online service.

More info: Some users may have received the error message '451 4.3.2 Temporary server error. Please try again later ATTR1' if they attempted to email an impacted organization.

Final status: We've monitored the environment and confirmed that the queued emails have processed as expected.

Scope of impact: Impact was specific to organizations hosted from infrastructure located in North America. However, if a user not hosted on the affected infrastructure attempted to send an email to a user within an impacted organization, they may have been unable to send the email.

Start time: Thursday, April 22, 2021, at 1:00 PM UTC

End time: Thursday, April 22, 2021, at 4:30 PM UTC

Preliminary root cause: Our preliminary investigation determined impact was caused by a load balancing configuration issue. This behavior occurred when a specific type of call happened when inbound mail was received. Under normal circumstances this type of call would be routed to the Data Center cache, but in this instance, the call was also being sent directly to the database, causing a conflict and resulting in a spike resource utilization.

Next steps:
– We're analyzing performance data and trends on the affected systems to help prevent this problem from happening again.

We'll publish a preliminary Post-Incident Report (PIR) within two business days and a final PIR within five business days.

Published Time: 22.04.2021 18:17:00

Title: Some users are unable to send or receive email messages within Exchange Online

User Impact: Users may experience delays or been unable to send or receive email messages within the Exchange Online service.

More info: Some users may receive the error message '451 4.3.2 Temporary server error. Please try again later ATTR1' if they attempted to email an impacted organization.

Current status: We've recovered the underlying database components and confirmed that new emails are processing as expected without delays. However, during the incident, a queue of email messages built up. The service is automatically retrying these emails and we expect recovery within the next hour. We're monitoring the service to confirm these email queues are processing correctly. Organizations will see recovery at different times depending on their volume of queued emails.

Scope of impact: Impact is specific to organizations hosted from infrastructure located in North America. However, if a user not hosted on the affected infrastructure attempted to send an email to a user within an impacted organization, they may be unable to send the email.

Start time: Thursday, April 22, 2021, at 1:00 PM UTC

Next update by: Thursday, April 22, 2021, at 6:00 PM UTC

Published Time: 22.04.2021 17:40:04

Title: Some users are unable to send or receive email messages within Exchange Online

User Impact: Users may be unable to send or receive email messages within the Exchange Online service.

More info: Some users may receive the error message '451 4.3.2 Temporary server error. Please try again later ATTR1' if they attempted to email an impacted organization.

Current status: Our preliminary investigation has determined impact is being caused by a load balancing configuration issue. This occurs when a call to validate inbound mail is received. This call is being duplicated, creating a spike in utilization. We're working to restore the underlying database infrastructure to remediate impact. Emails were queued for delivery and the service will automatically retry deliveries once the underlying database infrastructure has recovered. Users will not need to resend the impacted emails.

Scope of impact: Impact is specific to organizations hosted from infrastructure located in North America. However, if a user not hosted on the affected infrastructure attempted to send an email to a user within an impacted organization, they may be unable to send the email.

Next update by: Thursday, April 22, 2021, at 5:30 PM UTC

Published Time: 22.04.2021 16:31:36

Title: Some users are unable to send or receive email messages within Exchange Online

User Impact: Users may be unable to send or receive email messages within the Exchange Online service.

Current status: We're reviewing service monitoring telemetry to isolate the source of the issue and establish a fix.

Scope of impact: Impact is specific to users who are hosted out of the affected infrastructure in North America.

Next update by: Thursday, April 22, 2021, at 4:00 PM UTC