{"id":282177,"date":"2023-06-05T18:58:33","date_gmt":"2023-06-05T16:58:33","guid":{"rendered":"https:\/\/www.borncity.com\/blog\/?p=282177"},"modified":"2024-06-11T16:21:49","modified_gmt":"2024-06-11T14:21:49","slug":"exchange-online-strung-5-juni-2023","status":"publish","type":"post","link":"https:\/\/borncity.com\/blog\/2023\/06\/05\/exchange-online-strung-5-juni-2023\/","title":{"rendered":"Exchange Online-Störung (5. Juni 2023) – Werk russischer Hacker?"},"content":{"rendered":"

\"Stop[English<\/a>]Zum 5. Juni 2023 hat es bei Microsofts Exchange Online wohl eine massivere St\u00f6rung gegeben. Administratoren kamen nicht mehr ins Admin-Center und Outlook konnte im Web nicht mehr erreicht werden. Ein Nutzer hat mich auf diese St\u00f6rung hingewiesen, die kurz vor 16:00 Uhr deutscher Zeit begann, inzwischen (18:40 Uhr) aber wohl weitgehend behoben ist. Microsoft hat die St\u00f6rung inzwischen best\u00e4tigt. Erg\u00e4nzung:<\/strong> Inzwischen behauptet die pro-russische Hackergruppe Anonymous Sudan f\u00fcr die St\u00f6rung (per DDoS) verantwortlich zu sein.<\/p>\n

<\/p>\n

Eine Lesermeldung<\/h2>\n

\"\"Ein Blog-Leser hat sich kurz vor 18:00 Uhr bei mir per E-Mail gemeldet und berichtete \u00fcber die aufgetretene St\u00e4rung bei Exchange Online. Laut Leser gab es wohl \"einen richtig gro\u00dfen Exchange Online Ausfall\". Der Leser hat mir folgenden Screenshot des Service Health Dashboard\u00a0 mitgeschickt, der die Statusseite zeigt. Dazu schrieb der Leser:<\/p>\n

\"Exchange<\/p>\n

Ist bei uns trotz Azure Location West (Holland\/Irland) bemerkbar, dass Outlook kein Connect bekommt bzw. Outlook Online nur Fragmentiert was anzeigt. Mal gehts, mal gehts nicht, dann gehts dann wieder nicht :-)<\/p>\n

Mal schauen ob es noch mehr werden wie 100 …<\/p>\n

Im Admin Center schaut das ganze aus wie ein Alarmstufe Rot auf der Enterprise :-D<\/p><\/blockquote>\n

\"Exchange<\/a>
\n(Zum Vergr\u00f6\u00dferen klicken)<\/p>\n

Auf reddit.com gibt es ebenfalls diesen Thread<\/a>, wo jemand gegen 16:00 Uhr nachfragt, ob es eine St\u00f6rung g\u00e4be. Dort best\u00e4tigen weitere Betroffene den Ausfall. Ich habe mal den downdetector (bzw. die deutsche Seite allestoerungen.de) befragt und bekam diesen Ausfall quasi best\u00e4tigt – es gibt einen Peak bei den St\u00f6rungsmeldungen.<\/p>\n

\"Exchange<\/p>\n

Microsoft best\u00e4tigt den Ausfall<\/h2>\n

Auf Twitter gibt es von Microsoft inzwischen die Best\u00e4tigung zu einem Problem. Am 5. Juni 2023 schreibt Microsoft365-Status<\/a> gegen 16:47 Uhr deutscher Zeit folgendes:<\/p>\n

We're investigating an issue with accessing Outlook on the web. Further details can be found under EX571516 in the admin center.<\/p><\/blockquote>\n

Sp\u00e4ter wurde das dann folgenderma\u00dfen erg\u00e4nzt:<\/p>\n

We're reviewing our networking systems and recent updates in an effort to identify the underlying root cause of the issue. Additional information can be found in the admin center under EX571516.<\/p><\/blockquote>\n

Und vor 49 Minuten hie\u00df es:<\/p>\n

We've identified downstream impact for Microsoft Teams, SharePoint Online and OneDrive for Business. We're providing full impact details and updates for those services via MO571683. Updates pertaining to Exchange and Outlook on the web will continue to be provided via EX571516.<\/p>\n

We've halted an ongoing deployment and are monitoring services to see if that provides relief to the environment. Further information can be found in the admin center under EX571516 and MO571683.<\/p><\/blockquote>\n

Es gibt also eine St\u00f6rung, die den Zugriff auf Outlook im Web verhindert. Das hat auch Auswirkungen auf Microsoft Teams, SharePoint Online und OneDrive for Business identifiziert. Microsoft will vollst\u00e4ndige Details zu den Auswirkungen und Updates f\u00fcr diese Dienste \u00fcber MO571683 bereitstellen. Updates f\u00fcr Exchange und Outlook im Web werden weiterhin \u00fcber EX571516 bereitgestellt. Inzwischen hat Microsoft in nachfolgender Meldung mitgeteilt, dass eine laufende Bereitstellung gestoppt wurde.<\/p>\n

We've reverted the update and telemetry shows service improvement. We're continuing to monitor the service to ensure recovery and performing actions to address any residual impact. Further information can be found under EX571516 and MO571683 in the admin center.<\/p><\/blockquote>\n

Aktuell \u00fcberwacht Microsoft die Dienste und hofft, dass die St\u00f6rung langsam abklingt. War jemand von euch betroffen? Falls jemand Zugriff auf die Statusmeldungen im Admin-Center hat, kann er diese ja hier posten.<\/p>\n

Pro-russische Hacktivisten verantwortlich?<\/h2>\n

Erg\u00e4nzung:<\/strong> Inzwischen behauptet die pro-russische Hackergruppe Anonymous Sudan f\u00fcr die St\u00f6rung verantwortlich zu sein. Nachfolgender Tweet<\/a> verweist auf diesen Beitrag<\/a>, wo Ausz\u00fcge der Stellungnahmen dieser Hacktivisten zu finden sind. Die Hacktivisten geben an, Microsofts Server per DDoS-Angriff \u00fcberlastet zu haben. Wie belastbar das ist, kann ich nicht beurteilen.
\n\"Exchange<\/a>
\nMicrosofts Statusmeldungen<\/p>\n

Erg\u00e4nzung:<\/strong> Andreas P. hat mir inzwischen die nachfolgenden Ausz\u00fcge aus dem Status Dashboard von Exchange Online geschickt.<\/p>\n

Share: Incident: EX571516, impacted service: Exchange Online, impacted feature: E-Mail and calendar access, current status is: Service restored<\/p>\n

Published Time: 05.06.2023 19:58:46<\/p>\n

Title: Some users were unable to access Outlook on the web, and may have experienced issues with other Exchange Online services<\/p>\n

User impact: Users were unable to access Outlook on the web, and may have experienced issues with other Exchange Online services.<\/p>\n

More info: Additionally, other Microsoft 365 services also experienced impact:
\nMicrosoft Teams
\n– Users may have had difficulties scheduling meetings and\/or live events
\n– Users may have had trouble loading people profile cards
\n– Users may have had issues loading file lists
\n– Users may have been unable to create new teams & channels
\n– Users may have been unable to install apps
\n– Users may have experienced issues performing searches
\n– Users may have seen delays in admin policy changes taking effect
\n– Users might have seen errors when using messaging extensions
\n– Users may have been unable to view up to date Presence information
\n– Teams Graph APIs may have been impacted
\n– Assignments tab in Teams may have not loaded
\n– Teams Admin Center functionalities were not performing as expected<\/p>\n

SharePoint Online and OneDrive for Business
\n– Users may have been unable to use Search functionality<\/p>\n

Microsoft Power Automate in Microsoft 365
\n– Users were unable to trigger flows using Office 365 connectors in Microsoft Power Automate<\/p>\n

Power Apps in Microsoft 365
\n– Users were unable to run apps in Power Apps that utilize Office 365 connectors
\n– Flows using the Office 365 Groups, Groups Mail, Outlook, Users, and Videos connectors may have been impacted<\/p>\n

Final status: We've completed the restarts to address the residual impact, and after an extended period of monitoring, we've confirmed that the issue is resolved. We continue to investigate why the update caused impact and further details will be provided within the Post-Incident Report.<\/p>\n

Scope of impact: Impact was primarily to users hosted within infrastructure that received the update prior to the deployment halt. However, any user may have experienced some degree of impact as described in the \"More Info\" section above.<\/p>\n

Start time: Monday, June 5, 2023, at 2:10 PM UTC<\/p>\n

End time: Monday, June 5, 2023, at 5:13 PM UTC<\/p>\n

Preliminary root cause: A recent update, intended to add additional resilliencies against downstream request remaining in a hanging state, inadvertently caused impact.<\/p>\n

Next steps:
\n– We're reviewing dump files gathered from impacted components during the incident to better understand why impact occurred.
\n– We're investigating to content of the update to identify the underlying root cause.<\/p>\n

We'll publish a Post-Incident report within five business days.<\/p>\n

Published Time: 05.06.2023 19:07:56<\/p>\n

Telemetry indicates that service availability is at approximately 99.9% across the service. We're continuing to isolate a small number of components which remain in an unhealthy state and are performing targeted restarts to remediate the residual impact.<\/p>\n

This quick update is designed to give the latest information on this issue.<\/p>\n

Published Time: 05.06.2023 18:19:40<\/p>\n

Title: Some users are unable to access Outlook on the web, and may experience issues with other Exchange Online services<\/p>\n

User impact: Users are unable to access Outlook on the web, and may experience issues with other Exchange Online services.<\/p>\n

More info: Additionally, other Microsoft 365 services are also experiencing impact:
\nMicrosoft Teams
\n– Users may have difficulties scheduling meetings and\/or live events
\n– Users may have trouble loading people profile cards
\n– Users may have issues loading file lists
\n– Users may not be able to create new teams & channels
\n– Users may not be able to install apps
\n– Users may have trouble issuing searches
\n– Users may see delays in admin policy changes taking effect
\n– Users might see errors when using messaging extensions
\n– Users may not see up to date Presence information
\n– Teams Graph APIs may be impacted
\n– Assignments tab in Teams may not load
\n– Teams Admin Center functionalities may not perform as expected<\/p>\n

SharePoint Online and OneDrive for Business
\n– Users may be unable to use Search functionality<\/p>\n

Current status: We've reverted a change which occurred just prior to impact starting and after service replication took place, telemetry is showing significant improvement in availability across the service. Additionally, we've received confirmation from previously impacted users that the issue is no longer occurring. We're continuing to monitor to ensure recovery and are isolating any sections of the service showing residual impact which would require additional recovery actions.<\/p>\n

Scope of impact: Impact is specific to users routed through the affected infrastructure.<\/p>\n

Next update by: Monday, June 5, 2023, at 6:00 PM UTC<\/p>\n

Published Time: 05.06.2023 17:58:00<\/p>\n

We've prevented the potentially problematic update from propagating further across the service and are reviewing options to revert the change quickly and safely in those portions of our infrastructure where it has been applied.<\/p>\n

This quick update is designed to give the latest information on this issue.<\/p>\n

Published Time: 05.06.2023 17:14:38<\/p>\n

We've identified an update which was applied around the time that impact started. We're reverting the update to potentially mitigate impact whilst we continue to investigate the underlying cause of the issue.<\/p>\n

This quick update is designed to give the latest information on this issue.<\/p>\n

Published Time: 05.06.2023 17:09:33<\/p>\n

Title: Some users are unable to access Outlook on the web.<\/p>\n

User impact: Users are unable to access Outlook on the web.<\/p>\n

More info: Additionally, other Microsoft 365 services are also experiencing impact:
\nMicrosoft Teams
\n– Users may have difficulties scheduling meetings and\/or live events
\n– Users may have trouble loading people profile cards
\n– Users may have issues loading file lists
\n– Users may not be able to create new teams & channels
\n– Users may not be able to install apps
\n– Users may have trouble issuing searches
\n– Users may see delays in admin policy changes taking effect
\n– Users might see errors when using messaging extensions.
\n– Teams Graph APIs may be impacted<\/p>\n

Current status: We're continuing to review monitoring health systems targeted at networking, Client Access Front End (CAFE) routing, and database storage to determine the underlying cause of the issue.<\/p>\n

Scope of impact: Impact is specific to users routed through the affected infrastructure.<\/p>\n

Next update by: Monday, June 5, 2023, at 4:30 PM UTC<\/p>\n

Published Time: 05.06.2023 16:52:56<\/p>\n

Title: Some users may be unable to access Outlook on the web.<\/p>\n

User impact: Users may be unable to access Outlook on the web.<\/p>\n

Current status: We're reviewing monitoring telemetry to isolate the source of the issue.<\/p>\n

Scope of impact: Impact is specific to users routed through the affected infrastructure.<\/p>\n

Next update by: Monday, June 5, 2023, at 4:00 PM UTC<\/p>\n

Published Time: 05.06.2023 16:32:40<\/p>\n

Title: We're looking into a potential problem.<\/p>\n

User Impact: We're investigating the potential end-user impact.<\/p>\n

Current status: We're investigating a potential issue and checking for impact to your organization. We'll provide an update within 60 minutes.<\/p><\/blockquote>\n

Und hier ist der zweite Auszug:<\/p>\n

Share: Incident: MO572252, impacted service: Microsoft 365 suite, impacted feature: Portal, current status is: Service degradation<\/p>\n

Published Time: 05.06.2023 22:11:47<\/p>\n

Title: Can't access Outlook on the web and other Microsoft services and features<\/p>\n

User impact: Users may be unable to access Outlook on the web or other Microsoft 365 services and features.<\/p>\n

More info: Impacted services and features may include, but are not limited to:
\nExchange Online
\n– Users are unable to access Outlook on the web<\/p>\n

Microsoft Teams
\n– Users may have difficulties scheduling meetings and\/or live events
\n– Users may have trouble loading people profile cards
\n– Users may have issues loading file lists
\n– Users may not be able to create new teams & channels
\n– Users may not be able to install apps
\n– Users may have trouble issuing searches
\n– Users may see delays in admin policy changes taking effect
\n– Users might see errors when using messaging extensions
\n– Users may not see up to date Presence information
\n– Teams Graph APIs may be impacted
\n– Assignments tab in Teams may not load
\n– Teams Admin Center functionalities may not perform as expected<\/p>\n

SharePoint Online, OneDrive for Business, Microsoft Power Automate in Microsoft 365 and Power Apps in Microsoft 365 may also be experiencing some impact related to this issue.<\/p>\n

Current status: We've determined that impact associated with MO571683 and EX571516 is reoccurring. We suspect that impact to our services is similar, though we're investigating to determine the scope of impact and the source of the issue.<\/p>\n

Scope of impact: Users routed through the affected infrastructure are affected by this issue, however, impact can vary depending on where users are hosted.<\/p>\n

Next update by: Monday, June 5, 2023, at 9:00 PM UTC<\/p>\n

Published Time: 05.06.2023 19:57:28<\/p>\n

Title: Some users experienced impact to multiple Microsoft 365 services and features<\/p>\n

User impact: Users experienced impact to multiple Microsoft 365 services and features.<\/p>\n

More info: Impacted services and features include, but were not limited to:
\nExchange Online
\n– Users were unable to access Outlook on the web (as communicated under EX571516)<\/p>\n

Microsoft Teams
\n– Users may have had difficulties scheduling meetings and\/or live events
\n– Users may have had trouble loading people profile cards
\n– Users may have had issues loading file lists
\n– Users may have been unable to create new teams & channels
\n– Users may have been unable to install apps
\n– Users may have experienced issues performing searches
\n– Users may have seen delays in admin policy changes taking effect
\n– Users might have seen errors when using messaging extensions
\n– Users may have been unable to view up to date Presence information
\n– Teams Graph APIs may have been impacted
\n– Assignments tab in Teams may have not loaded
\n– Teams Admin Center functionalities were not performing as expected<\/p>\n

SharePoint Online and OneDrive for Business
\n– Users may have been unable to use Search functionality<\/p>\n

Microsoft Power Automate in Microsoft 365
\n– Users were unable to trigger flows using Office 365 connectors in Microsoft Power Automate<\/p>\n

Power Apps in Microsoft 365
\n– Users were unable to run apps in Power Apps that utilize Office 365 connectors
\n– Flows using the Office 365 Groups, Groups Mail, Outlook, Users, and Videos connectors may have been impacted<\/p>\n

Final status: We've completed the restarts to address the residual impact, and after an extended period of monitoring, we've confirmed that the issue is resolved. We continue to investigate why the update caused impact and further details will be provided within the Post-Incident Report.<\/p>\n

Scope of impact: Impact was primarily to users hosted within infrastructure that received the update prior to the deployment halt. However, any user may have experienced some degree of impact as described in the \"More Info\" section above and in Service Health Dashboard post MO571683.<\/p>\n

Start time: Monday, June 5, 2023, at 2:10 PM UTC<\/p>\n

End time: Monday, June 5, 2023, at 5:13 PM UTC<\/p>\n

Preliminary root cause: A recent update, intended to add additional resilliencies against downstream request remaining in a hanging state, inadvertently caused impact.<\/p>\n

Next steps:
\n– We're reviewing dump files gathered from impacted components during the incident to better understand why impact occurred.
\n– We're investigating to content of the update to identify the underlying root cause.<\/p>\n

We'll publish a Post-Incident report within five business days.<\/p>\n

Published Time: 05.06.2023 19:07:52<\/p>\n

Telemetry indicates that service availability is at approximately 99.9% across the service. We're continuing to isolate a small number of components which remain in an unhealthy state and are performing targeted restarts to remediate the residual impact.<\/p>\n

This quick update is designed to give the latest information on this issue.<\/p>\n

Published Time: 05.06.2023 18:21:37<\/p>\n

Title: Some users are experiencing impact to multiple Microsoft 365 services and features<\/p>\n

User impact: Users are experiencing impact to multiple Microsoft 365 services and features.<\/p>\n

More info: Impact services and features include, but are not limited to:
\nExchange Online
\n– Users are unable to access Outlook on the web (as communicated under EX571516)<\/p>\n

Microsoft Teams
\n– Users may have difficulties scheduling meetings and\/or live events
\n– Users may have trouble loading people profile cards
\n– Users may have issues loading file lists
\n– Users may not be able to create new teams & channels
\n– Users may not be able to install apps
\n– Users may have trouble issuing searches
\n– Users may see delays in admin policy changes taking effect
\n– Users might see errors when using messaging extensions
\n– Users may not see up to date Presence information
\n– Teams Graph APIs may be impacted
\n– Assignments tab in Teams may not load
\n– Teams Admin Center functionalities may not perform as expected<\/p>\n

SharePoint Online and OneDrive for Business
\n– Users may be unable to use Search functionality<\/p>\n

Current status: We've reverted a change which occurred just prior to impact starting and after service replication took place, telemetry is showing significant improvement in availability across the service. Additionally, we've received confirmation from previously impacted users that the issue is no longer occurring. We're continuing to monitor to ensure recovery and are isolating any sections of the service showing residual impact which would require additional recovery actions.<\/p>\n

Scope of impact: Impact is specific to users routed through the affected infrastructure.<\/p>\n

Next update by: Monday, June 5, 2023, at 6:00 PM UTC<\/p>\n

Published Time: 05.06.2023 17:58:21<\/p>\n

We've identified an update which was applied around the time that impact started. We've prevented the potentially problematic update from propagating further across the service and are reviewing options to revert the change quickly and safely in those portions of our infrastructure where it has been applied.<\/p>\n

This quick update is designed to give the latest information on this issue.<\/p>\n

Published Time: 05.06.2023 17:29:32<\/p>\n

Title: Some users are experiencing impact to multiple Microsoft 365 services and features<\/p>\n

User impact: Users are experiencing impact to multiple Microsoft 365 services and features.<\/p>\n

More info: Impact services and features include, but are not limited to:
\nExchange Online
\n– Users are unable to access Outlook on the web (as communicated under EX571516)<\/p>\n

Microsoft Teams
\n– Users may have difficulties scheduling meetings and\/or live events
\n– Users may have trouble loading people profile cards
\n– Users may have issues loading file lists
\n– Users may not be able to create new teams & channels
\n– Users may not be able to install apps
\n– Users may have trouble issuing searches
\n– Users may see delays in admin policy changes taking effect
\n– Users might see errors when using messaging extensions.
\n– Teams Graph APIs may be impacted<\/p>\n

SharePoint Online and OneDrive for Business
\n– Users may be unable to use Search functionality<\/p>\n

Current status: We're reviewing monitoring health systems targeted at networking, Client Access Front End (CAFE) routing, and database storage to determine the underlying cause of the issue.<\/p>\n

Scope of impact: Impact is specific to users routed through the affected infrastructure.<\/p>\n

Next update by: Monday, June 5, 2023, at 4:30 PM UTC<\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

[English]Zum 5. Juni 2023 hat es bei Microsofts Exchange Online wohl eine massivere St\u00f6rung gegeben. Administratoren kamen nicht mehr ins Admin-Center und Outlook konnte im Web nicht mehr erreicht werden. Ein Nutzer hat mich auf diese St\u00f6rung hingewiesen, die kurz … Weiterlesen →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7263,7862],"tags":[1171,8387,987],"class_list":["post-282177","post","type-post","status-publish","format-standard","hentry","category-cloud","category-stoerung","tag-cloud","tag-exhange-online","tag-storung"],"_links":{"self":[{"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/posts\/282177","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/comments?post=282177"}],"version-history":[{"count":0,"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/posts\/282177\/revisions"}],"wp:attachment":[{"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/media?parent=282177"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/categories?post=282177"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/borncity.com\/blog\/wp-json\/wp\/v2\/tags?post=282177"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}