
Azure, Virtualization, Windows, Linux 🐧. Other: PCs, music, wrestling and video games. #WeTheNorth #StarTrek 🖖🏽 🇬🇾 🇨🇦 Mastodon: @robindp@twit.social
Canada
Joined November 2013
- Tweets21.2K
- Following991
- Followers319
- Likes114K
Staples Canada says customer information accessed in data breach cp24.com/local/york/2026/11/…
Robin D. Persaud retweeted
The full PIR of Outlook/Microsoft outage is out, with more details than the pre PIR.
(1) It clarifies that the outage was not caused by AI tooling.
(2) More details on the cascading failures and how the overload was spread by automatic traffic management. Apparently, the traffic manager didn't expect the level of capacity shortage (plus the resource hogging bug).
(3) Why recovery took so long. Applying the bug fix takes 5 steps including two server restart (!), which needs to be done for all the servers in the fleet. A fast, live patching system would really help!
(4) A detailed action plan (most has been done).
Kudos to @Microsoft and the team @clamanna for writing the detailed postmortem report. It's very informative and educational. We shall all learn from it and prepare for disasters better.
I download the report here: tianyin.github.io/misc/pir_m…
The pre PIR of the Outlook/Microsoft outage has much more clarify. Thank you @Microsoft !
The outage is indeed a very hard one; many unfortunate events occurred at the same window.
A latent bug exhausting CPU/memory under specific load condition was deployed worldwide, with no impact for 3 months. The bug was triggered by a surge in load, caused by an unrelated failover of Teams and another unrelated loss of 14% of server capacity. The system is then badly overloaded; 80% of servers were unresponsive. Then, the isolation mechanism between fault domains didn't work (it was vague in the PIR), causing cascading failures till a global outage.
Then, the (likely automatic) recovery unsurprisingly hit the classic thundering herd effect.
In this case, root-cause analysis is on the critical path and it took more than 15 hours to figure out the latent bug and revert it (it's really a very nasty bug!)
The long recovery time is quite understandable. Given such a global outage, it has to be paced carefully.
I downloaded the report at,
tianyin.github.io/misc/prepi…
Robin D. Persaud retweeted
Google Is Shutting Down the Nest App in January iphoneincanada.ca/2026/11/20…
Robin D. Persaud retweeted
Microsoft is removing 32-bit app support by default from Windows Server 2028, marking another step away from legacy Windows components.
windowscentral.com/microsoft…
The company says the WoW64 subsystem, which allows 32-bit applications to run on 64-bit Windows, will no longer ship enabled out of the box. Instead, WoW64 will become an optional component that administrators can install manually when required.
Microsoft says the change will improve security, particularly by preventing 32-bit malware from running on Windows Server 2028 by default. It should also help reduce the overall OS footprint.
Robin D. Persaud retweeted
Windows Server 2028 - now in public preview! Explore stronger security foundations, high-performance storage, simplified management, and investments in hybrid AI.
Check out the preview: techcommunity.microsoft.com/…
Learn more at #MSIgnite: ignite.microsoft.com/en-US/s…
Robin D. Persaud retweeted
Hello Windows Server 2028!
Server build 29706 formally introduces the Windows Server 2028 branding
Robin D. Persaud retweeted
Our ambition with everything we are announcing at Ignite today is to parlay technological advances into real outcomes and new points of leverage for people, organizations, and society at large.
Just a few of the things we're announcing:
Robin D. Persaud retweeted
Over the past week, I’ve been overwhelmed by the love and support of friends, industry colleagues, and people I've never met. Thank you to everyone who has shown kindness to my family and me. It means the world to me.
I came to the United States 53 years ago, and becoming an American citizen is one of the greatest gifts and proudest moments of my life. NVIDIA has been my life’s work. Building it into the company it is today alongside my colleagues has been a privilege and an honor. Nowhere but in America could a company like NVIDIA be possible. I love our country, and I love NVIDIA.
I did not live up to the standards expected of everyone at NVIDIA, and I have made serious mistakes in my personal life. I created problems for the Board that I deeply regret. I own my mistakes completely, and I am committed to cooperating with the Board’s independent investigation.
Since my departure, I’ve seen an outpouring of calls from NVIDIA’s employees, investors, business partners, and customers for me to return as CEO. Many continue to reach out to me directly as the company navigates complex technology, market, competitive, and geopolitical dynamics. NVIDIA is a once-in-a-generation company. If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
Thank you again to everyone who has shared their good wishes. I am profoundly humbled by your support. To my family: I love you, and I will spend the rest of my life being worthy of yours.
Jensen
Robin D. Persaud retweeted
Preliminary incident report for the recent Microsoft outage
Multiple factors combined to create this outage, a complete incident report is still coming
1. A defect in an update from 3 months ago - a special update for M365 servers, not Windows Updates
admin.cloud.microsoft/#/serv…
We’re bringing back the original XBOX boot-up animation for all XBOX Series X|S and XBOX One players, along with two additional XBOX 360 boot-up animations!
This update will be rolling out throughout the day and thank you for being part of 25 years of XBOX.
Robin D. Persaud retweeted
Microsoft has published its preliminary post-incident report explaining the November 12 global outage that knocked Outlook, Exchange Online and other services for more than 12 hours. #Microsoft365 #Outage #Report neowin.net/news/microsoft-fi…
Robin D. Persaud retweeted
We are deeply sorry for the disruption this incident has caused our customers and partners. We know the trust they place in our services and take that responsibility extremely seriously. We are seeing broad recovery and stability across our services.
This was a technical issue not related to cyber or AI / agents. The incident was introduced by an issue during an earlier network capacity upgrade that surfaced following a recent network change. We have addressed the underlying issue and continue to restore service to remaining customers and regions.
Given the scale of demand, we restored services gradually, validating stability at each stage. While this took longer, it helped ensure a stable restoration.
We will provide a full post-incident report once our review is complete.
Robin D. Persaud retweeted
‼️ UPDATE: Microsoft's outage now reaches far beyond Outlook. Teams, SharePoint, Copilot and even its Defender XDR security platform are hit.
Consumers can't reach their OneDrive storage or Office on the web either, TechCrunch reports.
Microsoft first blamed elevated load. Now it says a large number of its servers became unexpectedly unavailable, dumping their load onto the rest. It hasn't said why.
It is restarting the servers with a fix in place, investigating why they show high processor use, and has paused all deployments.
Robin D. Persaud retweeted
We're investigating reports of users experiencing issues accessing Exchange Online mailboxes through multiple connection methods in the Americas. More details can be found in the Microsoft 365 admin center under EX1550543.
Robin D. Persaud retweeted
Outlook's SPF validation fails have disrupted email communication, blocking messages and connectivity. #Microsoft #Outlook #SPF neowin.net/news/microsoft-ou…
Robin D. Persaud retweeted
If we had Claude in 1998.
I asked it to free up some disk space.
What's the worst thing you ever deleted from C:\WINDOWS?
Robin D. Persaud retweeted
Need a fresh start for your Windows 11 PC? With Cloud rebuild, you can download and reinstall Windows and the drivers your PC needs directly from Windows Update, even if Windows can’t start. No USB drive or installation media needed.
Learn more: support.microsoft.com/window…


































