Microsoft improves AI feature Recall and adds "security measures" – is that enough?

[German]It was an absolute bombshell when Microsoft unveiled its "Copilot+PC" concept including the AI function Recall. Security experts tore Recall apart as an absolute nightmare because it opens up the possibility for cybercriminals to access user information. After a powerful headwind, Microsoft has now announced that Recall will be made available as an "opt-in" under Windows 11. In addition, security is to be provided by means of Windows Hello. But is this accurate, or is Recall simply bullshit?

Copilot+AI and Recall

In my the blog post Microsoft's AI PC with Copilot – some thoughts – Part 1 – Part 1, I discussed the "Copilot+PC" concept presented by Microsoft. There, the so-called recall feature was also mentioned briefly. The feature enables Windows to constantly take screenshots of the user's screen (or rather to save a snapshot each time, which also includes input and mouse movements). The results are stored in an SQL Light database in the user profile and can be analyzed and searched using a generative AI model. For example, the user should be able to ask "what did I look at recently as a travel destination" and then be shown the relevant documents, websites, emails etc. by Recall.

Shitstorm and PR disaster over Microsoft's recall

Satya Nadella, the head of Microsoft, dismissed the initial concerns of the questioner during an interview to present the Copilot+PC concept – everything runs locally. But security researchers were immediately up in arms about this feature because it offers the possibility of accessing everything the user does on the Windows PC. This also includes access to deleted information, passwords or login data or confidential documents.

In the blog post Copilot+AI: Recall, a security disaster – AI-assisted theft, I extracted an excerpt of what you should know about the function and how you could deactivate it via group policies. On Github there is the tool TotalRecall, which enables the reading of the database via script (see Add Recall module for dumping all users Microsoft Recall DBs & screenshot on GitHub).

This is PR for Microsoft, as Windows Central states in this article, noting that "Microsoft has lost the trust of its users, and Windows Recall is the straw that breaks the camel's back".

The above meme, which someone posted as a tweet on X, sums it up perfectly. The user actually only wants Windows as a working platform for launching programs, but Microsoft imposes a function that overwhelms everything. I read somewhere recently that Microsoft management, who approve functions such as Recall, are far removed from what normal users need on a daily basis. Users don't have 20 tabs open and have to quickly search through hundreds of emails to find out when they last went on a trip to the Maldives.

Microsoft tries to fix what can't be fixed

Microsoft is now trying to catch what should actually be scrapped. While Recall was previously activated by default, the function will only be rolled out as an "opt-in" in future. Pavan Davuluri – Corporate Vice President, Windows + Devices at Microsoft – announced this under the heading "We've heard your feedback" in the blog post Update on the Recall preview feature for Copilot+ PCs on June 7, 2024.

Recall Opt-in

During Windows setup, users should be given the option to explicitly activate the Recall function via opt-in (see image above). Furthermore, registration via Windows Hello authentication will be required as a security measure for recall activation. Proof of presence is required in order to use or search the recall function and the timeline of screenshots.

Furthermore, an additional data protection layer will be added that allows just-in-time decryption through Windows Hello Enhanced Sign-in Security (ESS). The recall snapshots can then only be decrypted and retrieved if the user authenticates themselves. In addition, the search index database has been encrypted. The whole thing should take effect from June 18, 2024. The blog post contains further details on how great they are and what else they are securing.

Comment: Too late, just dump it

If you think about Recall, you can only conclude that Microsoft has completely lost its grip. They are driving AI through the village, implementing a Recall function that monitors everything and rolling it out on millions of Windows computers, which are primarily used as work devices. A monitoring feature like Recall will be a wet dream for all surveillance enthusiasts – bit i's a nightmare for all others.

There's the old saying: "Where there's a trough, the pigs will come". The fact remains that even with opt-in, there will be enough "simpletons" who activate this option. Any information that is processed by these people (including emails, posts, messages, documents etc. from third parties) goes into the recall database. An absolute nightmare, and cybercriminals will find ways to circumvent Microsoft's ridiculous security measures. What's more, who's to say that Recall won't suddenly be rolled out to users as a "philosopher's stone" by Microsoft in the future?

In my opinion, there is only one thing to do: stamp it out and concentrate on other things. For users, the question arises as to whether Microsoft can still be the bank for IT solutions with its products. Microsoft has neither its on-premises software nor its cloud solutions under control in terms of reliability, maintainability, low error rates and security.

Similar articles:
Microsoft's AI PC with Copilot – some thoughts – Part 1
Microsofts Copilot+PC, a privacy and security nightmare – Part 2
Copilot+AI: Recall, a security disaster – AI-assisted theft