So - with the cumulative preview installed, I don't get the error when restarting/signing out, but I do get other driver issues (maybe a compatibility issue with the latest preview build and Riot Vanguard driver).
When uninstalling the update before, I got the startup critical errors, and also the error when restarting or signing out, but no visible executable or DLL that I could see. (It also flashes very quickly).
I'll try uninstalling the update again and seeing if it gives me the same errors - were there any issues in the original CBS log, or did that also look clean? If no luck, I don't have much on this PC, so I might just do a full reinstall.