There is really only one folder that I want sorted by date rather than by name. I frequently have to attach scanned documents to an email, so I save all scans to a designated folder. Obviously I want to attach the most recent scan, so that is why I want them sorted in date order rather than by name. For all other folders, sort by name order is fine.
I think that part of the reason that sorting them by date runs so slowly is because that scanned documents folder is on a second hard drive that I have in my laptop where I store files that I don't want to take up space on my main hard drive. That second hard drive is an old-fashioned magnetic HDD with spinning platters, so it's going to be slower than a SSD. But even if those platters are spinning at 33⅓ RPM it shouldn't take so long to sort them.