Hi again
Sorry for my recent delays in answering (been doing some good repair business!) ....
Performance Monitor
I looked over the Performance Monitor output, seems pretty good overall.
Nvidia GeForce Driver Tweaks
Any performance change with the new Nvidia driver? If not, you could try some of the tweaks that various users have tried - a guide I see referred to every now and then is over at TweakGuides ---
TweakGuides.com - Nvidia GeForce Tweak Guide
One example that I imagine the guide will mention is that you don't need to install all of the GeForce Experience modules (there are quite a few of them) or the Network Streaming service (if you aren't playing your games online, you can toggle that service on/off as necessary).
High Hard Pagefaults
And - here are some steps I've been mentioning for limiting hard pagefaults, since they were the worst offenders in some of your graphs:
To help lower high hard pagefaults, it can help to:
1) Limit startup processes that you don't need
2) Limit Windows-Updates file-sharing (in Settings > Updates and security > Windows Update > Advanced Options > Choose how updates are delivered > turn off "updates from more than one place" - that will limit unnecessary background network activity)
3) Limit the amount of "telemetry" (data sent to Microsoft ... choose the "Basic" option in Settings > Privacy > Feedback & Diagnostics ... and you can try "Never" as your "Feedback Frequency" while testing your latency issues)
4) Limit any Notifications that you don't need or want (Settings > System > Notifications & actions
5) Turn off "Live" tiles on your Start Menu (to limit unnecessary background updating of any information you don't want or need)
6) Uninstall any Windows "Universal" apps that you don't want or need (Settings > System > Apps & features -- click the app you wish to uninstall) ... and for those that you don't want, but can't uninstall (some of the built-in apps) - you can still keep them from starting unwanted services (in Control Panel > Administrative Tools > Services) or startup modules (in Task Manager > Startup tab)
Antivirus Firewalls
Some users find that certain modules of their antivirus program can have a rough affect on their audio quality. For some, it is especially noticeable when using the third-party firewall. You can try reverting to using just the Windows firewall, or to turn off a feature in the third-party firewall that blocks port scans (since most routers/modems/gateways have built-in port scanning blocking, it doesn't necessarily lower your defenses, since your hardware provides the service).
I noticed that you have Avast as your Antivirus (so do I, actually) ... If you have the "Avast Internet Security" version, it includes a firewall - so why not take a look and see if it has that port-scanning blocking feature available to toggle on/off (I would expect it to). I use the free version of Avast, which doesn't include the firewall, so I make do with the Windows 10 firewall.
Windows Updates
And .... there was another round of Windows Updates released today (Tuesday June 14, 2016)... I didn't notice any fixes specific to our issues, but the overall stability might improve things bit by bit.
Let's hope things start working a bit better ...