Corrupt drivers don't cause intermittent problems. But check Device Manager for any errors. It could the USB controller on your motherboard, but I would swap keyboard and mouse with a different pair, just in case one of them is messing up.
Other than the keyboard and mouse, you don't have any other USB devices attached?