Comment 6 for bug 90261

After some more checking, it turns out it's not xscreensaver. I had simply assumed it because it had loaded after closing it. The problem, strangely enough, lies in xbindkeys.

Just configure your keys through Xfce's keyboard settings, and remove xbindkeys from your list of startup programs. It's been working for me ever since.