Hmm... no, no special drivers are required. Maybe it is because you got such an outdated firmware (for which I have no experience as I started at 2.1.2).
Recommendation is to upgrade, REALLY. At least 2.0.0 would be a good idea to have, but it doesn't guarantee that it will fix the USB issue. But I must warn you again, FW upgrades are a bit risky if the power source is not reliable. Fresh good batteries or plugged to the wall my friend. And, take it slowly, you HAVE to jump to 2.0.0 first before going any further or you will likely brick your unit. Here's the location of the Firmwares section
on the archive. And
this is a GP2X user guide that describes how to do the upgrade and the risks involved, plus a lot of other stuff worth reading to get the most out of your unit. It's best to stick to 2.1.2 by the way, further upgrades don't offer that much IMHO. Or... well, we'll talk about it later...
Now back to the USB issue... just curious, do you really need to connect to the PC through USB? Most of us use an SD Card reader... anyway, hope you can solve it; if not don't hesitate to ask for more help.