You missed off power supply from your list. (Headphones arn't exciting because you can't get electric shocks from them) :P
The built in USB port is not a host port, meaning that it must be used to connect to a real host such as a PC. The GP2X will then appear on your PC as an external...