OK, just got my GP2X and unpacked it.
Of course, I forgot to order a memory card, but i thought I'd turn it on and have a look anyway.
It booted up fine, I went to the Games icon, then clicked on, I think, a memory card icon - despite not having one. The whole thing made a whirring noise then...