Alright not to be a killjoy...hmm, wait, I am going to be a killjoy.
There is no need for another GP2X website that simply mirrors all the information already available for the handheld, especially a poorly designed one.
If you want to build a site, ditch the WYSIWYG editors (ie. Yahoo Sitebuilder, the one you used) and learn to write HTML on your own, without a fancy frontend. I know this kind of comment gets thrown around all the time, but it has some merit. Of course it's possible to build a good looking site using one, but you should understand what you're working with to set your foundation. Knowing HTML also allows you to save your source from looking like complete, overbloated crap that could have been done in a much cleaner way, in less space.
Some design tips, the graphics look cheap, especially the random clipart/images you didn't actually make yourself. Next, it's generally a bad idea to use more than one or two typefaces on a single page, it tires the eyes and looks ugly, and non-uniform. It makes the site look like a random mishmash of crap.
The large image with the overlay of the logo makes absolutely no sense, especially in it's placement. Your page also overflows for far too long for no reason. Also, what's the deal with your lines seperating your news entries, why use underscores when the horizontal rule tag (< hr >) is available?
Consistency is the key to good webdesig
n. You should strive to not make it look like it's your first time using your pirated copy of photoshop. (A fair assumption, feel free to correct me)
You should want your webpage to contain useful information, easily accessible and preferably unavailable elsewhere. You need something to draw users to keep visiting the site, not just visit it once after you spam it on a forum. Try covering an original aspect about the GP2X if you're keen on having a site about it. Dzz had the right idea reviewing homebrew software for it, but hasn't updated his list in a long time. Why not try taking that on, keeping it up to date with the newest releases? Provide screenshots, links to the authors website, information on where to download it and what you thought of it. If you know how, maybe make a user rating system through scripting (ie. ASP or PHP) so people can get not just your opinion on it, but that of visitors. Keep them organized by date so people can easily find out what's been added since they last visited.
That's just one idea, but it's something that might actually be useful.
If it matters, I have done paid graphic and print design, so I like to think I know what I'm talking about.