Yeah, the wiki is where it's at. You will need to set up a Dev environment and learn either C, C++, Python as well as SDL, there are tutorials easily accessible.
You'll probably find that downloading existing Source Code for GP2X will provide you with a great learning example, source code is available for some apps through the GP2X Archive.