Do I need to recompile GCC if I already have it? AFAIK GCC is what I'm using to emerge things, so I think I already have it :unsure:. Or am I compiling another GCC to use only for GP32 dev?
You need a version of GCC that has been compiled with added support for ARM proccessors. If you follow those instructions to the letter, you will get one.