you can download public domain roms at my site. I'm working on adding some more roms in the packs i have as well as adding pd packs for some other systems such as psx and gba. these are homebrew and fully legal.
the only public domain neo geo rom i know of is a pong game and I'm not sure if it works with gngeo2x