Even if you empty the trash can, it doesnt totally remove it.
I've been using CoMi through the GP32.
This app allows you to rename, delete, move files and folders. You can make new folders. It is very handy when you want to rename your old save games, clear SMC from old roms, delete mp3s...