I'm assuming so. My friend gave it to me, I guess he used it for his mp3 player (seeing as it had a few mp3s on it). I deleted everything from it. It worked fine for him I guess. Maybe my GP32 just doesn't like it.
Edit - I formatted the card in Windows XP (Command Prompt, FORMAT H:, H: being...