To summarise what i remember people posting about this over the past few months. Several people have thought they had a problem with battery discharge whilst turned off, but seem to have silently resolved the issue (either with a replacement battery, or changing their usage).
From a few different reports, you should expect 1-2% loss when turned off for 24 hours. Noone has offered any results from a longer time 'off'.
If you see 10% battery loss in 24 hours, something is wrong (battery, pandora, charger, user). Troubleshooting this is probably complex, you would need to measure current from the battery whilst 'off' and that is not trivial to arrange. The only easy thing to do is try removing the battery for 24 hours to confirm that it is itself holding charge, and you have done that already. To some extent, it might just be an irritation and not a big inconvenience, so it might be hard to tell if it is more than a couple of people who have this problem.