You aren't the only person to notice this. Mine and many others keep perfect time, the only time it loses time (heh) is when the battery is out, which would be expected. Not entirely certain yet why some people keep losing time.
Do you know what hotfix you're on? Hotfix 3 and earlier, putting it into low power mode would cause the clock to slow down.
Constantly going back to the hardware clock is actually pretty slow in the grand scheme of computation. It's a lot faster to estimate one second and increment a software clock in memory and just refresh from the real time clock less frequently. Back at the beginning, low power mode used to drop the CPU to 14Mhz, a speed so low it couldn't keep up with the normal tasks, and the software clock suffered. With HF4, that was increased to 125Mhz and it no longer has any problems keeping up. That's why I asked which hotfix he was using. That won't be it anymore, though, mine sits in low power mode 18 hours a day and it hasn't lost any time.Yeah, that makes no sense to me either. The RTC in the TPS65950 has a hardware counter. I wonder why that isn't used.
neelix-openpandora:~$ date
Sun Mar 13 00:26:36 EST 2011
neelix-openpandora:~$ hwclock
Sat Mar 12 23:42:21 2011 0.000000 seconds
hwclock -wl