There was an update to the debian xorg package, and things seem to run much more stable with this one. Would be nice if you could try updating to that one as well and see if you can make it crash :)
an apt-get update/upgrade should do it, after changing the pin-priority in /etc/apt/preferences.d/pyra to something like 100.