I, too have the dreaded "Up doesn't work" problem. I've tried several copies of Duke3D (alas, I don't have the atomic one laying around).
But, as a side note, Start+Select doesn't get me back to the menu either, so ...
Anyone else have these problems? Resolutions?