I'm pretty sure, because I played through the whole game, but maybe I just never needed the umlauts.
I also noticed, that the current Windows version doesn't detect the keyboard layout correctly. Instead of the QWERTZ layout, it uses the QWERTY layout, which has no umlauts. The Linux version...