Thank you for the help!
I've since tried a few things, and indeed, it seems to be a problem of drivers mostly, with some added timing/voltage problems (which will be "fun" to debug).
Anyway, yesterday evening I tried connecting a mouse, and it worked, and I could even connect an old USB drive...