I would recommend either SDL or QT. LazyFoo has a SMALL section on SDL with OpenGL, but it really does focus on 2D.
One advantage of Qt as you head towards 3d is it's actively developed and supports GLES. SDL seemed to be heading in that direction with 1.3, but 1.3 hasn't seemed to go...