If your case is a bit bigger and also a bit thicker, no, not that hard really.
However, I used a small case, positioned the joystick out too much, and made the case as "slim" as could manage, so made life difficult for myself.
I would take a commission or two, however would only make one on if...