Well... it should make a difference, yes...
You'd probably notice the biggest difference on scenes with fast action, where you'd get loads of blocky artifacts on the moving image. You'd just get less of this with a higher bitrate setting, and the general picture should be a bit sharper.