If the universe were infinite, there would also have to be an infinite amount of matter, or no matter at all. But if there were an infinite amount of matter, there would be no empty space. But there is empty space. And there is matter. Thus, our universe is not infinite.