If you use it in read only mode, sure. Writing a bit puts a lot more stress on the silicon than making use of conventional silicon circuity, way more than what I would call common wear and tear of just using it - without wear leveling that would be quite a noticeable issue. In the case of SSDs it's usually the controller that dies first, though.Hypothetically a solid state device should never wear out. It's a good hypothesis.
The rather simple design of GPUs surely helps with durability, their performance mainly comes from throwing as much ALUs as possible at the problem.