From Wikipaedoia,
By extension of the meaning "child's pastime", a hobby-horse is also a favorite diversion or obsession of which a person won't let go. For instance, if a person keeps on and on about income taxes being too high someone might say "oh, he's off on his hobby-horse again..."