The DC comics character Etrigan is what they called a Rhyming Demon- as you might expect, he spoke in rhymes. Not that your guy is a demon or anything, but a "simple" shtick like that could be a good launch point.
Thanks for all the help guys, I'm really looking forward to playing this bard. I could use some help thinking of a backstory/personality for him, does anyone have some suggestions? Also, is Summer Rhymer a useful paragon path, or would I be better off taking another? It seemed pretty good to me.