Mine turned out to be a Isle of Thunder quest that was on the level 91 character I was having trouble with. As soon as I dropped the quest my FPS went back up. Turns out my 100+ character is fine since he wasn't running the wardens quest.
Quest:
http://www.wowhead.com/quest=32707