Littlefinger is a man who lives to play the Game of Thrones, and thrives in the chaos that he uses as a ladder. He seems to know pretty much everything about anyone, and even foreshadows some of the major deaths of season 4. While consoling Robert Arryn after sending his mother flying out the Moon Door, he says: People die at their dinner tables. They die in their beds. They die squatting over their chamber pots. Everybody dies sooner or later. Admittedly this happened after Joffreys death, but its still a clear reference to it, while later in the season we saw Shae killed in her bed, and Tywin on the pot. Petyr Baelish knows everything.