Pycelle is a pompous, dithering old man - on the surface at least. While he has served for decades under four different kings, and is clearly getting on, he's nowhere near as feeble in body or mind as he would like people to think. It's all an act designed to have his foes to underestimate him, and largely it works. It was his betrayal of King Aerys that allowed Tywin to ride in and sack the city. And of course, he also had a hand in the death of Eddard Stark. Let's be fair though, he wasn't particularly fond of Joffrey, though he did his best to conceal it. No, it's just that Pycelle is really annoying. He hasn't killed or maimed anyone, but his bumbling persona grates horribly. Not only does he irritate viewers with his duplicitous, blithering nature, he annoys everyone around him in King's Landing. Even Cersei is having him fazed out, and he effectively put her son on the thrown.