The good Reverend is not your typical clergyman - he is disliked by God and the majority of his parishoners.
"I remember another gentle visitor from the heavens, he came in peace and then died, only to come back to life, and his name was E.T., the extra terrestrial. I loved that little guy."
"Once something has been approved by the Government, It's no longer immoral."
"Today's Christian doesn't think he needs God. He's got his Hi Fi, his boob tube, and his instant pizza pie..."
"And as we pass the collection plate, please give as if the person next to you was watching."
"Dearly beloved, I will now read the special vows which Homer has prepared for this occasion. Do you Marge take Homer in richness and poorness, poorness is underlined, in impotence and im-potence, in quiet solitude or blasting across the alkali flats in a jet powered monkey navigated...and it goes on like this..."
Lovejoy: Get a divorce. Marge: But isn't that a sin? Lovejoy: Marge, just about everything is a sin. Y'ever sat down and read this thing? Technically, we're not allowed to go to the bathroom.
Homer: At times like this is wish I was a religious man. Lovejoy: It's all over people, we don't have a prayer! (suggested by dragonkidd785)
"Wait a minute, this sounds like rock-and-or-roll" (suggested by john)