The demon had had a sharp retort all lined up when Aziraphale mentioned a compulsion...

"You think I was forced into this by a love goddess?" clarified Crowley. They had met Aphrodite on that drive. And he had been a lot more interested in Ellie after that. (And somewhat in Cayce but he was never going to mention that to anyone ever.)

"But I'm not in love with Ellie."