Not that I've noticed, but I usually don't use it. It just popped into my head and seemed appropriate. I might have picked it up subconsciously, who knows?
I'm pretty sure I was reading a Rolling Stone once and they described Don Lemon as "milk toast" (spelled out just like that, can't remember if it was hyphenated) and I'm assuming it just took on its phonetic representation?