While chatting up the X Factor with E! News alongside fellow judges Paulina Rubio and Kelly Rowland, Cowell explained how he'd recently been photographed holding a baby because he was learning the proper way to hold a child.
From there, the topic of marriage, naturally, came up again. In particular, a remark Cowell made last week to Ryan Seacrest that he "wouldn't expect Lauren to be a single mother."
When Cowelll essentially reiterated the point by saying, "Obviously, I would never expect to bring a baby up without a proper father."
Then Cowell was asked, "Is that something to do before the birth of your son?"
To which Cowell quietly answered with a soft, "Yes."
Of course, only time will tell if a wedding or, at the very least, a proposal, actually takes place in the near future.
Meanwhile, Monday night was date night for Cowell and Silverman as the couple dined at Ago restaurant in West Hollywood.
"They were enjoying their dinner," a source tells E! News, noting that the two "looked at each other very warmly" and "were having a good time."
But it seems they had some company.
According to the source, joining them was Cowell's ex Terri Seymour, who was there with a male companion, as well as Dancing With the Stars' Bruno Tonioli.
"They were hanging out having fun and were very friendly," the source said.
—Reporting by Lindsey Caldwell
Be sure to see more of Simon Cowell's interview on Tuesday's E! News at 7 p.m. and 11:30 p.m. on E!