Kourtney admits she "can't" wrap her head around that idea just yet on this Sunday's Keeping Up With the Kardashians.
While Khloe says that she's going, Kourtney says she has to think about it.
"I don't know I said I'll have to decide last minute, see what's going on with the kids," Kourtney says.
"You should go," Kris tells her.
Kourtney then explains, "I'm just not sure if I wanna go. I mean I'm so happy that Scott and I are getting along so well and that we're co-parenting, but I think hanging out with Scott without the kids...Scott can just take any little thing and run with it and think that like we're getting back together tomorrow."
Would Kourtney be open to getting back together?
"Right now I can't even wrap my head around that idea, there's so much work that would be involved and I'm so not even there yet," Kourtney admits.
Take a look at the video above to see the trio talk about Scott's birthday party and find out what else Kourtney said about her ex!
Keeping Up With the Kardashians brand new Sundays at 9PM, only on E! UK & EIRE