Thornton, who was married to the actress from 2000 to 2003, told ABC's Nightline why he "blew it" with Jolie. "I didn't think I was good enough for her," he said. "She has one way she wanted to live her life and I had another way to live mine and I was just too insecure."
The 56-year-old Sling Blade star said he "did feel like the Phantom of the Opera hiding in the catacombs" during his marriage to Jolie, 36. "People have actually said that I didn't deserve to be with her."
"When you're in a relationship, any two celebrities or whatever, you know, I think that puts on a lot of pressure," he said. "When Angie and I got married, during that time, I was more famous than she was to start with and then she becomes this big thing, it's hard in these relationships."
And although Jolie is clearly off the market (she and Pitt are engaged with six beautiful children!), Thornton said he and the actress remain "good friends"
"We had a great time together," he said. "We had a great marriage and I chickened out because I didn't feel good enough. That's all that happened. It was no big deal, we never hated each other."
Thornton's full interview airs on ABC's Nightline Wednesday at 11:35 p.m.