This article is from the James Taylor FAQ, by Joel Risberg (firstname.lastname@example.org) with numerous contributions by others.
From Carrie Schwanke (email@example.com):
The reason Carly and James broke up was because James was spending alot of
time on the road, totally concentrating on his music (and we really don't
mind). Carly now had 2 kids by JT, and gave him a bit of an ultimatum:
Quit spending so much time on your music and more time with your kids or
I'll divorce you.
James' answer lies in the title of his next album: "Dad Loves His Work."