While Katie Holmes and little Suri laughed at an ice cream shop in New York City, a less gleeful Tom Cruise turned 50 in Beverly Hills, CA, with his other children, Connor and Isabella, and extended family.

That was not his original birthday plan.

"The plan was he was going to spend his birthday with Katie and Suri [in New York City]," a source told People. "Then they were going to fly to California where he is going to finish [filming] Oblivion and spend time there."

Now Tom is avoiding the paparazzi crush of NYC and he has to keep in touch with 6-year-old Suri by phone, which he reportedly does several times a day.

Credit: D. Hudson / Splash News Photo: Katie Holmes and Suri Cruise Get Ice Cream on July 3, 2012

"Say what you will about Tom, but there is no doubt he loves his daughter," a second source says. "Not seeing her would be very hard on him." Katie has reportedly filed for sole custody of Suri.

The insider said the mood of Tom's Tuesday birthday celebration was "somber" and "just very, very sad."

Katie was reportedly on the phone with Tom up until last week saying "I love you," but plans have been in the works for a while for her emancipation.

Source: People