Charlie Sheen may be working on getting his act together, but it seems like his transformation may be too little, too late for his family.

The Anger Management star and his ex-wife, Brooke Mueller, have been feuding over custody of the couple’s twins, Bob and Max, who are currently in the care of Brooke’s brother, Scott, and it looks as though their battle may last long past the end of the holiday season.

Although some sources had reported that Charlie would be visiting with his boys on Christmas, claims that the actor won’t be getting in any quality time with either his sons or his daughters, Lola and Sam, with ex Denise Richards.

Scott had never agreed to let Charlie spend Christmas Eve or Christmas day with his son’s with ex-wife, Brooke Mueller. Brooke would never have agreed to it either. Charlie was telling people he was going to see the boys so that he wouldn’t look bad for planning to take his porn star girlfriend to Europe,” says a source close to the family.

“Charlie has no one to blame for not being able to spend Christmas with his kids but himself. He is clearly in yet another downward spiral, and needs help. Lashing out at Denise, the courts, Brooke, child protective services doesn’t change the basic facts ... he needs to take responsibility for his actions and grow up.”