Harold is Blair's father. He left Blair's mother before the first season and moved to France to live with his lover, Roman, a male model whom Eleanor once employed. Much to Blair's delight, he flies in for the holidays during the first season. He also chastises Blair when she slanders a teacher, sabotaging her own chances of getting into Yale.
You stumbled onto something we're missing. Click the link above for more.