To me, it seems more of that he has a naturally cold disposition, and doesn't really know how to act like a parent. This is evidenced in the fact that he gifts his daughter something dangerous (presumably, based on how the residence manager reacted), and doesn't know he should greet her, not understand why. It would also help explain why he hasn't checked up on her at all while she was living with the Cyclamen family, not to mention that it is entirely possible that they have been sending false reports of her situation to him.

Speaking of, based on his sudden appearence with a dead body (if it came with him or it was someone he killed in the residence I don't know), the manager's mention of reminding him many times not to teleport in, that there is a barrier around the place, the managers lack of reaction to the body, and her father's initial reaction to her presence before he knew who it was, implies that he often gone, and there is a lot of danger that surrounds him and his house. Considering these, along with the implication that her mother passed away not long after her birth, I can also very easily understand why he would have her live with the Cyclamens.

He even shows the same protectiveness of her when the manager shows up and starts fussing over her. He notices his ears perk up, and, irritated with him, throws a rock at him and changes the subject.