Why do people hate Harrison?

He’s been through a lots of struggles, foster care and all that shi, but people criticize him for what he’s done to dexter like he’s not the one who abandoned him for his own beliefs? He been overlooked by a lot of people