always remember in the future, ivar was practically raised and taught by floki (asluag asked floki too previously). so his obviously shown to have sociopathic tendencies as a child, plus the fact his vikings which cant end well. and to top of off he has been raised believing in floki's vikings extremist views. So despite the other brothers and dad being rough as their vikings, his on a whole other level. the only people he can tolerate are those he idolises.