Actually I thought the field would be going left on top and right below... (i mean at any distance from the plane)
I don't really know how to explain 'why' the field is constant at any distance from the plane, that's what the derivation says though. I think it might be something similar to how charged plates have the same electric field at any distance.
Hang on i'll do a digram just in case i didn't explain well enough
I was just chatting to a friend and he gave the best answer to why.
Basically say we let the height of the loop be larger than l, but, widthwise still l, hence, the current through the loop hasn't changed and the loop no matter how heigh will always have the same magnetic field strength.
i.e. the magnetic field strength is independent on how far away you are from something in this case.