Z axis crashing into materials after setting work zero

I jog the machine to a certain location. Jog it down so it JUST touches the surface of the material and then select ‘set work xyz'

I then move the z axis up 25mm so I can fit the dust shoe.

If I now press go to work zero. It xy and fine but z will plunge into the workpiece and not stop just touching the work piece.

This is before running any gcode so it's a controller setup issue but I can't figure this out.