Iām still not sure what the problem was but I got around it by creating a new file and appending the first scene to it, so the models are now stored in separate .j3o(s). I also switched all the rotation units to quaternions and set the rotation location and scale in object mode.