I think you still need the set screw even with a new axle nut.
Last week I noticed that if I tighten the set screw, then remove the axle, the nut becomes loose again. When reinstalling the axle, I needed to re-tighten the set screw. So if you remove the back wheel often, I can see how you will have problems with the nut coming loose more often.