Yeah, the steerer tube is clean.
Okay, maybe there's grease in the stem's mounting hole?
Don't get me wrong, but that, along with using carbon paste, made all the difference, and now the stem is rock solid.
Perhaps another approach. Does the steerer tube have a consistent diameter across the clamping area? I
Them it's possible the clamp is only making contact with a small area of the tube...