I had the same problem, replaced my steering shaft with a Borgeson unit.
Check the play in the lower coupling on the shaft - where it attaches to the steering box. Lay under the Jeep, grab the lower end of the shaft, and see if there's play (up and down or twisting). If so, replace the steering shaft. Very common wear point for CJ's.
Borgeson shaft fixed it up great.
BTW, I had to sawzall the old shaft to get it out, not enough play in mine for some reason to slide either coupling off.