I have the same symptom, truck sort of wanders at highway speeds. I just rebuilt the front end, idler/support, pitman, tierods, bushings, stabilizer, ball joints. The lower shaft I think you are referring to (number 9 in the pic) might be the culprit for me as well. When I got it all done...