It should not shift side to side no matter what lift you have. Seems like the hole in track bar mount might be worn out. Either that or the nut on the trackbar is not tight enough.