Something has to move in and out as the wheel moves up and down. The inner joint is designed to do that. You're just hitting the limit of inward travel. That will not happen when the axle is installed. Do not pull out hard on the inner joint. If you over-extend it the triangle can come out of the cup and the rollers fall off. That requires taking the boot off to put it back together.