Because Joey did the moral thing...the thing that was waaaay overdue..and give the rematch to the man he won the middleweight title from AND the man who whipped Carter as well, Dick Tiger.
At least Carter did get a shot. Joey wanted to defend against Papp, who got sidelined by the Hungarian authorities.
Carter didnt deserve the shot he got. He lost the elimination bout he fought against Archer. The only reason he was chosen for Giardello was because it was thought his style would be easier for the aging Giardello at that point. He had a golden opportunity, blew it, and did nothing to garner another shot at the title.