Different guys age at different rates. Its more about watching a fighters legs, reflexes, snap in their punches, head movement, ... when those things start to go...the smart ones retire. The not so smart ones become Ali,Toney or RJJ.
It's about concern for the fighters. Stick around boxing long enough and you will see what happens to your favorite fighters when they stick around too long.