It is natural for people to get diseases & disorders. It may not be healthy, but it is not unfair. Any more than the large physical advantages many have compared to average in height, wingspan, muscle fiber type, speed, refleces etc. Nature is "unfair" in the sense of unequal distribution of inborn tendencies & talents. But that combined with overcoming weaknesses & strategy is part of the Humanity & charm of any sport or game. Whether an ability such as strength is a matter of being shaped by genetic forces that are a matter of degree or kind, it is a completely legitimate trait & state. Unlike dosing yourself with modern chemicals & hormones. If someone is unremarkable in every way except he was say 23" tall with a 26.5' wingspan, so that no meaningful legal punch could be landed on him except on his forearms when they rained blows down from The Heavens, we would have to live with that. Fortunately the advantage Primo (in all likelihood) had- was not nearly so deterministic.
It is hard to find anything that is definite in terms of proving a negative. You & I likely were never wife beaters-consider this as a thought experiment. Because many people were, but if you are prone to be suspicious that most people are, there is tons of suspect or irrational evidence that might be cited-if we have a temper, got into bar fights, quarreled with the ladieieies... The analogy to good evidence might be extreme agression towards the opposite sex might be roughly similar to an implausibly extreme rapidity of muscle gain OR a level attained beyond normal for height & frame. Gaining 15 lbs. of muscle-especially when not even ending up very big-at any age short of old is not suspect. Neither is an ex-jock losing mucho muscle-nor getting fat. I am not saying I doubt Byrd could ever have juiced. I am saying there is no good evidence here he did. And we have no good idea if he did. Nor is what percentage of boxers or the elites saucing-rarely or regularly-at all something we know. I'd say the same thing to anyone claiming that a distinct minority of fighters ever used PEDs. Many times the wisest course is to reserve judgement.