Yes, size matters. I was meaning big heavyweights though. Guys of 210 pounds against men of 220 or 230, or 6'1 against 6'3 or 6'4 - the difference is never massively noticeable. Of course Patterson was outgunned by Liston in every area, not just height or weight, but reach especially. And Liston's strength was immense.