I don't know that we have enough documentation of their golf skills, do we? Corrie Sanders was some sort of competitive golfer, so he'd likely beat both.
Google says Alvarez plays of 9, and that Joe Louis, while apparently gifted, did not play off a handicap. Most golf people would conclude that Alvarez is therefore better, but there is no way to know.