Would going back down in weight have been too much for Spinks? At CW I'm sure he had the punch to trouble Holyfield.
Going the distance against Qawi was invaluable to Holyfield as a fighter, chuck a green Holyfield in the deep end with anyone though and he would still swim, he was that good.