The only elite fighters at Middleweight during Golovkins' stay was Sergio and then Cotto after he TKO'd Sergio... Next best argument you would have would be Alvarez (in a pound-for-pound sense with him fighting at 155).