Probably. Nery or Tete probably are easier targets already, just look at Nery's last fight and I bet you top dollar he will have some trouble with Manny too.
on his own volition he stated he would never take easy opponents. of course what constitutes an easy opponent is subjective but he's made good and taken good fights so far.