Cotto beat two guys that I belive were a greater danger than Pac: Mosely (more power) and Zab (greater speed). So if Cotto did handle those two, why would he stumble vs a smaller version of these?
Those fights were before the Margarito fight. I wouldn't say Zab is faster than Pacquiao at this point either.