I think the fact that Oscar was fighting him shocked him, To me Vargas beleive Oscar would just run from him and not try to mix it up, when Vargas started to get tagged with meaningful shots, you could see him as the fight gets deeper look as if he was a deer lost in the headlights.