He's psychologically scarred. He could have taken him on instead of fighting a guy like Paul McCloskey had he have really wanted to.
Why doesnt Khan avenge his worst loss? Come on, its worth him doing so. Or does he have that nagging feeling that Prescott catches him again?