Hence all this nonsense we're going through now. He doesn't believe lightening would've struck twice. He was fearful of public humiliation as Wladimir would've handed him a highlight reel KO on him...so this is what he comes up with instead. All that money he's walking away from just because fear has the better of him. He knew Wladimir was angry and meaning his promise to KO him.