Is he? He constantly talks himself down and emotionally hedges by eating like crap, not training hard etc.
I commented this on another thread, but for the first Fisher fight Allen came to win against someone who was clearly overmatched and even then he gave the fight away (He was robbed, but he could have kept the fight in his control) as he didn't have the stamina to KO Fisher and fade down the end of the fight. Then he put weight back on again planning to KO Fisher early so he didn't see the back end of the fight. And now he has come in again at a similar weight to the Clarke fight and we all saw how that ended, especially as in the build up to that fight he talked about how hard he was training etc. So to answer your question, yeah he did good with Fisher and it definitely does count, but Fisher is not that good, levels below Makhmudov, and even Clarke.