Because as aforementioned Mills was thrown to the lions to tackle much larger opponents. He suffered from crippling headaches and depression as a result. Joey just came along and put the finishing touches on a damaged man. Mills never fought again.
Well, it was literally his last fight. He'd been recently hammered by Bruce Woodcock and his style of fighting made sure it put years on him. Just one of those things in boxing.