In a bare knuckle fight, under London Prize Ring Rules, Charlie could make it a long, troublesome fight for Jim Jeffries, although I think Jim would eventually win. With gloves, and Queensberry rules, Charlie has no chance, in my opinion, and Jim knocks him out in less than 9 rounds.
More realistically, Mitchell might beat some of the top contenders of Jeffries era. Match him against Ruhlin or McCoy, and you have got an interesting fight.