Size matters in a heavyweight contest as well. It's not the decisive factor though, which is why I don't outright favour Brown over Jofre.
Brown would've been a formidable task for any Bantamweight, but I don't think I'd favour him over any of the top rung like Jofre, Olivares, Zarate, etc. Not even sure I'd favour him over the likes of Castillo and Herrera.