I don't think Castillo would do that well with big punchers as he did with boxers. He was a bonafide class A brawler. He could box decent and had underrated power. I'll never forget the echoes of his powershots vs Chico. Each had very bad intentions. His jab and infighting at 135 would make it hard for Pacman just to get thru. 50/50 fight.
I believe Castillo did not do enough to get in HOF but... I'm going to use MVC's logic here. Just for some fun. Castillo ain't a Hall Of Famer because he got knocked out by Cesar Soto, a featherweight and Javier Jauregui twice. Sounds so stupid right?