It would be a good fast scrap. Floyd could fight Conn at 182, his weight for Archie Moore and for Ingo three years later.
The H2Hs I'm most confident picking Patterson in are against those 40s to 50s LHW to HW types. Joey Maxim did beat him but generally speaking.