They were signed to fight again in April 1967, but Muhammad Ali refused to step forward to be inducted into the Armed Forces. Ali was later indicted for refusal to accept induction ,he was stripped of his boxing license and title. Thus went the title shot rematch for Floyd Patterson.
Patterson had a back problem that hugely affected his performance. Don't think he would have won even without the problem, but the fight would have been more competitive.