No idea. No reason for Joe to have had any negative views on him. I'm sure that he lookd upon Angelo as one of the legendary trainers. Alongside his own Eddie Futch and Yancey' Yank' Durham.
I'd assume he had no hard feelings towards Angelo. Angelo always treated people with respect and separated himself from Ali's antics.
I read Frasier's book some years ago. As you can imagine he comes across as very down to earth and likeable on the page, but his bitterness towards Ali was there. Frasier didn't seem to blame Angelo Dundee for what Ali was. It was a bit like a wayward child who didn't get enough discipline. By comparison he recollected Futch calling him a 'Cocksucker' and telling him to work harder. 'You want water? Give me a big round you Cocksucker'. By comparison Ali was a spoiled child who just needed a beating. Fundementally Frasier believed he had the better trainer and didn't really attribute who or what Ali was to Angelo. Moreover he believed that Futch had worked out exactly how to beat Ali, and had proved it with himself and Ken Norton. I don't think there was any hard feelings for Angelo Dundee, but I think after a time Frasier and Futch hated Ali in equal measure.
Joe didnt really look for reasons to dislike people. As stated before he was a good down to earth guy. Both Angelo and Joe were Philly guys so they may have had a connection there.