You have to look at the big picture. We are all full of our own personal bias which clouds our perception. That's why you have to take a step back sometimes. Just ask yourself this, why is it that Mayweather has had a grand total of 1 point deducted from him in his entire career if he's such a dirty fighter?
I remember him getting a point deducted in the first castillo fight. Since then he has had warnings and he is smart enough to listen to those warnings and don't do them obsessively. Floyd is a smart fighter as the elbow is part of his natural guard therefore if a fighter lunges into floyd recklessly they may eat part of that guard, which is not wise. Floyd is not committing a foul unless he actively throws the elbow at his opponent, there is a big difference.