If a referee ignores a foul, what is a judge to do?

Does or should an official judge of a fight have discretion to take fouls into account if they are ignored by the referee? It's somewhat similar to the case of a tree falling in the forest that no one sees or hears.