Sadly, if this is happening, there's probably nothing you can do to stop it. The only thing I can think of is that maybe MH over at Ask Barefoot has something you can spray on your fruit trees. He makes sprays for people and animals so maybe there's something for trees too.
Look for solution and try to not worry, no matter what happens ...