Interesting that S/P's are very adept at doing things on the sly to shake up their targets. It comes across as totally innocent to others. I've read that this is the equivalent of an orgasm to a S/P. No kidding! In some ways, it could be called 'gaslighting', which is where someone tries to make another person feel off kilter - or even looney - by saying...or possibly "doing things" to their target, as you state in your post. Like shaking the rug out from undereath someone and pretending it didn't happen.
I am so sorry to hear about the situation with your garden. Gardens are such a source of pleasure and relaxation...which makes your situation even more unfortunate.
Sounds like the S/P has already manipulated your fellow gardeners since they barely have anything to do with you now. Once the S/P has manipulated those around you, it's too late. Again, don't know how they do it because eventually they can have people eating out of their hand. But, they DO it. Pixx on them!!!!
The best thing to do is to 'walk, don't run' away from your S/P. True, you have a garden, a shed, etc...but this S/P is trying his best to drive you insane...and laughing at you the entire time. They have no conscience.
Since I'm dealing with a complex situation at work caused by more than one S/P, I know how difficult it is to uproot yourself and do a 180 degree turn in order to have some peace of mind. I don't want to run from this because I need the job, and it enables me to save quite a bit of money, too. But, I may have to cut my losses and leave this place...don't know how much longer I can stand this.
Doesn't it pixx you off that this person has come into your life to make it hexx? Right now I'm pixxed and all I really want is to live a good life. I know that there is a spiritual side to any situation that will show us what we need to learn. HA! That's no consolation for sure. But in my experience, the S/P never lets up...they keep plugging away and upping their level of bullying. I've read that they will tire of it and move on...but I've yet to experience that...they just keep plugging away at what they're doing.
I took 1/2 day off today because I couldn't take what was going on at work due to the S/P's bullying...and I may take tomorrow off, too, because I cried for 2-3 hours this afternoon after I made it home. I kept asking myself how are these people able to be so cruel? How does it not bother them? I don't WANT to cry and feel yucky, but it's the only resource I have to deal with these god-awful people. This is over-the-top stressful. Tomorrow I may not have gotten rid of the "headache" I had today...and I don't care if we are short staffed at work...I need a breather and a couple mental health days.
Good luck to you with your S/P. I hope that you can figure out a way to cut your losses and get that guy out of your hair once and for all.