Ed no one can ignore what people are saying about you, but if you have accepted this gift from God then you should expect to be tested by other christians. Hunter is apparently not convinced, and he has a right to wait and see if the Holy Spirit convinces him otherwise. After all I remember you questioning me about my speaking in tongues. You needed enough info to be sure that it was not a fleshly thing. There is a big difference between Spirit quencher and spirit quencher. We must not allow ourselves to be deceived.
A good example is Edgar Cayce who was a christian. At first glance it looked as if God gifted him, yet he himself didn't even know. It took time for more truth to come out. Without the bible teaching us what to look for, many christians would have been led astray.
Whether or not people think you are gifted will be an ongoing thing for you to deal with as you share your story with more people. Don't we all wish people would take us on our word alone.
If you are at peace about it then keep doing what God has shown you to do, but please don't think that the Holy Spirit is going to instantly tell each person that you are what you say you are without believers testing the spirit first...and that may take time.
As far as how hard it is to be able to teach or just witness here is something we all have complained about. However we have endured. :)