Yep, happens to me and is totally "normal" for someone w/ AF and/or who's been out of the game a while.
Aside from engaging in other activities or socializing to purposely distract me from it, I've found modulating my B vitamins helps. If I'm imbalanced, I have panic attack type responses. Being balanced can help even out the irrational responses. I had to buy each individually and try them one at a time to figure out what each felt like and what combo I did better with.
My larger issue is how to explain to a potential mate about the AF. That, and I feel odd putting myself out there when I consider myself to be damaged goods at the moment. I feel I have a lot to offer, but I also value my integrity and want to be up-front about everything. But, the biggest thing that kills anything from even getting started is TMI in the beginning.