This sounds similar to ADD or ADHD, but I think you may have a different problem. (Sounds like severe anxiety, but I'm not a therapist.) I hope you find a good specialist who deals with adult ADD and not just children.
Have you tried using a check-card? You swipe it like a credit card, but it draws from your checking account. So you don't have to carry cash, but you don't have credit either.