I once had an overly acidic stomach from stress. The stomach is linked to worry, so if you're worrying a lot, it manifests in your stomach.
I would eat, and about half an hour later, would have to endure severe cramping and pains in the stomach.
I visited the doctor and he said use antacids til it goes away, i asked -what can i take for the pain, and he told me Slippery Elm Bark (powder), just mix it in water and drink. It coats the stomach lining and prevents the acid eating it, which causes the pain. Or at least, that's what he told me, so i tried it and it worked. I used that to help until i wasn't so stressed and i stopped producing so much stomach acid.
It would stand to reason that your stomach is acidic if taking baking soda quells the pain, as it alkalises things.

It could be stress related, and therefore perhaps not related to candida - i.e. that candida people have less stomach acid than others.

Hope this helps.
xoLeah.