yes it's too soon. This things can take few months and you have nothing to lose not eating that kind of food anyway. I'm also gluten, dairy and Sugar free for a several weeks. The only thing I'm not free of is coffee. I drink it far too much and I'm pretty sure it's not a good thing, but I didn't quit yet...
I will be gluten free for at least 6 months and I think it's a fair time for intestine to repair itself. Since I'm gluten free there is less bloating and farting so it's a good thing.