I actually did that for about 2 years. Make sure your using a natural balm. THen get off it slowly, leave the dead skin on more often, and you will see the changes. Sounds like your already advanced enough to do that, others will have a hard time. Believe me, I dont get the build up anymore, it will go away, you will see.
Keep notice for my update. I will try to do everything as precise as possible.