Gold is not magnetic. Proved by passing the airport controls numerous times with close to 80 gram of gold around my neck.:) all other metals has to be removed except gold.
No need to get rid of it, it has an important mission in the body , just like silver, copper and others. Just the right amount, of course.