"The oil swishing is done best before breakfast. To accelerate the healing process, it can be repeated three times a day, but always before meals on an empty stomach. The therapy is not harmful if it is repeated several times a day. Repetition hastens the healing process and renders it more effective."
Important rule you are following is waiting 3-4 hours after eating, i.e., until your stomach is empty.