The silica will look like a brown mud when it settles out. So as long as the water does not have a musky taste you are alright. The musky taste will only occur from microbial growth IF you somehow also got organic matter in there. I had this happen once when I was adding lemon juice to my water to help increase the formation of orthosilicic acid.
I usually change out my silica about every 6 months.