I'm not sure I totally agree with the above. Silica removes the moisture from the air, not the air. So in an airtight container, the moisture would be removed, and the air would be dry (or lower in humidity) and stay. In a non-airtight container, the initial volume of air would have the moisture removed, and as the air travels in and out of the container, the new air's moisture would be removed as well.
Stagnant air is what contributes to mold (fungus) growth. Because the movement in the bag is so minimal, and not being replaced regularly, the chances for problems are much greater. Mold/fungus need 3 things to grow: water, darkness, and air with minimal movement. Water is present in the air, and the other two are inherent to a closed container. Think of your home's basement or crawlspace. You will find that most mold problems originate in the corners (aside from plumbing problems). That's because there is less air movement in the corners. I was a home inspector for 20 years, and have seen 13,000+ basements and crawlspaces.
Because air movement in the bag would be so minimal to the point where recording levels of movement would be nearly impossible, I always use silica gel in my bags, and even will put one in the case I use to carry batteries inside the camera bag.
You do have to replace them periodically, as they (essentially) fill up with water, and can't remove the moisture anymore.