The bio media that is holding your bacteria, you want, is to be treated carefully. A gentle swish about in TANK water is enough. Scrubbing etc.. will remove some and dipping it in water from the tap can also kill it. The bio media shouldn't get as dirty as the mechanical and should only be rinsed if needed, not often.
Im actually not that careful with my bio media. I do rinse it in tank water but with canisters, I dump all the bio media in a bucket with tank water and roll it around with my hands. BUT, I have more than one filter on every tank, and I never clean both filters at the same time. I will loose some bacteria doing this but have never had any type of mini cycle or anything like that.