Once you get the stains scrubbed as much as possible, it is time to empty the fountain. When it is all drained, rinse the water feature. You will have to rinse it multiple times if you had to use the bleach or vinegar to clean it. In that case, you will have to rinse the feature, drain it, and begin to rinse it again. You are done rinsing the water feature when it doesn’t smell like bleach or vinegar.