You don't want to wash mushrooms under running water, because they will absorb the water. Instead, take a clean damp sponge (without soap!) and brush them gently to remove the dirt.