Fluoride in tap water: Will my teeth benefit if I just swish it in my mouth but don't drink it?

I want the benefits of fluoride for my teeth, but don't want to ingest it if I don't have to. Are the benefits of fluoride in tap water just from the water running past our teeth? Or is there some additional and important benefit to our teeth from actually ingesting it?