I've experienced the safety factor of a filter. And I use hoods, mostly. Helps avoid flare.
I noticed inconsidtencies with colour rendition a while back, learned not all lenses the same. In my film days, a UV filter down here was essential - so much UV!
Interesting thing I noted changing from my original 70-200 2.8 VR and my newer one. Images didn't have the same feel; colour rendition wasn't as good. My original one had a Nikon (L37c?) filter. The newer one had a Hoya. I'd tried some experiments with a B+W I got on sale (62mm mount) on a couple of other lenses on the basis it was similar optical quality to that Nikon filter. Yep.
Bit the bullet, bought the muticoated B+W for the 2.8VR lens and now, everything was as it should be. I've since equipped my 20, 50, 85, 35-70 with the same filter, and am delighted. I'd previously used Hoya or Marumi DHG Lens Protect. Now I have greater consistency between lenses, and it's very close to shooting filterless.
If you can work without a filter, I think you're better off without, generally. Where you need one, it's logical (to me) to select a filter with the least sins of omission. Getting out of the way, robbing you of less as the light makes its way to your sensor.
For me, the B+W filters are the optical equivalent of 'Naim Aro interconnect' - getting out of the way.