I mean the whole point of a notification is to well, notify. Vibration alone isn’t always adequate. Unless it’s going off repeatedly I don’t see the issue. Some sounds are normal in public.

Personally my phone is always on vibrate except for calls from certain people.