In my 50 years, I've experienced the same thing on all of my vehicles and many brands of oil with varying intensity. Many people I know do not notice any difference, My wife is typically one of those people.
That is until recently. At the thought of using the latest oil of choice here on BITOG and because I was changing the oil anyway, I changed my truck over to to VRP. Same weight as always, 5w-30. The initial smoothness and power were astounding. The start-up was also noticeably quieter, enough so that my wife asked without provocation, if had done something to my truck. A couple hundred miles later on the same oil, she asked me again: "Did you mess something up? You truck is loud again."
My guess is that oils shear to a certain degree and lose a little cushion that better absorbs sound and vibration. Some people are more sensitive to the sound and vibration.