One concern is that large amounts of seal swellers found in high-mileage oils could end up damaging your good seals. That's probably the biggest risk with HM oils.
They tend to have slightly higher ZDDP and HTHS viscosity for better wear protection but then if you want to get that, you can also use an HDEO. Of course, higher HTHS viscosity also means lower fuel economy, as it's always a compromise there.
Where are you getting your facts at that suggest the swell agents in a HM oil damage "good seals"
And the MPG loss because of the HTHS is marginal at best, you will not see more than a 2% mpg + or - if you are using the proper grade, which is maybe 1 or 2, you have a larger margin of error when calculating your MPG than what the viscosity is going to change.