My Lexus also has the non servicable fuel filter. It does say in the manual that it can be changed but only by a qualified technician.
It's a delicate balance. On the one hand, making it inaccessible means you or a Jiffy Lube won't go round changing something that normally wouldn't need to be changed. So that's good. In the rare event it needs to be changed, then you pay extra for someone who knows what they are doing to do the work.
On the other hand, what if you have had particles filtered and your performance is suffering but you don't know? My guess is that they've thought of that already by having some sort of fuel pressure sensor that would tell you when there is a problem.
I think for the vast majority of owners, this is probably the best option. For those who want to know more about whether their car is performing optimally, it would be nice if they could expose all this data in a user friendly way eg my Lexus has a screen, I can get into the diagnostic menu, but it would be good to see some sort of history of actual readings of everything it can measure vs the original spec.