Personally, I don’t notice the black level (as a problem) anywhere in Elite Dangerous. I recently traveled to the very top of the galaxy, until the stars were thinned out and I could jump no further, even using FSD synthesis. It’s very dark there.
Yes, the black is not truly black, but it doesn’t bother me at all in-game. The only time I notice it is if there’s a problem and the headset is displaying nothing but black screens.
Caveats: I have an 8K and I’ve set Brightness to Low in PiTool.