Sorry for the late response just found your post this morning.
Any time you can find a true VR port at least imho it would be favorable to using VorpX, There are some however that prefer using vorpx to mod SE.
SkyrimVR is a well optimized game so you should have no problem.
I run it with 195 active mods using my 1080ti and many of which are hd pks. 1k,2k,4k,.
Just to note the more mods you use you can expect decreasing performance each fps loss of 1 or 2 add up and then you have to start worrying about load order and merging mods. I like to keep it simple and enjoy more time in game than tweaking, luckily I did not use a load order tool this time and everything is working.
I’m off to experiment more with vorpX and a few favorite games I’m now trying. Oblivion, s.t.a.l.k.e.r. soc, Re 7, and the newly released Call of Cthulhu.