Solved! Nvidia-dkms was needed not nvidia!

So the problem is this. I am even surprised that this gpu works with 470 driver. In pop os before it didnt work. But now I can play doom somehow. So it works. But when I run the zen kernel with it, it fails. What to do? Nvidia-smi says cant reach the gpu blah blah. Vkcube doesnt work also. But all these work on stock kernel.

I just want it for fsync, for games. Is it really that worth it btw? They say its important.