So I had an issue with the Windows store and I decided to just reinstall Windows. After the reinstall I got the exact same driver as before, no change, but my fps in 1.18 is dogshit and in 1.2.5 its almost unplayable. This issue did not happen before even though I was on the exact same "setup" as now. Same OS, same drivers, same mods.
Edit: Another reinstall and it has fixed itself. I guess I just messed something up the first time