llama.cpp works on windows too (or any os for that matter), though linux will vive you better performances

Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.

You are limited by bandwidth not compute with llm, so accelerator won’t change the interferance tp/s

I use it + portmaster + O&O to kill all of windows spyware, this is great software and should be recommended if you have to run windows

Edited typo