

That’s a very good point. The gains / results are less significant apparently. Recently heard about a software supplier actually asking for MORE money than contracted, to cover for the expenses on tokens for the software work they provide. That means, the cost for the customer actually went up. That feels completely backward.



I guess the options would be to either increase VRAM by replacing the 3070 (8GB VRAM), or adding system RAM. In all fairness, system RAM for local AI can be really slow, so token/s output benefits much more from VRAM. Then again, I guess upgrading to a 16GB VRAM card is more expensive. Any chance to snatch up a cheap used 16GB video card?
If you upgrade system RAM, be sure to get a set with similar capacity and speed as you currently have in your system to avoid problems.