I’ve wanted to try local AI in my homelab, but the expense of setting it all up has unfortunately been putting me off. From what I can see, local AI would require me to spend thousands on a server with multiple GPUs, a lot of memory, and power consumption equal to that of a small supermarket.