Experimenting with Local Inference

#Rust#Maud#LLMs

At what point do the models become smart and efficient enough that I can just run them on my commodity hardware rather than shelling out to someone else hosting it publicly?

Read more →