I’m slowly catching up on this subject. I have installed Bazzite on a gaming computer that has a decent GPU (one day i might even play a game on it).
I’ve installed ollama and dabbled in a little ollama serve and ollama run. Very promising, but it’s still a bit slow for my tastes. I’m also completely unfamiliar with the different models. The ones that i have tried seem pretty verbose.
So, with all of that in mind, i’m gonna set up an email interface. I’ve created an account and i’ve started a python script to poll that email address. When email that address, i want that python script to reply to say that it’s working on it. Then i want it to use the body of the email as te question to submit to each of the models installed. I’m hoping that within five minutes i’ll get back a second email with a response from each of the models installed (which i can add to or remove from over time).
I’m thinking of my self hosted llm solution as “a smart dude that craps on a bit so you’d rather email him than ask him directly”.
Does this approach sound like a good idea, or am i just turning this into another script to write.