So I've got some open source AI models running locally on my machine now. I actually find the image and 3D model generation ones to be pretty useful -- I mean I'm not doing anything *important* with them, but generally after a lot of finagling and tweaking prompts I can come up with something that looks at least as good as and sometimes even better than the thing I set out to make. And I do genuinely enjoy the creative back-and-forth of prompt tweaking and the ability to really play with variations on a theme. It's neat.

What I've done less with, however, is the chat functions. A lot of the open source chat models just won't run for me (whether that's because my CPU doesn't have dedicated AI hardware -- my GPU does -- or configuration issues or other reasons, I cannot say), but the ones that do are, uh, interesting. Granted, local open source models were never going to be as knowledgeable as ChatGPT or Gemini (the things I have can't access the internet and rely on data last updated in 2024), but even taking that into account they're just... well. Let me show you. (more...)