this post was submitted on 27 Nov 2023
1 points (100.0% liked)

Animal House

2 readers
1 users here now

Discussion area for the main blog: animal-machine.com. Feel free to comment here to discuss any of my blog posts.

Rules:

  1. Excessive hate speech such racism will not be tolerated.
  2. Excessive self-promotion or advertisement will probably get modded.
  3. Try to be kind where possible. At the very least, be respectful when disagreeing.

founded 1 year ago
MODERATORS
[email protected]
1
Sentient Core v0.1.0 Released! (github.com)
submitted 10 months ago by [email protected] to c/[email protected]
0 comments fedilink hide all child comments
 

I've finally released the AI chat software I've been working on. I'll try to write a blog post about it at some point, but until then, you can find more information at the github repo.

Sentient_Core is a local llm AI application so all of the text inference is done on your machine. Optionally, it can support calling out to koboldcpp through it's API so it is possible to do the heavy compute on a different machine - or use more up to date model formats because rustformer's llm project is still trying to merge a current version of ggml after being behind for months.

If you have any questions or comments, feel free to ask away!

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here