Local Chatbot RAG with FreeBSD Knowledge

(hackacad.net)

95 points | by todsacerdoti 2 days ago

4 comments

JKCalhoun 1 day ago
I want to do this for some cut of Wikipedia. If there is already a RAG for Wikipedia, that would be cool. I want my own ... I don't know ... is it the Encyclopedia Galactica? (Or Hitchhiker's Guide to Earth and its Inhabitants?)
[-]
- PhilippGille 1 day ago
  Here's a simple example using a part of a DBpedia dataset, but you can download other Wikipedia datasets and import those: https://github.com/philippgille/chromem-go/tree/v0.7.0/examp...
  (Disclosure: I'm the author)
  [-]
  - JKCalhoun 1 day ago
    Very cool — thanks. I'll play with it.
another_twist 1 day ago
Neat. Does ollama have native support for storing documents ? I dont think the author wrote anything custom here (and I mean it in a good way)
[-]
- coolspot 1 day ago
  The Open-WebUI has a built-in vector database and document storage.
danlitt 1 day ago
Examples would be good - I'm not going to run all that locally just to check whether it's useful. (LLM helpers rarely are)
[-]
- hackacad 1 day ago
  Yes, I will add some examples within the next days.
alexey-salmin 1 day ago
I hope now I'll finally figure out how to patch KDE2 for FreeBSD
[-]
- VTimofeenko 1 day ago
  In that case the RAG should be based on an anime dataset