Looking for advice for small office looking for local AI RAG
r/LocalLLaMA
September 14, 2026 at 10:53 AM
📌 My company is looking for basically a local hardware back-end for an already set up Open WebUI Windows AD joined setup. We are already on the frontier models thru Open WebUI. ~10 users. Workload is a lot of contract and chat based email stuff, generate contracts, generate quotes. We want a local back end so we can get our RAG data set going that we have been preparing. Not a huge library but maybe ~500 pdfs ready to be converted to .md mostly standards related to the field we work in (civil)...
My company is looking for basically a local hardware back-end for an already set up Open WebUI Windows AD joined setup. We are already on the frontier models thru Open WebUI. ~10 users.
Workload is a lot of contract and chat based email stuff, generate contracts, generate quotes. We want a local back end so we can get our RAG data set going that we have been preparing. Not a huge library but maybe ~500 pdfs ready to be converted to .md mostly standards related to the field we work in (civil). Budget ~$5-6k
Are the GB10 Blackwell rigs still the best option now? Last we looked was about 6 months ago.
[link] [comments]
Read the full article at
r/LocalLLaMA
More in Models & Releases
Models & Releases
NVIDIA Unveils RTX PRO 5500 "Blackwell" Workstation GPU with 84 GB GDDR7 Memory
submitted by /u/Lumpy_Phase_9539 [link] [comments]
What happened to AI browsers?
AI browsers were supposedly going to kill Chrome/Safari, and help people quickly buy stuff, book tickets etc. at reasonable prices while avoiding ads. That was such a great sales pitch, but it has been just radio silence from then on. Ar...
[Bi-Weekly Megathread] Project Showcase
Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it! Recommendation on presentation: Please share plain english description of what your project does and why people should care about it Ho...