With all the news around Deepseek. I am starting to see more talk about running the model locally. Therefore, stopping leakage / privacy concerns around material. One recent option I’ve seen for an easier approach is LM studio. I will be looking into it with some interest for a Local AI instance with RAG.
https://lmstudio.ai/