Looking for a LLM to run i Ollama to use as RAG with OpenWebUI. Has to fit on 4GB VRAM... Any suggesstions?I have tried ...

Looking for a LLM to run i Ollama to use as RAG with OpenWebUI. Has to fit on 4GB VRAM... Any suggesstions?I have tried qwen2.5:3b, phi4-mini:3.8b and gemma3:4b...#selfhosting #rag #localai #llm

Read Original

Related