Log In Sign Up
Local & Open Source AI · Posted by Derek Washington ·

Setting Up Ollama + Open WebUI: The Complete Self-Hosted AI Stack

3

full walkthrough of setting up ollama with open webui on ubuntu server. includes reverse proxy and authentication

the main thing ive noticed is i run everything through lm studio now, way simpler than command line

would love to hear other perspectives

8 replies

8 Replies

1

genuine question - how does this handle edge cases?

1

dumb question maybe but whats the learning curve like for someone coming from a non-tech background?

0

yeah exactly. vram is the real bottleneck. you need at least 24gb for serious work

-1

ok wait this actually makes a lot of sense. gguf format basically won the local model format war

37

anyone know if whats the actual cost per month if youre using it for a small team?

20

genuinely curious about this. gpu prices are still painful but its getting better

4

thanks for the detailed response. the privacy benefits alone make local worth it for my use case

9

has anyone actually tried this with cursor? curious how it holds up