Add option to work with Ollama

[plamen-datalaked-com]

It would be nice to have the option to work with local (inside LAN) Ollama.

[AstraBert]

I would encourage you to fork the repo and implement this and/or open a PR :)

[tomtom215]

vLLM support would also be great!

[amscosta]

Hi tomtom215
WebUI does all that with ollama running locally;-)

[AstraBert]

We are accepting PRs from the community for a local implementation.
However, we will not be adding support out of the box for local options.

[g0ldingkev]

It would be nice to have the option to work with local (inside LAN) Ollama.

@plamen-datalaked-com did you find anyone who had created a local side option to run this?