https://github.com/go-skynet/LocalAI
Check this GitHub repository out. LocalAI - Let's you easily run LLM locally.