David Burela

I've been working with #LLM to explore patterns that allows for running on #EdgeCompute or #Azure #OpenAI

I've found using a combination of #Langchain & #llamacpp allows me to do this.
I've created a small example repo, that shows how to quickly get up and running with GPU support.

https://github.com/DavidBurela/edgellm#edgellm