This repository was archived by the owner on Aug 13, 2024. It is now read-only.
Repository navigation
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
How do you let the ACE_Framework for example Stacey demo run on a local llm (local language model), instead of the online OpenAI?
I think a start would be:
https://github.com/Josh-XT/Local-LLM/
Local-LLM is a llama.cpp server in Docker with OpenAI Style Endpoints.
http://localhost:8091/v1
How would you let the ACE_Framework and the first demo I am trying to get to work is Stacey access that local OpenAI Endpoint instead of the online OpenAI? Or is there a better way to make the Stacey demo work locally with a local language model?
All reactions