Repository navigation
Replies: 1 comment
|
The same question, but for a different reason. I want to use the web interface and tools from llama.cpp, but with Polystrata serving as the backend. Is this possible? And how can I instruct llama.cpp to use the Polystrata endpoint? |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hello,
I'm looking to use the server in a different project that uses selenium instead of a local model. Actually I have a simpler version of the server that also uses uvicorn/FastAPI that I improved on from this article. Is it possible to import the server and use it without a model? Maybe a hook system where I could pass a function that I want to call when there's a post to "/v1/chat/completions" or something similar?
All reactions