From 5a60bea7d4a69a795f69c082ae8f9b224e88dff7 Mon Sep 17 00:00:00 2001 From: Richard Anthony Hein <richard.hein@gmail.com> Date: Thu, 22 Aug 2024 14:51:12 +0000 Subject: [PATCH] update submodule and readme --- playground/demos/chatbot/README.md | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/playground/demos/chatbot/README.md b/playground/demos/chatbot/README.md index af25f803..d74ca062 100644 --- a/playground/demos/chatbot/README.md +++ b/playground/demos/chatbot/README.md @@ -28,7 +28,7 @@ docker run --rm --env "HF_TOKEN=<your hugging face token>" \ --ipc=host \ -p 8000:8000 \ llm-serving:vllm-cpu \ - --model NousResearch/Hermes-3-Llama-3.1-8B + --model <Huggingface Model Path> ``` * Start the Chatbot API Server with the following shell command: @@ -37,6 +37,15 @@ docker run --rm --env "HF_TOKEN=<your hugging face token>" \ uvicorn server:app --port 8888 ``` +* Start the Chatbot UI + +From the chatbot-ui directory: + +```bash + yarn install + yarn run dev. +``` + ## Chatbot API Server (FastAPI) This API is written in Python and depends on FastAPI.