|
|
@ -3,13 +3,24 @@ title: "Language Model"
|
|
|
|
description: "The LLM that powers your 01"
|
|
|
|
description: "The LLM that powers your 01"
|
|
|
|
---
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
## Llamafile
|
|
|
|
## llamafile
|
|
|
|
|
|
|
|
|
|
|
|
Llamafile is cool!
|
|
|
|
llamafile lets you distribute and run LLMs with a single file. Read more about llamafile [here](https://github.com/Mozilla-Ocho/llamafile)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
|
|
|
# Set the LLM service to llamafile
|
|
|
|
|
|
|
|
poetry run 01 --llm-service llamafile
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
## Llamaedge
|
|
|
|
## Llamaedge
|
|
|
|
|
|
|
|
|
|
|
|
Llamaedge is also cool!
|
|
|
|
llamaedge makes it easy for you to run LLM inference apps and create OpenAI-compatible API services for the Llama2 series of LLMs locally.
|
|
|
|
|
|
|
|
Read more about Llamaedge [here](https://github.com/LlamaEdge/LlamaEdge)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
|
|
|
# Set the LLM service to Llamaedge
|
|
|
|
|
|
|
|
poetry run 01 --llm-service llamaedge
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
## Hosted Models
|
|
|
|
## Hosted Models
|
|
|
|
|
|
|
|
|
|
|
|