|
|
@ -3,7 +3,25 @@ title: "Language Model"
|
|
|
|
description: "The LLM that powers your 01"
|
|
|
|
description: "The LLM that powers your 01"
|
|
|
|
---
|
|
|
|
---
|
|
|
|
|
|
|
|
|
|
|
|
- Llamafile (Local)
|
|
|
|
## Llamafile
|
|
|
|
- Llamaedge (Local)
|
|
|
|
|
|
|
|
- Hosted Models (explains that we use litellm, you can pass in many different model flags to this)
|
|
|
|
Llamafile is cool!
|
|
|
|
- Add more (placeholder, we will add instructions soon)
|
|
|
|
|
|
|
|
|
|
|
|
## Llamaedge
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Llamaedge is also cool!
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Hosted Models
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
01OS leverages liteLLM which supports [many hosted models](https://docs.litellm.ai/docs/providers/).
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
To select your providers
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
|
|
|
# Set the LLM service
|
|
|
|
|
|
|
|
poetry run 01 --llm-service openai
|
|
|
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Other Models
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
More instructions coming soon!
|
|
|
|