You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
17 lines
588 B
17 lines
588 B
---
|
|
title: "Language Model"
|
|
description: "The LLM that powers your 01"
|
|
---
|
|
|
|
## Hosted Models
|
|
|
|
The default LLM for 01 is GPT-4-Turbo. You can find this in the default profile in `software/source/server/profiles/default.py`.
|
|
|
|
The fast profile uses Llama3-8b served by Groq. You can find this in the fast profile in `software/source/server/profiles/fast.py`.
|
|
|
|
## Local Models
|
|
|
|
You can use local models to power 01.
|
|
|
|
Using the local profile launches the Local Explorer where you can select your inference provider and model. The default options include Llamafile, Jan, Ollama, and LM Studio.
|