...
| Code Block |
|---|
|
# List installed models
ollama list
# Install a model
ollama pull llama3.1:8b
# Run a model with cli
ollama run llama3.1:8b
# Show model information
ollama show llama3.1
# Remove a models
ollama rm llama3.1 |
Tips
Some environment parameters of Ollama
The below ENVs maybe need to set
| Code Block |
|---|
|
# Liston on 0.0.0.0 instead of 127.0.0.1
Environment="OLLAMA_HOST=0.0.0.0:11434"
# max loaded models
Environment="OLLAMA_MAX_LOADED_MODELS=4"
# keep a model loaded in memory always
Environment="OLLAMA_KEEP_ALIVE=-1" |
