Welcome to your LocalAI

The powerful FOSS alternative to OpenAI, Claude, and more

Documentation Model Gallery Import Model

Operations in Progress

Installed Models

1 model ready to use

Qwen3-VL-Reranker-8B-GGUF icon

Qwen3-VL-Reranker-8B-GGUF

llama-cpp
Chat
Edit

Installed Backends

2 backends ready to use

cpu-llama-cpp

User Installed
Alias: llama-cpp
Installed: 2026-01-27T08:09:28+01:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh

llama-cpp

User Installed
Alias: llama-cpp
Installed: 2026-01-27T08:09:28+01:00
Gallery: github:mudler/LocalAI/backend/index.yaml@master
Path: /var/www/localai/backends/cpu-llama-cpp/run.sh