A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
🎥 Demo:
🐳 Docker:
🐙 Docker Compose:
Ensure you have Docker Desktop installed, WSL2 configured, and enough free RAM to run models.
LLaMA will crash if you don't have enough available memory for the mo…