deepseek-r1s

About

Highly portable full-stack DeepSeek-r1 backend + frontend, allowing you to host the model and toy with it on your own system without the need for complex installations.

Features:

• Streaming - Responses are streamed as they are generated
• Parsed Thoughts - Thoughts are contained seperately visually to allow users to see the process, and are unexpanded on the final result
• Message History - Retains messages throughout conversations
• Asynchronus - You can hold multiple conversations with the model simultaneously
• Markdown and LaTeX Support - Ask it about programming, math, and more - all without having to know special syntax

Usage

Docker Compose

Clone this repository and start the stack:

git clone https://github.com/hiibolt/deepseek-r1s.git
cd deepseek-r1s
docker compose up

From Source

Requires the Nix Package Manager with Nix Flakes enabled.

Clone this repository:

git clone https://github.com/hiibolt/deepseek-r1s.git
cd deepseek-r1s

Enter its development environment:

nix develop .#deepseek-r1s

Set your environment variables:

export MODEL_NAME='deepseek-r1:1.5b'
export DATA_DIR_PATH='./data'

Start the backend, and visit localhost:5776!

cargo run