← Back to Projects
In Development · Private Deployment

Self-Hosted AI Chatbot Platform

A self-hosted AI platform combining local and cloud-based language models, secure remote access, web search and document retrieval.

System Architecture

Web Browser

Authorised users

Cloudflare Access + Tunnel

Authentication and secure access

Ubuntu Mini PC

Open WebUI · Docker

Local inference

Unsloth Studio · Qwen3.5 2B

Bidirectional API communication with external model providers.

OpenRouter

Cloud models

Windows Desktop

Gemma 4 12B

Development & Remote Administration

MacBook Pro

VS Code · Tailscale · SSH · Browser

Web access via Cloudflare; administration of Ubuntu via Tailscale/SSH.

Technical Implementation

Models & Connectivity

  • Hybrid AI Models

    Open WebUI integrates OpenRouter cloud models with Ubuntu-hosted Qwen3.5 2B and Windows-hosted Gemma 4 12B through Unsloth Studio.

  • Secure Remote Access

    Cloudflare Access and Tunnel secure browser access, while Tailscale and SSH enable remote server administration.

AI Capabilities

  • Web Search

    SearXNG and DDGS enable AI-assisted web search and access to current information.

  • Document Retrieval

    Retrieval-augmented generation (RAG) grounds AI responses in uploaded documents.

  • Assistant Presets

    Custom presets tailor assistants for Python, SQL, data analytics, research and document analysis.

Infrastructure & Development

Platform Screenshots

Select a thumbnail to explore the platform. Click the main image to enlarge.

Open WebUI showing the locally hosted Gemma model in the model selector.

Open WebUI Interface

Self-hosted Open WebUI interface providing access to locally hosted and cloud-based language models.

1 of 6

Technology Stack

AI & Models

Open WebUI OpenRouter Unsloth Studio Qwen3.5 2B Gemma 4 12B GGUF

Infrastructure & Data

Ubuntu Linux Docker PostgreSQL

Search & Monitoring

Security & Development

Cloudflare Tailscale SSH VS Code macOS