Open WebUI

Open WebUI is a web based frontend to LLMs models, and let you run your own private chatbot, or in general AI models.

To install Open WebUI, of course, you need it's dedicated user, so add user:

useradd -d /data/daemons/openwebui -m openwebui

Open WebUI can be installed on bare metal, without containers, using pip, but due to strict python requirement (3.11 at the time of writing this), this is not recomended (Gentoo has already Python 3.13).

Let's go with the containers way, using of course Podman compose.

From this page, select “docker compose” and

This is the compose file i am using, adapt to your needs:

docker-compose.yaml

Open WebUI can be hosted on subdomain, let's assume you choose ai.mydomain.com.

As usual you want it protected by the Reverse Proxy, so create the ai.conf file:

ai.conf

server {
        server_name ai.mydomain.com;
        listen 443 ssl;
        listen 8443 ssl;
        http2 on;

        include "com.mydomain/authelia_location-basic.conf";

        access_log /var/log/nginx/ai.mydomain.com_access_log main;
        error_log /var/log/nginx/ai.mydomain.com_error_log info;

        location / { # The trailing / is important!
                proxy_pass        http://127.0.0.1:3080/; # The / is important!
                proxy_set_header  X-Script-Name /;
                proxy_set_header  X-Remote-User $remote_user;
                proxy_set_header  X-Forwarded-For $proxy_add_x_forwarded_for;
                proxy_set_header  Host $http_host;
                proxy_pass_header Authorization;
                include "com.mydomain/authelia_proxy.conf";
                include "com.mydomain/authelia_authrequest-basic.conf";
        }

        include com.mydomain/certbot.conf;
}

add this config file to NGINX (see The Reverse Proxy concept for more details) and restart nginx.

This set-up links also to use your SSO (see this page, which is a good approach.

Now go with browser to https://ai.mydomain.com to finish setup.