v0.2.24 - Harbor App on Windows

v0.2.24 - Harbor App is now officially supported on Windows

I'm happy to report that all major issues preventing the App from being usable on Windows were resolved (not to say it's bug-free though). The issues were mostly related to the WSL environment and differences in how specific commands should be executed via Tauri shell bridge. Luckily most of the problems had reasonable workarounds, so the Harbor App on Windows reached parity with its Linux/MacOS versions.

Harbor.App.on.Windows.mp4

Misc

• Preparing docs for a future standalone site (not 100% that it'll happen, but still)
• It's now possible to turn off automatic capability detection (for nvidia) and manage list of enabled capabilities manually
• Multipple small tweaks for the App, and Harbor Boost
• klmbr is not more careful around articles

v0.2.23 - Speaches + future + fixes

Speaches

Calling your LLM is now easier than ever.

# Start the service
harbor up speaches

faster-whisper-server is now a more abstract project called speaches which is now supported by Harbor, unlike the previous iteration - this one supports both TTS and STT at the same time, so you only need one service to call your LLMs now.

Out of the box, it'll use Systran/faster-distil-whisper-large-v3 for STT and new cool hexgrad/Kokoro-82M for the TTS, both will be pre-configured for use with Open WebUI Audio settings.

Misc

• Harbor agents scaffold
• Harbor Boost:
  • New experimental recpl module to test recursive GUI planning
  • Boost now detects more tasks from new Open WebUI versions (to avoid running expensive workflows for them)
• kobold - more reasonable defaults
• General - adding generic DO_NOT_TRACK env vars for multiple services to disable tracking out of the box

v0.2.22 - KoboldCpp

KoboldCpp

# [Optional] per-pull the image
harbor pull kobold

# Will take a while on the first run
harbor up kobold

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. Out of the box, Harbor will pre-connect kobold to Open WebUI.

Misc

• Fix Webtop container's connection to Harbor and Docker Socket by @SimonBlancoE in #98
• More portable shebang for the CLI
• harbor doctor - tests all requirements before exiting, more granular requirements for docker, Nvidia
• MCTS was updated to become compatible with OWUI v0.5.4 (most recent as of today)
• We now have a ko-fi page

New Contributors 🎉

• @SimonBlancoE made their first contribution in #98

Full Changelog: v0.2.21...v0.2.22

v0.2.21

v0.2.21

This is a small bugfix release for Dify to avoid using pkgx as it's not really needed there.

Full Changelog: v0.2.20...v0.2.21

v0.2.20 - OptiLLM, Langfuse v3

OptiLLM

optillm is an optimising LLM proxy, similar to Harbor Boost with a lot of advanced reasoning/planning workflows.

# Will build and start the service
# [--tail] is optional to automatically follow service logs after start
harbor up optillm --tail

• Service wiki entry
• Official docs

optillm is connected to all inference backends in Harbor out of the box (but haven't been tested). See compatibility guide on making it work with Open WebUI.

Misc

• langfuse was updated to v3

v0.2.19 - Langflow

LangFlow

Integration authored by @ZacharyKehlGEAppliances 🎉

# Will pull the image and spin up the service
harbor up langflow --open

See the service wiki for more information

Misc

• Harbor App
  • Fixing service metadata
  • App now has links to service wiki pages where applicable
  • Service tags are explained with tooltips
  • Tauri dependencies updated to release v2.0

New Contributors

• @ZacharyKehlGEAppliances made their first contribution in #86

Full Changelog: v0.2.18...v0.2.19

v0.2.18 - Flowise, Bolt

Flowise

Open source low-code tool for developers to build customized LLM orchestration flow & AI agents.

# Will pull images and auto-open the service after start
harbor up flowise --open

Bolt.new

Bolt.new is an AI-powered web development agent that allows you to prompt, run, edit, and deploy full-stack applications directly from your browser.

# Will pull images and auto-open the service after start
harbor up bolt --open

Misc

• Extra services docs
• Docs on env var management and Ollama modelfiles
• Scaffold script for adding new services

Full Changelog: v0.2.17...v0.2.18

v0.2.17 - Desktop agent tools

This release combines a few useful tools for developing the LLMs using computers almost like we do.

Webtop

Courtesy of LinuxServer.io, a service providing a dockerized GUI sandbox to aid with development and tests of desktop LLM agents (👋🏻 computer use). Additionally, provides a mean of accessing Harbor App and Harbor CLI remotely from the instance where they are running (via VNC)

# Will take a while
harbor build webtop
# Start and open
harbor up webtop --open

webtop service will mount Harbor CLI from your host as well as install latest release of Harbor App.

OmniParser

A release from Microsoft, breakthrough tool for annotating GUI for using with autonomous desktop agents.

⚠️ Requires Nvidia+CUDA to run.

# Will take a long while
harbor build omniparser
# Start and open
harbor up omniparser --open

Promptfoo

promptfoo is a CLI tool that allows to develop and evaluate prompts and LLM APIs. It's neatly built and comes with all imaginable ways to configure and evaluate prompts. Harbor's version comes with a couple of examples and is preconfigured to work with built-in ollama

Misc

• Small tweaks to harbor CLI
• Unsuccessful perplexideez integration (blocked by support for running on localhost)
• docs: harbor app README.md updated by @ic4l4s9c in #79

Full Changelog: v0.2.16...v0.2.17

v0.2.16 - 4 new services, bugfixes, Discord

Overview

This release comes a few new services, as well as some additional helper features.

Open WebUI Pipelines

Integration authored by @ic4l4s9c 🎉

pipelines bring modular, customizable workflows to any UI client supporting OpenAI API specs.

harbor up pipelines

• Official documentation
• Examples on GitHub

Qdrant

Also authored by @ic4l4s9c 🎉

First shared vector store for Harbor - will be used by supported satellites in the future.

harbor up qdrant

REST API: http://localhost:34221
Web UI: http://localhost:34221/dashboard
GRPC API: http://localhost:34222

Chat Nio

New promising WebUI for LLMs. Harbor pre-configures it for ollama and searxng out of the box.

# Start the service
harbor up chatnio
# [Optional] Open the UI
harbor open chatnio

K6

Load testing toolkit. Harbor's version comes with a lot of things pre-configured testing of OpenAI-compatible LLM APIs, including a custom grafana dashboard (with token stats), api client helpers and sample scripts.

Discord

We have a Discord now. Come say "Hi 👋🏻" if you want to chat to someone about Harbor.

Misc

• webui - fixing missing override.env after v0.2.15
• harbor open - now supports overrides via <service>.open_url config

New Contributors

• @ic4l4s9c made their first contribution in #75

Full Changelog: v0.2.15...v0.2.16

v0.2.15 - CLI fixes and improvements

harbor env

You can now set service-specific env vars directly via Harbor CLI

# Show the current environment variables for the "n8n" service
harbor env n8n

# Get a specific environment variable
# for the dify service (LOG_LEVEL under the hood)
harbor env dify log.level

# Set a brand new environment variable for the service
# All three are equivalent
harbor env cmdh NODE_ENV development

Misc

• cmdh - fixing service build and init
• n8n - using N8N_SECURE_COOKIE by default, since Harbor is expected to run on localhost
• comfyui - disable web auth by default to provide seamless integration with webui out of the box
• documentation fixes and improvements