chat-ui

• A chat interface using open source models like OpenAssistant or Llama, built with SvelteKit
• Powers the HuggingChat app
• Features web search, text embedding models, and multimodal support (IDEFICS, OpenAI, Claude 3)
• Supports multiple inference backends:
  • Local (llama.cpp, Ollama, text-generation-inference)
  • Cloud (Hugging Face Inference API, OpenAI, Anthropic, Cloudflare, Google Vertex AI, etc.)
  • Custom endpoints (OpenAI-compatible APIs, LangServe, AWS SageMaker/Lambda)
• Key capabilities:
  • Retrieval-augmented generation (RAG) for web search results
  • Customizable UI theming and authentication (OpenID Connect)
  • Reasoning model support for chain-of-thought visualization
  • MongoDB-based conversation history
• Target audience:
  • Developers wanting to deploy open-source chat UIs
  • Organizations needing customizable chat interfaces
  • Researchers experimenting with different LLM backends

Built with SvelteKit and designed for both local development and production deployment via Docker/Hugging Face Spaces.