chat-ui

• A chat interface using open source models like OpenAssistant or Llama
• Built as a SvelteKit app
• Powers the HuggingChat app on hf.co/chat
• Features web search capability that:
  • Generates search queries from prompts
  • Performs searches and extracts content
  • Creates embeddings for similarity search
  • Uses Retrieval-Augmented Generation
• Supports multiple model providers:
  • Local models via llama.cpp
  • Hugging Face Inference API
  • OpenAI-compatible APIs
  • Anthropic models
  • Cloudflare Workers AI
  • Google Vertex AI
  • AWS SageMaker/Lambda
• Key capabilities:
  • Customizable UI theming
  • Multimodal support (images)
  • Reasoning/Chain-of-Thought models
  • Multiple authentication methods
  • Conversation history via MongoDB
• Target audience:
  • Developers wanting to deploy chat interfaces
  • Organizations needing customizable AI chat solutions
  • Researchers experimenting with different LLMs
• Notable technical aspects:
  • Supports Model Context Protocol (upcoming feature)
  • Handlebars/Jinja2 templating for prompts
  • Docker deployment options
  • Extensive configuration via environment variables