Overview
FastChat is an open platform developed by LMSYS for training, serving, and evaluating large language models. It powers the Chatbot Arena.
Key Features
- Model Serving: Deploy LLMs with web UI and API
- Chatbot Arena: Crowdsourced LLM evaluation
- Training Tools: Fine-tune models
- Multi-model Support: Vicuna, Alpaca, Llama
- Gradio Interface: Easy-to-use web interface
Installation
pip install fschat
python -m fastchat.serve.cli --model-path lmsys/vicuna-7b-v1.5
Resources
Source: GitHub