Qwen3.5-9B Benchmark

Comprehensive benchmark suite for Qwen3.5-9B model performance testing.

Overview

This project provides tools to evaluate:

• Inference speed and throughput
• Concurrency performance
• GPU memory usage
• Model accuracy on standard NLP tasks
• Hardware compatibility

Project Structure

• src/ - Core source code modules
• tests/ - Unit tests
• benchmarks/ - Benchmark execution scripts
• results/ - Output directory for benchmark results
• scripts/ - Utility scripts

Quick Start

1. Install dependencies:

   pip install -r requirements.txt
   

2. Configure environment:

   cp .env.example .env
   # Edit .env as needed
   

3. Download model:

   python scripts/download_model.py
   

4. Run benchmarks:

   python run_benchmarks.py
   

Hardware Requirements

See docs/hardware_requirements.md for detailed GPU compatibility information.

License

MIT