51 lines
959 B
Markdown
51 lines
959 B
Markdown
# Qwen3.5-9B Benchmark
|
|
|
|
Comprehensive benchmark suite for Qwen3.5-9B model performance testing.
|
|
|
|
## Overview
|
|
|
|
This project provides tools to evaluate:
|
|
- Inference speed and throughput
|
|
- Concurrency performance
|
|
- GPU memory usage
|
|
- Model accuracy on standard NLP tasks
|
|
- Hardware compatibility
|
|
|
|
## Project Structure
|
|
|
|
- `src/` - Core source code modules
|
|
- `tests/` - Unit tests
|
|
- `benchmarks/` - Benchmark execution scripts
|
|
- `results/` - Output directory for benchmark results
|
|
- `scripts/` - Utility scripts
|
|
|
|
## Quick Start
|
|
|
|
1. Install dependencies:
|
|
```bash
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
2. Configure environment:
|
|
```bash
|
|
cp .env.example .env
|
|
# Edit .env as needed
|
|
```
|
|
|
|
3. Download model:
|
|
```bash
|
|
python scripts/download_model.py
|
|
```
|
|
|
|
4. Run benchmarks:
|
|
```bash
|
|
python run_benchmarks.py
|
|
```
|
|
|
|
## Hardware Requirements
|
|
|
|
See `docs/hardware_requirements.md` for detailed GPU compatibility information.
|
|
|
|
## License
|
|
|
|
MIT |