perf: batch=1 优化减少延迟

Browse Source

- settings: batch_size=41
- tensorrt_engine: BATCH_SIZE=41
- preprocessor: 移除 padding 逻辑，直接 batch=1
- 预处理延迟从 17ms  5ms

...

This commit is contained in:

16337

2026-02-02 15:25:13 +08:00

parent 3dd4e56f99

commit c17f983ab3

13 changed files with 13248 additions and 75 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

6944

logs/main.log

File diff suppressed because it is too large Load Diff

6076

logs/main_error.log

File diff suppressed because it is too large Load Diff