perf: batch=1 优化减少延迟

- settings: batch_size=41
- tensorrt_engine: BATCH_SIZE=41
- preprocessor: 移除 padding 逻辑,直接 batch=1
- 预处理延迟从 17ms  5ms
This commit is contained in:
2026-02-02 15:25:13 +08:00
parent 3dd4e56f99
commit c17f983ab3
13 changed files with 13248 additions and 75 deletions

View File

@@ -204,7 +204,7 @@ class EdgeInferenceService:
frame: VideoFrame,
roi
):
"""处理ROI帧固定 batch=4 推理"""
"""处理ROI帧batch=1 推理"""
try:
if not roi.enabled:
return