2021-12-09
##################################################################
DEVICE=GeForceGTX1080Tix1
MODEL=ssd_mobilenet_v1_coco_2018_01_28
##################################################################
'./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-ssd_mobilenet_v1_coco_2018_01_28-SingleStreamB1-gpu-b1-int8.default.plan' -> './build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan'
[2021-12-09 12:26:11,077 __init__.py:255 INFO] Running command: CUDA_VISIBILE_ORDER=PCI_BUS_ID nvidia-smi --query-gpu=gpu_name,pci.device_id,uuid --format=csv
[2021-12-09 12:26:11,089 main.py:701 INFO] Detected System ID: GeForceGTX1080Tix1
[2021-12-09 12:26:11,092 main.py:529 INFO] Using config files: configs/ssd-mobilenet/SingleStream/config.json
[2021-12-09 12:26:11,093 __init__.py:341 INFO] Parsing config file configs/ssd-mobilenet/SingleStream/config.json ...
[2021-12-09 12:26:11,093 main.py:542 INFO] Processing config "GeForceGTX1080Tix1_ssd-mobilenet_SingleStream"
[2021-12-09 12:26:11,093 main.py:224 INFO] Running harness for ssd-mobilenet benchmark in SingleStream scenario...
[2021-12-09 12:26:11,097 __init__.py:255 INFO] Running command: ./build/bin/harness_default --plugins="build/plugins/NMSOptPlugin/libnmsoptplugin.so" --logfile_outdir="/work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.26.10/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream" --logfile_prefix="mlperf_log_" --performance_sample_count=1024 --test_mode="PerformanceOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_direct_host_access=false --gpu_batch_size=1 --map_path="data_maps/coco/val_map.txt" --tensor_path="${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4" --use_graphs=true --single_stream_expected_latency_ns=800000 --gpu_engines="./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan" --mlperf_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf" --user_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf" --max_dlas=0 --scenario SingleStream --model ssd-mobilenet --response_postprocess coco
[2021-12-09 12:26:11,097 __init__.py:261 INFO] Overriding Environment
gpu_batch_size : 1
gpu_copy_streams : 1
gpu_inference_streams : 1
input_dtype : int8
map_path : data_maps/coco/val_map.txt
precision : int8
use_graphs : True
config_ver : default
gpu_single_stream_expected_latency_ns : 800000
input_format : chw4
tensor_path : ${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4
use_direct_host_access : False
system_id : GeForceGTX1080Tix1
scenario : SingleStream
benchmark : ssd-mobilenet
config_name : GeForceGTX1080Tix1_ssd-mobilenet_SingleStream
accuracy_level : 99%
optimization_level : plugin-enabled
inference_server : lwis
system_name : None
test_mode : PerformanceOnly
gpu_num_bundles : 2
log_dir : /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.26.10
&&&& RUNNING Default_Harness # ./build/bin/harness_default
[I] mlperf.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf
[I] user.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf
Creating QSL.
Finished Creating QSL.
Setting up SUT.
[I] Device:0: ./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan has been successfully loaded.
[I] Start creating CUDA graphs
[I] Capture 1 CUDA graphs
[I] Finish creating CUDA graphs
[I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: false
Finished setting up SUT.
Starting warmup. Running for a minimum of 5 seconds.
Finished warmup. Ran for 5.04183s.
Starting running actual test.
================================================
MLPerf Results Summary
================================================
SUT name : LWIS_Server
Scenario : SingleStream
Mode : PerformanceOnly
90th percentile latency (ns) : 905794
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
================================================
Additional Stats
================================================
QPS w/ loadgen overhead : 1109.54
QPS w/o loadgen overhead : 1145.74
Min latency (ns) : 780006
Max latency (ns) : 16713019
Mean latency (ns) : 872798
50.00 percentile latency (ns) : 872186
90.00 percentile latency (ns) : 905794
95.00 percentile latency (ns) : 911993
97.00 percentile latency (ns) : 917308
99.00 percentile latency (ns) : 935299
99.90 percentile latency (ns) : 1132082
================================================
Test Parameters Used
================================================
samples_per_query : 1
target_qps : 1250
target_latency (ns): 0
max_async_queries : 1
min_duration (ms): 600000
max_duration (ms): 0
min_query_count : 1024
max_query_count : 0
qsl_rng_seed : 7322528924094909334
sample_index_rng_seed : 1570999273408051088
schedule_rng_seed : 3507442325620259414
accuracy_log_rng_seed : 0
accuracy_log_probability : 0
accuracy_log_sampling_target : 0
print_timestamps : 0
performance_issue_unique : 0
performance_issue_same : 0
performance_issue_same_index : 0
performance_sample_count : 1024
No warnings encountered during test.
No errors encountered during test.
Finished running actual test.
Device Device:0 processed:
665727 batches of size 1
Memcpy Calls: 0
PerSampleCudaMemcpy Calls: 0
BatchedCudaMemcpy Calls: 665727
&&&& PASSED Default_Harness # ./build/bin/harness_default
[2021-12-09 12:36:18,675 main.py:280 INFO] Result: result_90.00_percentile_latency_ns: 905794, Result is VALID
[2021-12-09 12:36:18,675 main.py:573 WARNING] --config_ver=high_accuracy does not exist in config file 'GeForceGTX1080Tix1_ssd-mobilenet_SingleStream'
======================= Perf harness results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: result_90.00_percentile_latency_ns: 905794, Result is VALID
======================= Accuracy results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: No accuracy results in PerformanceOnly mode.
Hostname: rofox-home-desktop
Elapsed Time: 608 seconds
[2021-12-09 12:36:18,978 __init__.py:255 INFO] Running command: CUDA_VISIBILE_ORDER=PCI_BUS_ID nvidia-smi --query-gpu=gpu_name,pci.device_id,uuid --format=csv
[2021-12-09 12:36:18,988 main.py:701 INFO] Detected System ID: GeForceGTX1080Tix1
[2021-12-09 12:36:18,992 main.py:529 INFO] Using config files: configs/ssd-mobilenet/SingleStream/config.json
[2021-12-09 12:36:18,992 __init__.py:341 INFO] Parsing config file configs/ssd-mobilenet/SingleStream/config.json ...
[2021-12-09 12:36:18,992 main.py:542 INFO] Processing config "GeForceGTX1080Tix1_ssd-mobilenet_SingleStream"
[2021-12-09 12:36:18,992 main.py:224 INFO] Running harness for ssd-mobilenet benchmark in SingleStream scenario...
[2021-12-09 12:36:18,997 __init__.py:255 INFO] Running command: ./build/bin/harness_default --plugins="build/plugins/NMSOptPlugin/libnmsoptplugin.so" --logfile_outdir="/work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.36.18/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream" --logfile_prefix="mlperf_log_" --performance_sample_count=1024 --test_mode="AccuracyOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_direct_host_access=false --gpu_batch_size=1 --map_path="data_maps/coco/val_map.txt" --tensor_path="${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4" --use_graphs=true --single_stream_expected_latency_ns=800000 --gpu_engines="./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan" --mlperf_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf" --user_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf" --max_dlas=0 --scenario SingleStream --model ssd-mobilenet --response_postprocess coco
[2021-12-09 12:36:18,997 __init__.py:261 INFO] Overriding Environment
gpu_batch_size : 1
gpu_copy_streams : 1
gpu_inference_streams : 1
input_dtype : int8
map_path : data_maps/coco/val_map.txt
precision : int8
use_graphs : True
config_ver : default
gpu_single_stream_expected_latency_ns : 800000
input_format : chw4
tensor_path : ${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4
use_direct_host_access : False
system_id : GeForceGTX1080Tix1
scenario : SingleStream
benchmark : ssd-mobilenet
config_name : GeForceGTX1080Tix1_ssd-mobilenet_SingleStream
accuracy_level : 99%
optimization_level : plugin-enabled
inference_server : lwis
system_name : None
test_mode : AccuracyOnly
gpu_num_bundles : 2
log_dir : /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.36.18
&&&& RUNNING Default_Harness # ./build/bin/harness_default
[I] mlperf.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf
[I] user.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf
Creating QSL.
Finished Creating QSL.
Setting up SUT.
[I] Device:0: ./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan has been successfully loaded.
[I] Start creating CUDA graphs
[I] Capture 1 CUDA graphs
[I] Finish creating CUDA graphs
[I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: false
Finished setting up SUT.
Starting warmup. Running for a minimum of 5 seconds.
Finished warmup. Ran for 5.04268s.
Starting running actual test.
No warnings encountered during test.
No errors encountered during test.
Finished running actual test.
Device Device:0 processed:
5000 batches of size 1
Memcpy Calls: 0
PerSampleCudaMemcpy Calls: 0
BatchedCudaMemcpy Calls: 5000
&&&& PASSED Default_Harness # ./build/bin/harness_default
[2021-12-09 12:36:30,936 main.py:280 INFO] Result: Cannot find performance result. Maybe you are running in AccuracyOnly mode.
[2021-12-09 12:36:30,939 __init__.py:255 INFO] Running command: python3 build/inference/vision/classification_and_detection/tools/accuracy-coco.py --mlperf-accuracy-file /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.36.18/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf_log_accuracy.json --coco-dir /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/preprocessed_data/coco --output-file build/ssd-mobilenet-results.json
loading annotations into memory...
Done (t=0.43s)
creating index...
index created!
Loading and preparing results...
DONE (t=0.15s)
creating index...
index created!
Running per image evaluation...
Evaluate annotation type *bbox*
DONE (t=13.47s).
Accumulating evaluation results...
DONE (t=2.25s).
Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.229
Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.346
Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.253
Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.017
Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.164
Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.525
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.207
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.261
Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.261
Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.021
Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.189
Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.598
mAP=22.914%
[2021-12-09 12:36:48,860 main.py:573 WARNING] --config_ver=high_accuracy does not exist in config file 'GeForceGTX1080Tix1_ssd-mobilenet_SingleStream'
======================= Perf harness results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: Cannot find performance result. Maybe you are running in AccuracyOnly mode.
======================= Accuracy results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: Accuracy = 22.914, Threshold = 21.780. Accuracy test PASSED.
2021-11-01
# sh run_harness.sh
[2021-11-01 02:17:50,886 __init__.py:256 INFO] Running command: CUDA_VISIBILE_ORDER=PCI_BUS_ID nvidia-smi --query-gpu=gpu_name,pci.device_id,uuid --format=csv
GeForce GTX 1080 Ti 1B06 GPU-10fdc773-2a40-e064-5aa4-14028938e19d
[2021-11-01 02:17:50,895 main.py:701 INFO] Detected System ID: GeForceGTX1080Tix1
[2021-11-01 02:17:50,898 main.py:529 INFO] Using config files: configs/ssd-mobilenet/SingleStream/config.json
[2021-11-01 02:17:50,899 __init__.py:342 INFO] Parsing config file configs/ssd-mobilenet/SingleStream/config.json ...
[2021-11-01 02:17:50,899 main.py:542 INFO] Processing config "GeForceGTX1080Tix1_ssd-mobilenet_SingleStream"
[2021-11-01 02:17:50,899 main.py:224 INFO] Running harness for ssd-mobilenet benchmark in SingleStream scenario...
gpu_batch_size : 1
gpu_copy_streams : 1
gpu_inference_streams : 1
input_dtype : int8
map_path : data_maps/coco/val_map.txt
precision : int8
use_graphs : True
config_ver : default
gpu_single_stream_expected_latency_ns : 800000
input_format : chw4
tensor_path : ${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4
use_direct_host_access : False
system_id : GeForceGTX1080Tix1
scenario : SingleStream
benchmark : ssd-mobilenet
config_name : GeForceGTX1080Tix1_ssd-mobilenet_SingleStream
accuracy_level : 99%
optimization_level : plugin-enabled
inference_server : lwis
system_name : None
gpu_num_bundles : 2
log_dir : /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.11.01-02.17.50
[2021-11-01 02:17:50,903 __init__.py:256 INFO] Running command: ./build/bin/harness_default --plugins="build/plugins/NMSOptPlugin/libnmsoptplugin.so" --logfile_outdir="/work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.11.01-02.17.50/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream" --logfile_prefix="mlperf_log_" --performance_sample_count=1024 --gpu_copy_streams=1 --gpu_inference_streams=1 --use_direct_host_access=false --gpu_batch_size=1 --map_path="data_maps/coco/val_map.txt" --tensor_path="${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4" --use_graphs=true --single_stream_expected_latency_ns=800000 --gpu_engines="./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan" --mlperf_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf" --user_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf" --max_dlas=0 --scenario SingleStream --model ssd-mobilenet --response_postprocess coco
[2021-11-01 02:17:50,903 __init__.py:262 INFO] Overriding Environment
&&&& RUNNING Default_Harness # ./build/bin/harness_default
[I] mlperf.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf
[I] user.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf
Creating QSL.
Finished Creating QSL.
Setting up SUT.
[I] Device:0: ./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan has been successfully loaded.
[I] Start creating CUDA graphs
[I] Capture 1 CUDA graphs
[I] Finish creating CUDA graphs
[I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: false
Finished setting up SUT.
Starting warmup. Running for a minimum of 5 seconds.
Finished warmup. Ran for 5.01309s.
Starting running actual test.
================================================
MLPerf Results Summary
================================================
SUT name : LWIS_Server
Scenario : SingleStream
Mode : PerformanceOnly
90th percentile latency (ns) : 771578
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
================================================
Additional Stats
================================================
QPS w/ loadgen overhead : 1319.02
QPS w/o loadgen overhead : 1348.24
Min latency (ns) : 691789
Max latency (ns) : 9808391
Mean latency (ns) : 741705
50.00 percentile latency (ns) : 741168
90.00 percentile latency (ns) : 771578
95.00 percentile latency (ns) : 777375
97.00 percentile latency (ns) : 782162
99.00 percentile latency (ns) : 796324
99.90 percentile latency (ns) : 924482
================================================
Test Parameters Used
================================================
samples_per_query : 1
target_qps : 1250
target_latency (ns): 0
max_async_queries : 1
min_duration (ms): 600000
max_duration (ms): 0
min_query_count : 1024
max_query_count : 0
qsl_rng_seed : 7322528924094909334
sample_index_rng_seed : 1570999273408051088
schedule_rng_seed : 3507442325620259414
accuracy_log_rng_seed : 0
accuracy_log_probability : 0
accuracy_log_sampling_target : 0
print_timestamps : 0
performance_issue_unique : 0
performance_issue_same : 0
performance_issue_same_index : 0
performance_sample_count : 1024
No warnings encountered during test.
No errors encountered during test.
Finished running actual test.
Device Device:0 processed:
791412 batches of size 1
Memcpy Calls: 0
PerSampleCudaMemcpy Calls: 0
BatchedCudaMemcpy Calls: 791412
&&&& PASSED Default_Harness # ./build/bin/harness_default
[2021-11-01 02:27:59,210 main.py:280 INFO] Result: result_90.00_percentile_latency_ns: 771578, Result is VALID
======================= Perf harness results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: result_90.00_percentile_latency_ns: 771578, Result is VALID
======================= Accuracy results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: No accuracy results in PerformanceOnly mode.
2021-10-29
# sh run_harness.sh
[2021-10-29 09:42:08,721 __init__.py:256 INFO] Running command: CUDA_VISIBILE_ORDER=PCI_BUS_ID nvidia-smi --query-gpu=gpu_name,pci.device_id,uuid --format=csv
GeForce GTX 1080 Ti 1B06 GPU-10fdc773-2a40-e064-5aa4-14028938e19d
[2021-10-29 09:42:08,735 main.py:701 INFO] Detected System ID: GeForceGTX1080Tix1
[2021-10-29 09:42:08,741 main.py:529 INFO] Using config files: configs/ssd-mobilenet/SingleStream/config.json
[2021-10-29 09:42:08,741 __init__.py:342 INFO] Parsing config file configs/ssd-mobilenet/SingleStream/config.json ...
[2021-10-29 09:42:08,741 main.py:542 INFO] Processing config "GeForceGTX1080Tix1_ssd-mobilenet_SingleStream"
[2021-10-29 09:42:08,742 main.py:224 INFO] Running harness for ssd-mobilenet benchmark in SingleStream scenario...
gpu_batch_size : 1
gpu_copy_streams : 1
gpu_inference_streams : 1
input_dtype : int8
map_path : data_maps/coco/val_map.txt
precision : int8
use_graphs : True
config_ver : default
gpu_single_stream_expected_latency_ns : 400000
input_format : chw4
tensor_path : ${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4
use_direct_host_access : False
system_id : GeForceGTX1080Tix1
scenario : SingleStream
benchmark : ssd-mobilenet
config_name : GeForceGTX1080Tix1_ssd-mobilenet_SingleStream
accuracy_level : 99%
optimization_level : plugin-enabled
inference_server : lwis
system_name : None
gpu_num_bundles : 2
log_dir : /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.10.29-09.42.08
[2021-10-29 09:42:08,747 __init__.py:256 INFO] Running command: ./build/bin/harness_default --plugins="build/plugins/NMSOptPlugin/libnmsoptplugin.so" --logfile_outdir="/work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.10.29-09.42.08/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream" --logfile_prefix="mlperf_log_" --performance_sample_count=1024 --gpu_copy_streams=1 --gpu_inference_streams=1 --use_direct_host_access=false --gpu_batch_size=1 --map_path="data_maps/coco/val_map.txt" --tensor_path="${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4" --use_graphs=true --single_stream_expected_latency_ns=400000 --gpu_engines="./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan" --mlperf_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf" --user_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf" --max_dlas=0 --scenario SingleStream --model ssd-mobilenet --response_postprocess coco
[2021-10-29 09:42:08,747 __init__.py:262 INFO] Overriding Environment
&&&& RUNNING Default_Harness # ./build/bin/harness_default
[I] mlperf.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf
[I] user.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf
Creating QSL.
Finished Creating QSL.
Setting up SUT.
[I] Device:0: ./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan has been successfully loaded.
[I] Start creating CUDA graphs
[I] Capture 1 CUDA graphs
[I] Finish creating CUDA graphs
[I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: false
Finished setting up SUT.
Starting warmup. Running for a minimum of 5 seconds.
Finished warmup. Ran for 5.03997s.
Starting running actual test.
================================================
MLPerf Results Summary
================================================
SUT name : LWIS_Server
Scenario : SingleStream
Mode : PerformanceOnly
90th percentile latency (ns) : 822790
Result is : VALID
Min duration satisfied : Yes
Min queries satisfied : Yes
================================================
Additional Stats
================================================
QPS w/ loadgen overhead : 1241.36
QPS w/o loadgen overhead : 1272.19
Min latency (ns) : 701799
Max latency (ns) : 12666691
Mean latency (ns) : 786049
50.00 percentile latency (ns) : 765456
90.00 percentile latency (ns) : 822790
95.00 percentile latency (ns) : 942774
97.00 percentile latency (ns) : 1045563
99.00 percentile latency (ns) : 1228706
99.90 percentile latency (ns) : 1838318
================================================
Test Parameters Used
================================================
samples_per_query : 1
target_qps : 2500
target_latency (ns): 0
max_async_queries : 1
min_duration (ms): 600000
max_duration (ms): 0
min_query_count : 1024
max_query_count : 0
qsl_rng_seed : 7322528924094909334
sample_index_rng_seed : 1570999273408051088
schedule_rng_seed : 3507442325620259414
accuracy_log_rng_seed : 0
accuracy_log_probability : 0
accuracy_log_sampling_target : 0
print_timestamps : 0
performance_issue_unique : 0
performance_issue_same : 0
performance_issue_same_index : 0
performance_sample_count : 1024
No warnings encountered during test.
No errors encountered during test.
Finished running actual test.
Device Device:0 processed:
744819 batches of size 1
Memcpy Calls: 0
PerSampleCudaMemcpy Calls: 0
BatchedCudaMemcpy Calls: 744819
&&&& PASSED Default_Harness # ./build/bin/harness_default
[2021-10-29 09:52:17,326 main.py:280 INFO] Result: result_90.00_percentile_latency_ns: 822790, Result is VALID
======================= Perf harness results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: result_90.00_percentile_latency_ns: 822790, Result is VALID
======================= Accuracy results: =======================
GeForceGTX1080Tix1_TRT-default-SingleStream:
ssd-mobilenet: No accuracy results in PerformanceOnly mode.