GeForceGTX1080Tix1 SSDLiteBallMobilenetV2 - wom-ai/inference_results_v1.0 GitHub Wiki

2021-12-09

##################################################################
DEVICE=GeForceGTX1080Tix1
MODEL=ssdlite_mobilenet_v2_ball
##################################################################

'./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-ssdlite_mobilenet_v2_ball-SingleStreamB1-gpu-b1-int8.default.plan' -> './build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan'
[2021-12-09 12:59:35,022 __init__.py:255 INFO] Running command: CUDA_VISIBILE_ORDER=PCI_BUS_ID nvidia-smi --query-gpu=gpu_name,pci.device_id,uuid --format=csv
[2021-12-09 12:59:35,038 main.py:701 INFO] Detected System ID: GeForceGTX1080Tix1
[2021-12-09 12:59:35,045 main.py:529 INFO] Using config files: configs/ssd-mobilenet/SingleStream/config.json
[2021-12-09 12:59:35,046 __init__.py:341 INFO] Parsing config file configs/ssd-mobilenet/SingleStream/config.json ...
[2021-12-09 12:59:35,047 main.py:542 INFO] Processing config "GeForceGTX1080Tix1_ssd-mobilenet_SingleStream"
[2021-12-09 12:59:35,047 main.py:224 INFO] Running harness for ssd-mobilenet benchmark in SingleStream scenario...
[2021-12-09 12:59:35,057 __init__.py:255 INFO] Running command: ./build/bin/harness_default --plugins="build/plugins/NMSOptPlugin/libnmsoptplugin.so" --logfile_outdir="/work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.59.34/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream" --logfile_prefix="mlperf_log_" --performance_sample_count=1024 --test_mode="PerformanceOnly" --gpu_copy_streams=1 --gpu_inference_streams=1 --use_direct_host_access=false --gpu_batch_size=1 --map_path="data_maps/coco/val_map.txt" --tensor_path="${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4" --use_graphs=true --single_stream_expected_latency_ns=800000 --gpu_engines="./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan" --mlperf_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf" --user_conf_path="measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf" --max_dlas=0 --scenario SingleStream --model ssd-mobilenet --response_postprocess coco
[2021-12-09 12:59:35,058 __init__.py:261 INFO] Overriding Environment
gpu_batch_size : 1
gpu_copy_streams : 1
gpu_inference_streams : 1
input_dtype : int8
map_path : data_maps/coco/val_map.txt
precision : int8
use_graphs : True
config_ver : default
gpu_single_stream_expected_latency_ns : 800000
input_format : chw4
tensor_path : ${PREPROCESSED_DATA_DIR}/coco/val2017/SSDMobileNet/int8_chw4
use_direct_host_access : False
system_id : GeForceGTX1080Tix1
scenario : SingleStream
benchmark : ssd-mobilenet
config_name : GeForceGTX1080Tix1_ssd-mobilenet_SingleStream
accuracy_level : 99%
optimization_level : plugin-enabled
inference_server : lwis
system_name : None
test_mode : PerformanceOnly
gpu_num_bundles : 2
log_dir : /work/mlperf/inference_results_v1.0/closed/NVIDIA/build/logs/2021.12.09-12.59.34
&&&& RUNNING Default_Harness # ./build/bin/harness_default
[I] mlperf.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/mlperf.conf
[I] user.conf path: measurements/GeForceGTX1080Tix1_TRT/ssd-mobilenet/SingleStream/user.conf
Creating QSL.
Finished Creating QSL.
Setting up SUT.
[I] Device:0: ./build/engines/GeForceGTX1080Tix1/ssd-mobilenet/SingleStream/ssd-mobilenet-SingleStream-gpu-b1-int8.default.plan has been successfully loaded.
[I] Start creating CUDA graphs
[I] Capture 1 CUDA graphs
[I] Finish creating CUDA graphs
[I] Creating batcher thread: 0 EnableBatcherThreadPerDevice: false
Finished setting up SUT.
Starting warmup. Running for a minimum of 5 seconds.
Finished warmup. Ran for 5.01056s.
Starting running actual test.
================================================
MLPerf Results Summary
================================================
SUT name : LWIS_Server
Scenario : SingleStream
Mode     : PerformanceOnly
90th percentile latency (ns) : 1022098
Result is : VALID
  Min duration satisfied : Yes
  Min queries satisfied : Yes

================================================
Additional Stats
================================================
QPS w/ loadgen overhead         : 985.66
QPS w/o loadgen overhead        : 1012.72

Min latency (ns)                : 889665
Max latency (ns)                : 15491510
Mean latency (ns)               : 987439
50.00 percentile latency (ns)   : 986273
90.00 percentile latency (ns)   : 1022098
95.00 percentile latency (ns)   : 1030588
97.00 percentile latency (ns)   : 1039416
99.00 percentile latency (ns)   : 1066584
99.90 percentile latency (ns)   : 1260097

================================================
Test Parameters Used
================================================
samples_per_query : 1
target_qps : 1250
target_latency (ns): 0
max_async_queries : 1
min_duration (ms): 600000
max_duration (ms): 0
min_query_count : 1024
max_query_count : 0
qsl_rng_seed : 7322528924094909334
sample_index_rng_seed : 1570999273408051088
schedule_rng_seed : 3507442325620259414
accuracy_log_rng_seed : 0
accuracy_log_probability : 0
accuracy_log_sampling_target : 0
print_timestamps : 0
performance_issue_unique : 0
performance_issue_same : 0
performance_issue_same_index : 0
performance_sample_count : 1024

No warnings encountered during test.

No errors encountered during test.
Finished running actual test.
Device Device:0 processed:
  591396 batches of size 1
  Memcpy Calls: 0
  PerSampleCudaMemcpy Calls: 0
  BatchedCudaMemcpy Calls: 591396
&&&& PASSED Default_Harness # ./build/bin/harness_default
[2021-12-09 13:09:42,776 main.py:280 INFO] Result: result_90.00_percentile_latency_ns: 1022098, Result is VALID
[2021-12-09 13:09:42,776 main.py:573 WARNING] --config_ver=high_accuracy does not exist in config file 'GeForceGTX1080Tix1_ssd-mobilenet_SingleStream'

======================= Perf harness results: =======================

GeForceGTX1080Tix1_TRT-default-SingleStream:
    ssd-mobilenet: result_90.00_percentile_latency_ns: 1022098, Result is VALID


======================= Accuracy results: =======================

GeForceGTX1080Tix1_TRT-default-SingleStream:
    ssd-mobilenet: No accuracy results in PerformanceOnly mode.

Hostname: rofox-home-desktop
Elapsed Time: 608 seconds