##################################################### Coral Compatability Test Suite ##################################################### lstpu: Passed tflite_utils_test: Passed inference_stress_test: Passed model_loading_stress_test: Passed inference_repeatability_test: Passed classification_models_test: Passed detection_models_test: Passed segmentation_models_test: Passed models_benchmark: Passed Overall Compatability: Passed ----------------------------------------------------- Detected TPUs (lstpu) ----------------------------------------------------- 0 USB /sys/bus/usb/devices/2-6 ----------------------------------------------------- System Info ----------------------------------------------------- Linux-5.7.17-1rodete4-amd64-x86_64-with-glibc2.29 ***** USB Devices ***** Bus 002 Device 006: ID 18d1:9302 Google Inc. ***** USB Tree ***** /: Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/10p, 5000M |__ Port 1: Dev 7, If 0, Class=Hub, Driver=hub/4p, 5000M |__ Port 3: Dev 8, If 0, Class=Hub, Driver=hub/4p, 5000M |__ Port 4: Dev 9, If 0, Class=Hub, Driver=hub/4p, 5000M |__ Port 6: Dev 6, If 0, Class=Vendor Specific Class, Driver=, 5000M /: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci_hcd/16p, 480M |__ Port 4: Dev 2, If 0, Class=Human Interface Device, Driver=usbhid, 12M |__ Port 7: Dev 31, If 0, Class=Hub, Driver=hub/5p, 480M |__ Port 3: Dev 32, If 0, Class=Hub, Driver=hub/5p, 480M |__ Port 1: Dev 34, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M |__ Port 2: Dev 36, If 0, Class=Human Interface Device, Driver=usbhid, 1.5M |__ Port 2: Dev 36, If 1, Class=Human Interface Device, Driver=usbhid, 1.5M |__ Port 4: Dev 37, If 0, Class=Video, Driver=uvcvideo, 480M |__ Port 4: Dev 37, If 1, Class=Video, Driver=uvcvideo, 480M |__ Port 4: Dev 37, If 2, Class=Audio, Driver=snd-usb-audio, 480M |__ Port 4: Dev 37, If 3, Class=Audio, Driver=snd-usb-audio, 480M |__ Port 4: Dev 33, If 0, Class=Hub, Driver=hub/5p, 480M |__ Port 2: Dev 35, If 0, Class=Vendor Specific Class, Driver=cp210x, 12M |__ Port 2: Dev 35, If 1, Class=Vendor Specific Class, Driver=cp210x, 12M |__ Port 11: Dev 30, If 0, Class=Vendor Specific Class, Driver=, 12M |__ Port 12: Dev 6, If 0, Class=Vendor Specific Class, Driver=rtsx_usb, 480M ***** USB Detailed Info ***** Bus 002 Device 006: ID 18d1:9302 Google Inc. Device Descriptor: bLength 18 bDescriptorType 1 bcdUSB 3.10 bDeviceClass 0 bDeviceSubClass 0 bDeviceProtocol 0 bMaxPacketSize0 9 idVendor 0x18d1 Google Inc. idProduct 0x9302 bcdDevice 1.00 iManufacturer 0 iProduct 0 iSerial 0 bNumConfigurations 1 Configuration Descriptor: bLength 9 bDescriptorType 2 wTotalLength 0x0060 bNumInterfaces 1 bConfigurationValue 1 iConfiguration 0 bmAttributes 0x80 (Bus Powered) MaxPower 896mA Interface Descriptor: bLength 9 bDescriptorType 4 bInterfaceNumber 0 bAlternateSetting 0 bNumEndpoints 6 bInterfaceClass 255 Vendor Specific Class bInterfaceSubClass 255 Vendor Specific Subclass bInterfaceProtocol 255 Vendor Specific Protocol iInterface 0 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x01 EP 1 OUT bmAttributes 2 Transfer Type Bulk Synch Type None Usage Type Data wMaxPacketSize 0x0400 1x 1024 bytes bInterval 0 bMaxBurst 15 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x02 EP 2 OUT bmAttributes 2 Transfer Type Bulk Synch Type None Usage Type Data wMaxPacketSize 0x0400 1x 1024 bytes bInterval 0 bMaxBurst 15 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x03 EP 3 OUT bmAttributes 2 Transfer Type Bulk Synch Type None Usage Type Data wMaxPacketSize 0x0400 1x 1024 bytes bInterval 0 bMaxBurst 15 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x81 EP 1 IN bmAttributes 2 Transfer Type Bulk Synch Type None Usage Type Data wMaxPacketSize 0x0400 1x 1024 bytes bInterval 0 bMaxBurst 15 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x82 EP 2 IN bmAttributes 2 Transfer Type Bulk Synch Type None Usage Type Data wMaxPacketSize 0x0400 1x 1024 bytes bInterval 0 bMaxBurst 15 Endpoint Descriptor: bLength 7 bDescriptorType 5 bEndpointAddress 0x83 EP 3 IN bmAttributes 3 Transfer Type Interrupt Synch Type None Usage Type Data wMaxPacketSize 0x0040 1x 64 bytes bInterval 1 bMaxBurst 0 Binary Object Store Descriptor: bLength 5 bDescriptorType 15 wTotalLength 0x0016 bNumDeviceCaps 2 USB 2.0 Extension Device Capability: bLength 7 bDescriptorType 16 bDevCapabilityType 2 bmAttributes 0x00000002 HIRD Link Power Management (LPM) Supported SuperSpeed USB Device Capability: bLength 10 bDescriptorType 16 bDevCapabilityType 3 can't get debug descriptor: Resource temporarily unavailable bmAttributes 0x00 wSpeedsSupported 0x000c Device can operate at High Speed (480Mbps) Device can operate at SuperSpeed (5Gbps) bFunctionalitySupport 2 Lowest fully-functional device speed is High Speed (480Mbps) bU1DevExitLat 0 micro seconds bU2DevExitLat 0 micro seconds Device Status: 0x0000 (Bus Powered) ----------------------------------------------------- tflite_utils_test ----------------------------------------------------- [==========] Running 10 tests from 3 test suites. [----------] Global test environment set-up. [----------] 6 tests from TfLiteUtilsEdgeTpuTest [ RUN ] TfLiteUtilsEdgeTpuTest.MakeEdgeTpuInterpreter [ OK ] TfLiteUtilsEdgeTpuTest.MakeEdgeTpuInterpreter (2677 ms) [ RUN ] TfLiteUtilsEdgeTpuTest.ContainsEdgeTpuCustomOp [ OK ] TfLiteUtilsEdgeTpuTest.ContainsEdgeTpuCustomOp (0 ms) [ RUN ] TfLiteUtilsEdgeTpuTest.MobilenetV1FloatInputs [ OK ] TfLiteUtilsEdgeTpuTest.MobilenetV1FloatInputs (2731 ms) [ RUN ] TfLiteUtilsEdgeTpuTest.MobilenetV1WithL2Norm [ OK ] TfLiteUtilsEdgeTpuTest.MobilenetV1WithL2Norm (2731 ms) [ RUN ] TfLiteUtilsEdgeTpuTest.TwoInterpretersSharedEdgeTpuSingleThreadInference [ OK ] TfLiteUtilsEdgeTpuTest.TwoInterpretersSharedEdgeTpuSingleThreadInference (3017 ms) [ RUN ] TfLiteUtilsEdgeTpuTest.TwoInterpretersSharedEdgeTpuMultiThreadInference WARNING: Logging before InitGoogleLogging() is written to STDERR I20210111 17:02:13.514922 3086310 tflite_utils_test.cc:192] Thread: 139637087356672 created. I20210111 17:02:13.515038 3086311 tflite_utils_test.cc:217] Thread: 139637078963968 created. I20210111 17:02:13.515084 3086312 tflite_utils_test.cc:192] Thread: 139637070571264 created. I20210111 17:02:13.515134 3086313 tflite_utils_test.cc:217] Thread: 139637062178560 created. I20210111 17:02:13.547087 3086310 tflite_utils_test.cc:208] Thread: 139637087356672 sleep for 4ms. I20210111 17:02:13.547120 3086310 tflite_utils_test.cc:210] Thread: 139637087356672 job done. I20210111 17:02:13.558285 3086312 tflite_utils_test.cc:208] Thread: 139637070571264 sleep for 4ms. I20210111 17:02:13.558315 3086312 tflite_utils_test.cc:210] Thread: 139637070571264 job done. I20210111 17:02:13.568353 3086313 tflite_utils_test.cc:233] Thread: 139637062178560 sleep for 3ms. I20210111 17:02:13.568383 3086313 tflite_utils_test.cc:235] Thread: 139637062178560 job done. I20210111 17:02:13.579489 3086311 tflite_utils_test.cc:233] Thread: 139637078963968 sleep for 3ms. I20210111 17:02:13.579519 3086311 tflite_utils_test.cc:235] Thread: 139637078963968 job done. [ OK ] TfLiteUtilsEdgeTpuTest.TwoInterpretersSharedEdgeTpuMultiThreadInference (2750 ms) [----------] 6 tests from TfLiteUtilsEdgeTpuTest (13906 ms total) [----------] 2 tests from TfLiteUtilsCpuTest [ RUN ] TfLiteUtilsCpuTest.TestRunInferenceFailure_ModelInvokeError [ OK ] TfLiteUtilsCpuTest.TestRunInferenceFailure_ModelInvokeError (0 ms) [ RUN ] TfLiteUtilsCpuTest.InvokeWithMemBuffer [ OK ] TfLiteUtilsCpuTest.InvokeWithMemBuffer (65 ms) [----------] 2 tests from TfLiteUtilsCpuTest (65 ms total) [----------] 2 tests from TfliteUtilsEdgeTpuTest [ RUN ] TfliteUtilsEdgeTpuTest.GetEdgetpuContext [ OK ] TfliteUtilsEdgeTpuTest.GetEdgetpuContext (19278 ms) [ RUN ] TfliteUtilsEdgeTpuTest.InvokeWithMemBufferSuccess [ OK ] TfliteUtilsEdgeTpuTest.InvokeWithMemBufferSuccess (2723 ms) [----------] 2 tests from TfliteUtilsEdgeTpuTest (22001 ms total) [----------] Global test environment tear-down [==========] 10 tests from 3 test suites ran. (35972 ms total) [ PASSED ] 10 tests. ----------------------------------------------------- inference_stress_test ----------------------------------------------------- [==========] Running 6 tests from 1 test suite. [----------] Global test environment set-up. [----------] 6 tests from InferenceStressTest [ RUN ] InferenceStressTest.MobilenetV1 WARNING: Logging before InitGoogleLogging() is written to STDERR I20210111 17:02:38.360271 3086556 inference_stress_test.cc:30] inference running iter 0... I20210111 17:02:42.969782 3086556 inference_stress_test.cc:30] inference running iter 2000... I20210111 17:02:47.534591 3086556 inference_stress_test.cc:30] inference running iter 4000... I20210111 17:02:52.128418 3086556 inference_stress_test.cc:30] inference running iter 6000... I20210111 17:02:56.736577 3086556 inference_stress_test.cc:30] inference running iter 8000... [ OK ] InferenceStressTest.MobilenetV1 (25654 ms) [ RUN ] InferenceStressTest.SsdMobileNetV1 I20210111 17:03:04.023556 3086556 inference_stress_test.cc:30] inference running iter 0... I20210111 17:03:55.489426 3086556 inference_stress_test.cc:30] inference running iter 2000... I20210111 17:04:46.620072 3086556 inference_stress_test.cc:30] inference running iter 4000... I20210111 17:05:34.831146 3086556 inference_stress_test.cc:30] inference running iter 6000... I20210111 17:06:18.375761 3086556 inference_stress_test.cc:30] inference running iter 8000... [ OK ] InferenceStressTest.SsdMobileNetV1 (248029 ms) [ RUN ] InferenceStressTest.InceptionV2 I20210111 17:07:12.251947 3086556 inference_stress_test.cc:30] inference running iter 0... I20210111 17:07:38.215771 3086556 inference_stress_test.cc:30] inference running iter 2000... I20210111 17:08:04.181291 3086556 inference_stress_test.cc:30] inference running iter 4000... I20210111 17:08:30.130076 3086556 inference_stress_test.cc:30] inference running iter 6000... I20210111 17:08:56.112303 3086556 inference_stress_test.cc:30] inference running iter 8000... [ OK ] InferenceStressTest.InceptionV2 (132734 ms) [ RUN ] InferenceStressTest.InceptionV4 I20210111 17:09:24.807684 3086556 inference_stress_test.cc:30] inference running iter 0... I20210111 17:12:12.088006 3086556 inference_stress_test.cc:30] inference running iter 2000... I20210111 17:14:59.349483 3086556 inference_stress_test.cc:30] inference running iter 4000... I20210111 17:17:46.618778 3086556 inference_stress_test.cc:30] inference running iter 6000... I20210111 17:20:33.895313 3086556 inference_stress_test.cc:30] inference running iter 8000... [ OK ] InferenceStressTest.InceptionV4 (839102 ms) [ RUN ] InferenceStressTest.MobilenetV1_WithSleep I20210111 17:23:23.883541 3086556 inference_stress_test.cc:30] inference running iter 0... I20210111 17:25:23.996940 3086556 inference_stress_test.cc:30] inference running iter 40... I20210111 17:27:24.100628 3086556 inference_stress_test.cc:30] inference running iter 80... I20210111 17:29:24.202682 3086556 inference_stress_test.cc:30] inference running iter 120... I20210111 17:31:24.306133 3086556 inference_stress_test.cc:30] inference running iter 160... [ OK ] InferenceStressTest.MobilenetV1_WithSleep (603229 ms) [ RUN ] InferenceStressTest.InceptionV2_WithSleep I20210111 17:33:27.119798 3086556 inference_stress_test.cc:30] inference running iter 0... I20210111 17:35:27.668475 3086556 inference_stress_test.cc:30] inference running iter 40... I20210111 17:37:28.201251 3086556 inference_stress_test.cc:30] inference running iter 80... I20210111 17:39:28.734275 3086556 inference_stress_test.cc:30] inference running iter 120... I20210111 17:41:29.268600 3086556 inference_stress_test.cc:30] inference running iter 160... [ OK ] InferenceStressTest.InceptionV2_WithSleep (605391 ms) [----------] 6 tests from InferenceStressTest (2454139 ms total) [----------] Global test environment tear-down [==========] 6 tests from 1 test suite ran. (2454139 ms total) [ PASSED ] 6 tests. ----------------------------------------------------- model_loading_stress_test ----------------------------------------------------- [==========] Running 1 test from 1 test suite. [----------] Global test environment set-up. [----------] 1 test from ModelLoadingStressTest [ RUN ] ModelLoadingStressTest.AlternateEdgeTpuModels WARNING: Logging before InitGoogleLogging() is written to STDERR I20210111 17:43:29.821110 3105782 model_loading_stress_test.cc:28] Stress test iter 0... [ OK ] ModelLoadingStressTest.AlternateEdgeTpuModels (1080887 ms) [----------] 1 test from ModelLoadingStressTest (1080887 ms total) [----------] Global test environment tear-down [==========] 1 test from 1 test suite ran. (1080887 ms total) [ PASSED ] 1 test. ----------------------------------------------------- inference_repeatability_test ----------------------------------------------------- Repeating all tests (iteration 1) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 WARNING: Logging before InitGoogleLogging() is written to STDERR I20210111 18:01:33.417059 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:01:33.646662 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:01:33.876642 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:01:34.103658 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:01:34.332772 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:01:34.561055 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:01:34.795266 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:01:35.028937 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:01:35.262735 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:01:35.497087 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5021 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:01:38.467788 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:01:39.768188 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:01:41.065827 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:01:42.370177 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:01:43.674665 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:01:44.977682 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:01:46.276916 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:01:47.575901 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:01:48.874390 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:01:50.173316 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15742 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:01:54.296963 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:02:02.661391 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:02:11.026330 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:02:19.391698 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:02:27.756625 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:02:36.120983 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:02:44.483108 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:02:52.846901 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:03:01.210435 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:03:09.574159 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86466 ms) [----------] 3 tests from InferenceRepeatabilityTest (107229 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107229 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 2) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:03:20.662814 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:03:20.896185 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:03:21.130039 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:03:21.364125 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:03:21.596665 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:03:21.831089 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:03:22.065196 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:03:22.299077 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:03:22.532102 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:03:22.765553 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5060 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:03:25.734596 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:03:27.037647 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:03:28.335544 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:03:29.635349 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:03:30.936885 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:03:32.240005 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:03:33.545145 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:03:34.845765 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:03:36.149521 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:03:37.453064 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15759 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:03:41.583220 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:03:49.947908 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:03:58.313845 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:04:06.678596 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:04:15.044028 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:04:23.408160 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:04:31.772215 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:04:40.139510 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:04:48.503845 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:04:56.867944 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86477 ms) [----------] 3 tests from InferenceRepeatabilityTest (107296 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107296 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 3) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:05:07.945502 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:05:08.178758 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:05:08.407300 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:05:08.642473 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:05:08.876677 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:05:09.110736 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:05:09.345635 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:05:09.578873 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:05:09.811676 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:05:10.041862 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5035 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:05:13.005635 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:05:14.300890 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:05:15.599910 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:05:16.896924 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:05:18.196184 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:05:19.492511 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:05:20.795289 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:05:22.096745 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:05:23.399473 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:05:24.698658 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15724 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:05:28.817903 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:05:37.184116 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:05:45.549197 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:05:53.914423 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:06:02.279242 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:06:10.644980 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:06:19.010097 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:06:27.375077 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:06:35.740562 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:06:44.107363 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86483 ms) [----------] 3 tests from InferenceRepeatabilityTest (107242 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107242 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 4) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:06:55.187695 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:06:55.417390 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:06:55.648825 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:06:55.882740 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:06:56.114809 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:06:56.343669 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:06:56.572326 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:06:56.797204 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:06:57.024525 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:06:57.252174 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5008 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:07:00.220216 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:07:01.518916 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:07:02.815482 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:07:04.116536 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:07:05.415572 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:07:06.720516 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:07:08.020628 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:07:09.319026 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:07:10.618057 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:07:11.918368 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15728 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:07:16.032917 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:07:24.394814 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:07:32.758056 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:07:41.123857 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:07:49.489293 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:07:57.851826 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:08:06.211014 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:08:14.570325 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:08:22.930570 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:08:31.292881 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86446 ms) [----------] 3 tests from InferenceRepeatabilityTest (107182 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107182 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 5) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:08:42.369242 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:08:42.598045 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:08:42.826723 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:08:43.056030 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:08:43.284754 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:08:43.513495 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:08:43.743238 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:08:43.971560 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:08:44.200112 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:08:44.428936 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5000 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:08:47.392370 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:08:48.691951 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:08:49.989850 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:08:51.291178 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:08:52.588021 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:08:53.886528 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:08:55.185088 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:08:56.480933 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:08:57.775985 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:08:59.073316 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15713 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:09:03.192479 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:09:11.556373 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:09:19.921154 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:09:28.284502 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:09:36.650156 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:09:45.014912 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:09:53.378971 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:10:01.744038 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:10:10.109324 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:10:18.474447 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86470 ms) [----------] 3 tests from InferenceRepeatabilityTest (107183 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107183 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 6) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:10:29.550796 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:10:29.773749 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:10:29.997300 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:10:30.223707 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:10:30.449643 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:10:30.676950 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:10:30.905679 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:10:31.134778 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:10:31.362931 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:10:31.589941 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (4975 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:10:34.551883 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:10:35.847002 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:10:37.144367 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:10:38.440786 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:10:39.736371 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:10:41.032361 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:10:42.333132 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:10:43.631645 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:10:44.929805 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:10:46.226590 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15708 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:10:50.349064 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:10:58.712550 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:11:07.076239 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:11:15.439759 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:11:23.804075 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:11:32.168529 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:11:40.532322 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:11:48.898128 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:11:57.261865 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:12:05.626081 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86468 ms) [----------] 3 tests from InferenceRepeatabilityTest (107151 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107151 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 7) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:12:16.703486 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:12:16.934808 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:12:17.162909 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:12:17.390061 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:12:17.617904 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:12:17.846490 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:12:18.077509 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:12:18.305258 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:12:18.537295 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:12:18.769603 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5008 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:12:21.735232 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:12:23.035068 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:12:24.336277 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:12:25.633831 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:12:26.934207 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:12:28.234196 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:12:29.535763 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:12:30.832824 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:12:32.129982 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:12:33.428074 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15724 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:12:37.548527 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:12:45.913025 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:12:54.276914 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:13:02.642417 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:13:11.007292 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:13:19.372294 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:13:27.736882 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:13:36.100292 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:13:44.464116 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:13:52.829237 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86471 ms) [----------] 3 tests from InferenceRepeatabilityTest (107203 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107203 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 8) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:14:03.908210 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:14:04.136092 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:14:04.364169 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:14:04.592294 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:14:04.821887 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:14:05.051718 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:14:05.281586 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:14:05.509479 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:14:05.740334 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:14:05.971999 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5003 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:14:09.143621 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:14:10.439146 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:14:11.735448 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:14:13.036482 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:14:14.334728 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:14:15.636960 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:14:16.934185 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:14:18.230904 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:14:19.527159 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:14:20.824337 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15926 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:14:24.948923 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:14:33.314698 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:14:41.680748 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:14:50.045482 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:14:58.410210 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:15:06.775130 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:15:15.135839 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:15:23.495705 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:15:31.858338 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:15:40.222798 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86463 ms) [----------] 3 tests from InferenceRepeatabilityTest (107392 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107392 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 9) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:15:51.504683 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:15:51.734593 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:15:51.960368 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:15:52.186957 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:15:52.413805 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:15:52.641451 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:15:52.868680 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:15:53.098918 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:15:53.325930 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:15:53.554224 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5193 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:15:56.519306 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:15:57.817167 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:15:59.119071 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:16:00.418622 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:16:01.721009 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:16:03.023690 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:16:04.325691 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:16:05.621644 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:16:06.917040 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:16:08.211445 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15728 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:16:12.333118 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:16:20.694576 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:16:29.056154 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:16:37.418880 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:16:45.780136 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:16:54.143586 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:17:02.507211 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:17:10.871049 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:17:19.235239 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:17:27.596153 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86453 ms) [----------] 3 tests from InferenceRepeatabilityTest (107374 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107374 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 10) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:17:38.673570 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:17:38.906347 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:17:39.139676 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:17:39.373008 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:17:39.601758 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:17:39.834475 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:17:40.066136 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:17:40.299741 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:17:40.527635 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:17:40.759703 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5029 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:17:43.725968 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:17:45.024919 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:17:46.326922 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:17:47.625111 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:17:48.923466 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:17:50.227910 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:17:51.528417 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:17:52.818883 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:17:54.116459 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:17:55.413800 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15720 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:17:59.542863 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:18:07.906750 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:18:16.270319 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:18:24.633392 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:18:32.996644 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:18:41.360852 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:18:49.726213 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:18:58.091588 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:19:06.456462 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:19:14.820521 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86471 ms) [----------] 3 tests from InferenceRepeatabilityTest (107220 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107221 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 11) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:19:25.895068 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:19:26.123239 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:19:26.353544 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:19:26.585781 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:19:26.817688 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:19:27.044863 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:19:27.272907 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:19:27.499110 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:19:27.727497 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:19:27.956329 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5004 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:19:30.922410 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:19:32.218839 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:19:33.519062 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:19:34.822093 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:19:36.119045 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:19:37.416797 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:19:38.715003 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:19:40.012239 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:19:41.310071 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:19:42.608511 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15722 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:19:46.732758 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:19:55.098325 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:20:03.463228 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:20:11.827303 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:20:20.192052 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:20:28.556090 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:20:36.920559 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:20:45.284406 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:20:53.648200 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:21:02.011504 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86469 ms) [----------] 3 tests from InferenceRepeatabilityTest (107195 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107195 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 12) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:21:13.088160 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:21:13.316733 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:21:13.545763 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:21:13.775099 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:21:14.003901 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:21:14.234697 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:21:14.467717 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:21:14.699298 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:21:14.933796 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:21:15.162379 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5013 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:21:18.123461 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:21:19.420547 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:21:20.724750 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:21:22.024013 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:21:23.322171 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:21:24.619879 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:21:25.918011 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:21:27.215137 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:21:28.511837 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:21:29.808940 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15719 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:21:33.932369 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:21:42.295382 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:21:50.660066 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:21:59.024170 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:22:07.389684 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:22:15.754390 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:22:24.118752 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:22:32.484270 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:22:40.848187 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:22:49.211834 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86468 ms) [----------] 3 tests from InferenceRepeatabilityTest (107200 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107200 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 13) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:23:00.290073 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:23:00.513823 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:23:00.738273 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:23:00.969323 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:23:01.199673 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:23:01.422399 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:23:01.644906 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:23:01.867354 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:23:02.091317 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:23:02.315012 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (4964 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:23:05.279994 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:23:06.579877 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:23:07.879750 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:23:09.179241 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:23:10.479172 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:23:11.778074 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:23:13.076790 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:23:14.375103 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:23:15.672386 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:23:16.972227 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15734 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:23:21.096894 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:23:29.460415 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:23:37.825402 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:23:46.191694 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:23:54.556432 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:24:02.921344 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:24:11.284870 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:24:19.649658 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:24:28.013531 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:24:36.378510 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86469 ms) [----------] 3 tests from InferenceRepeatabilityTest (107167 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107168 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 14) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:24:47.457746 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:24:47.682974 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:24:47.909633 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:24:48.137740 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:24:48.363351 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:24:48.591311 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:24:48.820425 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:24:49.046136 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:24:49.268520 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:24:49.493892 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (4976 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:24:52.460187 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:24:53.757905 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:24:55.055454 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:24:56.352309 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:24:57.649487 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:24:58.949389 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:25:00.253597 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:25:01.552153 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:25:02.852437 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:25:04.155346 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15739 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:25:08.492713 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:25:16.854740 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:25:25.212038 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:25:33.575986 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:25:41.941808 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:25:50.306787 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:25:58.671663 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:26:07.035989 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:26:15.401063 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:26:23.763558 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86665 ms) [----------] 3 tests from InferenceRepeatabilityTest (107380 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107380 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 15) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:26:34.835544 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:26:35.064571 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:26:35.293534 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:26:35.523259 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:26:35.751264 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:26:35.980223 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:26:36.208976 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:26:36.438517 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:26:36.667546 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:26:36.896986 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5000 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:26:39.859800 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:26:41.159302 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:26:42.460103 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:26:43.755873 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:26:45.052615 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:26:46.349864 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:26:47.647096 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:26:48.943256 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:26:50.238884 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:26:51.535353 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15704 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:26:55.653471 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:27:04.015758 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:27:12.372354 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:27:20.729049 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:27:29.089309 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:27:37.453214 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:27:45.816433 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:27:54.179086 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:28:02.541667 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:28:10.901473 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86433 ms) [----------] 3 tests from InferenceRepeatabilityTest (107137 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107137 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 16) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:28:21.975262 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:28:22.199580 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:28:22.433378 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:28:22.663736 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:28:22.892354 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:28:23.121263 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:28:23.348153 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:28:23.575278 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:28:23.802300 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:28:24.030742 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (4996 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:28:26.991257 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:28:28.284724 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:28:29.577466 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:28:30.870196 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:28:32.168090 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:28:33.464915 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:28:34.758729 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:28:36.050633 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:28:37.346078 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:28:38.640172 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15676 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:28:42.756830 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:28:51.119295 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:28:59.481868 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:29:07.844861 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:29:16.207587 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:29:24.569803 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:29:32.932061 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:29:41.295079 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:29:49.659047 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:29:58.022338 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86453 ms) [----------] 3 tests from InferenceRepeatabilityTest (107125 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107125 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 17) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:30:09.099644 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:30:09.330018 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:30:09.563776 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:30:09.797549 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:30:10.030779 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:30:10.264389 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:30:10.497973 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:30:10.729822 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:30:10.959511 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:30:11.180091 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5019 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:30:14.143739 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:30:15.439380 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:30:16.736893 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:30:18.031896 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:30:19.324079 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:30:20.621285 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:30:21.920053 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:30:23.218508 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:30:24.512315 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:30:25.804325 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15690 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:30:29.922402 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:30:38.286708 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:30:46.650722 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:30:55.014230 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:31:03.378008 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:31:11.740291 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:31:20.103797 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:31:28.463147 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:31:36.827150 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:31:45.190845 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86460 ms) [----------] 3 tests from InferenceRepeatabilityTest (107169 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107169 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 18) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:31:56.267614 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:31:56.496280 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:31:56.725692 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:31:56.959226 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:31:57.193334 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:31:57.428601 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:31:57.663712 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:31:57.898525 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:31:58.131502 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:31:58.363452 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5040 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:32:01.334036 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:32:02.628585 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:32:03.923707 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:32:05.216051 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:32:06.507632 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:32:07.799134 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:32:09.093005 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:32:10.385650 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:32:11.680330 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:32:12.973104 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15670 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:32:17.092892 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:32:25.455874 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:32:33.819664 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:32:42.180589 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:32:50.546267 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:32:58.909148 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:33:07.272841 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:33:15.636466 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:33:23.999109 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:33:32.360491 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86458 ms) [----------] 3 tests from InferenceRepeatabilityTest (107168 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107168 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 19) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:33:43.441056 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:33:43.673898 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:33:43.903862 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:33:44.133262 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:33:44.363796 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:33:44.599161 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:33:44.829349 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:33:45.058564 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:33:45.286291 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:33:45.516350 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5021 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:33:48.478139 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:33:49.777020 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:33:51.076820 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:33:52.377142 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:33:53.677388 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:33:54.976155 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:33:56.272951 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:33:57.567154 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:33:58.866356 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:34:00.157064 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15698 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:34:04.271889 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:34:12.633388 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:34:20.993774 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:34:29.355851 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:34:37.719630 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:34:46.083950 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:34:54.447397 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:35:02.810752 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:35:11.173980 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:35:19.537983 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86459 ms) [----------] 3 tests from InferenceRepeatabilityTest (107178 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107178 ms total) [ PASSED ] 3 tests. Repeating all tests (iteration 20) . . . [==========] Running 3 tests from 1 test suite. [----------] Global test environment set-up. [----------] 3 tests from InferenceRepeatabilityTest [ RUN ] InferenceRepeatabilityTest.MobilenetV1 I20210111 18:35:30.614519 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:35:30.842052 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:35:31.072538 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:35:31.305567 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:35:31.538681 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:35:31.770081 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:35:32.001703 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:35:32.234767 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:35:32.467193 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:35:32.700116 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.MobilenetV1 (5031 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV2 I20210111 18:35:35.671595 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:35:36.967844 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:35:38.266014 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:35:39.562603 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:35:40.855461 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:35:42.152186 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:35:43.445822 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:35:44.740303 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:35:46.032488 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:35:47.328157 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV2 (15694 ms) [ RUN ] InferenceRepeatabilityTest.InceptionV4 I20210111 18:35:51.454128 3117988 inference_repeatability_test.cc:33] inference running iter 0... I20210111 18:35:59.818017 3117988 inference_repeatability_test.cc:33] inference running iter 100... I20210111 18:36:08.182139 3117988 inference_repeatability_test.cc:33] inference running iter 200... I20210111 18:36:16.546820 3117988 inference_repeatability_test.cc:33] inference running iter 300... I20210111 18:36:24.911698 3117988 inference_repeatability_test.cc:33] inference running iter 400... I20210111 18:36:33.276335 3117988 inference_repeatability_test.cc:33] inference running iter 500... I20210111 18:36:41.640069 3117988 inference_repeatability_test.cc:33] inference running iter 600... I20210111 18:36:50.004820 3117988 inference_repeatability_test.cc:33] inference running iter 700... I20210111 18:36:58.368553 3117988 inference_repeatability_test.cc:33] inference running iter 800... I20210111 18:37:06.733526 3117988 inference_repeatability_test.cc:33] inference running iter 900... [ OK ] InferenceRepeatabilityTest.InceptionV4 (86471 ms) [----------] 3 tests from InferenceRepeatabilityTest (107196 ms total) [----------] Global test environment tear-down [==========] 3 tests from 1 test suite ran. (107196 ms total) [ PASSED ] 3 tests. ----------------------------------------------------- classification_models_test ----------------------------------------------------- Repeating all tests (iteration 1) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu WARNING: Logging before InitGoogleLogging() is written to STDERR I20210111 18:37:15.112432 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:15.112511 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:15.112517 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:15.112524 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:15.112551 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:15.112558 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:15.112565 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:15.112571 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:37:15.112578 3135511 test_utils.cc:89] k: 3 I20210111 18:37:15.112584 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:15.112589 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2933 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:37:18.045948 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:18.045964 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:37:18.045970 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:18.045976 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:18.045991 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:18.045998 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:18.046005 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:18.046010 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:37:18.046018 3135511 test_utils.cc:89] k: 3 I20210111 18:37:18.046025 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:18.046030 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2724 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:20.769989 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:20.770004 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:20.770011 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:20.770016 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:20.770031 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:20.770038 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:20.770045 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:20.770051 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:37:20.770059 3135511 test_utils.cc:89] k: 3 I20210111 18:37:20.770064 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:20.770071 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2734 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:23.503477 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:23.503494 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:23.503500 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:23.503506 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:23.503520 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:23.503526 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:23.503532 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:23.503538 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:37:23.503547 3135511 test_utils.cc:89] k: 3 I20210111 18:37:23.503552 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:37:23.503558 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2776 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:37:26.279749 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:26.279765 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:37:26.279772 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:26.279778 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:26.279793 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:26.279799 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:26.279805 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:26.279811 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:37:26.279820 3135511 test_utils.cc:89] k: 3 I20210111 18:37:26.279825 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:37:26.279831 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2773 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:29.052610 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:29.052626 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:29.052634 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:29.052639 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:29.052654 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:29.052660 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:29.052666 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:29.052672 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:37:29.052680 3135511 test_utils.cc:89] k: 3 I20210111 18:37:29.052686 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:29.052692 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2831 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:37:31.883846 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:31.883862 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:37:31.883868 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:31.883875 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:31.883888 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:31.883895 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:31.883903 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:31.883908 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:37:31.883916 3135511 test_utils.cc:89] k: 3 I20210111 18:37:31.883922 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:31.883927 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2828 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:37:34.711939 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:34.711956 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:37:34.711961 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:34.711967 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:34.711982 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:34.711988 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:34.711995 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:34.712002 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:37:34.712009 3135511 test_utils.cc:89] k: 3 I20210111 18:37:34.712015 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:34.712020 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2831 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:37:37.542251 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:37.542268 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:37:37.542274 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:37.542280 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:37.542294 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:37.542301 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:37.542307 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:37.542313 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:37:37.542321 3135511 test_utils.cc:89] k: 3 I20210111 18:37:37.542327 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:37.542333 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (3037 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:40.579217 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:40.579234 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:40.579241 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:40.579246 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:40.579262 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:40.579268 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:40.579275 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:40.579282 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:37:40.579289 3135511 test_utils.cc:89] k: 3 I20210111 18:37:40.579295 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:37:40.579301 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:37:43.273341 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:43.273355 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:37:43.273358 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:43.273363 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:43.273375 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:43.273380 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:43.273383 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:43.273388 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:37:43.273394 3135511 test_utils.cc:89] k: 3 I20210111 18:37:43.273397 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:37:43.273401 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:37:45.969499 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:45.969516 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:37:45.969522 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:45.969527 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:45.969542 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:45.969548 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:45.969554 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:45.969561 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:37:45.969569 3135511 test_utils.cc:89] k: 3 I20210111 18:37:45.969575 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:37:45.969580 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:48.665091 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:48.665107 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:48.665112 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:48.665118 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:48.665132 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:48.665138 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:48.665144 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:48.665151 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:37:48.665159 3135511 test_utils.cc:89] k: 3 I20210111 18:37:48.665165 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:48.665170 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:37:51.361799 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:51.361821 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:37:51.361829 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:51.361833 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:51.361852 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:51.361860 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:51.361865 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:51.361872 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:37:51.361881 3135511 test_utils.cc:89] k: 3 I20210111 18:37:51.361886 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:51.361892 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2702 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:54.063385 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:54.063421 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:54.063427 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:54.063433 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:54.063448 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:54.063454 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:54.063462 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:54.063467 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:37:54.063477 3135511 test_utils.cc:89] k: 3 I20210111 18:37:54.063482 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:37:54.063488 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2703 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:37:56.766469 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:56.766486 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:37:56.766494 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:56.766502 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:56.766516 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:56.766522 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:56.766530 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:56.766535 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:37:56.766544 3135511 test_utils.cc:89] k: 3 I20210111 18:37:56.766549 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:56.766556 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:37:59.477705 3135511 test_utils.cc:82] Testing parameters: I20210111 18:37:59.477725 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:37:59.477735 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:37:59.477741 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:37:59.477756 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:59.477762 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:59.477769 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:37:59.477775 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:37:59.477783 3135511 test_utils.cc:89] k: 3 I20210111 18:37:59.477789 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:37:59.477797 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:38:02.188881 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:02.188897 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:38:02.188905 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:02.188910 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:02.188925 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:02.188931 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:02.188938 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:02.188944 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:38:02.188952 3135511 test_utils.cc:89] k: 3 I20210111 18:38:02.188958 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:02.188964 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:38:04.894268 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:04.894284 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:38:04.894291 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:04.894297 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:04.894310 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:04.894317 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:04.894325 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:04.894330 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:38:04.894338 3135511 test_utils.cc:89] k: 3 I20210111 18:38:04.894345 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:04.894351 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:38:07.600628 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:07.600646 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:38:07.600651 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:07.600657 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:07.600670 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:07.600677 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:07.600684 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:07.600690 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:38:07.600699 3135511 test_utils.cc:89] k: 3 I20210111 18:38:07.600705 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:38:07.600711 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:38:10.292455 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:10.292471 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:38:10.292477 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:10.292484 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:10.292497 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:10.292505 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:10.292510 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:10.292517 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:38:10.292526 3135511 test_utils.cc:89] k: 3 I20210111 18:38:10.292531 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:10.292537 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2697 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:38:12.989532 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:12.989545 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:38:12.989549 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:12.989554 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:12.989565 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:12.989570 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:12.989574 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:12.989579 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:38:12.989585 3135511 test_utils.cc:89] k: 3 I20210111 18:38:12.989589 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:38:12.989593 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:38:15.695807 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:15.695823 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:38:15.695829 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:15.695835 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:15.695848 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:15.695855 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:15.695863 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:15.695868 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:38:15.695878 3135511 test_utils.cc:89] k: 3 I20210111 18:38:15.695883 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:15.695888 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:38:18.403391 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:18.403424 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:38:18.403431 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:18.403437 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:18.403451 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:18.403458 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:18.403465 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:18.403470 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:38:18.403479 3135511 test_utils.cc:89] k: 3 I20210111 18:38:18.403484 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:38:18.403491 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2723 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:38:21.126303 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:21.126319 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:38:21.126327 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:21.126332 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:21.126346 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:21.126353 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:21.126359 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:21.126366 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:38:21.126374 3135511 test_utils.cc:89] k: 3 I20210111 18:38:21.126380 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:21.126386 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2735 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:38:23.861744 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:23.861759 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:38:23.861766 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:23.861773 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:23.861788 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:23.861794 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:23.861800 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:23.861807 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:38:23.861815 3135511 test_utils.cc:89] k: 3 I20210111 18:38:23.861821 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:38:23.861827 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2776 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:38:26.637588 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:26.637604 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:38:26.637611 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:26.637617 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:26.637632 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:26.637639 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:26.637645 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:26.637651 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:38:26.637660 3135511 test_utils.cc:89] k: 3 I20210111 18:38:26.637665 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:26.637671 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2823 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:38:29.460741 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:29.460757 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:38:29.460762 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:38:29.460769 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:29.460783 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:29.460790 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:29.460796 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:29.460803 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:38:29.460811 3135511 test_utils.cc:89] k: 1 I20210111 18:38:29.460817 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:38:29.460822 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:38:32.173688 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:32.173704 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:38:32.173712 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:38:32.173717 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:32.173730 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:32.173738 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:32.173743 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:32.173750 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:38:32.173758 3135511 test_utils.cc:89] k: 1 I20210111 18:38:32.173764 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:38:32.173769 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2714 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:38:34.887483 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:34.887498 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:38:34.887504 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:38:34.887511 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:34.887523 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:34.887529 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:34.887535 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:34.887542 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:38:34.887548 3135511 test_utils.cc:89] k: 1 I20210111 18:38:34.887554 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:38:34.887559 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:38:37.595207 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:37.595223 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:38:37.595230 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:37.595237 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:38:37.595250 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:38:37.595259 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:38:37.595268 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:38:37.595274 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:38:37.595281 3135511 test_utils.cc:89] k: 3 I20210111 18:38:37.595288 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:37.595293 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2720 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:38:40.316015 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:40.316033 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:38:40.316040 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:40.316047 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:38:40.316061 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:38:40.316071 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:38:40.316078 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:38:40.316085 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:38:40.316093 3135511 test_utils.cc:89] k: 3 I20210111 18:38:40.316099 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:40.316104 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2725 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:38:43.041030 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:43.041046 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:38:43.041054 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:43.041059 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:38:43.041074 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:38:43.041082 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:38:43.041090 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:38:43.041097 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:38:43.041105 3135511 test_utils.cc:89] k: 3 I20210111 18:38:43.041110 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:43.041116 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2745 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:38:45.786550 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:45.786568 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:38:45.786574 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:45.786581 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:45.786593 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:45.786600 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:45.786607 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:45.786613 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:38:45.786623 3135511 test_utils.cc:89] k: 3 I20210111 18:38:45.786628 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:45.786633 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:38:48.499128 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:48.499143 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:38:48.499150 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:48.499156 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:48.499171 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:48.499176 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:48.499183 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:48.499192 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:38:48.499203 3135511 test_utils.cc:89] k: 3 I20210111 18:38:48.499212 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:48.499220 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:38:51.206707 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:51.206723 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:38:51.206730 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:51.206737 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:38:51.206749 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:38:51.206758 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:38:51.206766 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:38:51.206773 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:38:51.206780 3135511 test_utils.cc:89] k: 3 I20210111 18:38:51.206786 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:51.206791 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:38:53.918051 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:53.918067 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:38:53.918073 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:53.918079 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:38:53.918092 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:38:53.918102 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:38:53.918109 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:38:53.918116 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:38:53.918124 3135511 test_utils.cc:89] k: 3 I20210111 18:38:53.918130 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:38:53.918135 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2982 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101788 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:38:56.900408 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:56.900422 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:38:56.900429 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:56.900434 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:56.900449 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.900455 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.900462 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.900468 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:38:56.900476 3135511 test_utils.cc:89] k: 3 I20210111 18:38:56.900482 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:56.900487 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (66 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:38:56.966737 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:56.966743 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:38:56.966745 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:56.966747 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:56.966751 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.966754 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.966756 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.966758 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:38:56.966760 3135511 test_utils.cc:89] k: 3 I20210111 18:38:56.966763 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:38:56.966764 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:38:56.970707 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:56.970712 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:38:56.970715 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:56.970716 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:56.970721 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.970722 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.970726 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.970727 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:38:56.970729 3135511 test_utils.cc:89] k: 3 I20210111 18:38:56.970731 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:56.970733 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:38:56.981603 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:56.981607 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:38:56.981609 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:56.981611 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:56.981616 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.981617 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.981619 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:56.981622 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:38:56.981624 3135511 test_utils.cc:89] k: 3 I20210111 18:38:56.981626 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:38:56.981628 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:38:57.006916 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:57.006922 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:38:57.006923 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:57.006924 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:57.006928 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.006930 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.006933 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.006935 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:38:57.006937 3135511 test_utils.cc:89] k: 3 I20210111 18:38:57.006939 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:57.006942 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (48 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:38:57.054141 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:57.054144 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:38:57.054147 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:57.054148 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:57.054152 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.054155 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.054157 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.054159 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:38:57.054162 3135511 test_utils.cc:89] k: 3 I20210111 18:38:57.054163 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:38:57.054165 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:38:57.140516 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:57.140522 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:38:57.140524 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:57.140527 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:57.140532 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.140533 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.140535 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.140537 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:38:57.140540 3135511 test_utils.cc:89] k: 3 I20210111 18:38:57.140542 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:57.140544 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (127 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:38:57.267158 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:57.267165 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:38:57.267168 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:57.267169 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:57.267174 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.267177 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.267179 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.267181 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:38:57.267184 3135511 test_utils.cc:89] k: 3 I20210111 18:38:57.267185 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:38:57.267187 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (322 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:38:57.589253 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:57.589262 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:38:57.589264 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:57.589265 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:57.589274 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.589277 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.589278 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:57.589280 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:38:57.589283 3135511 test_utils.cc:89] k: 3 I20210111 18:38:57.589285 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:57.589287 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (664 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:38:58.253854 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:58.253862 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:38:58.253865 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:38:58.253866 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:58.253873 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.253876 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.253878 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.253880 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:38:58.253882 3135511 test_utils.cc:89] k: 1 I20210111 18:38:58.253885 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:38:58.253886 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (48 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:38:58.301198 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:58.301205 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:38:58.301208 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:38:58.301209 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:58.301214 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.301216 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.301218 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.301220 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:38:58.301223 3135511 test_utils.cc:89] k: 1 I20210111 18:38:58.301225 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:38:58.301227 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:38:58.347846 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:58.347851 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:38:58.347853 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:38:58.347856 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:38:58.347860 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.347862 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.347864 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:38:58.347867 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:38:58.347869 3135511 test_utils.cc:89] k: 1 I20210111 18:38:58.347872 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:38:58.347873 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:38:58.393847 3135511 test_utils.cc:82] Testing parameters: I20210111 18:38:58.393852 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:38:58.393854 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:38:58.393857 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:38:58.393860 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:38:58.393863 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:38:58.393867 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:38:58.393868 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:38:58.393870 3135511 test_utils.cc:89] k: 3 I20210111 18:38:58.393872 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:38:58.393874 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6540 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:39:04.933122 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:04.933130 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:39:04.933132 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:04.933135 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:39:04.933141 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:39:04.933145 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:39:04.933147 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:39:04.933149 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:39:04.933152 3135511 test_utils.cc:89] k: 3 I20210111 18:39:04.933154 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:39:04.933156 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10117 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:39:15.050566 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:15.050573 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:39:15.050576 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:15.050578 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:39:15.050585 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:39:15.050588 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:39:15.050590 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:39:15.050593 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:39:15.050595 3135511 test_utils.cc:89] k: 3 I20210111 18:39:15.050597 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:39:15.050599 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26569 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:39:41.619995 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:41.620003 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:39:41.620005 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:41.620007 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:39:41.620015 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:41.620018 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:41.620020 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:41.620023 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:39:41.620025 3135511 test_utils.cc:89] k: 3 I20210111 18:39:41.620028 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:39:41.620028 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1570 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:39:43.189426 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:43.189433 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:39:43.189435 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:43.189438 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:39:43.189445 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:43.189446 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:43.189448 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:43.189451 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:39:43.189453 3135511 test_utils.cc:89] k: 3 I20210111 18:39:43.189455 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:39:43.189457 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (847 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:39:44.036979 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:44.036986 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:39:44.036988 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:44.036990 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:39:44.036996 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:39:44.036999 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:39:44.037003 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:39:44.037004 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:39:44.037007 3135511 test_utils.cc:89] k: 3 I20210111 18:39:44.037009 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:39:44.037011 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2772 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:39:46.808173 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:46.808180 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:39:46.808182 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:46.808184 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:39:46.808192 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:39:46.808194 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:39:46.808197 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:39:46.808199 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:39:46.808202 3135511 test_utils.cc:89] k: 3 I20210111 18:39:46.808203 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:39:46.808205 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11368 ms) [----------] 19 tests from ClassificationModelCpuTest (61276 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (163064 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 2) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:39:58.176955 3135511 test_utils.cc:82] Testing parameters: I20210111 18:39:58.176962 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:39:58.176964 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:39:58.176966 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:39:58.176975 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:58.176976 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:58.176978 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:39:58.176980 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:39:58.176983 3135511 test_utils.cc:89] k: 3 I20210111 18:39:58.176985 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:39:58.176987 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:40:00.882885 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:00.882902 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:40:00.882908 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:00.882915 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:00.882927 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:00.882934 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:00.882941 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:00.882947 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:40:00.882956 3135511 test_utils.cc:89] k: 3 I20210111 18:40:00.882961 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:00.882966 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2721 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:03.603319 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:03.603335 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:03.603343 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:03.603348 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:03.603363 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:03.603370 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:03.603376 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:03.603382 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:40:03.603391 3135511 test_utils.cc:89] k: 3 I20210111 18:40:03.603397 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:03.603420 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2729 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:06.332124 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:06.332140 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:06.332146 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:06.332152 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:06.332166 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:06.332173 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:06.332180 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:06.332186 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:40:06.332195 3135511 test_utils.cc:89] k: 3 I20210111 18:40:06.332201 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:40:06.332206 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2968 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:40:09.300514 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:09.300530 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:40:09.300536 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:09.300542 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:09.300556 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:09.300563 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:09.300570 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:09.300576 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:40:09.300585 3135511 test_utils.cc:89] k: 3 I20210111 18:40:09.300590 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:40:09.300595 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2766 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:12.066606 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:12.066623 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:12.066629 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:12.066637 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:12.066651 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:12.066658 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:12.066664 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:12.066670 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:40:12.066679 3135511 test_utils.cc:89] k: 3 I20210111 18:40:12.066684 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:12.066690 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2816 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:40:14.882989 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:14.883006 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:40:14.883013 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:14.883018 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:14.883033 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:14.883038 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:14.883045 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:14.883051 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:40:14.883059 3135511 test_utils.cc:89] k: 3 I20210111 18:40:14.883064 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:14.883070 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2815 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:40:17.697508 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:17.697525 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:40:17.697531 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:17.697538 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:17.697551 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:17.697558 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:17.697564 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:17.697571 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:40:17.697579 3135511 test_utils.cc:89] k: 3 I20210111 18:40:17.697585 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:17.697590 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2817 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:40:20.514210 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:20.514226 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:40:20.514233 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:20.514240 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:20.514252 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:20.514259 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:20.514266 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:20.514271 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:40:20.514279 3135511 test_utils.cc:89] k: 3 I20210111 18:40:20.514286 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:20.514292 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2812 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:23.326270 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:23.326287 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:23.326293 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:23.326299 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:23.326313 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:23.326320 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:23.326326 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:23.326333 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:40:23.326340 3135511 test_utils.cc:89] k: 3 I20210111 18:40:23.326346 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:40:23.326352 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:40:26.021191 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:26.021207 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:40:26.021214 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:26.021219 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:26.021232 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:26.021239 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:26.021246 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:26.021252 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:40:26.021260 3135511 test_utils.cc:89] k: 3 I20210111 18:40:26.021266 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:40:26.021272 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:40:28.713522 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:28.713537 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:40:28.713544 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:28.713551 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:28.713563 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:28.713570 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:28.713577 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:28.713583 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:40:28.713591 3135511 test_utils.cc:89] k: 3 I20210111 18:40:28.713598 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:40:28.713603 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:31.409987 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:31.410003 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:31.410009 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:31.410015 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:31.410028 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:31.410035 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:31.410043 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:31.410048 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:40:31.410058 3135511 test_utils.cc:89] k: 3 I20210111 18:40:31.410063 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:31.410068 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2700 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:40:34.109504 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:34.109521 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:40:34.109527 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:34.109545 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:34.109558 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:34.109565 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:34.109570 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:34.109575 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:40:34.109581 3135511 test_utils.cc:89] k: 3 I20210111 18:40:34.109586 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:34.109591 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:36.805378 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:36.805394 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:36.805400 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:36.805406 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:36.805420 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:36.805428 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:36.805433 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:36.805439 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:40:36.805449 3135511 test_utils.cc:89] k: 3 I20210111 18:40:36.805454 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:40:36.805460 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:40:39.511147 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:39.511162 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:40:39.511169 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:39.511174 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:39.511188 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:39.511194 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:39.511200 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:39.511205 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:40:39.511214 3135511 test_utils.cc:89] k: 3 I20210111 18:40:39.511219 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:39.511224 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:40:42.219725 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:42.219741 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:40:42.219748 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:42.219753 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:42.219769 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:42.219774 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:42.219781 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:42.219787 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:40:42.219795 3135511 test_utils.cc:89] k: 3 I20210111 18:40:42.219801 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:42.219806 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:40:44.927225 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:44.927242 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:40:44.927248 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:44.927255 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:44.927269 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:44.927276 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:44.927282 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:44.927289 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:40:44.927297 3135511 test_utils.cc:89] k: 3 I20210111 18:40:44.927302 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:44.927309 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:40:47.639851 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:47.639868 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:40:47.639875 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:47.639883 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:47.639896 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:47.639904 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:47.639909 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:47.639915 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:40:47.639925 3135511 test_utils.cc:89] k: 3 I20210111 18:40:47.639930 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:47.639935 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:40:50.348946 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:50.348963 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:40:50.348969 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:50.348975 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:50.348990 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:50.348997 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:50.349004 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:50.349009 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:40:50.349017 3135511 test_utils.cc:89] k: 3 I20210111 18:40:50.349023 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:40:50.349030 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:40:53.042402 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:53.042418 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:40:53.042425 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:53.042431 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:53.042444 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:53.042451 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:53.042459 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:53.042464 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:40:53.042472 3135511 test_utils.cc:89] k: 3 I20210111 18:40:53.042479 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:53.042484 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2704 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:40:55.746439 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:55.746455 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:40:55.746461 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:55.746467 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:55.746481 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:55.746487 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:55.746495 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:55.746500 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:40:55.746508 3135511 test_utils.cc:89] k: 3 I20210111 18:40:55.746515 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:40:55.746520 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2704 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:40:58.450157 3135511 test_utils.cc:82] Testing parameters: I20210111 18:40:58.450174 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:40:58.450181 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:40:58.450186 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:40:58.450199 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:58.450206 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:58.450213 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:40:58.450219 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:40:58.450227 3135511 test_utils.cc:89] k: 3 I20210111 18:40:58.450233 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:40:58.450239 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:41:01.161295 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:01.161311 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:41:01.161317 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:01.161324 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:01.161339 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:01.161345 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:01.161351 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:01.161358 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:41:01.161366 3135511 test_utils.cc:89] k: 3 I20210111 18:41:01.161372 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:41:01.161377 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2723 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:41:03.884927 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:03.884943 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:41:03.884950 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:03.884959 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:03.884974 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:03.884980 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:03.884987 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:03.884994 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:41:03.885002 3135511 test_utils.cc:89] k: 3 I20210111 18:41:03.885008 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:03.885013 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2732 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:41:06.616765 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:06.616780 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:41:06.616787 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:06.616792 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:06.616807 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:06.616814 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:06.616820 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:06.616827 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:41:06.616835 3135511 test_utils.cc:89] k: 3 I20210111 18:41:06.616840 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:41:06.616847 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2762 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:41:09.378643 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:09.378659 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:41:09.378665 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:09.378671 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:09.378685 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:09.378691 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:09.378698 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:09.378705 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:41:09.378712 3135511 test_utils.cc:89] k: 3 I20210111 18:41:09.378718 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:09.378724 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2815 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:41:12.193298 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:12.193315 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:41:12.193321 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:41:12.193327 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:12.193341 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:12.193348 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:12.193354 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:12.193361 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:41:12.193369 3135511 test_utils.cc:89] k: 1 I20210111 18:41:12.193375 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:41:12.193382 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:41:14.904949 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:14.904965 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:41:14.904973 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:41:14.904978 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:14.904992 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:14.904999 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:14.905005 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:14.905012 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:41:14.905020 3135511 test_utils.cc:89] k: 1 I20210111 18:41:14.905026 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:41:14.905031 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:41:17.611007 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:17.611023 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:41:17.611029 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:41:17.611035 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:17.611050 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:17.611057 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:17.611063 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:17.611069 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:41:17.611078 3135511 test_utils.cc:89] k: 1 I20210111 18:41:17.611083 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:41:17.611089 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:41:20.320084 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:20.320101 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:41:20.320107 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:20.320113 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:41:20.320127 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:41:20.320137 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:41:20.320145 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:41:20.320152 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:41:20.320159 3135511 test_utils.cc:89] k: 3 I20210111 18:41:20.320165 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:20.320171 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2722 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:41:23.042183 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:23.042199 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:41:23.042205 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:23.042213 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:41:23.042227 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:41:23.042237 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:41:23.042244 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:41:23.042251 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:41:23.042259 3135511 test_utils.cc:89] k: 3 I20210111 18:41:23.042265 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:23.042270 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2725 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:41:25.768040 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:25.768056 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:41:25.768062 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:25.768071 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:41:25.768086 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:41:25.768096 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:41:25.768103 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:41:25.768110 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:41:25.768118 3135511 test_utils.cc:89] k: 3 I20210111 18:41:25.768124 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:25.768129 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2741 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:41:28.509196 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:28.509212 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:41:28.509218 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:28.509225 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:28.509239 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:28.509245 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:28.509253 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:28.509258 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:41:28.509266 3135511 test_utils.cc:89] k: 3 I20210111 18:41:28.509272 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:28.509279 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2925 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:41:31.434839 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:31.434854 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:41:31.434861 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:31.434866 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:31.434880 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:31.434887 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:31.434893 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:31.434900 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:41:31.434908 3135511 test_utils.cc:89] k: 3 I20210111 18:41:31.434914 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:31.434921 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:41:34.145841 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:34.145857 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:41:34.145864 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:34.145869 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:41:34.145884 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:41:34.145893 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:41:34.145900 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:41:34.145907 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:41:34.145915 3135511 test_utils.cc:89] k: 3 I20210111 18:41:34.145920 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:34.145926 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:41:36.853812 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:36.853828 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:41:36.853835 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:36.853842 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:41:36.853855 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:41:36.853865 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:41:36.853873 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:41:36.853880 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:41:36.853888 3135511 test_utils.cc:89] k: 3 I20210111 18:41:36.853893 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:41:36.853899 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2762 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101439 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:41:39.615741 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.615756 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:41:39.615763 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.615768 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.615782 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.615789 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.615795 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.615801 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:41:39.615810 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.615815 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:39.615821 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (65 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:41:39.680963 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.680969 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:41:39.680971 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.680974 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.680979 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.680981 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.680984 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.680985 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:41:39.680987 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.680989 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:41:39.680991 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:41:39.684963 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.684969 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:41:39.684971 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.684973 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.684978 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.684979 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.684981 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.684983 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:41:39.684986 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.684988 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:39.684990 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:41:39.695829 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.695835 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:41:39.695837 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.695839 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.695844 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.695847 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.695848 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.695852 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:41:39.695853 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.695855 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:41:39.695858 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (26 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:41:39.721105 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.721109 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:41:39.721112 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.721113 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.721117 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.721119 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.721122 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.721124 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:41:39.721127 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.721128 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:39.721130 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (46 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:41:39.767720 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.767724 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:41:39.767726 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.767729 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.767733 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.767735 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.767737 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.767740 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:41:39.767742 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.767745 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:41:39.767745 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:41:39.853556 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.853562 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:41:39.853565 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.853567 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.853571 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.853574 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.853576 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.853579 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:41:39.853580 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.853582 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:39.853585 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:41:39.979629 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:39.979635 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:41:39.979636 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:39.979638 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:39.979642 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.979645 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.979647 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:39.979650 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:41:39.979651 3135511 test_utils.cc:89] k: 3 I20210111 18:41:39.979653 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:41:39.979655 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (319 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:41:40.298725 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:40.298734 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:41:40.298736 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:40.298738 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:40.298745 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:40.298748 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:40.298750 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:40.298753 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:41:40.298755 3135511 test_utils.cc:89] k: 3 I20210111 18:41:40.298758 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:40.298758 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:41:40.963438 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:40.963447 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:41:40.963449 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:41:40.963451 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:40.963459 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:40.963461 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:40.963464 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:40.963465 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:41:40.963469 3135511 test_utils.cc:89] k: 1 I20210111 18:41:40.963470 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:41:40.963472 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:41:41.010826 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:41.010833 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:41:41.010835 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:41:41.010838 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:41.010843 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:41.010845 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:41.010848 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:41.010850 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:41:41.010854 3135511 test_utils.cc:89] k: 1 I20210111 18:41:41.010855 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:41:41.010857 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:41:41.057199 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:41.057205 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:41:41.057207 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:41:41.057209 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:41:41.057214 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:41.057216 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:41.057219 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:41:41.057220 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:41:41.057224 3135511 test_utils.cc:89] k: 1 I20210111 18:41:41.057224 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:41:41.057226 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:41:41.103399 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:41.103411 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:41:41.103413 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:41.103415 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:41:41.103420 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:41:41.103423 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:41:41.103426 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:41:41.103428 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:41:41.103431 3135511 test_utils.cc:89] k: 3 I20210111 18:41:41.103432 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:41.103435 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6493 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:41:47.596194 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:47.596201 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:41:47.596204 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:47.596205 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:41:47.596212 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:41:47.596216 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:41:47.596218 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:41:47.596221 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:41:47.596223 3135511 test_utils.cc:89] k: 3 I20210111 18:41:47.596225 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:47.596227 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10106 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:41:57.702495 3135511 test_utils.cc:82] Testing parameters: I20210111 18:41:57.702503 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:41:57.702505 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:41:57.702508 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:41:57.702515 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:41:57.702518 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:41:57.702522 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:41:57.702523 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:41:57.702527 3135511 test_utils.cc:89] k: 3 I20210111 18:41:57.702528 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:41:57.702530 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26560 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:42:24.262332 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:24.262341 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:42:24.262342 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:24.262344 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:24.262353 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:24.262356 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:24.262357 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:24.262359 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:42:24.262362 3135511 test_utils.cc:89] k: 3 I20210111 18:42:24.262364 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:24.262367 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1568 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:42:25.830574 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:25.830583 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:42:25.830585 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:25.830587 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:25.830595 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:25.830597 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:25.830600 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:25.830601 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:42:25.830605 3135511 test_utils.cc:89] k: 3 I20210111 18:42:25.830606 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:25.830608 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (848 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:42:26.678037 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:26.678045 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:42:26.678046 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:26.678048 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:42:26.678054 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:42:26.678058 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:42:26.678061 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:42:26.678062 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:42:26.678066 3135511 test_utils.cc:89] k: 3 I20210111 18:42:26.678067 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:26.678069 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2770 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:42:29.448091 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:29.448098 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:42:29.448101 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:29.448102 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:42:29.448109 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:42:29.448113 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:42:29.448115 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:42:29.448118 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:42:29.448120 3135511 test_utils.cc:89] k: 3 I20210111 18:42:29.448122 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:42:29.448124 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11363 ms) [----------] 19 tests from ClassificationModelCpuTest (61196 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162635 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 3) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:42:40.811146 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:40.811152 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:42:40.811156 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:40.811157 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:40.811165 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:40.811167 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:40.811169 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:40.811172 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:42:40.811174 3135511 test_utils.cc:89] k: 3 I20210111 18:42:40.811177 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:40.811178 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2703 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:42:43.515031 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:43.515048 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:42:43.515054 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:43.515060 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:43.515074 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:43.515080 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:43.515087 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:43.515094 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:42:43.515101 3135511 test_utils.cc:89] k: 3 I20210111 18:42:43.515107 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:43.515113 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2714 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:42:46.229720 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:46.229737 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:42:46.229743 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:46.229749 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:46.229763 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:46.229770 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:46.229776 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:46.229784 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:42:46.229791 3135511 test_utils.cc:89] k: 3 I20210111 18:42:46.229797 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:46.229804 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2729 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:42:48.958829 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:48.958847 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:42:48.958853 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:48.958860 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:48.958874 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:48.958880 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:48.958887 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:48.958894 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:42:48.958901 3135511 test_utils.cc:89] k: 3 I20210111 18:42:48.958907 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:42:48.958914 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2766 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:42:51.724733 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:51.724750 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:42:51.724757 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:51.724763 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:51.724777 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:51.724784 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:51.724792 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:51.724797 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:42:51.724807 3135511 test_utils.cc:89] k: 3 I20210111 18:42:51.724812 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:42:51.724818 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2764 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:42:54.488507 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:54.488524 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:42:54.488533 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:54.488539 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:54.488552 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:54.488559 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:54.488566 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:54.488572 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:42:54.488581 3135511 test_utils.cc:89] k: 3 I20210111 18:42:54.488586 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:54.488592 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2814 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:42:57.302358 3135511 test_utils.cc:82] Testing parameters: I20210111 18:42:57.302376 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:42:57.302384 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:42:57.302390 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:42:57.302404 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:57.302412 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:57.302418 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:42:57.302424 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:42:57.302433 3135511 test_utils.cc:89] k: 3 I20210111 18:42:57.302438 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:42:57.302444 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2815 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:43:00.117215 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:00.117231 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:43:00.117240 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:00.117245 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:00.117259 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:00.117266 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:00.117274 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:00.117280 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:43:00.117288 3135511 test_utils.cc:89] k: 3 I20210111 18:43:00.117295 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:00.117300 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2812 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:43:02.929178 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:02.929195 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:43:02.929203 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:02.929208 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:02.929222 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:02.929229 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:02.929235 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:02.929241 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:43:02.929250 3135511 test_utils.cc:89] k: 3 I20210111 18:43:02.929256 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:02.929262 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2816 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:43:05.745344 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:05.745362 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:43:05.745369 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:05.745375 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:05.745389 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:05.745396 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:05.745404 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:05.745409 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:43:05.745417 3135511 test_utils.cc:89] k: 3 I20210111 18:43:05.745424 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:43:05.745429 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:43:08.441741 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:08.441756 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:43:08.441762 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:08.441767 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:08.441779 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:08.441787 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:08.441792 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:08.441797 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:43:08.441804 3135511 test_utils.cc:89] k: 3 I20210111 18:43:08.441809 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:43:08.441814 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:43:11.135064 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:11.135079 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:43:11.135087 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:11.135092 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:11.135105 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:11.135111 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:11.135118 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:11.135124 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:43:11.135133 3135511 test_utils.cc:89] k: 3 I20210111 18:43:11.135138 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:43:11.135143 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:43:13.829676 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:13.829691 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:43:13.829697 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:13.829702 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:13.829713 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:13.829720 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:13.829725 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:13.829730 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:43:13.829736 3135511 test_utils.cc:89] k: 3 I20210111 18:43:13.829741 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:13.829746 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:43:16.525162 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:16.525174 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:43:16.525178 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:16.525182 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:16.525192 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:16.525199 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:16.525203 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:16.525207 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:43:16.525213 3135511 test_utils.cc:89] k: 3 I20210111 18:43:16.525218 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:16.525221 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:43:19.221381 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:19.221411 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:43:19.221415 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:19.221421 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:19.221431 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:19.221436 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:19.221439 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:19.221443 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:43:19.221449 3135511 test_utils.cc:89] k: 3 I20210111 18:43:19.221453 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:43:19.221457 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2699 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:43:21.921000 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:21.921013 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:43:21.921020 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:21.921063 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:21.921077 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:21.921082 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:21.921087 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:21.921092 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:43:21.921099 3135511 test_utils.cc:89] k: 3 I20210111 18:43:21.921104 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:21.921108 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:43:24.630651 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:24.630667 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:43:24.630674 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:24.630682 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:24.630697 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:24.630704 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:24.630710 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:24.630717 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:43:24.630725 3135511 test_utils.cc:89] k: 3 I20210111 18:43:24.630730 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:24.630736 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:43:27.340618 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:27.340634 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:43:27.340641 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:27.340647 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:27.340662 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:27.340668 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:27.340674 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:27.340682 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:43:27.340689 3135511 test_utils.cc:89] k: 3 I20210111 18:43:27.340695 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:27.340701 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:43:30.050607 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:30.050623 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:43:30.050631 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:30.050638 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:30.050652 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:30.050659 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:30.050665 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:30.050673 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:43:30.050680 3135511 test_utils.cc:89] k: 3 I20210111 18:43:30.050686 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:30.050693 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:43:32.760339 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:32.760355 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:43:32.760361 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:32.760367 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:32.760381 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:32.760388 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:32.760396 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:32.760401 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:43:32.760411 3135511 test_utils.cc:89] k: 3 I20210111 18:43:32.760416 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:43:32.760421 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2698 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:43:35.458586 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:35.458602 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:43:35.458609 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:35.458618 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:35.458631 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:35.458638 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:35.458645 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:35.458652 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:43:35.458660 3135511 test_utils.cc:89] k: 3 I20210111 18:43:35.458667 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:35.458673 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2699 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:43:38.157927 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:38.157945 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:43:38.157953 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:38.157960 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:38.157974 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:38.157980 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:38.157987 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:38.157994 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:43:38.158002 3135511 test_utils.cc:89] k: 3 I20210111 18:43:38.158008 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:43:38.158013 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2912 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:43:41.070036 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:41.070051 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:43:41.070056 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:41.070061 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:41.070075 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:41.070081 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:41.070086 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:41.070092 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:43:41.070099 3135511 test_utils.cc:89] k: 3 I20210111 18:43:41.070104 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:41.070109 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:43:43.781369 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:43.781389 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:43:43.781399 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:43.781407 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:43.781427 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:43.781437 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:43.781447 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:43.781457 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:43:43.781471 3135511 test_utils.cc:89] k: 3 I20210111 18:43:43.781479 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:43:43.781487 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2719 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:43:46.500434 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:46.500450 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:43:46.500458 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:46.500463 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:46.500478 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:46.500484 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:46.500490 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:46.500497 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:43:46.500505 3135511 test_utils.cc:89] k: 3 I20210111 18:43:46.500511 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:46.500517 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2733 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:43:49.233255 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:49.233273 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:43:49.233279 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:49.233285 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:49.233299 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:49.233306 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:49.233314 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:49.233319 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:43:49.233328 3135511 test_utils.cc:89] k: 3 I20210111 18:43:49.233333 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:43:49.233340 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2766 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:43:51.999186 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:51.999203 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:43:51.999209 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:43:51.999218 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:51.999233 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:51.999239 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:51.999245 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:51.999253 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:43:51.999260 3135511 test_utils.cc:89] k: 3 I20210111 18:43:51.999266 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:43:51.999272 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2813 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:43:54.812280 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:54.812296 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:43:54.812302 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:43:54.812309 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:54.812323 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:54.812330 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:54.812336 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:54.812343 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:43:54.812351 3135511 test_utils.cc:89] k: 1 I20210111 18:43:54.812356 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:43:54.812362 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:43:57.523243 3135511 test_utils.cc:82] Testing parameters: I20210111 18:43:57.523259 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:43:57.523267 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:43:57.523272 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:43:57.523285 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:57.523293 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:57.523298 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:43:57.523305 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:43:57.523313 3135511 test_utils.cc:89] k: 1 I20210111 18:43:57.523319 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:43:57.523325 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:44:00.234287 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:00.234304 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:44:00.234310 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:44:00.234319 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:00.234333 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:00.234340 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:00.234346 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:00.234354 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:44:00.234361 3135511 test_utils.cc:89] k: 1 I20210111 18:44:00.234367 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:44:00.234374 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:44:02.944027 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:02.944044 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:44:02.944051 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:02.944058 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:44:02.944072 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:44:02.944082 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:44:02.944089 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:44:02.944097 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:44:02.944104 3135511 test_utils.cc:89] k: 3 I20210111 18:44:02.944110 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:02.944116 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2716 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:44:05.660908 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:05.660924 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:44:05.660931 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:05.660939 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:44:05.660953 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:44:05.660964 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:44:05.660970 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:44:05.660977 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:44:05.660985 3135511 test_utils.cc:89] k: 3 I20210111 18:44:05.660991 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:05.660997 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2722 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:44:08.382952 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:08.382969 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:44:08.382977 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:08.382982 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:44:08.382997 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:44:08.383005 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:44:08.383013 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:44:08.383020 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:44:08.383028 3135511 test_utils.cc:89] k: 3 I20210111 18:44:08.383034 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:08.383039 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2742 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:44:11.124626 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:11.124644 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:44:11.124650 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:11.124656 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:11.124670 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:11.124676 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:11.124683 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:11.124689 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:44:11.124697 3135511 test_utils.cc:89] k: 3 I20210111 18:44:11.124703 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:11.124709 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2921 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:44:14.045135 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:14.045152 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:44:14.045158 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:14.045164 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:14.045178 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:14.045186 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:14.045192 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:14.045198 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:44:14.045207 3135511 test_utils.cc:89] k: 3 I20210111 18:44:14.045212 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:14.045218 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2705 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:44:16.750878 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:16.750895 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:44:16.750900 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:16.750906 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:44:16.750921 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:44:16.750929 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:44:16.750937 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:44:16.750944 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:44:16.750952 3135511 test_utils.cc:89] k: 3 I20210111 18:44:16.750957 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:16.750963 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:44:19.462607 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:19.462625 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:44:19.462630 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:19.462638 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:44:19.462651 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:44:19.462661 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:44:19.462668 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:44:19.462675 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:44:19.462682 3135511 test_utils.cc:89] k: 3 I20210111 18:44:19.462688 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:44:19.462693 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2763 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101414 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:44:22.225872 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.225888 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:44:22.225895 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.225901 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.225914 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.225921 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.225929 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.225934 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:44:22.225944 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.225950 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:22.225955 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (67 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:44:22.292549 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.292555 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:44:22.292558 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.292560 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.292564 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.292567 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.292568 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.292572 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:44:22.292573 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.292575 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:44:22.292577 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:44:22.296512 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.296517 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:44:22.296519 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.296520 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.296525 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.296527 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.296530 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.296531 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:44:22.296535 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.296536 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:22.296537 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:44:22.307410 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.307413 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:44:22.307415 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.307417 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.307422 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.307425 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.307427 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.307430 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:44:22.307431 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.307433 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:44:22.307435 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:44:22.332629 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.332634 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:44:22.332636 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.332638 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.332643 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.332644 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.332646 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.332648 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:44:22.332651 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.332653 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:22.332654 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (47 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:44:22.379163 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.379168 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:44:22.379170 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.379173 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.379176 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.379179 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.379180 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.379182 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:44:22.379185 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.379187 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:44:22.379189 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:44:22.465027 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.465034 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:44:22.465035 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.465037 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.465041 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.465044 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.465046 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.465049 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:44:22.465050 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.465052 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:22.465054 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:44:22.591152 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.591158 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:44:22.591161 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.591162 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.591167 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.591169 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.591171 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.591173 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:44:22.591176 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.591178 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:44:22.591179 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (319 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:44:22.910179 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:22.910187 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:44:22.910189 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:22.910192 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:22.910198 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.910202 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.910203 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:22.910205 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:44:22.910208 3135511 test_utils.cc:89] k: 3 I20210111 18:44:22.910209 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:22.910212 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (664 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:44:23.574477 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:23.574486 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:44:23.574487 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:44:23.574489 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:23.574497 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.574499 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.574501 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.574503 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:44:23.574506 3135511 test_utils.cc:89] k: 1 I20210111 18:44:23.574508 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:44:23.574510 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:44:23.621901 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:23.621907 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:44:23.621909 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:44:23.621912 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:23.621915 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.621918 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.621920 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.621922 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:44:23.621924 3135511 test_utils.cc:89] k: 1 I20210111 18:44:23.621927 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:44:23.621928 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:44:23.668298 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:23.668303 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:44:23.668305 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:44:23.668308 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:44:23.668313 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.668314 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.668316 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:44:23.668318 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:44:23.668321 3135511 test_utils.cc:89] k: 1 I20210111 18:44:23.668323 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:44:23.668325 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:44:23.714713 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:23.714720 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:44:23.714721 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:23.714723 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:44:23.714727 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:44:23.714731 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:44:23.714733 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:44:23.714735 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:44:23.714738 3135511 test_utils.cc:89] k: 3 I20210111 18:44:23.714740 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:23.714742 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6498 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:44:30.212713 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:30.212720 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:44:30.212723 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:30.212724 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:44:30.212731 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:44:30.212735 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:44:30.212738 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:44:30.212740 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:44:30.212743 3135511 test_utils.cc:89] k: 3 I20210111 18:44:30.212745 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:30.212746 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10124 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:44:40.336750 3135511 test_utils.cc:82] Testing parameters: I20210111 18:44:40.336758 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:44:40.336760 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:44:40.336762 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:44:40.336769 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:44:40.336773 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:44:40.336776 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:44:40.336777 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:44:40.336781 3135511 test_utils.cc:89] k: 3 I20210111 18:44:40.336782 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:44:40.336784 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26557 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:45:06.893715 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:06.893723 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:45:06.893725 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:06.893728 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:06.893735 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:06.893738 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:06.893740 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:06.893743 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:45:06.893745 3135511 test_utils.cc:89] k: 3 I20210111 18:45:06.893748 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:06.893749 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1568 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:45:08.461946 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:08.461954 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:45:08.461956 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:08.461958 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:08.461966 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:08.461968 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:08.461971 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:08.461972 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:45:08.461975 3135511 test_utils.cc:89] k: 3 I20210111 18:45:08.461977 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:08.461978 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (848 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:45:09.309290 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:09.309298 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:45:09.309300 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:09.309303 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:45:09.309310 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:45:09.309314 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:45:09.309315 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:45:09.309319 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:45:09.309320 3135511 test_utils.cc:89] k: 3 I20210111 18:45:09.309322 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:09.309324 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2770 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:45:12.079702 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:12.079711 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:45:12.079713 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:12.079715 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:45:12.079722 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:45:12.079725 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:45:12.079728 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:45:12.079730 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:45:12.079733 3135511 test_utils.cc:89] k: 3 I20210111 18:45:12.079735 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:45:12.079737 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11361 ms) [----------] 19 tests from ClassificationModelCpuTest (61215 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162629 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 4) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:45:23.440330 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:23.440337 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:45:23.440340 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:23.440343 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:23.440351 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:23.440353 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:23.440356 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:23.440357 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:45:23.440361 3135511 test_utils.cc:89] k: 3 I20210111 18:45:23.440362 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:23.440363 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2704 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:45:26.144495 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:26.144510 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:45:26.144517 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:26.144524 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:26.144538 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:26.144546 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:26.144551 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:26.144558 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:45:26.144567 3135511 test_utils.cc:89] k: 3 I20210111 18:45:26.144572 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:26.144577 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2715 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:45:28.859163 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:28.859179 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:45:28.859186 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:28.859195 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:28.859208 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:28.859215 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:28.859221 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:28.859227 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:45:28.859236 3135511 test_utils.cc:89] k: 3 I20210111 18:45:28.859242 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:28.859247 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2730 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:45:31.589323 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:31.589340 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:45:31.589346 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:31.589355 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:31.589370 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:31.589376 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:31.589382 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:31.589390 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:45:31.589397 3135511 test_utils.cc:89] k: 3 I20210111 18:45:31.589403 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:45:31.589408 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2764 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:45:34.353180 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:34.353196 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:45:34.353204 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:34.353210 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:34.353224 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:34.353231 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:34.353237 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:34.353243 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:45:34.353251 3135511 test_utils.cc:89] k: 3 I20210111 18:45:34.353257 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:45:34.353263 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2768 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:45:37.121464 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:37.121481 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:45:37.121487 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:37.121493 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:37.121507 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:37.121515 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:37.121520 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:37.121526 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:45:37.121534 3135511 test_utils.cc:89] k: 3 I20210111 18:45:37.121541 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:37.121546 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2812 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:45:39.933908 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:39.933925 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:45:39.933933 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:39.933938 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:39.933951 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:39.933959 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:39.933965 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:39.933971 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:45:39.933979 3135511 test_utils.cc:89] k: 3 I20210111 18:45:39.933985 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:39.933991 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2812 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:45:42.745551 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:42.745568 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:45:42.745577 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:42.745584 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:42.745596 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:42.745604 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:42.745610 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:42.745616 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:45:42.745625 3135511 test_utils.cc:89] k: 3 I20210111 18:45:42.745630 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:42.745635 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2814 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:45:45.559990 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:45.560006 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:45:45.560014 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:45.560019 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:45.560034 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:45.560039 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:45.560046 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:45.560052 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:45:45.560060 3135511 test_utils.cc:89] k: 3 I20210111 18:45:45.560066 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:45.560072 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2814 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:45:48.373934 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:48.373950 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:45:48.373958 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:48.373963 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:48.373977 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:48.373984 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:48.373991 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:48.373996 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:45:48.374004 3135511 test_utils.cc:89] k: 3 I20210111 18:45:48.374011 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:45:48.374015 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:45:51.065382 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:51.065398 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:45:51.065405 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:51.065412 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:51.065425 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:51.065431 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:51.065438 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:51.065445 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:45:51.065452 3135511 test_utils.cc:89] k: 3 I20210111 18:45:51.065459 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:45:51.065464 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:45:53.757287 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:53.757300 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:45:53.757305 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:53.757309 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:53.757319 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:53.757324 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:53.757328 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:53.757333 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:45:53.757337 3135511 test_utils.cc:89] k: 3 I20210111 18:45:53.757341 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:45:53.757345 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2693 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:45:56.450337 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:56.450353 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:45:56.450361 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:56.450366 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:56.450379 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:56.450387 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:56.450392 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:56.450398 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:45:56.450407 3135511 test_utils.cc:89] k: 3 I20210111 18:45:56.450412 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:56.450418 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2699 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:45:59.149145 3135511 test_utils.cc:82] Testing parameters: I20210111 18:45:59.149158 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:45:59.149161 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:45:59.149165 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:45:59.149175 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:59.149180 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:59.149184 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:45:59.149188 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:45:59.149194 3135511 test_utils.cc:89] k: 3 I20210111 18:45:59.149197 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:45:59.149201 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:46:01.845371 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:01.845383 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:46:01.845388 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:01.845391 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:01.845402 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:01.845407 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:01.845412 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:01.845415 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:46:01.845420 3135511 test_utils.cc:89] k: 3 I20210111 18:46:01.845424 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:46:01.845427 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2699 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:46:04.544930 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:04.544947 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:46:04.544955 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:04.544960 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:04.544973 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:04.544981 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:04.544987 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:04.544993 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:46:04.545001 3135511 test_utils.cc:89] k: 3 I20210111 18:46:04.545007 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:04.545013 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:46:07.256588 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:07.256605 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:46:07.256613 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:07.256618 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:07.256633 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:07.256639 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:07.256645 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:07.256652 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:46:07.256660 3135511 test_utils.cc:89] k: 3 I20210111 18:46:07.256666 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:07.256672 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:46:09.964051 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:09.964066 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:46:09.964073 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:09.964079 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:09.964093 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:09.964100 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:09.964107 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:09.964112 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:46:09.964121 3135511 test_utils.cc:89] k: 3 I20210111 18:46:09.964128 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:09.964133 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:46:12.675740 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:12.675755 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:46:12.675761 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:12.675770 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:12.675783 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:12.675791 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:12.675796 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:12.675802 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:46:12.675812 3135511 test_utils.cc:89] k: 3 I20210111 18:46:12.675817 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:12.675822 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:46:15.383481 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:15.383497 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:46:15.383503 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:15.383509 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:15.383523 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:15.383530 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:15.383538 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:15.383543 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:46:15.383551 3135511 test_utils.cc:89] k: 3 I20210111 18:46:15.383558 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:46:15.383563 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2698 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:46:18.081943 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:18.081959 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:46:18.081965 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:18.081970 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:18.081984 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:18.081990 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:18.081996 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:18.082001 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:46:18.082010 3135511 test_utils.cc:89] k: 3 I20210111 18:46:18.082015 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:18.082020 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:46:20.782166 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:20.782182 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:46:20.782188 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:20.782194 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:20.782207 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:20.782214 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:20.782220 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:20.782227 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:46:20.782235 3135511 test_utils.cc:89] k: 3 I20210111 18:46:20.782241 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:46:20.782248 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2705 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:46:23.487191 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:23.487207 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:46:23.487213 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:23.487219 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:23.487233 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:23.487241 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:23.487246 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:23.487252 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:46:23.487262 3135511 test_utils.cc:89] k: 3 I20210111 18:46:23.487267 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:23.487272 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:46:26.197018 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:26.197036 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:46:26.197041 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:26.197047 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:26.197060 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:26.197067 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:26.197073 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:26.197080 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:46:26.197088 3135511 test_utils.cc:89] k: 3 I20210111 18:46:26.197094 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:46:26.197099 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2715 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:46:28.911258 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:28.911274 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:46:28.911281 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:28.911288 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:28.911301 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:28.911307 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:28.911314 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:28.911320 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:46:28.911329 3135511 test_utils.cc:89] k: 3 I20210111 18:46:28.911334 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:28.911340 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2733 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:46:31.644215 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:31.644232 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:46:31.644237 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:31.644243 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:31.644258 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:31.644264 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:31.644270 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:31.644276 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:46:31.644284 3135511 test_utils.cc:89] k: 3 I20210111 18:46:31.644290 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:46:31.644296 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2764 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:46:34.408740 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:34.408756 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:46:34.408762 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:34.408769 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:34.408782 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:34.408789 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:34.408795 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:34.408802 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:46:34.408810 3135511 test_utils.cc:89] k: 3 I20210111 18:46:34.408815 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:34.408821 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (3024 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:46:37.432713 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:37.432729 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:46:37.432735 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:46:37.432741 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:37.432755 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:37.432762 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:37.432768 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:37.432775 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:46:37.432783 3135511 test_utils.cc:89] k: 1 I20210111 18:46:37.432790 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:46:37.432794 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2719 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:46:40.152015 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:40.152031 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:46:40.152037 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:46:40.152043 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:40.152056 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:40.152063 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:40.152070 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:40.152076 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:46:40.152084 3135511 test_utils.cc:89] k: 1 I20210111 18:46:40.152091 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:46:40.152096 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:46:42.863581 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:42.863598 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:46:42.863605 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:46:42.863613 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:42.863626 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:42.863633 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:42.863639 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:42.863646 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:46:42.863654 3135511 test_utils.cc:89] k: 1 I20210111 18:46:42.863660 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:46:42.863667 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:46:45.570958 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:45.570974 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:46:45.570981 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:45.570989 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:46:45.571003 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:46:45.571012 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:46:45.571019 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:46:45.571027 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:46:45.571034 3135511 test_utils.cc:89] k: 3 I20210111 18:46:45.571040 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:45.571046 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2721 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:46:48.291874 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:48.291890 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:46:48.291896 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:48.291904 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:46:48.291918 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:46:48.291927 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:46:48.291934 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:46:48.291941 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:46:48.291949 3135511 test_utils.cc:89] k: 3 I20210111 18:46:48.291955 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:48.291960 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2723 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:46:51.014528 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:51.014546 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:46:51.014552 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:51.014559 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:46:51.014573 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:46:51.014583 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:46:51.014590 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:46:51.014597 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:46:51.014605 3135511 test_utils.cc:89] k: 3 I20210111 18:46:51.014611 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:51.014617 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2741 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:46:53.755524 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:53.755542 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:46:53.755548 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:53.755555 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:53.755569 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:53.755576 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:53.755582 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:53.755589 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:46:53.755597 3135511 test_utils.cc:89] k: 3 I20210111 18:46:53.755604 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:53.755609 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:46:56.465447 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:56.465463 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:46:56.465469 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:56.465476 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:46:56.465489 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:56.465497 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:56.465502 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:46:56.465508 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:46:56.465517 3135511 test_utils.cc:89] k: 3 I20210111 18:46:56.465523 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:56.465528 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:46:59.176196 3135511 test_utils.cc:82] Testing parameters: I20210111 18:46:59.176213 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:46:59.176218 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:46:59.176224 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:46:59.176239 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:46:59.176249 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:46:59.176255 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:46:59.176262 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:46:59.176270 3135511 test_utils.cc:89] k: 3 I20210111 18:46:59.176276 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:46:59.176282 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:47:01.885792 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:01.885808 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:47:01.885815 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:01.885821 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:47:01.885834 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:47:01.885844 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:47:01.885851 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:47:01.885859 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:47:01.885866 3135511 test_utils.cc:89] k: 3 I20210111 18:47:01.885872 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:47:01.885879 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2761 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101206 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:47:04.646843 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.646858 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:47:04.646865 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.646872 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.646885 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.646893 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.646899 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.646905 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:47:04.646914 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.646920 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:04.646925 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (67 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:47:04.713690 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.713697 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:47:04.713699 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.713701 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.713707 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.713709 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.713711 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.713713 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:47:04.713716 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.713718 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:47:04.713721 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:47:04.717739 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.717744 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:47:04.717746 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.717748 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.717753 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.717756 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.717758 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.717761 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:47:04.717763 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.717765 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:04.717767 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:47:04.728664 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.728669 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:47:04.728672 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.728673 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.728678 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.728680 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.728682 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.728684 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:47:04.728688 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.728689 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:47:04.728691 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (26 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:47:04.754065 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.754070 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:47:04.754071 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.754073 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.754077 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.754079 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.754081 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.754083 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:47:04.754086 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.754087 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:04.754089 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (46 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:47:04.800772 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.800776 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:47:04.800778 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.800781 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.800784 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.800786 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.800788 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.800791 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:47:04.800793 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.800796 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:47:04.800797 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:47:04.886307 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:04.886313 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:47:04.886315 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:04.886317 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:04.886322 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.886324 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.886327 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:04.886328 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:47:04.886332 3135511 test_utils.cc:89] k: 3 I20210111 18:47:04.886333 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:04.886334 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:47:05.012518 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:05.012524 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:47:05.012526 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:05.012528 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:05.012532 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.012535 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.012537 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.012539 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:47:05.012542 3135511 test_utils.cc:89] k: 3 I20210111 18:47:05.012543 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:47:05.012545 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (319 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:47:05.331863 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:05.331872 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:47:05.331876 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:05.331877 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:05.331884 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.331887 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.331888 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.331892 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:47:05.331893 3135511 test_utils.cc:89] k: 3 I20210111 18:47:05.331895 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:05.331897 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:47:05.996737 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:05.996747 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:47:05.996748 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:47:05.996750 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:05.996757 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.996759 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.996762 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:05.996763 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:47:05.996767 3135511 test_utils.cc:89] k: 1 I20210111 18:47:05.996768 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:47:05.996770 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (48 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:47:06.044196 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:06.044203 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:47:06.044204 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:47:06.044206 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:06.044211 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:06.044214 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:06.044215 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:06.044219 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:47:06.044220 3135511 test_utils.cc:89] k: 1 I20210111 18:47:06.044222 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:47:06.044224 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:47:06.090487 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:06.090492 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:47:06.090494 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:47:06.090497 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:06.090502 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:06.090503 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:06.090505 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:06.090508 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:47:06.090510 3135511 test_utils.cc:89] k: 1 I20210111 18:47:06.090512 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:47:06.090514 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:47:06.136364 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:06.136369 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:47:06.136371 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:06.136373 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:47:06.136377 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:47:06.136380 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:47:06.136382 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:47:06.136385 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:47:06.136387 3135511 test_utils.cc:89] k: 3 I20210111 18:47:06.136389 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:06.136391 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6490 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:47:12.626890 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:12.626899 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:47:12.626900 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:12.626902 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:47:12.626909 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:47:12.626912 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:47:12.626915 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:47:12.626917 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:47:12.626920 3135511 test_utils.cc:89] k: 3 I20210111 18:47:12.626922 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:12.626924 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10107 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:47:22.733364 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:22.733372 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:47:22.733374 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:22.733376 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:47:22.733384 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:47:22.733387 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:47:22.733389 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:47:22.733392 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:47:22.733394 3135511 test_utils.cc:89] k: 3 I20210111 18:47:22.733397 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:22.733398 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26574 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:47:49.307548 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:49.307556 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:47:49.307559 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:49.307560 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:49.307569 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:49.307570 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:49.307572 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:49.307574 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:47:49.307577 3135511 test_utils.cc:89] k: 3 I20210111 18:47:49.307579 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:49.307581 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1569 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:47:50.876127 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:50.876134 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:47:50.876137 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:50.876138 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:47:50.876145 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:50.876147 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:50.876149 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:47:50.876152 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:47:50.876154 3135511 test_utils.cc:89] k: 3 I20210111 18:47:50.876157 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:50.876158 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (847 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:47:51.723848 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:51.723855 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:47:51.723856 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:51.723858 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:47:51.723865 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:47:51.723868 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:47:51.723870 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:47:51.723873 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:47:51.723875 3135511 test_utils.cc:89] k: 3 I20210111 18:47:51.723877 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:47:51.723879 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2770 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:47:54.493913 3135511 test_utils.cc:82] Testing parameters: I20210111 18:47:54.493921 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:47:54.493923 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:47:54.493925 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:47:54.493932 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:47:54.493937 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:47:54.493938 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:47:54.493942 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:47:54.493943 3135511 test_utils.cc:89] k: 3 I20210111 18:47:54.493945 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:47:54.493947 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11365 ms) [----------] 19 tests from ClassificationModelCpuTest (61212 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162418 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 5) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:05.858690 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:05.858697 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:05.858700 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:05.858701 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:05.858708 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:05.858711 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:05.858712 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:05.858714 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:48:05.858717 3135511 test_utils.cc:89] k: 3 I20210111 18:48:05.858719 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:05.858721 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:48:08.564957 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:08.564973 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:48:08.564980 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:08.564986 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:08.565001 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:08.565007 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:08.565014 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:08.565021 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:48:08.565028 3135511 test_utils.cc:89] k: 3 I20210111 18:48:08.565034 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:08.565040 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2714 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:11.278447 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:11.278465 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:11.278470 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:11.278476 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:11.278491 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:11.278497 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:11.278503 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:11.278510 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:48:11.278518 3135511 test_utils.cc:89] k: 3 I20210111 18:48:11.278524 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:11.278530 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2937 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:14.215466 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:14.215483 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:14.215490 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:14.215495 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:14.215509 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:14.215517 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:14.215523 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:14.215529 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:48:14.215538 3135511 test_utils.cc:89] k: 3 I20210111 18:48:14.215544 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:48:14.215549 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2767 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:48:16.982518 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:16.982535 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:48:16.982544 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:16.982550 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:16.982564 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:16.982570 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:16.982578 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:16.982583 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:48:16.982591 3135511 test_utils.cc:89] k: 3 I20210111 18:48:16.982597 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:48:16.982604 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2975 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:19.957989 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:19.958005 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:19.958012 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:19.958019 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:19.958032 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:19.958039 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:19.958045 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:19.958051 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:48:19.958060 3135511 test_utils.cc:89] k: 3 I20210111 18:48:19.958065 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:19.958071 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2818 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:48:22.775424 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:22.775442 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:48:22.775449 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:22.775454 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:22.775467 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:22.775475 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:22.775481 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:22.775487 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:48:22.775496 3135511 test_utils.cc:89] k: 3 I20210111 18:48:22.775501 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:22.775507 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2813 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:48:25.588697 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:25.588713 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:48:25.588721 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:25.588727 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:25.588740 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:25.588747 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:25.588753 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:25.588759 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:48:25.588768 3135511 test_utils.cc:89] k: 3 I20210111 18:48:25.588773 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:25.588779 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (3025 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:48:28.613095 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:28.613111 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:48:28.613119 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:28.613126 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:28.613139 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:28.613147 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:28.613152 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:28.613158 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:48:28.613166 3135511 test_utils.cc:89] k: 3 I20210111 18:48:28.613173 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:28.613178 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2813 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:31.426066 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:31.426082 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:31.426090 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:31.426096 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:31.426110 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:31.426117 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:31.426123 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:31.426131 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:48:31.426138 3135511 test_utils.cc:89] k: 3 I20210111 18:48:31.426144 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:48:31.426149 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:48:34.118279 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:34.118296 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:48:34.118302 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:34.118309 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:34.118322 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:34.118330 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:34.118335 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:34.118342 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:48:34.118350 3135511 test_utils.cc:89] k: 3 I20210111 18:48:34.118355 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:48:34.118361 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:48:36.813597 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:36.813613 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:48:36.813621 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:36.813627 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:36.813640 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:36.813647 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:36.813653 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:36.813660 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:48:36.813668 3135511 test_utils.cc:89] k: 3 I20210111 18:48:36.813674 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:48:36.813680 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2691 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:39.504916 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:39.504932 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:39.504938 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:39.504945 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:39.504959 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:39.504966 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:39.504972 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:39.504979 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:48:39.504987 3135511 test_utils.cc:89] k: 3 I20210111 18:48:39.504993 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:39.504999 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:48:42.213071 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:42.213088 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:48:42.213095 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:42.213102 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:42.213115 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:42.213122 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:42.213129 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:42.213135 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:48:42.213143 3135511 test_utils.cc:89] k: 3 I20210111 18:48:42.213150 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:42.213155 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:44.909266 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:44.909281 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:44.909286 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:44.909289 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:44.909301 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:44.909305 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:44.909310 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:44.909314 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:48:44.909320 3135511 test_utils.cc:89] k: 3 I20210111 18:48:44.909324 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:48:44.909328 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2704 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:48:47.613957 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:47.613974 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:48:47.613981 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:47.613986 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:47.614001 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:47.614007 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:47.614013 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:47.614020 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:48:47.614028 3135511 test_utils.cc:89] k: 3 I20210111 18:48:47.614034 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:47.614040 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:48:50.323980 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:50.323997 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:48:50.324003 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:50.324010 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:50.324023 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:50.324030 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:50.324038 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:50.324043 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:48:50.324051 3135511 test_utils.cc:89] k: 3 I20210111 18:48:50.324057 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:50.324064 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:48:53.032943 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:53.032960 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:48:53.032966 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:53.032972 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:53.032986 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:53.032994 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:53.032999 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:53.033006 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:48:53.033015 3135511 test_utils.cc:89] k: 3 I20210111 18:48:53.033020 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:53.033026 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:48:55.742799 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:55.742815 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:48:55.742820 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:55.742830 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:55.742842 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:55.742849 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:55.742856 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:55.742862 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:48:55.742871 3135511 test_utils.cc:89] k: 3 I20210111 18:48:55.742877 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:48:55.742882 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:48:58.452469 3135511 test_utils.cc:82] Testing parameters: I20210111 18:48:58.452486 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:48:58.452492 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:48:58.452502 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:48:58.452515 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:58.452522 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:58.452529 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:48:58.452535 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:48:58.452543 3135511 test_utils.cc:89] k: 3 I20210111 18:48:58.452549 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:48:58.452555 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2693 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:49:01.145115 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:01.145133 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:49:01.145138 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:01.145144 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:01.145169 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:01.145174 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:01.145179 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:01.145182 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:49:01.145188 3135511 test_utils.cc:89] k: 3 I20210111 18:49:01.145192 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:01.145195 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2697 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:49:03.842411 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:03.842432 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:49:03.842439 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:03.842444 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:03.842463 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:03.842469 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:03.842476 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:03.842483 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:49:03.842491 3135511 test_utils.cc:89] k: 3 I20210111 18:49:03.842497 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:49:03.842504 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:49:06.551970 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:06.551990 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:49:06.551997 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:06.552003 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:06.552018 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:06.552024 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:06.552031 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:06.552037 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:49:06.552047 3135511 test_utils.cc:89] k: 3 I20210111 18:49:06.552052 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:06.552057 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:49:09.264742 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:09.264760 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:49:09.264766 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:09.264772 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:09.264786 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:09.264793 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:09.264799 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:09.264806 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:49:09.264814 3135511 test_utils.cc:89] k: 3 I20210111 18:49:09.264820 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:49:09.264827 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2722 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:49:11.986829 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:11.986851 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:49:11.986857 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:11.986863 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:11.986878 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:11.986886 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:11.986891 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:11.986898 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:49:11.986907 3135511 test_utils.cc:89] k: 3 I20210111 18:49:11.986912 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:11.986918 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2732 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:49:14.718066 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:14.718083 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:49:14.718089 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:14.718096 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:14.718109 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:14.718116 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:14.718123 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:14.718129 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:49:14.718138 3135511 test_utils.cc:89] k: 3 I20210111 18:49:14.718143 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:49:14.718149 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2768 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:49:17.486375 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:17.486392 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:49:17.486397 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:17.486404 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:17.486418 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:17.486424 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:17.486431 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:17.486438 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:49:17.486445 3135511 test_utils.cc:89] k: 3 I20210111 18:49:17.486451 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:17.486457 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2818 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:49:20.304443 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:20.304461 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:49:20.304467 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:49:20.304472 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:20.304486 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:20.304493 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:20.304500 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:20.304507 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:49:20.304514 3135511 test_utils.cc:89] k: 1 I20210111 18:49:20.304520 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:49:20.304527 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:49:23.017046 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:23.017062 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:49:23.017069 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:49:23.017077 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:23.017091 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:23.017098 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:23.017105 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:23.017112 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:49:23.017119 3135511 test_utils.cc:89] k: 1 I20210111 18:49:23.017125 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:49:23.017132 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2916 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:49:25.933238 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:25.933254 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:49:25.933260 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:49:25.933269 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:25.933282 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:25.933288 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:25.933295 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:25.933301 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:49:25.933310 3135511 test_utils.cc:89] k: 1 I20210111 18:49:25.933315 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:49:25.933321 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:49:28.643311 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:28.643326 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:49:28.643333 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:28.643339 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:49:28.643353 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:49:28.643363 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:49:28.643370 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:49:28.643378 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:49:28.643384 3135511 test_utils.cc:89] k: 3 I20210111 18:49:28.643390 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:28.643396 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2720 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:49:31.363325 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:31.363341 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:49:31.363348 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:31.363353 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:49:31.363368 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:49:31.363377 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:49:31.363384 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:49:31.363391 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:49:31.363399 3135511 test_utils.cc:89] k: 3 I20210111 18:49:31.363423 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:31.363430 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2724 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:49:34.087504 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:34.087520 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:49:34.087527 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:34.087533 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:49:34.087548 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:49:34.087558 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:49:34.087564 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:49:34.087571 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:49:34.087579 3135511 test_utils.cc:89] k: 3 I20210111 18:49:34.087584 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:34.087590 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2742 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:49:36.829151 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:36.829167 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:49:36.829174 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:36.829180 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:36.829195 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:36.829201 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:36.829208 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:36.829214 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:49:36.829222 3135511 test_utils.cc:89] k: 3 I20210111 18:49:36.829228 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:36.829233 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:49:39.536087 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:39.536100 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:49:39.536106 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:39.536111 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:39.536123 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:39.536129 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:39.536135 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:39.536140 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:49:39.536147 3135511 test_utils.cc:89] k: 3 I20210111 18:49:39.536152 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:39.536157 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:49:42.242791 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:42.242806 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:49:42.242811 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:42.242816 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:49:42.242843 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:49:42.242852 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:49:42.242859 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:49:42.242866 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:49:42.242873 3135511 test_utils.cc:89] k: 3 I20210111 18:49:42.242879 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:42.242885 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:49:44.952821 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:44.952838 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:49:44.952844 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:44.952850 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:49:44.952864 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:49:44.952874 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:49:44.952881 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:49:44.952888 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:49:44.952896 3135511 test_utils.cc:89] k: 3 I20210111 18:49:44.952901 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:49:44.952908 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2767 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101861 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:49:47.719133 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.719147 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:49:47.719154 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.719161 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.719174 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.719182 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.719187 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.719194 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:49:47.719202 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.719208 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:47.719213 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (65 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:49:47.784183 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.784189 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:49:47.784191 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.784193 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.784198 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.784200 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.784202 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.784205 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:49:47.784209 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.784210 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:49:47.784211 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:49:47.788203 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.788208 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:49:47.788210 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.788213 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.788218 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.788219 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.788223 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.788224 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:49:47.788228 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.788229 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:47.788231 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:49:47.799074 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.799079 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:49:47.799082 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.799082 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.799086 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.799089 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.799091 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.799093 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:49:47.799095 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.799098 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:49:47.799099 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:49:47.824389 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.824394 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:49:47.824396 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.824398 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.824402 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.824404 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.824406 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.824409 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:49:47.824411 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.824414 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:47.824414 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (46 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:49:47.870991 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.870995 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:49:47.870997 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.870999 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.871003 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.871006 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.871007 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.871009 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:49:47.871011 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.871013 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:49:47.871016 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:49:47.956809 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:47.956815 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:49:47.956816 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:47.956818 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:47.956823 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.956825 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.956827 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:47.956830 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:49:47.956831 3135511 test_utils.cc:89] k: 3 I20210111 18:49:47.956833 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:47.956835 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:49:48.082981 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:48.082988 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:49:48.082990 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:48.082993 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:48.082998 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:48.082999 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:48.083001 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:48.083003 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:49:48.083006 3135511 test_utils.cc:89] k: 3 I20210111 18:49:48.083009 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:49:48.083010 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (320 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:49:48.402248 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:48.402258 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:49:48.402261 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:48.402262 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:48.402269 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:48.402271 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:48.402274 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:48.402276 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:49:48.402278 3135511 test_utils.cc:89] k: 3 I20210111 18:49:48.402281 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:48.402282 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:49:49.067140 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:49.067149 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:49:49.067152 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:49:49.067153 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:49.067160 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.067162 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.067165 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.067167 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:49:49.067169 3135511 test_utils.cc:89] k: 1 I20210111 18:49:49.067171 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:49:49.067175 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:49:49.114578 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:49.114585 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:49:49.114588 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:49:49.114589 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:49.114594 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.114596 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.114598 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.114600 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:49:49.114603 3135511 test_utils.cc:89] k: 1 I20210111 18:49:49.114605 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:49:49.114607 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:49:49.160778 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:49.160784 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:49:49.160786 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:49:49.160789 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:49:49.160792 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.160794 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.160797 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:49:49.160799 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:49:49.160801 3135511 test_utils.cc:89] k: 1 I20210111 18:49:49.160804 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:49:49.160805 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:49:49.206656 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:49.206662 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:49:49.206665 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:49.206666 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:49:49.206671 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:49:49.206674 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:49:49.206676 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:49:49.206679 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:49:49.206681 3135511 test_utils.cc:89] k: 3 I20210111 18:49:49.206683 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:49.206686 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6491 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:49:55.697958 3135511 test_utils.cc:82] Testing parameters: I20210111 18:49:55.697966 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:49:55.697968 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:49:55.697970 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:49:55.697978 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:49:55.697981 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:49:55.697983 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:49:55.697986 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:49:55.697988 3135511 test_utils.cc:89] k: 3 I20210111 18:49:55.697990 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:49:55.697993 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10107 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:50:05.804548 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:05.804555 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:50:05.804558 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:05.804559 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:50:05.804567 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:50:05.804570 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:50:05.804574 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:50:05.804575 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:50:05.804579 3135511 test_utils.cc:89] k: 3 I20210111 18:50:05.804580 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:05.804582 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26555 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:50:32.359871 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:32.359879 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:50:32.359881 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:32.359884 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:32.359891 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:32.359894 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:32.359895 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:32.359897 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:50:32.359900 3135511 test_utils.cc:89] k: 3 I20210111 18:50:32.359902 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:32.359905 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1570 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:50:33.929390 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:33.929399 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:50:33.929400 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:33.929402 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:33.929411 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:33.929414 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:33.929415 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:33.929417 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:50:33.929420 3135511 test_utils.cc:89] k: 3 I20210111 18:50:33.929422 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:33.929425 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (848 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:50:34.777197 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:34.777205 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:50:34.777207 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:34.777209 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:50:34.777215 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:50:34.777218 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:50:34.777221 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:50:34.777223 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:50:34.777226 3135511 test_utils.cc:89] k: 3 I20210111 18:50:34.777227 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:34.777230 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2769 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:50:37.546808 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:37.546816 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:50:37.546819 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:37.546821 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:50:37.546828 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:50:37.546831 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:50:37.546834 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:50:37.546836 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:50:37.546839 3135511 test_utils.cc:89] k: 3 I20210111 18:50:37.546840 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:50:37.546842 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11363 ms) [----------] 19 tests from ClassificationModelCpuTest (61190 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (163051 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 6) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:50:48.909746 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:48.909754 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:50:48.909757 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:48.909761 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:48.909767 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:48.909770 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:48.909772 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:48.909775 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:50:48.909777 3135511 test_utils.cc:89] k: 3 I20210111 18:50:48.909778 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:48.909780 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:50:51.616958 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:51.616976 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:50:51.616982 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:51.616987 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:51.617002 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:51.617009 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:51.617015 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:51.617022 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:50:51.617030 3135511 test_utils.cc:89] k: 3 I20210111 18:50:51.617036 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:51.617041 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2719 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:50:54.335332 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:54.335350 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:50:54.335355 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:54.335364 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:54.335378 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:54.335386 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:54.335391 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:54.335398 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:50:54.335427 3135511 test_utils.cc:89] k: 3 I20210111 18:50:54.335435 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:50:54.335443 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2732 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:50:57.067586 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:57.067603 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:50:57.067610 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:57.067618 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:57.067632 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:57.067639 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:57.067646 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:57.067652 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:50:57.067660 3135511 test_utils.cc:89] k: 3 I20210111 18:50:57.067667 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:50:57.067672 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2769 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:50:59.836696 3135511 test_utils.cc:82] Testing parameters: I20210111 18:50:59.836714 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:50:59.836721 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:50:59.836727 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:50:59.836741 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:59.836748 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:59.836755 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:50:59.836760 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:50:59.836769 3135511 test_utils.cc:89] k: 3 I20210111 18:50:59.836774 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:50:59.836781 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2763 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:51:02.600023 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:02.600041 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:51:02.600049 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:02.600054 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:02.600069 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:02.600075 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:02.600082 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:02.600088 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:51:02.600096 3135511 test_utils.cc:89] k: 3 I20210111 18:51:02.600102 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:02.600108 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2814 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:51:05.414103 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:05.414120 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:51:05.414126 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:05.414132 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:05.414146 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:05.414153 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:05.414160 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:05.414166 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:51:05.414175 3135511 test_utils.cc:89] k: 3 I20210111 18:51:05.414180 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:05.414186 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2810 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:51:08.224619 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:08.224637 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:51:08.224643 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:08.224649 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:08.224663 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:08.224669 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:08.224676 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:08.224682 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:51:08.224690 3135511 test_utils.cc:89] k: 3 I20210111 18:51:08.224696 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:08.224702 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2810 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:51:11.035043 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:11.035060 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:51:11.035066 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:11.035073 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:11.035086 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:11.035094 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:11.035100 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:11.035106 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:51:11.035115 3135511 test_utils.cc:89] k: 3 I20210111 18:51:11.035120 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:11.035126 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2814 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:51:13.850025 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:13.850042 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:51:13.850049 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:13.850055 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:13.850069 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:13.850076 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:13.850082 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:13.850090 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:51:13.850097 3135511 test_utils.cc:89] k: 3 I20210111 18:51:13.850103 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:51:13.850109 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:51:16.542069 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:16.542084 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:51:16.542091 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:16.542099 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:16.542112 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:16.542119 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:16.542125 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:16.542132 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:51:16.542140 3135511 test_utils.cc:89] k: 3 I20210111 18:51:16.542146 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:51:16.542151 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:51:19.237790 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:19.237807 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:51:19.237814 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:19.237820 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:19.237833 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:19.237841 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:19.237848 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:19.237854 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:51:19.237862 3135511 test_utils.cc:89] k: 3 I20210111 18:51:19.237869 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:51:19.237874 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:51:21.933609 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:21.933624 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:51:21.933631 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:21.933636 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:21.933650 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:21.933657 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:21.933663 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:21.933670 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:51:21.933678 3135511 test_utils.cc:89] k: 3 I20210111 18:51:21.933684 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:21.933691 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2700 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:51:24.633316 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:24.633332 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:51:24.633339 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:24.633345 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:24.633359 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:24.633365 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:24.633373 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:24.633378 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:51:24.633386 3135511 test_utils.cc:89] k: 3 I20210111 18:51:24.633392 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:24.633399 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:51:27.328809 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:27.328821 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:51:27.328825 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:27.328830 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:27.328840 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:27.328845 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:27.328850 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:27.328853 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:51:27.328858 3135511 test_utils.cc:89] k: 3 I20210111 18:51:27.328862 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:51:27.328866 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:51:30.034862 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:30.034876 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:51:30.034883 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:30.034888 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:30.034901 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:30.034907 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:30.034914 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:30.034919 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:51:30.034925 3135511 test_utils.cc:89] k: 3 I20210111 18:51:30.034930 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:30.034935 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:51:32.745018 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:32.745033 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:51:32.745039 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:32.745045 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:32.745060 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:32.745067 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:32.745074 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:32.745079 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:51:32.745088 3135511 test_utils.cc:89] k: 3 I20210111 18:51:32.745093 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:32.745100 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2715 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:51:35.459393 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:35.459427 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:51:35.459434 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:35.459440 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:35.459455 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:35.459462 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:35.459468 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:35.459475 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:51:35.459483 3135511 test_utils.cc:89] k: 3 I20210111 18:51:35.459489 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:35.459496 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:51:38.167470 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:38.167486 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:51:38.167492 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:38.167497 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:38.167510 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:38.167517 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:38.167523 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:38.167529 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:51:38.167537 3135511 test_utils.cc:89] k: 3 I20210111 18:51:38.167542 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:38.167548 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:51:40.878643 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:40.878659 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:51:40.878665 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:40.878670 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:40.878684 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:40.878691 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:40.878698 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:40.878705 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:51:40.878712 3135511 test_utils.cc:89] k: 3 I20210111 18:51:40.878718 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:51:40.878724 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:51:43.573508 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:43.573523 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:51:43.573529 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:43.573534 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:43.573547 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:43.573554 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:43.573559 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:43.573565 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:51:43.573573 3135511 test_utils.cc:89] k: 3 I20210111 18:51:43.573580 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:43.573585 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2700 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:51:46.274030 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:46.274046 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:51:46.274052 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:46.274058 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:46.274072 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:46.274080 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:46.274085 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:46.274091 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:51:46.274101 3135511 test_utils.cc:89] k: 3 I20210111 18:51:46.274106 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:51:46.274111 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2703 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:51:48.977322 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:48.977339 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:51:48.977345 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:48.977351 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:48.977365 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:48.977371 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:48.977378 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:48.977385 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:51:48.977392 3135511 test_utils.cc:89] k: 3 I20210111 18:51:48.977398 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:48.977404 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:51:51.688807 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:51.688824 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:51:51.688830 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:51.688835 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:51.688848 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:51.688855 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:51.688861 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:51.688866 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:51:51.688874 3135511 test_utils.cc:89] k: 3 I20210111 18:51:51.688879 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:51:51.688885 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2719 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:51:54.407132 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:54.407150 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:51:54.407155 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:54.407161 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:54.407176 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:54.407182 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:54.407189 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:54.407196 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:51:54.407203 3135511 test_utils.cc:89] k: 3 I20210111 18:51:54.407209 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:54.407215 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2730 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:51:57.137548 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:57.137564 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:51:57.137571 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:57.137578 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:57.137591 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:57.137598 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:57.137604 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:57.137610 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:51:57.137619 3135511 test_utils.cc:89] k: 3 I20210111 18:51:57.137624 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:51:57.137630 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2764 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:51:59.901912 3135511 test_utils.cc:82] Testing parameters: I20210111 18:51:59.901928 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:51:59.901934 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:51:59.901940 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:51:59.901955 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:59.901962 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:59.901968 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:51:59.901974 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:51:59.901983 3135511 test_utils.cc:89] k: 3 I20210111 18:51:59.901988 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:51:59.901994 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2817 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:52:02.718638 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:02.718657 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:52:02.718662 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:52:02.718668 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:02.718683 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:02.718689 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:02.718696 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:02.718703 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:52:02.718711 3135511 test_utils.cc:89] k: 1 I20210111 18:52:02.718717 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:52:02.718722 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:52:05.425899 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:05.425915 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:52:05.425922 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:52:05.425928 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:05.425942 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:05.425949 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:05.425956 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:05.425962 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:52:05.425971 3135511 test_utils.cc:89] k: 1 I20210111 18:52:05.425976 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:52:05.425982 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:52:08.136878 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:08.136894 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:52:08.136900 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:52:08.136909 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:08.136924 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:08.136930 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:08.136936 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:08.136943 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:52:08.136951 3135511 test_utils.cc:89] k: 1 I20210111 18:52:08.136957 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:52:08.136963 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:52:10.847247 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:10.847263 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:52:10.847270 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:10.847275 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:52:10.847290 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:52:10.847299 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:52:10.847306 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:52:10.847314 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:52:10.847321 3135511 test_utils.cc:89] k: 3 I20210111 18:52:10.847327 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:10.847333 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2726 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:52:13.573359 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:13.573375 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:52:13.573382 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:13.573388 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:52:13.573401 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:52:13.573411 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:52:13.573419 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:52:13.573426 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:52:13.573434 3135511 test_utils.cc:89] k: 3 I20210111 18:52:13.573439 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:13.573446 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2722 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:52:16.295702 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:16.295717 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:52:16.295724 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:16.295730 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:52:16.295745 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:52:16.295754 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:52:16.295761 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:52:16.295768 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:52:16.295776 3135511 test_utils.cc:89] k: 3 I20210111 18:52:16.295783 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:16.295787 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2740 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:52:19.035174 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:19.035192 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:52:19.035197 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:19.035204 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:19.035218 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:19.035225 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:19.035231 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:19.035238 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:52:19.035246 3135511 test_utils.cc:89] k: 3 I20210111 18:52:19.035251 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:19.035257 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:52:21.746125 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:21.746141 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:52:21.746147 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:21.746153 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:21.746167 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:21.746174 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:21.746181 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:21.746187 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:52:21.746196 3135511 test_utils.cc:89] k: 3 I20210111 18:52:21.746201 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:21.746207 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:52:24.455876 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:24.455893 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:52:24.455899 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:24.455904 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:52:24.455919 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:52:24.455929 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:52:24.455935 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:52:24.455942 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:52:24.455950 3135511 test_utils.cc:89] k: 3 I20210111 18:52:24.455956 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:24.455961 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:52:27.167498 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:27.167512 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:52:27.167517 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:27.167522 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:52:27.167534 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:52:27.167542 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:52:27.167548 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:52:27.167553 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:52:27.167559 3135511 test_utils.cc:89] k: 3 I20210111 18:52:27.167564 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:52:27.167569 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2762 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101021 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:52:29.930073 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:29.930090 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:52:29.930096 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:29.930104 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:29.930117 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:29.930124 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:29.930130 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:29.930137 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:52:29.930146 3135511 test_utils.cc:89] k: 3 I20210111 18:52:29.930152 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:29.930157 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (69 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:52:29.999338 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:29.999346 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:52:29.999347 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:29.999349 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:29.999354 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:29.999356 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:29.999359 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:29.999361 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:52:29.999363 3135511 test_utils.cc:89] k: 3 I20210111 18:52:29.999366 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:52:29.999367 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:52:30.003413 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.003418 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:52:30.003420 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.003422 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.003427 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.003428 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.003432 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.003433 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:52:30.003435 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.003437 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:30.003439 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:52:30.014290 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.014294 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:52:30.014297 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.014298 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.014303 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.014305 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.014307 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.014309 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:52:30.014312 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.014314 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:52:30.014317 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:52:30.039508 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.039513 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:52:30.039515 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.039517 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.039521 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.039523 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.039525 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.039527 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:52:30.039530 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.039532 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:30.039535 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (47 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:52:30.086144 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.086149 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:52:30.086151 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.086153 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.086158 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.086159 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.086161 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.086163 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:52:30.086166 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.086169 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:52:30.086169 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (85 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:52:30.171658 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.171663 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:52:30.171665 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.171667 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.171672 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.171674 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.171676 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.171679 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:52:30.171681 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.171684 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:30.171685 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:52:30.297689 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.297695 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:52:30.297698 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.297700 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.297704 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.297708 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.297709 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.297711 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:52:30.297713 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.297715 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:52:30.297717 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (319 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:52:30.616850 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:30.616859 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:52:30.616861 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:30.616863 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:30.616871 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.616873 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.616875 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:30.616878 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:52:30.616880 3135511 test_utils.cc:89] k: 3 I20210111 18:52:30.616883 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:30.616884 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:52:31.281329 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:31.281337 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:52:31.281339 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:52:31.281342 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:31.281348 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.281350 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.281352 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.281354 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:52:31.281358 3135511 test_utils.cc:89] k: 1 I20210111 18:52:31.281359 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:52:31.281361 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:52:31.328856 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:31.328863 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:52:31.328866 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:52:31.328867 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:31.328872 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.328876 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.328877 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.328879 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:52:31.328881 3135511 test_utils.cc:89] k: 1 I20210111 18:52:31.328883 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:52:31.328886 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:52:31.374882 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:31.374888 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:52:31.374891 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:52:31.374892 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:52:31.374897 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.374899 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.374902 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:52:31.374903 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:52:31.374907 3135511 test_utils.cc:89] k: 1 I20210111 18:52:31.374908 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:52:31.374909 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:52:31.420542 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:31.420547 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:52:31.420548 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:31.420550 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:52:31.420554 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:52:31.420557 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:52:31.420560 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:52:31.420562 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:52:31.420565 3135511 test_utils.cc:89] k: 3 I20210111 18:52:31.420567 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:31.420568 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6491 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:52:37.911664 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:37.911671 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:52:37.911674 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:37.911675 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:52:37.911684 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:52:37.911686 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:52:37.911689 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:52:37.911691 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:52:37.911693 3135511 test_utils.cc:89] k: 3 I20210111 18:52:37.911695 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:37.911697 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10106 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:52:48.017657 3135511 test_utils.cc:82] Testing parameters: I20210111 18:52:48.017664 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:52:48.017668 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:52:48.017669 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:52:48.017675 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:52:48.017679 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:52:48.017681 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:52:48.017684 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:52:48.017686 3135511 test_utils.cc:89] k: 3 I20210111 18:52:48.017688 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:52:48.017690 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26561 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:53:14.578330 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:14.578337 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:53:14.578339 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:14.578341 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:14.578349 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:14.578351 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:14.578353 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:14.578356 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:53:14.578358 3135511 test_utils.cc:89] k: 3 I20210111 18:53:14.578361 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:14.578362 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1569 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:53:16.147130 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:16.147138 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:53:16.147140 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:16.147142 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:16.147150 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:16.147152 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:16.147154 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:16.147156 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:53:16.147159 3135511 test_utils.cc:89] k: 3 I20210111 18:53:16.147161 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:16.147163 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (847 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:53:16.994524 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:16.994532 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:53:16.994534 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:16.994536 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:53:16.994542 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:53:16.994546 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:53:16.994549 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:53:16.994551 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:53:16.994554 3135511 test_utils.cc:89] k: 3 I20210111 18:53:16.994555 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:16.994557 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2770 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:53:19.764083 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:19.764091 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:53:19.764093 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:19.764096 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:53:19.764102 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:53:19.764106 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:53:19.764108 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:53:19.764111 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:53:19.764113 3135511 test_utils.cc:89] k: 3 I20210111 18:53:19.764115 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:53:19.764117 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11361 ms) [----------] 19 tests from ClassificationModelCpuTest (61195 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162216 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 7) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:53:31.125471 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:31.125479 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:53:31.125483 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:31.125484 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:31.125491 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:31.125494 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:31.125495 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:31.125499 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:53:31.125500 3135511 test_utils.cc:89] k: 3 I20210111 18:53:31.125502 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:31.125504 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:53:33.831812 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:33.831828 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:53:33.831835 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:33.831840 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:33.831854 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:33.831861 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:33.831867 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:33.831874 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:53:33.831882 3135511 test_utils.cc:89] k: 3 I20210111 18:53:33.831887 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:33.831893 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2717 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:53:36.548221 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:36.548238 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:53:36.548243 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:36.548249 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:36.548262 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:36.548269 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:36.548275 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:36.548282 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:53:36.548290 3135511 test_utils.cc:89] k: 3 I20210111 18:53:36.548296 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:36.548302 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2726 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:53:39.274731 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:39.274749 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:53:39.274755 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:39.274761 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:39.274775 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:39.274785 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:39.274791 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:39.274797 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:53:39.274806 3135511 test_utils.cc:89] k: 3 I20210111 18:53:39.274811 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:53:39.274817 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2762 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:53:42.036592 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:42.036608 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:53:42.036614 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:42.036621 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:42.036634 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:42.036641 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:42.036648 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:42.036653 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:53:42.036662 3135511 test_utils.cc:89] k: 3 I20210111 18:53:42.036669 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:53:42.036674 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2765 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:53:44.801167 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:44.801183 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:53:44.801189 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:44.801198 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:44.801211 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:44.801218 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:44.801224 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:44.801230 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:53:44.801239 3135511 test_utils.cc:89] k: 3 I20210111 18:53:44.801244 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:44.801250 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2811 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:53:47.613003 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:47.613018 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:53:47.613025 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:47.613031 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:47.613045 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:47.613052 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:47.613059 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:47.613065 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:53:47.613072 3135511 test_utils.cc:89] k: 3 I20210111 18:53:47.613078 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:47.613083 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2815 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:53:50.427649 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:50.427665 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:53:50.427671 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:50.427677 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:50.427690 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:50.427697 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:50.427704 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:50.427711 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:53:50.427718 3135511 test_utils.cc:89] k: 3 I20210111 18:53:50.427723 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:50.427729 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2815 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:53:53.242815 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:53.242830 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:53:53.242837 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:53.242844 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:53.242857 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:53.242864 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:53.242871 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:53.242877 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:53:53.242885 3135511 test_utils.cc:89] k: 3 I20210111 18:53:53.242892 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:53:53.242897 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2813 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:53:56.055871 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:56.055887 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:53:56.055893 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:56.055899 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:56.055913 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:56.055919 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:56.055927 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:56.055932 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:53:56.055940 3135511 test_utils.cc:89] k: 3 I20210111 18:53:56.055946 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:53:56.055953 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:53:58.749672 3135511 test_utils.cc:82] Testing parameters: I20210111 18:53:58.749689 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:53:58.749696 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:53:58.749702 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:53:58.749716 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:58.749722 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:58.749728 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:53:58.749734 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:53:58.749743 3135511 test_utils.cc:89] k: 3 I20210111 18:53:58.749749 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:53:58.749754 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2699 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:54:01.449045 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:01.449062 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:54:01.449069 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:01.449074 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:01.449087 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:01.449095 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:01.449100 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:01.449107 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:54:01.449115 3135511 test_utils.cc:89] k: 3 I20210111 18:54:01.449121 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:54:01.449127 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2692 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:54:04.141945 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:04.141963 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:54:04.141968 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:04.141974 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:04.141988 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:04.141995 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:04.142001 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:04.142007 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:54:04.142016 3135511 test_utils.cc:89] k: 3 I20210111 18:54:04.142022 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:04.142027 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:54:06.842265 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:06.842281 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:54:06.842288 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:06.842293 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:06.842306 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:06.842314 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:06.842320 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:06.842326 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:54:06.842335 3135511 test_utils.cc:89] k: 3 I20210111 18:54:06.842341 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:06.842346 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2698 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:54:09.540779 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:09.540792 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:54:09.540796 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:09.540800 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:09.540810 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:09.540815 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:09.540819 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:09.540823 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:54:09.540829 3135511 test_utils.cc:89] k: 3 I20210111 18:54:09.540832 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:54:09.540836 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:54:12.241112 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:12.241129 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:54:12.241135 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:12.241142 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:12.241155 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:12.241163 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:12.241168 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:12.241175 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:54:12.241183 3135511 test_utils.cc:89] k: 3 I20210111 18:54:12.241189 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:12.241195 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:54:14.952258 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:14.952275 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:54:14.952281 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:14.952287 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:14.952301 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:14.952308 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:14.952316 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:14.952322 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:54:14.952329 3135511 test_utils.cc:89] k: 3 I20210111 18:54:14.952335 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:14.952342 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:54:17.660887 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:17.660903 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:54:17.660909 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:17.660915 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:17.660930 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:17.660938 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:17.660943 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:17.660950 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:54:17.660959 3135511 test_utils.cc:89] k: 3 I20210111 18:54:17.660964 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:17.660970 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:54:20.370343 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:20.370357 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:54:20.370362 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:20.370368 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:20.370380 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:20.370386 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:20.370391 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:20.370398 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:54:20.370404 3135511 test_utils.cc:89] k: 3 I20210111 18:54:20.370409 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:20.370414 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:54:23.078992 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:23.079008 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:54:23.079015 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:23.079021 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:23.079036 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:23.079043 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:23.079049 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:23.079056 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:54:23.079064 3135511 test_utils.cc:89] k: 3 I20210111 18:54:23.079071 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:54:23.079077 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:54:25.773736 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:25.773752 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:54:25.773758 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:25.773767 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:25.773780 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:25.773787 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:25.773793 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:25.773799 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:54:25.773808 3135511 test_utils.cc:89] k: 3 I20210111 18:54:25.773814 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:25.773820 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:54:28.469211 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:28.469223 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:54:28.469228 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:28.469230 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:28.469240 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:28.469244 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:28.469250 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:28.469254 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:54:28.469260 3135511 test_utils.cc:89] k: 3 I20210111 18:54:28.469264 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:54:28.469267 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2700 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:54:31.169093 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:31.169108 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:54:31.169114 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:31.169119 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:31.169131 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:31.169137 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:31.169143 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:31.169148 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:54:31.169157 3135511 test_utils.cc:89] k: 3 I20210111 18:54:31.169162 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:31.169165 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:54:33.879173 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:33.879194 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:54:33.879202 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:33.879210 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:33.879228 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:33.879238 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:33.879246 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:33.879254 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:54:33.879261 3135511 test_utils.cc:89] k: 3 I20210111 18:54:33.879266 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:54:33.879272 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2716 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:54:36.595232 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:36.595248 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:54:36.595254 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:36.595260 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:36.595273 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:36.595280 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:36.595286 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:36.595293 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:54:36.595302 3135511 test_utils.cc:89] k: 3 I20210111 18:54:36.595307 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:36.595314 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2730 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:54:39.325130 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:39.325146 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:54:39.325152 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:39.325160 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:39.325174 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:39.325181 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:39.325187 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:39.325194 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:54:39.325201 3135511 test_utils.cc:89] k: 3 I20210111 18:54:39.325207 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:54:39.325213 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2762 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:54:42.088013 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:42.088029 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:54:42.088037 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:42.088042 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:42.088055 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:42.088063 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:42.088069 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:42.088075 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:54:42.088084 3135511 test_utils.cc:89] k: 3 I20210111 18:54:42.088089 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:42.088095 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2815 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:54:44.902725 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:44.902741 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:54:44.902747 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:54:44.902753 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:44.902770 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:44.902776 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:44.902782 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:44.902789 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:54:44.902797 3135511 test_utils.cc:89] k: 1 I20210111 18:54:44.902802 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:54:44.902808 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:54:47.615092 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:47.615108 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:54:47.615114 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:54:47.615123 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:47.615135 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:47.615142 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:47.615149 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:47.615155 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:54:47.615164 3135511 test_utils.cc:89] k: 1 I20210111 18:54:47.615170 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:54:47.615175 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:54:50.327114 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:50.327129 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:54:50.327136 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:54:50.327142 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:54:50.327157 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:50.327162 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:50.327169 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:54:50.327175 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:54:50.327183 3135511 test_utils.cc:89] k: 1 I20210111 18:54:50.327189 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:54:50.327194 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:54:53.037531 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:53.037547 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:54:53.037554 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:53.037559 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:54:53.037575 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:54:53.037585 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:54:53.037591 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:54:53.037598 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:54:53.037606 3135511 test_utils.cc:89] k: 3 I20210111 18:54:53.037611 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:53.037617 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2720 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:54:55.757825 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:55.757841 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:54:55.757848 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:55.757855 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:54:55.757869 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:54:55.757879 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:54:55.757885 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:54:55.757894 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:54:55.757900 3135511 test_utils.cc:89] k: 3 I20210111 18:54:55.757906 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:55.757912 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2725 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:54:58.482352 3135511 test_utils.cc:82] Testing parameters: I20210111 18:54:58.482369 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:54:58.482375 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:54:58.482383 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:54:58.482398 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:54:58.482406 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:54:58.482414 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:54:58.482420 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:54:58.482429 3135511 test_utils.cc:89] k: 3 I20210111 18:54:58.482434 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:54:58.482440 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2742 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:55:01.224704 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:01.224720 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:55:01.224726 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:01.224735 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:01.224748 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:01.224756 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:01.224762 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:01.224768 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:55:01.224776 3135511 test_utils.cc:89] k: 3 I20210111 18:55:01.224782 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:01.224788 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:55:03.931783 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:03.931800 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:55:03.931807 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:03.931813 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:03.931825 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:03.931833 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:03.931839 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:03.931845 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:55:03.931854 3135511 test_utils.cc:89] k: 3 I20210111 18:55:03.931859 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:03.931865 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:55:06.638797 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:06.638813 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:55:06.638819 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:06.638828 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:55:06.638842 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:55:06.638851 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:55:06.638859 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:55:06.638866 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:55:06.638873 3135511 test_utils.cc:89] k: 3 I20210111 18:55:06.638880 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:06.638885 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:55:09.349861 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:09.349877 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:55:09.349884 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:09.349892 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:55:09.349905 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:55:09.349915 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:55:09.349922 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:55:09.349931 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:55:09.349937 3135511 test_utils.cc:89] k: 3 I20210111 18:55:09.349943 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:55:09.349949 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2765 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (100990 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:55:12.115049 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.115065 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:55:12.115072 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.115077 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.115092 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.115099 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.115105 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.115113 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:55:12.115120 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.115126 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:12.115132 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (65 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:55:12.180109 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.180115 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:55:12.180117 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.180119 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.180125 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.180128 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.180130 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.180132 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:55:12.180135 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.180137 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:55:12.180140 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:55:12.184163 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.184168 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:55:12.184170 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.184172 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.184177 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.184180 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.184181 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.184183 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:55:12.184186 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.184188 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:12.184190 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:55:12.195127 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.195132 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:55:12.195133 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.195135 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.195139 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.195142 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.195144 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.195147 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:55:12.195148 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.195150 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:55:12.195152 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:55:12.220435 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.220440 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:55:12.220443 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.220444 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.220448 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.220451 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.220453 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.220455 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:55:12.220458 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.220459 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:12.220461 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (47 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:55:12.267168 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.267171 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:55:12.267174 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.267175 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.267179 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.267181 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.267184 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.267186 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:55:12.267189 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.267190 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:55:12.267192 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:55:12.353061 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.353067 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:55:12.353070 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.353071 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.353076 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.353080 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.353081 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.353083 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:55:12.353085 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.353087 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:12.353089 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:55:12.479524 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.479530 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:55:12.479532 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.479534 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.479540 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.479542 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.479544 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.479547 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:55:12.479549 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.479550 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:55:12.479552 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (320 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:55:12.799062 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:12.799072 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:55:12.799073 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:12.799075 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:12.799083 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.799085 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.799088 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:12.799089 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:55:12.799093 3135511 test_utils.cc:89] k: 3 I20210111 18:55:12.799094 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:12.799098 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (664 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:55:13.463922 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:13.463930 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:55:13.463933 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:55:13.463935 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:13.463943 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.463945 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.463948 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.463949 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:55:13.463953 3135511 test_utils.cc:89] k: 1 I20210111 18:55:13.463953 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:55:13.463955 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (48 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:55:13.511384 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:13.511389 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:55:13.511391 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:55:13.511394 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:13.511399 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.511406 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.511409 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.511410 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:55:13.511413 3135511 test_utils.cc:89] k: 1 I20210111 18:55:13.511415 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:55:13.511417 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:55:13.557884 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:13.557890 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:55:13.557893 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:55:13.557894 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:13.557899 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.557901 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.557904 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:13.557905 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:55:13.557909 3135511 test_utils.cc:89] k: 1 I20210111 18:55:13.557910 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:55:13.557912 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (47 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:55:13.604483 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:13.604488 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:55:13.604490 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:13.604492 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:55:13.604497 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:55:13.604501 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:55:13.604502 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:55:13.604506 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:55:13.604507 3135511 test_utils.cc:89] k: 3 I20210111 18:55:13.604509 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:13.604511 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6497 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:55:20.101919 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:20.101927 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:55:20.101929 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:20.101931 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:55:20.101938 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:55:20.101941 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:55:20.101943 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:55:20.101946 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:55:20.101948 3135511 test_utils.cc:89] k: 3 I20210111 18:55:20.101950 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:20.101953 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10108 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:55:30.209589 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:30.209597 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:55:30.209600 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:30.209602 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:55:30.209609 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:55:30.209612 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:55:30.209615 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:55:30.209617 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:55:30.209620 3135511 test_utils.cc:89] k: 3 I20210111 18:55:30.209622 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:30.209625 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26553 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:55:56.763020 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:56.763029 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:55:56.763031 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:56.763033 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:56.763039 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:56.763042 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:56.763044 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:56.763046 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:55:56.763049 3135511 test_utils.cc:89] k: 3 I20210111 18:55:56.763051 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:56.763053 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1568 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:55:58.331117 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:58.331125 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:55:58.331127 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:58.331130 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:55:58.331136 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:58.331140 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:58.331141 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:55:58.331143 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:55:58.331146 3135511 test_utils.cc:89] k: 3 I20210111 18:55:58.331147 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:58.331149 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (847 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:55:59.178583 3135511 test_utils.cc:82] Testing parameters: I20210111 18:55:59.178591 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:55:59.178594 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:55:59.178596 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:55:59.178603 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:55:59.178606 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:55:59.178608 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:55:59.178611 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:55:59.178613 3135511 test_utils.cc:89] k: 3 I20210111 18:55:59.178615 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:55:59.178617 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2770 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:56:01.948457 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:01.948465 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:56:01.948467 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:01.948469 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:56:01.948477 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:56:01.948480 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:56:01.948482 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:56:01.948485 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:56:01.948487 3135511 test_utils.cc:89] k: 3 I20210111 18:56:01.948489 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:56:01.948491 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11361 ms) [----------] 19 tests from ClassificationModelCpuTest (61194 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162184 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 8) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:13.309517 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:13.309525 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:13.309527 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:13.309528 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:13.309536 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:13.309538 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:13.309540 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:13.309542 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:56:13.309545 3135511 test_utils.cc:89] k: 3 I20210111 18:56:13.309547 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:13.309549 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:56:16.015996 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:16.016013 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:56:16.016021 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:16.016026 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:16.016041 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:16.016047 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:16.016053 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:16.016060 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:56:16.016068 3135511 test_utils.cc:89] k: 3 I20210111 18:56:16.016074 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:16.016079 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2721 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:18.736809 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:18.736826 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:18.736832 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:18.736838 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:18.736852 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:18.736860 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:18.736865 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:18.736872 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:56:18.736881 3135511 test_utils.cc:89] k: 3 I20210111 18:56:18.736886 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:18.736892 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2733 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:21.469192 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:21.469208 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:21.469214 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:21.469223 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:21.469238 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:21.469244 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:21.469250 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:21.469256 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:56:21.469264 3135511 test_utils.cc:89] k: 3 I20210111 18:56:21.469270 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:56:21.469276 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2772 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:56:24.241782 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:24.241799 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:56:24.241806 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:24.241811 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:24.241827 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:24.241833 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:24.241839 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:24.241847 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:56:24.241854 3135511 test_utils.cc:89] k: 3 I20210111 18:56:24.241860 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:56:24.241866 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2766 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:27.007140 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:27.007158 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:27.007164 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:27.007170 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:27.007184 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:27.007191 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:27.007198 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:27.007205 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:56:27.007212 3135511 test_utils.cc:89] k: 3 I20210111 18:56:27.007218 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:27.007223 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2829 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:56:29.836855 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:29.836872 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:56:29.836879 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:29.836885 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:29.836899 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:29.836906 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:29.836913 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:29.836920 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:56:29.836927 3135511 test_utils.cc:89] k: 3 I20210111 18:56:29.836933 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:29.836939 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2824 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:56:32.660622 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:32.660640 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:56:32.660646 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:32.660651 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:32.660665 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:32.660671 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:32.660678 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:32.660684 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:56:32.660692 3135511 test_utils.cc:89] k: 3 I20210111 18:56:32.660698 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:32.660704 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (3033 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:56:35.693744 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:35.693760 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:56:35.693768 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:35.693773 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:35.693787 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:35.693794 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:35.693800 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:35.693806 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:56:35.693814 3135511 test_utils.cc:89] k: 3 I20210111 18:56:35.693820 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:35.693825 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2824 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:38.517395 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:38.517411 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:38.517419 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:38.517424 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:38.517438 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:38.517446 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:38.517452 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:38.517458 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:56:38.517467 3135511 test_utils.cc:89] k: 3 I20210111 18:56:38.517472 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:56:38.517477 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2693 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:56:41.210707 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:41.210723 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:56:41.210731 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:41.210736 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:41.210750 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:41.210757 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:41.210763 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:41.210769 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:56:41.210778 3135511 test_utils.cc:89] k: 3 I20210111 18:56:41.210784 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:56:41.210790 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:56:43.906561 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:43.906577 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:56:43.906584 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:43.906590 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:43.906603 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:43.906610 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:43.906617 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:43.906623 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:56:43.906631 3135511 test_utils.cc:89] k: 3 I20210111 18:56:43.906637 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:56:43.906643 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:46.601172 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:46.601186 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:46.601191 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:46.601195 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:46.601207 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:46.601212 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:46.601217 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:46.601222 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:56:46.601228 3135511 test_utils.cc:89] k: 3 I20210111 18:56:46.601233 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:46.601238 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:56:49.297084 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:49.297097 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:56:49.297102 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:49.297106 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:49.297116 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:49.297122 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:49.297125 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:49.297130 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:56:49.297137 3135511 test_utils.cc:89] k: 3 I20210111 18:56:49.297140 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:49.297143 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:51.998260 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:51.998276 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:51.998282 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:51.998288 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:51.998301 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:51.998308 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:51.998315 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:51.998322 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:56:51.998329 3135511 test_utils.cc:89] k: 3 I20210111 18:56:51.998335 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:56:51.998342 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2912 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:56:54.910750 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:54.910766 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:56:54.910773 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:54.910778 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:54.910791 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:54.910799 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:54.910804 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:54.910811 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:56:54.910820 3135511 test_utils.cc:89] k: 3 I20210111 18:56:54.910825 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:54.910831 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:56:57.619604 3135511 test_utils.cc:82] Testing parameters: I20210111 18:56:57.619621 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:56:57.619628 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:56:57.619634 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:56:57.619647 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:57.619654 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:57.619661 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:56:57.619668 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:56:57.619676 3135511 test_utils.cc:89] k: 3 I20210111 18:56:57.619683 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:56:57.619688 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:57:00.332880 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:00.332895 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:57:00.332901 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:00.332907 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:00.332919 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:00.332926 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:00.332932 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:00.332937 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:57:00.332947 3135511 test_utils.cc:89] k: 3 I20210111 18:57:00.332952 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:00.332957 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:57:03.038918 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:03.038935 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:57:03.038941 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:03.038947 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:03.038962 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:03.038969 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:03.038975 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:03.038982 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:57:03.038990 3135511 test_utils.cc:89] k: 3 I20210111 18:57:03.038996 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:03.039002 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:57:05.747159 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:05.747176 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:57:05.747184 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:05.747189 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:05.747203 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:05.747210 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:05.747216 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:05.747223 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:57:05.747231 3135511 test_utils.cc:89] k: 3 I20210111 18:57:05.747237 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:57:05.747243 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:57:08.441843 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:08.441859 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:57:08.441866 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:08.441872 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:08.441885 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:08.441892 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:08.441898 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:08.441905 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:57:08.441915 3135511 test_utils.cc:89] k: 3 I20210111 18:57:08.441920 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:08.441926 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:57:11.142426 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:11.142442 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:57:11.142449 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:11.142455 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:11.142468 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:11.142475 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:11.142482 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:11.142488 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:57:11.142498 3135511 test_utils.cc:89] k: 3 I20210111 18:57:11.142503 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:57:11.142509 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:57:13.850160 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:13.850176 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:57:13.850183 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:13.850189 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:13.850204 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:13.850211 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:13.850217 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:13.850224 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:57:13.850232 3135511 test_utils.cc:89] k: 3 I20210111 18:57:13.850239 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:13.850244 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2709 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:57:16.559099 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:16.559114 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:57:16.559120 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:16.559125 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:16.559137 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:16.559144 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:16.559149 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:16.559154 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:57:16.559161 3135511 test_utils.cc:89] k: 3 I20210111 18:57:16.559166 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:57:16.559171 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2714 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 18:57:19.273054 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:19.273069 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 18:57:19.273077 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:19.273082 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:19.273095 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:19.273102 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:19.273108 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:19.273114 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:57:19.273123 3135511 test_utils.cc:89] k: 3 I20210111 18:57:19.273128 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:19.273134 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2731 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 18:57:22.004570 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:22.004586 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 18:57:22.004593 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:22.004599 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:22.004613 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:22.004621 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:22.004627 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:22.004634 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:57:22.004642 3135511 test_utils.cc:89] k: 3 I20210111 18:57:22.004648 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:57:22.004653 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2764 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 18:57:24.768832 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:24.768849 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 18:57:24.768857 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:24.768862 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:24.768877 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:24.768883 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:24.768890 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:24.768896 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:57:24.768904 3135511 test_utils.cc:89] k: 3 I20210111 18:57:24.768910 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:24.768916 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2825 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 18:57:27.593997 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:27.594013 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 18:57:27.594020 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:57:27.594027 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:27.594040 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:27.594048 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:27.594053 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:27.594060 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:57:27.594069 3135511 test_utils.cc:89] k: 1 I20210111 18:57:27.594074 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:57:27.594079 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 18:57:30.304826 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:30.304843 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 18:57:30.304849 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:57:30.304855 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:30.304869 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:30.304877 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:30.304883 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:30.304888 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:57:30.304896 3135511 test_utils.cc:89] k: 1 I20210111 18:57:30.304903 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:57:30.304908 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 18:57:33.011363 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:33.011379 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 18:57:33.011386 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:57:33.011392 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:33.011426 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:33.011436 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:33.011445 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:33.011454 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:57:33.011466 3135511 test_utils.cc:89] k: 1 I20210111 18:57:33.011471 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:57:33.011477 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 18:57:35.718492 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:35.718508 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 18:57:35.718514 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:35.718520 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:57:35.718534 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:57:35.718544 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:57:35.718551 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:57:35.718559 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:57:35.718566 3135511 test_utils.cc:89] k: 3 I20210111 18:57:35.718571 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:35.718577 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2718 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 18:57:38.436898 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:38.436914 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 18:57:38.436921 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:38.436928 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:57:38.436941 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:57:38.436951 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:57:38.436959 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:57:38.436966 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:57:38.436973 3135511 test_utils.cc:89] k: 3 I20210111 18:57:38.436980 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:38.436985 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2722 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 18:57:41.158972 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:41.158988 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 18:57:41.158994 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:41.159000 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:57:41.159014 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:57:41.159024 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:57:41.159031 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:57:41.159039 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:57:41.159046 3135511 test_utils.cc:89] k: 3 I20210111 18:57:41.159052 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:41.159057 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2742 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 18:57:43.900202 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:43.900219 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 18:57:43.900225 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:43.900231 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:43.900244 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:43.900251 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:43.900259 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:43.900264 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:57:43.900272 3135511 test_utils.cc:89] k: 3 I20210111 18:57:43.900279 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:43.900283 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 18:57:46.608362 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:46.608378 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 18:57:46.608384 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:46.608390 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:46.608403 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:46.608410 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:46.608417 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:46.608423 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:57:46.608431 3135511 test_utils.cc:89] k: 3 I20210111 18:57:46.608438 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:46.608443 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 18:57:49.321601 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:49.321617 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 18:57:49.321624 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:49.321630 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:57:49.321643 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:57:49.321653 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:57:49.321660 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:57:49.321667 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:57:49.321676 3135511 test_utils.cc:89] k: 3 I20210111 18:57:49.321681 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:49.321686 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 18:57:52.032724 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:52.032740 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 18:57:52.032747 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:52.032752 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:57:52.032765 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:57:52.032775 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:57:52.032783 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:57:52.032789 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:57:52.032796 3135511 test_utils.cc:89] k: 3 I20210111 18:57:52.032802 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:57:52.032809 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2775 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101498 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 18:57:54.807253 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:54.807268 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 18:57:54.807276 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:54.807281 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:54.807296 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.807302 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.807308 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.807315 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:57:54.807323 3135511 test_utils.cc:89] k: 3 I20210111 18:57:54.807329 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:54.807334 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (66 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 18:57:54.873982 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:54.873988 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 18:57:54.873991 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:54.873992 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:54.873997 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.873999 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.874001 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.874003 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:57:54.874006 3135511 test_utils.cc:89] k: 3 I20210111 18:57:54.874008 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:57:54.874009 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 18:57:54.877960 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:54.877965 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 18:57:54.877967 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:54.877969 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:54.877974 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.877976 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.877979 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.877980 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:57:54.877983 3135511 test_utils.cc:89] k: 3 I20210111 18:57:54.877985 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:54.877987 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 18:57:54.888842 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:54.888846 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 18:57:54.888849 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:54.888850 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:54.888854 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.888857 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.888859 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.888861 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:57:54.888864 3135511 test_utils.cc:89] k: 3 I20210111 18:57:54.888865 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:57:54.888867 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (26 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 18:57:54.914155 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:54.914160 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 18:57:54.914162 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:54.914165 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:54.914168 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.914170 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.914172 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.914175 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:57:54.914177 3135511 test_utils.cc:89] k: 3 I20210111 18:57:54.914180 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:54.914181 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (46 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 18:57:54.960893 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:54.960897 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 18:57:54.960899 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:54.960901 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:54.960906 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.960908 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.960911 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:54.960912 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:57:54.960914 3135511 test_utils.cc:89] k: 3 I20210111 18:57:54.960917 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:57:54.960918 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 18:57:55.046650 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:55.046655 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 18:57:55.046658 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:55.046659 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:55.046664 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.046666 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.046669 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.046670 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:57:55.046674 3135511 test_utils.cc:89] k: 3 I20210111 18:57:55.046675 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:55.046677 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 18:57:55.172662 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:55.172667 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 18:57:55.172669 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:55.172672 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:55.172677 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.172678 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.172680 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.172683 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:57:55.172685 3135511 test_utils.cc:89] k: 3 I20210111 18:57:55.172686 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:57:55.172688 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (321 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 18:57:55.493325 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:55.493332 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 18:57:55.493335 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:55.493336 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:55.493343 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.493345 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.493347 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:55.493350 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:57:55.493352 3135511 test_utils.cc:89] k: 3 I20210111 18:57:55.493355 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:55.493356 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 18:57:56.158164 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:56.158172 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 18:57:56.158174 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 18:57:56.158176 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:56.158185 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.158187 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.158190 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.158191 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:57:56.158195 3135511 test_utils.cc:89] k: 1 I20210111 18:57:56.158196 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 18:57:56.158200 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 18:57:56.205608 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:56.205615 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 18:57:56.205617 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 18:57:56.205619 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:56.205626 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.205627 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.205629 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.205631 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 18:57:56.205634 3135511 test_utils.cc:89] k: 1 I20210111 18:57:56.205636 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 18:57:56.205638 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 18:57:56.251971 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:56.251977 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 18:57:56.251979 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 18:57:56.251981 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:57:56.251986 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.251989 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.251991 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:57:56.251993 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:57:56.251996 3135511 test_utils.cc:89] k: 1 I20210111 18:57:56.251997 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 18:57:56.251999 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (47 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 18:57:56.298703 3135511 test_utils.cc:82] Testing parameters: I20210111 18:57:56.298709 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 18:57:56.298712 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:57:56.298713 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 18:57:56.298718 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:57:56.298722 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:57:56.298723 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 18:57:56.298727 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:57:56.298728 3135511 test_utils.cc:89] k: 3 I20210111 18:57:56.298730 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:57:56.298732 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6504 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 18:58:02.802383 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:02.802392 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 18:58:02.802394 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:02.802397 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 18:58:02.802403 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:58:02.802407 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:58:02.802409 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 18:58:02.802412 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:58:02.802414 3135511 test_utils.cc:89] k: 3 I20210111 18:58:02.802417 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:02.802418 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10117 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 18:58:12.919515 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:12.919523 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 18:58:12.919525 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:12.919528 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 18:58:12.919534 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:58:12.919538 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:58:12.919540 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 18:58:12.919543 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:58:12.919545 3135511 test_utils.cc:89] k: 3 I20210111 18:58:12.919548 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:12.919549 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26580 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 18:58:39.499373 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:39.499382 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 18:58:39.499383 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:39.499385 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:58:39.499392 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:39.499394 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:39.499397 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:39.499398 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 18:58:39.499408 3135511 test_utils.cc:89] k: 3 I20210111 18:58:39.499408 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:39.499410 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1569 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 18:58:41.068919 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:41.068928 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 18:58:41.068929 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:41.068931 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:58:41.068938 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:41.068940 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:41.068943 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:41.068944 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:58:41.068948 3135511 test_utils.cc:89] k: 3 I20210111 18:58:41.068949 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:41.068950 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (848 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 18:58:41.916731 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:41.916738 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 18:58:41.916739 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:41.916741 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 18:58:41.916749 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:58:41.916751 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:58:41.916754 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 18:58:41.916756 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:58:41.916759 3135511 test_utils.cc:89] k: 3 I20210111 18:58:41.916760 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:41.916762 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2772 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 18:58:44.688212 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:44.688220 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 18:58:44.688222 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:44.688225 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 18:58:44.688231 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:58:44.688235 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:58:44.688236 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 18:58:44.688239 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 18:58:44.688241 3135511 test_utils.cc:89] k: 3 I20210111 18:58:44.688243 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 18:58:44.688246 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11369 ms) [----------] 19 tests from ClassificationModelCpuTest (61250 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162748 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 9) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:58:56.057368 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:56.057376 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:58:56.057379 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:56.057382 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:58:56.057390 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:56.057392 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:56.057394 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:56.057396 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:58:56.057399 3135511 test_utils.cc:89] k: 3 I20210111 18:58:56.057401 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:56.057404 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2704 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:58:58.761752 3135511 test_utils.cc:82] Testing parameters: I20210111 18:58:58.761768 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:58:58.761775 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:58:58.761781 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:58:58.761795 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:58.761801 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:58.761807 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:58:58.761814 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:58:58.761822 3135511 test_utils.cc:89] k: 3 I20210111 18:58:58.761827 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:58:58.761833 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2717 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:01.478647 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:01.478664 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:01.478670 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:01.478677 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:01.478689 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:01.478695 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:01.478703 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:01.478708 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:59:01.478716 3135511 test_utils.cc:89] k: 3 I20210111 18:59:01.478722 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:01.478727 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2729 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:04.207780 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:04.207796 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:04.207803 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:04.207808 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:04.207823 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:04.207829 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:04.207835 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:04.207841 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:59:04.207850 3135511 test_utils.cc:89] k: 3 I20210111 18:59:04.207855 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:59:04.207861 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2764 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:59:06.971122 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:06.971139 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:59:06.971146 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:06.971153 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:06.971168 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:06.971174 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:06.971180 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:06.971187 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 18:59:06.971195 3135511 test_utils.cc:89] k: 3 I20210111 18:59:06.971200 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:59:06.971206 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2766 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:09.737774 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:09.737792 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:09.737798 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:09.737804 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:09.737818 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:09.737825 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:09.737831 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:09.737838 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:59:09.737846 3135511 test_utils.cc:89] k: 3 I20210111 18:59:09.737852 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:09.737857 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2825 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 18:59:12.562572 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:12.562587 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 18:59:12.562594 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:12.562600 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:12.562614 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:12.562621 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:12.562628 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:12.562633 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:59:12.562642 3135511 test_utils.cc:89] k: 3 I20210111 18:59:12.562647 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:12.562654 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2820 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 18:59:15.382244 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:15.382261 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 18:59:15.382267 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:15.382273 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:15.382287 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:15.382293 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:15.382299 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:15.382306 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 18:59:15.382314 3135511 test_utils.cc:89] k: 3 I20210111 18:59:15.382319 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:15.382325 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2834 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:59:18.216264 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:18.216282 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:59:18.216289 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:18.216295 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:18.216308 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:18.216315 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:18.216321 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:18.216327 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:59:18.216336 3135511 test_utils.cc:89] k: 3 I20210111 18:59:18.216341 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:18.216347 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2825 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:21.041581 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:21.041601 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:21.041608 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:21.041615 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:21.041627 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:21.041635 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:21.041641 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:21.041647 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:59:21.041656 3135511 test_utils.cc:89] k: 3 I20210111 18:59:21.041661 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:59:21.041667 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2698 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 18:59:23.739341 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:23.739360 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 18:59:23.739368 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:23.739374 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:23.739387 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:23.739394 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:23.739415 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:23.739421 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:59:23.739430 3135511 test_utils.cc:89] k: 3 I20210111 18:59:23.739436 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:59:23.739442 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2700 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:59:26.439939 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:26.439952 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:59:26.439958 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:26.439963 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:26.439975 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:26.439981 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:26.439986 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:26.439992 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:59:26.439999 3135511 test_utils.cc:89] k: 3 I20210111 18:59:26.440004 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:59:26.440009 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2694 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:29.133910 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:29.133924 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:29.133930 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:29.133936 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:29.133949 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:29.133955 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:29.133961 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:29.133968 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:59:29.133976 3135511 test_utils.cc:89] k: 3 I20210111 18:59:29.133981 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:29.133987 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:59:31.834228 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:31.834242 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:59:31.834247 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:31.834254 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:31.834265 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:31.834270 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:31.834275 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:31.834280 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:59:31.834287 3135511 test_utils.cc:89] k: 3 I20210111 18:59:31.834291 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:31.834295 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2699 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:34.533277 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:34.533293 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:34.533299 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:34.533308 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:34.533322 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:34.533329 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:34.533335 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:34.533341 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:59:34.533350 3135511 test_utils.cc:89] k: 3 I20210111 18:59:34.533356 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:59:34.533361 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2700 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 18:59:37.233772 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:37.233788 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 18:59:37.233794 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:37.233800 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:37.233814 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:37.233821 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:37.233827 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:37.233834 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:59:37.233844 3135511 test_utils.cc:89] k: 3 I20210111 18:59:37.233848 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:37.233855 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:59:39.945744 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:39.945760 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:59:39.945766 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:39.945775 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:39.945787 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:39.945794 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:39.945801 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:39.945807 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:59:39.945816 3135511 test_utils.cc:89] k: 3 I20210111 18:59:39.945822 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:39.945827 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:59:42.652194 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:42.652209 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:59:42.652215 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:42.652220 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:42.652233 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:42.652240 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:42.652245 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:42.652251 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:59:42.652257 3135511 test_utils.cc:89] k: 3 I20210111 18:59:42.652262 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:42.652267 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 18:59:45.358582 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:45.358597 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 18:59:45.358605 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:45.358611 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:45.358625 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:45.358631 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:45.358639 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:45.358644 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 18:59:45.358654 3135511 test_utils.cc:89] k: 3 I20210111 18:59:45.358659 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:45.358664 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 18:59:48.070657 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:48.070673 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 18:59:48.070679 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:48.070688 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:48.070703 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:48.070708 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:48.070715 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:48.070721 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 18:59:48.070730 3135511 test_utils.cc:89] k: 3 I20210111 18:59:48.070735 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:59:48.070741 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2697 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 18:59:50.767283 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:50.767298 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 18:59:50.767305 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:50.767313 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:50.767328 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:50.767334 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:50.767340 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:50.767346 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 18:59:50.767355 3135511 test_utils.cc:89] k: 3 I20210111 18:59:50.767361 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:50.767366 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2698 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 18:59:53.465996 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:53.466012 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 18:59:53.466018 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:53.466024 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:53.466037 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:53.466044 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:53.466051 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:53.466058 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 18:59:53.466066 3135511 test_utils.cc:89] k: 3 I20210111 18:59:53.466071 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 18:59:53.466078 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2912 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 18:59:56.378027 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:56.378043 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 18:59:56.378049 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:56.378055 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:56.378069 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:56.378077 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:56.378082 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:56.378089 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 18:59:56.378098 3135511 test_utils.cc:89] k: 3 I20210111 18:59:56.378103 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 18:59:56.378109 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 18:59:59.086493 3135511 test_utils.cc:82] Testing parameters: I20210111 18:59:59.086511 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 18:59:59.086520 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 18:59:59.086527 3135511 test_utils.cc:85] effective_scale: 1 I20210111 18:59:59.086544 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:59.086555 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:59.086563 3135511 test_utils.cc:87] effective_means: 0 I20210111 18:59:59.086572 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 18:59:59.086585 3135511 test_utils.cc:89] k: 3 I20210111 18:59:59.086591 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 18:59:59.086599 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2720 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 19:00:01.806357 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:01.806377 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 19:00:01.806386 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:01.806393 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:01.806412 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:01.806421 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:01.806430 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:01.806440 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:00:01.806452 3135511 test_utils.cc:89] k: 3 I20210111 19:00:01.806460 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:01.806468 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2735 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 19:00:04.541188 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:04.541208 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 19:00:04.541216 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:04.541224 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:04.541242 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:04.541252 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:04.541261 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:04.541270 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:00:04.541282 3135511 test_utils.cc:89] k: 3 I20210111 19:00:04.541290 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:00:04.541298 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2768 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 19:00:07.309737 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:07.309757 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 19:00:07.309767 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:07.309774 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:07.309792 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:07.309801 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:07.309810 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:07.309819 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:00:07.309830 3135511 test_utils.cc:89] k: 3 I20210111 19:00:07.309839 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:07.309846 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2832 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 19:00:10.141366 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:10.141382 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 19:00:10.141389 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 19:00:10.141396 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:10.141410 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:10.141417 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:10.141423 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:10.141430 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:00:10.141438 3135511 test_utils.cc:89] k: 1 I20210111 19:00:10.141443 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 19:00:10.141449 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 19:00:12.849946 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:12.849962 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 19:00:12.849969 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 19:00:12.849975 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:12.849989 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:12.849995 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:12.850003 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:12.850008 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 19:00:12.850016 3135511 test_utils.cc:89] k: 1 I20210111 19:00:12.850023 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 19:00:12.850028 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 19:00:15.562825 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:15.562840 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 19:00:15.562847 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 19:00:15.562856 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:15.562870 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:15.562876 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:15.562882 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:15.562889 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:00:15.562897 3135511 test_utils.cc:89] k: 1 I20210111 19:00:15.562902 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 19:00:15.562908 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2715 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 19:00:18.277118 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:18.277134 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 19:00:18.277141 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:18.277148 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 19:00:18.277161 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:00:18.277170 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:00:18.277177 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:00:18.277184 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:00:18.277192 3135511 test_utils.cc:89] k: 3 I20210111 19:00:18.277199 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:18.277204 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2721 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 19:00:20.998468 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:20.998484 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 19:00:20.998492 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:20.998499 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 19:00:20.998512 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:00:20.998522 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:00:20.998529 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:00:20.998536 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:00:20.998544 3135511 test_utils.cc:89] k: 3 I20210111 19:00:20.998550 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:20.998556 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2730 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 19:00:23.729022 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:23.729038 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 19:00:23.729044 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:23.729050 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 19:00:23.729064 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:00:23.729074 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:00:23.729081 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:00:23.729089 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:00:23.729096 3135511 test_utils.cc:89] k: 3 I20210111 19:00:23.729101 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:23.729107 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2947 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 19:00:26.676774 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:26.676790 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 19:00:26.676797 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:26.676807 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:26.676820 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:26.676827 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:26.676833 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:26.676839 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:00:26.676848 3135511 test_utils.cc:89] k: 3 I20210111 19:00:26.676853 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:26.676859 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2708 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 19:00:29.384876 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:29.384892 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 19:00:29.384899 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:29.384905 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:29.384918 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:29.384925 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:29.384932 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:29.384938 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:00:29.384946 3135511 test_utils.cc:89] k: 3 I20210111 19:00:29.384953 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:29.384958 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 19:00:32.090992 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:32.091009 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 19:00:32.091015 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:32.091022 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 19:00:32.091035 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:00:32.091044 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:00:32.091053 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:00:32.091059 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:00:32.091066 3135511 test_utils.cc:89] k: 3 I20210111 19:00:32.091073 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:32.091078 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 19:00:34.802325 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:34.802342 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 19:00:34.802348 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:34.802354 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 19:00:34.802367 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:00:34.802377 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:00:34.802386 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:00:34.802392 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:00:34.802399 3135511 test_utils.cc:89] k: 3 I20210111 19:00:34.802405 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 19:00:34.802410 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2760 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101505 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 19:00:37.562351 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.562367 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 19:00:37.562373 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.562379 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.562393 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.562399 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.562407 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.562412 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 19:00:37.562422 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.562427 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:37.562433 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (67 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 19:00:37.629583 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.629590 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 19:00:37.629592 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.629595 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.629599 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.629601 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.629603 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.629606 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:00:37.629608 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.629611 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:00:37.629612 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 19:00:37.633607 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.633612 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 19:00:37.633615 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.633616 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.633620 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.633623 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.633625 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.633627 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:00:37.633630 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.633631 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:37.633633 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 19:00:37.644492 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.644497 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 19:00:37.644500 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.644501 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.644505 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.644507 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.644510 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.644511 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:00:37.644515 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.644516 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:00:37.644518 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 19:00:37.669773 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.669778 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 19:00:37.669780 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.669782 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.669786 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.669788 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.669790 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.669792 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 19:00:37.669795 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.669797 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:37.669800 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (47 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 19:00:37.716477 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.716482 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 19:00:37.716485 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.716486 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.716490 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.716492 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.716495 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.716496 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 19:00:37.716500 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.716501 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:00:37.716503 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 19:00:37.802438 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.802443 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 19:00:37.802446 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.802448 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.802453 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.802454 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.802456 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.802459 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:00:37.802461 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.802464 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:37.802464 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 19:00:37.928473 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:37.928478 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 19:00:37.928480 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:37.928483 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:37.928488 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.928489 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.928491 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:37.928493 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:00:37.928496 3135511 test_utils.cc:89] k: 3 I20210111 19:00:37.928498 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:00:37.928500 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (319 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 19:00:38.247422 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:38.247431 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 19:00:38.247433 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:38.247435 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:38.247443 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.247445 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.247447 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.247449 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:00:38.247454 3135511 test_utils.cc:89] k: 3 I20210111 19:00:38.247457 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:38.247458 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 19:00:38.912222 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:38.912230 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 19:00:38.912233 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 19:00:38.912235 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:38.912242 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.912245 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.912247 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.912250 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:00:38.912251 3135511 test_utils.cc:89] k: 1 I20210111 19:00:38.912253 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 19:00:38.912256 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 19:00:38.959669 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:38.959676 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 19:00:38.959677 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 19:00:38.959679 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:38.959686 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.959687 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.959689 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:38.959692 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 19:00:38.959694 3135511 test_utils.cc:89] k: 1 I20210111 19:00:38.959697 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 19:00:38.959698 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (47 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 19:00:39.006588 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:39.006595 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 19:00:39.006597 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 19:00:39.006599 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:00:39.006604 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:39.006606 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:39.006608 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:00:39.006610 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:00:39.006613 3135511 test_utils.cc:89] k: 1 I20210111 19:00:39.006615 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 19:00:39.006616 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (46 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 19:00:39.052978 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:39.052984 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 19:00:39.052986 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:39.052989 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 19:00:39.052992 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:00:39.052996 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:00:39.052999 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:00:39.053000 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:00:39.053004 3135511 test_utils.cc:89] k: 3 I20210111 19:00:39.053005 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:39.053007 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6493 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 19:00:45.545090 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:45.545099 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 19:00:45.545101 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:45.545104 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 19:00:45.545110 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:00:45.545114 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:00:45.545116 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:00:45.545118 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:00:45.545121 3135511 test_utils.cc:89] k: 3 I20210111 19:00:45.545123 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:45.545125 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10108 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 19:00:55.653676 3135511 test_utils.cc:82] Testing parameters: I20210111 19:00:55.653685 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 19:00:55.653687 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:00:55.653689 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 19:00:55.653695 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:00:55.653699 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:00:55.653702 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:00:55.653704 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:00:55.653707 3135511 test_utils.cc:89] k: 3 I20210111 19:00:55.653708 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:00:55.653710 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26563 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 19:01:22.216522 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:22.216531 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 19:01:22.216533 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:22.216536 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:22.216543 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:22.216545 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:22.216547 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:22.216549 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:01:22.216552 3135511 test_utils.cc:89] k: 3 I20210111 19:01:22.216554 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:22.216557 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1570 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 19:01:23.786306 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:23.786314 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 19:01:23.786317 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:23.786319 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:23.786325 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:23.786327 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:23.786330 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:23.786332 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:01:23.786334 3135511 test_utils.cc:89] k: 3 I20210111 19:01:23.786336 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:23.786339 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (849 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 19:01:24.635157 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:24.635164 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 19:01:24.635166 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:24.635169 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 19:01:24.635175 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:01:24.635179 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:01:24.635182 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:01:24.635185 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:01:24.635187 3135511 test_utils.cc:89] k: 3 I20210111 19:01:24.635188 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:24.635190 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2770 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 19:01:27.405666 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:27.405674 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 19:01:27.405678 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:27.405679 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 19:01:27.405686 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:01:27.405689 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:01:27.405692 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:01:27.405694 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:01:27.405697 3135511 test_utils.cc:89] k: 3 I20210111 19:01:27.405699 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 19:01:27.405701 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11366 ms) [----------] 19 tests from ClassificationModelCpuTest (61209 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162714 ms total) [ PASSED ] 56 tests. Repeating all tests (iteration 10) . . . [==========] Running 56 tests from 2 test suites. [----------] Global test environment set-up. [----------] 37 tests from ClassificationModelEdgeTpuTest [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu I20210111 19:01:38.771241 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:38.771250 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:01:38.771251 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:38.771255 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:38.771262 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:38.771265 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:38.771266 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:38.771268 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:01:38.771271 3135511 test_utils.cc:89] k: 3 I20210111 19:01:38.771273 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:38.771275 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_3quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 19:01:41.477324 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:41.477340 3135511 test_utils.cc:83] model_path: cocompilation/inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 19:01:41.477347 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:41.477353 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:41.477367 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:41.477375 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:41.477380 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:41.477387 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:01:41.477396 3135511 test_utils.cc:89] k: 3 I20210111 19:01:41.477401 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:41.477406 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v1_224_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2718 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu I20210111 19:01:44.195516 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:44.195533 3135511 test_utils.cc:83] model_path: cocompilation/inception_v2_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:01:44.195538 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:44.195544 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:44.195559 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:44.195565 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:44.195571 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:44.195578 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:01:44.195586 3135511 test_utils.cc:89] k: 3 I20210111 19:01:44.195591 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:44.195597 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v2_224_quant_cocompiled_with_3quant_edgetpu (2728 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu I20210111 19:01:46.923648 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:46.923664 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:01:46.923671 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:46.923676 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:46.923691 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:46.923697 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:46.923704 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:46.923710 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:01:46.923718 3135511 test_utils.cc:89] k: 3 I20210111 19:01:46.923724 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:01:46.923730 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_3quant_edgetpu (2763 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 19:01:49.686504 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:49.686522 3135511 test_utils.cc:83] model_path: cocompilation/inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 19:01:49.686528 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:49.686534 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:49.686548 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:49.686555 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:49.686561 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:49.686568 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:01:49.686576 3135511 test_utils.cc:89] k: 3 I20210111 19:01:49.686583 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:01:49.686589 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v3_299_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2766 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu I20210111 19:01:52.452476 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:52.452493 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:01:52.452500 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:52.452507 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:52.452520 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:52.452527 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:52.452533 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:52.452540 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:01:52.452548 3135511 test_utils.cc:89] k: 3 I20210111 19:01:52.452554 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:52.452559 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_3quant_edgetpu (2826 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu I20210111 19:01:55.278188 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:55.278205 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu.tflite I20210111 19:01:55.278211 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:55.278218 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:55.278231 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:55.278239 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:55.278245 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:55.278251 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:01:55.278259 3135511 test_utils.cc:89] k: 3 I20210111 19:01:55.278265 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:55.278270 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v1_224_quant_edgetpu (2825 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu I20210111 19:01:58.103677 3135511 test_utils.cc:82] Testing parameters: I20210111 19:01:58.103694 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu.tflite I20210111 19:01:58.103703 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:01:58.103709 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:01:58.103722 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:58.103729 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:58.103735 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:01:58.103741 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:01:58.103750 3135511 test_utils.cc:89] k: 3 I20210111 19:01:58.103755 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:01:58.103761 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_inception_v3_299_quant_edgetpu (2827 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 19:02:00.930212 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:00.930229 3135511 test_utils.cc:83] model_path: cocompilation/inception_v4_299_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 19:02:00.930236 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:00.930243 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:00.930256 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:00.930263 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:00.930269 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:00.930276 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:02:00.930284 3135511 test_utils.cc:89] k: 3 I20210111 19:02:00.930290 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:00.930296 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_inception_v4_299_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2828 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu I20210111 19:02:03.758177 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:03.758193 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:02:03.758199 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:03.758205 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:03.758219 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:03.758226 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:03.758234 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:03.758239 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:02:03.758249 3135511 test_utils.cc:89] k: 3 I20210111 19:02:03.758253 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:02:03.758260 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_3quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu I20210111 19:02:06.453732 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:06.453747 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu.tflite I20210111 19:02:06.453753 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:06.453758 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:06.453771 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:06.453778 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:06.453783 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:06.453789 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:02:06.453797 3135511 test_utils.cc:89] k: 3 I20210111 19:02:06.453804 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:02:06.453809 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_inception_v4_299_quant_edgetpu (2693 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu I20210111 19:02:09.146643 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:09.146659 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.25_128_quant_cocompiled_with_mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 19:02:09.146667 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:09.146672 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:09.146687 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:09.146694 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:09.146700 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:09.146706 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:02:09.146715 3135511 test_utils.cc:89] k: 3 I20210111 19:02:09.146720 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:02:09.146726 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_25_128_quant_cocompiled_with_mobilenet_v1_0_5_160_quant_edgetpu (2696 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu I20210111 19:02:11.842450 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:11.842468 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:02:11.842474 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:11.842480 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:11.842494 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:11.842500 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:11.842506 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:11.842514 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:02:11.842521 3135511 test_utils.cc:89] k: 3 I20210111 19:02:11.842527 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:11.842533 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_3quant_edgetpu (2701 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu I20210111 19:02:14.543695 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:14.543711 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.5_160_quant_cocompiled_with_mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 19:02:14.543718 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:14.543726 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:14.543740 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:14.543748 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:14.543754 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:14.543761 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:02:14.543769 3135511 test_utils.cc:89] k: 3 I20210111 19:02:14.543776 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:14.543781 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_5_160_quant_cocompiled_with_mobilenet_v1_0_25_128_quant_edgetpu (2698 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu I20210111 19:02:17.241755 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:17.241771 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_0.75_192_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:02:17.241778 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:17.241784 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:17.241797 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:17.241804 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:17.241811 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:17.241817 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:02:17.241827 3135511 test_utils.cc:89] k: 3 I20210111 19:02:17.241832 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:02:17.241837 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_0_75_192_quant_cocompiled_with_3quant_edgetpu (2704 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu I20210111 19:02:19.945324 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:19.945340 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_3quant_edgetpu.tflite I20210111 19:02:19.945349 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:19.945355 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:19.945369 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:19.945376 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:19.945384 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:19.945389 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 19:02:19.945399 3135511 test_utils.cc:89] k: 3 I20210111 19:02:19.945405 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:19.945410 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_3quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu I20210111 19:02:22.656670 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:22.656687 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v1_1.0_224_quant_cocompiled_with_mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 19:02:22.656693 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:22.656700 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:22.656713 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:22.656720 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:22.656728 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:22.656733 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 19:02:22.656741 3135511 test_utils.cc:89] k: 3 I20210111 19:02:22.656747 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:22.656754 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v1_1_0_224_quant_cocompiled_with_mobilenet_v2_1_0_224_quant_edgetpu (2713 ms) [ RUN ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu I20210111 19:02:25.369639 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:25.369654 3135511 test_utils.cc:83] model_path: cocompilation/mobilenet_v2_1.0_224_quant_cocompiled_with_mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 19:02:25.369661 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:25.369668 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:25.369681 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:25.369688 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:25.369694 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:25.369700 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 19:02:25.369709 3135511 test_utils.cc:89] k: 3 I20210111 19:02:25.369714 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:25.369720 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.cocompilation_mobilenet_v2_1_0_224_quant_cocompiled_with_mobilenet_v1_1_0_224_quant_edgetpu (2706 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu I20210111 19:02:28.075285 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:28.075302 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant_edgetpu.tflite I20210111 19:02:28.075309 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:28.075315 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:28.075328 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:28.075335 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:28.075342 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:28.075348 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 19:02:28.075357 3135511 test_utils.cc:89] k: 3 I20210111 19:02:28.075363 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:28.075368 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_1_0_224_quant_edgetpu (2715 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu I20210111 19:02:30.790377 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:30.790392 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant_edgetpu.tflite I20210111 19:02:30.790398 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:30.790403 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:30.790417 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:30.790423 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:30.790429 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:30.790436 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:02:30.790443 3135511 test_utils.cc:89] k: 3 I20210111 19:02:30.790448 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:02:30.790454 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_25_128_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu I20210111 19:02:33.485703 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:33.485720 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant_edgetpu.tflite I20210111 19:02:33.485728 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:33.485733 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:33.485746 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:33.485754 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:33.485760 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:33.485766 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:02:33.485775 3135511 test_utils.cc:89] k: 3 I20210111 19:02:33.485781 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:33.485787 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_5_160_quant_edgetpu (2695 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu I20210111 19:02:36.180593 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:36.180606 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant_edgetpu.tflite I20210111 19:02:36.180610 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:36.180614 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:36.180624 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:36.180629 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:36.180632 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:36.180637 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:02:36.180644 3135511 test_utils.cc:89] k: 3 I20210111 19:02:36.180646 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:02:36.180650 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v1_0_75_192_quant_edgetpu (2910 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu I20210111 19:02:39.090922 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:39.090939 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant_edgetpu.tflite I20210111 19:02:39.090945 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:39.090951 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:39.090965 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:39.090972 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:39.090978 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:39.090986 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 19:02:39.090993 3135511 test_utils.cc:89] k: 3 I20210111 19:02:39.090999 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:39.091006 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_quant_edgetpu (2712 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu I20210111 19:02:41.803071 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:41.803094 3135511 test_utils.cc:83] model_path: inception_v1_224_quant_edgetpu.tflite I20210111 19:02:41.803102 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:41.803107 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:41.803124 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:41.803131 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:41.803138 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:41.803145 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 19:02:41.803153 3135511 test_utils.cc:89] k: 3 I20210111 19:02:41.803159 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:02:41.803165 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v1_224_quant_edgetpu (2722 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu I20210111 19:02:44.525272 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:44.525292 3135511 test_utils.cc:83] model_path: inception_v2_224_quant_edgetpu.tflite I20210111 19:02:44.525298 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:44.525305 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:44.525318 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:44.525326 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:44.525331 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:44.525337 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:02:44.525346 3135511 test_utils.cc:89] k: 3 I20210111 19:02:44.525352 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:44.525357 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v2_224_quant_edgetpu (2737 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu I20210111 19:02:47.262778 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:47.262794 3135511 test_utils.cc:83] model_path: inception_v3_299_quant_edgetpu.tflite I20210111 19:02:47.262801 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:47.262809 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:47.262823 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:47.262830 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:47.262836 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:47.262843 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:02:47.262851 3135511 test_utils.cc:89] k: 3 I20210111 19:02:47.262857 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:02:47.262862 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v3_299_quant_edgetpu (2767 ms) [ RUN ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu I20210111 19:02:50.029681 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:50.029697 3135511 test_utils.cc:83] model_path: inception_v4_299_quant_edgetpu.tflite I20210111 19:02:50.029704 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:02:50.029711 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:50.029724 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:50.029731 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:50.029737 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:50.029743 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:02:50.029752 3135511 test_utils.cc:89] k: 3 I20210111 19:02:50.029757 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:02:50.029763 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.inception_v4_299_quant_edgetpu (2829 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu I20210111 19:02:52.858479 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:52.858500 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant_edgetpu.tflite I20210111 19:02:52.858505 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 19:02:52.858511 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:52.858525 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:52.858532 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:52.858538 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:52.858546 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:02:52.858553 3135511 test_utils.cc:89] k: 1 I20210111 19:02:52.858559 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 19:02:52.858564 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_plant_quant_edgetpu (2715 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu I20210111 19:02:55.573176 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:55.573194 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant_edgetpu.tflite I20210111 19:02:55.573199 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 19:02:55.573205 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:55.573218 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:55.573225 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:55.573231 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:55.573238 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 19:02:55.573246 3135511 test_utils.cc:89] k: 1 I20210111 19:02:55.573252 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 19:02:55.573258 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_insect_quant_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu I20210111 19:02:58.280536 3135511 test_utils.cc:82] Testing parameters: I20210111 19:02:58.280552 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant_edgetpu.tflite I20210111 19:02:58.280560 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 19:02:58.280565 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:02:58.280578 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:58.280584 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:58.280591 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:02:58.280596 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:02:58.280603 3135511 test_utils.cc:89] k: 1 I20210111 19:02:58.280609 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 19:02:58.280614 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.mobilenet_v2_1_0_224_inat_bird_quant_edgetpu (2711 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu I20210111 19:03:00.991194 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:00.991209 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant_edgetpu.tflite I20210111 19:03:00.991215 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:00.991220 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 19:03:00.991233 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:03:00.991241 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:03:00.991247 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:03:00.991253 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:03:00.991261 3135511 test_utils.cc:89] k: 3 I20210111 19:03:00.991266 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:00.991271 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_S_quant_edgetpu (2719 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu I20210111 19:03:03.710845 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:03.710862 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant_edgetpu.tflite I20210111 19:03:03.710868 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:03.710875 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 19:03:03.710889 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:03:03.710899 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:03:03.710906 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:03:03.710913 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:03:03.710922 3135511 test_utils.cc:89] k: 3 I20210111 19:03:03.710927 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:03.710933 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_M_quant_edgetpu (2724 ms) [ RUN ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu I20210111 19:03:06.434937 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:06.434953 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant_edgetpu.tflite I20210111 19:03:06.434960 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:06.434968 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 19:03:06.434981 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:03:06.434991 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:03:06.434998 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:03:06.435005 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:03:06.435014 3135511 test_utils.cc:89] k: 3 I20210111 19:03:06.435019 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:06.435024 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.efficientnet_edgetpu_L_quant_edgetpu (2744 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu I20210111 19:03:09.178375 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:09.178391 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq_edgetpu.tflite I20210111 19:03:09.178398 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:09.178404 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:09.178418 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:09.178426 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:09.178431 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:09.178438 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:03:09.178447 3135511 test_utils.cc:89] k: 3 I20210111 19:03:09.178452 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:09.178458 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v1_1_0_224_ptq_edgetpu (2710 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu I20210111 19:03:11.888069 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:11.888085 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq_edgetpu.tflite I20210111 19:03:11.888092 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:11.888098 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:11.888113 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:11.888119 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:11.888125 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:11.888132 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:03:11.888140 3135511 test_utils.cc:89] k: 3 I20210111 19:03:11.888146 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:11.888152 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v2_1_0_224_ptq_edgetpu (2707 ms) [ RUN ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu I20210111 19:03:14.595300 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:14.595316 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq_edgetpu.tflite I20210111 19:03:14.595324 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:14.595329 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 19:03:14.595343 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:03:14.595352 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:03:14.595360 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:03:14.595367 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:03:14.595376 3135511 test_utils.cc:89] k: 3 I20210111 19:03:14.595381 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:14.595386 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq_edgetpu (2718 ms) [ RUN ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu I20210111 19:03:17.313549 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:17.313565 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq_edgetpu.tflite I20210111 19:03:17.313571 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:17.313577 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 19:03:17.313591 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:03:17.313601 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:03:17.313607 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:03:17.313614 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:03:17.313622 3135511 test_utils.cc:89] k: 3 I20210111 19:03:17.313627 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 19:03:17.313633 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelEdgeTpuTest.tfhub_tf2_resnet_50_imagenet_ptq_edgetpu (2766 ms) [----------] 37 tests from ClassificationModelEdgeTpuTest (101308 ms total) [----------] 19 tests from ClassificationModelCpuTest [ RUN ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant I20210111 19:03:20.079358 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.079375 3135511 test_utils.cc:83] model_path: mobilenet_v1_1.0_224_quant.tflite I20210111 19:03:20.079381 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.079387 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.079421 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.079428 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.079435 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.079442 3135511 test_utils.cc:88] score_threshold: 0.78 I20210111 19:03:20.079450 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.079455 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:20.079461 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_1_0_224_quant (69 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant I20210111 19:03:20.148115 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.148123 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.25_128_quant.tflite I20210111 19:03:20.148124 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.148126 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.148130 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.148133 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.148135 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.148138 3135511 test_utils.cc:88] score_threshold: 0.25 I20210111 19:03:20.148140 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.148142 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:03:20.148144 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_25_128_quant (4 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant I20210111 19:03:20.152209 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.152215 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.5_160_quant.tflite I20210111 19:03:20.152216 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.152218 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.152222 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.152225 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.152227 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.152230 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:03:20.152231 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.152233 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:20.152235 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_5_160_quant (11 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant I20210111 19:03:20.163136 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.163141 3135511 test_utils.cc:83] model_path: mobilenet_v1_0.75_192_quant.tflite I20210111 19:03:20.163143 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.163146 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.163149 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.163151 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.163153 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.163156 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:03:20.163158 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.163161 3135511 test_utils.cc:90] expected_topk_label: 283 I20210111 19:03:20.163162 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v1_0_75_192_quant (25 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant I20210111 19:03:20.188488 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.188493 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_quant.tflite I20210111 19:03:20.188495 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.188498 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.188501 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.188503 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.188506 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.188508 3135511 test_utils.cc:88] score_threshold: 0.7 I20210111 19:03:20.188510 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.188513 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:20.188514 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_quant (47 ms) [ RUN ] ClassificationModelCpuTest.inception_v1_224_quant I20210111 19:03:20.235255 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.235260 3135511 test_utils.cc:83] model_path: inception_v1_224_quant.tflite I20210111 19:03:20.235261 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.235263 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.235267 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.235270 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.235272 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.235275 3135511 test_utils.cc:88] score_threshold: 0.37 I20210111 19:03:20.235276 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.235278 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:03:20.235280 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v1_224_quant (86 ms) [ RUN ] ClassificationModelCpuTest.inception_v2_224_quant I20210111 19:03:20.321125 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.321131 3135511 test_utils.cc:83] model_path: inception_v2_224_quant.tflite I20210111 19:03:20.321133 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.321135 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.321141 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.321142 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.321144 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.321146 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:03:20.321149 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.321151 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:20.321153 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v2_224_quant (126 ms) [ RUN ] ClassificationModelCpuTest.inception_v3_299_quant I20210111 19:03:20.447384 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.447389 3135511 test_utils.cc:83] model_path: inception_v3_299_quant.tflite I20210111 19:03:20.447391 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.447393 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.447398 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.447409 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.447412 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.447413 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:03:20.447415 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.447417 3135511 test_utils.cc:90] expected_topk_label: 282 I20210111 19:03:20.447419 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v3_299_quant (319 ms) [ RUN ] ClassificationModelCpuTest.inception_v4_299_quant I20210111 19:03:20.766688 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:20.766695 3135511 test_utils.cc:83] model_path: inception_v4_299_quant.tflite I20210111 19:03:20.766698 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:20.766700 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:20.766707 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.766710 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.766712 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:20.766714 3135511 test_utils.cc:88] score_threshold: 0.3 I20210111 19:03:20.766717 3135511 test_utils.cc:89] k: 3 I20210111 19:03:20.766719 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:20.766721 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.inception_v4_299_quant (665 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant I20210111 19:03:21.431859 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:21.431867 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_plant_quant.tflite I20210111 19:03:21.431869 3135511 test_utils.cc:84] image_path: sunflower.bmp I20210111 19:03:21.431871 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:21.431879 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.431881 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.431883 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.431885 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:03:21.431888 3135511 test_utils.cc:89] k: 1 I20210111 19:03:21.431891 3135511 test_utils.cc:90] expected_topk_label: 1680 I20210111 19:03:21.431893 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_plant_quant (48 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant I20210111 19:03:21.479285 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:21.479290 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_insect_quant.tflite I20210111 19:03:21.479292 3135511 test_utils.cc:84] image_path: dragonfly.bmp I20210111 19:03:21.479295 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:21.479300 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.479301 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.479303 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.479305 3135511 test_utils.cc:88] score_threshold: 0.2 I20210111 19:03:21.479308 3135511 test_utils.cc:89] k: 1 I20210111 19:03:21.479310 3135511 test_utils.cc:90] expected_topk_label: 912 I20210111 19:03:21.479312 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_insect_quant (46 ms) [ RUN ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant I20210111 19:03:21.525615 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:21.525620 3135511 test_utils.cc:83] model_path: mobilenet_v2_1.0_224_inat_bird_quant.tflite I20210111 19:03:21.525622 3135511 test_utils.cc:84] image_path: bird.bmp I20210111 19:03:21.525624 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:03:21.525629 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.525631 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.525633 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:03:21.525635 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:03:21.525638 3135511 test_utils.cc:89] k: 1 I20210111 19:03:21.525640 3135511 test_utils.cc:90] expected_topk_label: 659 I20210111 19:03:21.525641 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.mobilenet_v2_1_0_224_inat_bird_quant (47 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant I20210111 19:03:21.572461 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:21.572466 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-S_quant.tflite I20210111 19:03:21.572468 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:21.572470 3135511 test_utils.cc:85] effective_scale: 1.60845 I20210111 19:03:21.572474 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:03:21.572477 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:03:21.572480 3135511 test_utils.cc:87] effective_means: -83.7067 I20210111 19:03:21.572484 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:03:21.572485 3135511 test_utils.cc:89] k: 3 I20210111 19:03:21.572487 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:21.572489 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_S_quant (6502 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant I20210111 19:03:28.074537 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:28.074545 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-M_quant.tflite I20210111 19:03:28.074548 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:28.074550 3135511 test_utils.cc:85] effective_scale: 1.54739 I20210111 19:03:28.074556 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:03:28.074560 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:03:28.074563 3135511 test_utils.cc:87] effective_means: -72.6136 I20210111 19:03:28.074565 3135511 test_utils.cc:88] score_threshold: 0.5 I20210111 19:03:28.074568 3135511 test_utils.cc:89] k: 3 I20210111 19:03:28.074569 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:28.074571 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_M_quant (10121 ms) [ RUN ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant I20210111 19:03:38.195927 3135511 test_utils.cc:82] Testing parameters: I20210111 19:03:38.195936 3135511 test_utils.cc:83] model_path: efficientnet-edgetpu-L_quant.tflite I20210111 19:03:38.195938 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:03:38.195940 3135511 test_utils.cc:85] effective_scale: 1.59488 I20210111 19:03:38.195948 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:03:38.195951 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:03:38.195955 3135511 test_utils.cc:87] effective_means: -78.7395 I20210111 19:03:38.195956 3135511 test_utils.cc:88] score_threshold: 0.51 I20210111 19:03:38.195960 3135511 test_utils.cc:89] k: 3 I20210111 19:03:38.195961 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:03:38.195963 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.efficientnet_edgetpu_L_quant (26578 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq I20210111 19:04:04.773492 3135511 test_utils.cc:82] Testing parameters: I20210111 19:04:04.773500 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v1_1.0_224_ptq.tflite I20210111 19:04:04.773504 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:04:04.773505 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:04:04.773512 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:04:04.773514 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:04:04.773516 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:04:04.773519 3135511 test_utils.cc:88] score_threshold: 0.8 I20210111 19:04:04.773522 3135511 test_utils.cc:89] k: 3 I20210111 19:04:04.773524 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:04:04.773525 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v1_1_0_224_ptq (1569 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq I20210111 19:04:06.342581 3135511 test_utils.cc:82] Testing parameters: I20210111 19:04:06.342587 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v2_1.0_224_ptq.tflite I20210111 19:04:06.342590 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:04:06.342592 3135511 test_utils.cc:85] effective_scale: 1 I20210111 19:04:06.342598 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:04:06.342602 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:04:06.342603 3135511 test_utils.cc:87] effective_means: 0 I20210111 19:04:06.342605 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:04:06.342608 3135511 test_utils.cc:89] k: 3 I20210111 19:04:06.342610 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:04:06.342612 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v2_1_0_224_ptq (848 ms) [ RUN ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq I20210111 19:04:07.190802 3135511 test_utils.cc:82] Testing parameters: I20210111 19:04:07.190809 3135511 test_utils.cc:83] model_path: tf2_mobilenet_v3_edgetpu_1.0_224_ptq.tflite I20210111 19:04:07.190812 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:04:07.190814 3135511 test_utils.cc:85] effective_scale: 1.48106 I20210111 19:04:07.190821 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:04:07.190824 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:04:07.190826 3135511 test_utils.cc:87] effective_means: -55.1698 I20210111 19:04:07.190829 3135511 test_utils.cc:88] score_threshold: 0.35 I20210111 19:04:07.190832 3135511 test_utils.cc:89] k: 3 I20210111 19:04:07.190834 3135511 test_utils.cc:90] expected_topk_label: 286 I20210111 19:04:07.190836 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tf2_mobilenet_v3_edgetpu_1_0_224_ptq (2771 ms) [ RUN ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq I20210111 19:04:09.961982 3135511 test_utils.cc:82] Testing parameters: I20210111 19:04:09.961990 3135511 test_utils.cc:83] model_path: tfhub_tf2_resnet_50_imagenet_ptq.tflite I20210111 19:04:09.961992 3135511 test_utils.cc:84] image_path: cat.bmp I20210111 19:04:09.961994 3135511 test_utils.cc:85] effective_scale: 1.26011 I20210111 19:04:09.962002 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:04:09.962004 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:04:09.962007 3135511 test_utils.cc:87] effective_means: -27.7223 I20210111 19:04:09.962009 3135511 test_utils.cc:88] score_threshold: 0.6 I20210111 19:04:09.962013 3135511 test_utils.cc:89] k: 3 I20210111 19:04:09.962014 3135511 test_utils.cc:90] expected_topk_label: 285 I20210111 19:04:09.962016 3135511 test_utils.cc:91] rgb2bgr: 0 [ OK ] ClassificationModelCpuTest.tfhub_tf2_resnet_50_imagenet_ptq (11373 ms) [----------] 19 tests from ClassificationModelCpuTest (61255 ms total) [----------] Global test environment tear-down [==========] 56 tests from 2 test suites ran. (162563 ms total) [ PASSED ] 56 tests. ----------------------------------------------------- detection_models_test ----------------------------------------------------- Repeating all tests (iteration 1) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 WARNING: Logging before InitGoogleLogging() is written to STDERR I20210111 19:04:21.341290 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:04:21.471966 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:04:21.569996 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (359 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:04:21.700074 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:04:21.808928 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (573 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:04:21.914822 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:04:24.658907 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:04:27.589241 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8394 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:04:30.308365 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:04:33.036427 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13858 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14431 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 2) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:04:35.772753 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:04:35.896433 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:04:35.993292 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:04:36.122241 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:04:36.230860 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:04:36.336737 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:04:39.074556 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:04:41.786571 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8171 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:04:44.507917 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:04:47.235541 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13635 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14199 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 3) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:04:49.971616 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:04:50.094736 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:04:50.191817 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:04:50.320722 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:04:50.429373 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:04:50.534204 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:04:53.277187 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:04:56.003094 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8192 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:04:58.727035 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:01.458110 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2744 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13668 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14231 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 4) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:04.202116 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:05:04.326030 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:05:04.423996 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (353 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:04.555752 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:04.664846 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (567 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:04.769860 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:07.509922 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:10.224112 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:12.945688 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:15.675731 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14213 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 5) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:18.415825 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:05:18.540055 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:05:18.637094 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:18.766117 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:18.875684 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (566 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:18.981196 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:21.720706 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:24.450971 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8191 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:27.172260 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:29.898164 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2734 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13651 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14217 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 6) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:32.632966 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:05:32.756590 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:05:32.853796 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:32.982939 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:33.091823 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (107 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (566 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:33.198393 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:35.938962 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:38.654084 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8183 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:41.381525 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:44.110584 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13651 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14217 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 7) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:46.849316 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:05:46.973177 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:05:47.069792 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:47.198671 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:47.307018 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:05:47.412925 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:50.156234 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:05:52.870070 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:05:55.592730 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2722 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:05:58.314857 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13638 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14201 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 8) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:01.050608 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:06:01.174885 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:06:01.271792 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:01.400593 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:01.509353 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:01.614276 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:04.355340 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:07.067421 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:09.792235 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:12.518347 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2734 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13638 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14202 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 9) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:15.252679 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:06:15.376369 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:06:15.473738 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:15.602596 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:15.711025 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:15.817265 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:18.555277 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:21.274494 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:23.995936 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:26.726883 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 10) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:29.462654 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:06:29.586464 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:06:29.683496 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:29.812290 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:29.920799 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:30.025596 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:32.764710 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:35.687171 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8384 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:38.409191 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:41.139941 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13852 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14415 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 11) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:43.877867 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:06:44.001616 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:06:44.098726 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:44.227500 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:44.335958 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (107 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:44.442191 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:47.188383 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:06:49.903276 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8182 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:52.624790 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:55.351537 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13647 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 12) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:58.089401 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:06:58.213485 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:06:58.310408 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:06:58.439321 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:06:58.547775 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:06:58.652709 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:01.392550 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:04.108379 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:06.832105 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:09.560123 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13647 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 13) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:12.299634 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:07:12.423936 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:07:12.520938 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:12.650697 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:12.759074 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:12.863854 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:15.604952 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:18.318948 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:21.042091 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:23.771836 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 14) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:26.511067 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:07:26.634868 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:07:26.731992 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:26.860852 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:26.969830 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:27.074798 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:29.816154 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:32.530931 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:35.253222 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2732 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:37.985137 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13651 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14214 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 15) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:40.725320 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:07:40.848997 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:07:40.946048 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:41.074877 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:41.183127 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (562 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:41.287930 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:44.028690 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:46.750315 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8190 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:49.477226 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2734 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:52.211083 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2741 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13665 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14227 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 16) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:54.952534 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:07:55.076694 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:07:55.174216 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:07:55.303174 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:07:55.411682 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:07:55.516575 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:07:58.254833 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:00.968729 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:03.692265 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:06.419935 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13643 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14207 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 17) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:09.159507 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:08:09.283845 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:08:09.381045 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:09.509965 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:09.618785 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:09.723539 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:12.464840 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:15.181275 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:17.899752 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:20.629437 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14209 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 18) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:23.368523 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:08:23.492033 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:08:23.589442 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:23.718297 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:23.826812 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:23.933024 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:26.670509 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:29.382455 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8170 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:32.103966 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:34.833667 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13637 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14202 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 19) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:37.570297 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:08:37.692945 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:08:37.789764 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (348 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:37.918599 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:38.026922 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (561 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:38.131743 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:40.871726 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:43.588562 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:46.308938 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:49.038977 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14206 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 20) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:51.776928 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:08:51.903048 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:08:51.999801 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (352 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:08:52.128170 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:08:52.236256 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:08:52.341058 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:55.075054 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:08:57.786118 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8167 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:00.508268 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:03.238904 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13636 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14201 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 21) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:05.977174 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:09:06.107091 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:09:06.204121 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (356 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:06.333037 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:06.441323 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (569 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:06.546176 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:09.286378 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:11.998095 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8174 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:14.720108 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:17.448745 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13640 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14209 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 22) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:20.186676 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:09:20.310518 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:09:20.407501 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:20.536391 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:20.644889 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:20.749718 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:23.489303 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:26.205607 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:28.930670 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:31.659543 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2741 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13651 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14214 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 23) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:34.400207 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:09:34.524875 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:09:34.622073 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:34.750881 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:34.859508 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:34.964288 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:37.705952 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:40.418751 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:43.141760 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:45.872045 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14209 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 24) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:48.609328 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:09:48.731190 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:09:48.828224 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (348 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:48.957157 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:09:49.065483 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (562 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:09:49.171571 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:51.915206 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:09:54.628232 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:09:57.349684 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:00.078999 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2741 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 25) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:02.819291 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:10:02.941887 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:10:03.039131 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:03.168198 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:03.276520 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (562 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:03.381345 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:06.120337 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:08.839895 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:11.561851 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:14.287434 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14208 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 26) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:17.027374 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:10:17.156358 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:10:17.253566 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (355 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:17.382350 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:17.490756 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (568 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:17.595536 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:20.337620 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:23.050695 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:25.773418 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:28.499296 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13642 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 27) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:31.237334 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:10:31.368788 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:10:31.465955 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (357 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:31.594960 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:31.703614 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (572 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:31.809692 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:34.551687 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:37.267092 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:39.989924 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:42.715654 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13643 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14215 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 28) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:45.452826 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:10:45.583925 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:10:45.680531 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (357 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:45.809278 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:45.917637 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (570 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:46.022444 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:48.765015 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:10:51.478135 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:10:54.201509 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:10:56.930729 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13647 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14217 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 29) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:10:59.669278 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:10:59.791921 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:10:59.888890 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (348 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:00.017745 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:00.126255 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:00.232142 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:02.972249 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:05.686911 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:08.410100 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2734 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:11.144068 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14211 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 30) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:13.880157 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:11:14.008780 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:11:14.105826 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (354 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:14.234814 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:14.343309 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (569 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:14.449242 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:17.192029 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:19.908463 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8182 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:22.631156 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:25.361451 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2742 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13654 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14223 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 31) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:28.103863 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:11:28.228013 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:11:28.324905 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:28.453718 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:28.562162 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:28.666991 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:31.409137 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:34.332324 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8388 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:37.054209 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:39.780568 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2747 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13861 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14424 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 32) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:42.527606 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:11:42.651366 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:11:42.748394 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:42.877362 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:42.985738 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:43.090628 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:45.829710 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:11:48.547304 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:51.269436 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:54.000267 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13649 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 33) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:56.739511 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:11:56.863593 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:11:56.960994 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:11:57.089884 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:11:57.198369 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:11:57.303884 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:00.045337 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:02.768491 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8184 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:05.487507 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:08.215085 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2734 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 34) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:10.949774 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:12:11.074007 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:12:11.170997 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:11.299839 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:11.408010 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:11.512806 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:14.247437 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:16.968304 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8175 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:19.687834 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:22.415524 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2735 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13638 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14201 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 35) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:25.150982 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:12:25.274811 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:12:25.371734 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:25.500427 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:25.608630 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:25.713833 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:28.457058 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:31.170761 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:33.894801 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:36.622958 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2746 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13655 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14218 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 36) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:39.368774 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:12:39.492975 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:12:39.589929 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:39.719230 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:39.827474 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:39.933552 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:42.673672 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:45.386744 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:48.109858 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:50.835275 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13639 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14204 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 37) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:53.572304 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:12:53.696094 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:12:53.793076 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:12:53.921893 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:12:54.030344 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:12:54.135119 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:56.875649 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:12:59.803879 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8391 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:02.526600 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:05.254542 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2745 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13864 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14427 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 38) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:07.999873 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:13:08.124362 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:13:08.221426 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:08.350404 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:08.458993 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (107 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (566 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:08.565189 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:11.307301 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:14.020009 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:16.741436 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2745 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:19.487840 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2942 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13864 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14430 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 39) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:22.429373 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:13:22.552263 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:13:22.649644 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:22.779155 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:22.888820 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (107 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (566 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:22.995196 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:25.734185 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:28.446522 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8174 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:31.169800 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:33.895110 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2948 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13848 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14414 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 40) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:36.843751 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:13:36.968765 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:13:37.066331 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (352 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:37.195152 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:37.303653 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (566 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:37.409889 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:40.156541 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:42.877708 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8192 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:45.601624 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:48.331053 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13660 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14226 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 41) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:51.069492 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:13:51.193828 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:13:51.291218 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:51.420321 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:13:51.528956 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:13:51.633817 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:54.378536 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:13:57.090741 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:13:59.813783 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:02.543474 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 42) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:05.279968 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:14:05.404091 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:14:05.501667 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (352 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:05.631188 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:05.740687 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (567 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:05.846251 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:08.585155 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:11.302639 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:14.025188 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2741 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:16.766188 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13657 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14224 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 43) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:19.503463 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:14:19.627590 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:14:19.724643 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:19.853566 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:19.962455 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:20.067543 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:22.805920 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:25.516106 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8168 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:28.235419 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:30.966661 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2735 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13634 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14198 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 44) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:33.701746 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:14:33.826449 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:14:33.923947 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (352 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:34.053122 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:34.163007 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (567 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:34.268366 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:37.008870 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:39.728480 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:42.446842 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:45.175587 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13647 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14214 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 45) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:47.915623 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:14:48.039445 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:14:48.136561 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:48.265528 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:48.374550 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:14:48.479578 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:51.216408 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:14:53.942649 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:14:56.658063 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:14:59.384084 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13644 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14208 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 46) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:02.123279 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:15:02.246004 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:15:02.343567 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:02.472645 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:02.580998 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:02.686489 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:05.425271 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:08.140646 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:10.863209 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2936 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:13.799165 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13852 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14415 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 47) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:16.538796 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:15:16.662744 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:15:16.841286 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (487 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:17.025348 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:17.134399 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (701 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:17.239547 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:19.976517 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:22.964450 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8575 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:25.814565 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:28.541985 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (14040 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14741 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 48) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:31.279821 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:15:31.403120 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:15:31.500618 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:31.629904 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:31.738885 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:31.843987 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:34.576006 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:37.290390 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8166 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:40.009248 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:42.739712 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13633 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14197 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 49) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:45.476593 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:15:45.599467 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:15:45.696815 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:45.826053 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:45.935309 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:46.040673 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:48.780478 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:15:51.500903 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8186 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:15:54.226284 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:15:56.957314 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2742 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13659 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14223 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 50) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:15:59.699723 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:15:59.823060 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:15:59.920460 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:00.049569 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:00.158274 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:00.264315 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:03.001996 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:05.715445 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8174 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:08.438761 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:11.167143 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13639 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14204 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 51) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:13.904026 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:16:14.027341 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:16:14.124650 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:14.253789 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:14.362350 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:14.467378 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:17.207962 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:19.932337 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8187 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:22.655045 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:25.383358 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2741 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13657 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14220 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 52) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:28.124138 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:16:28.248893 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:16:28.345741 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:28.474535 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:28.583178 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:28.688721 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:31.427981 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:34.148156 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:36.869860 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:39.594815 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13643 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14207 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 53) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:42.332016 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:16:42.455626 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:16:42.552680 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:42.681511 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:42.790052 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (562 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:42.894888 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:45.635545 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:48.352008 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:51.070807 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:53.800357 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13644 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14207 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 54) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:56.538530 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:16:56.662395 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:16:56.759811 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:16:56.888579 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:16:56.997287 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:16:57.102667 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:16:59.843384 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:02.555049 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8175 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:05.277067 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:08.002976 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13638 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14202 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 55) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:10.740936 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:17:10.869810 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:17:10.966969 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (356 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:11.096244 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:11.204597 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (570 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:11.310451 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:14.051606 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:16.772779 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8183 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:19.493300 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:22.223536 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13651 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14221 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 56) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:24.961930 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:17:25.085870 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:17:25.182865 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:25.311522 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:25.419945 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:25.524745 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:28.265972 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:30.994602 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8191 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:33.715381 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:36.443312 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13656 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14219 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 57) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:39.180363 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:17:39.308849 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:17:39.405820 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (354 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:39.534811 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:39.643414 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (568 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:39.748194 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:42.484309 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:45.207026 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:47.929239 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:50.654469 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2733 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13639 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14207 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 58) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:53.387976 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:17:53.511098 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:17:53.608278 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:17:53.737215 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:17:53.845681 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:17:53.951706 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:56.692399 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:17:59.421442 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8188 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:02.139384 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:04.869282 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13657 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14221 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 59) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:07.608284 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:18:07.738957 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:18:07.835924 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (356 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:07.964807 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:08.073295 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (570 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:08.178735 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:10.920130 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:13.643133 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8186 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:16.364374 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:19.092989 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2748 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13662 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14232 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 60) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:21.840169 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:18:21.964382 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:18:22.061543 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:22.190534 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:22.299027 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:22.403877 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:25.142762 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:27.854235 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8171 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:30.574173 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:33.299217 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2734 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13630 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14193 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 61) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:36.033640 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:18:36.156999 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:18:36.254061 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:36.382953 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:36.491603 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:36.596527 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:39.336333 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:42.051081 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8175 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:44.771227 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:47.499917 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13640 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14203 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 62) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:50.236508 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:18:50.365116 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:18:50.462224 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (355 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:50.591100 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:18:50.699777 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (568 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:18:50.804571 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:53.544430 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:18:56.260891 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8175 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:18:58.979728 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2729 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:01.708869 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2741 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14213 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 63) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:04.449803 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:19:04.577015 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:19:04.674141 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (354 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:04.803027 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:04.911556 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (568 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:05.017647 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:07.765074 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:10.478811 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8184 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:13.201280 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:15.928872 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13650 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14218 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 64) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:18.667608 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:19:18.790761 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:19:18.887920 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:19.016774 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:19.125778 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:19.230726 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:21.968726 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:24.685693 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:27.410423 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:30.137689 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14208 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 65) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:32.875387 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:19:33.003933 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:19:33.101358 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (355 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:33.230944 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:33.339558 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (569 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:33.444670 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:36.185410 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:38.906527 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8189 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:41.633239 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:44.363819 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13655 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14224 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 66) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:47.099949 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:19:47.223505 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:19:47.320590 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:47.449440 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:47.558390 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:19:47.663764 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:50.401808 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:19:53.120781 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:19:55.840131 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:19:58.568840 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2743 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 67) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:01.311373 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:20:01.435042 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:20:01.532351 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:01.661217 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:01.769912 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:01.874857 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:04.613392 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:07.326386 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8174 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:10.048657 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2741 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:12.789288 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13655 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14218 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 68) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:15.529834 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:20:15.654107 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:20:15.751065 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:15.879874 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:15.988344 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:16.093164 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:19.044749 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:21.758802 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8388 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:24.481400 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:27.207345 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13851 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14415 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 69) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:29.944092 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:20:30.068202 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:20:30.165325 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:30.294207 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:30.402746 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:30.507689 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:33.248574 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:35.962918 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:38.688788 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:41.413247 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2943 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13849 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14412 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 70) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:44.356520 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:20:44.480630 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:20:44.577684 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:44.706651 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:44.815110 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:44.919986 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:47.660135 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:20:50.374994 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:53.097714 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2733 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:55.830989 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2734 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14208 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 71) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:58.564745 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:20:58.687733 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:20:58.784907 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:20:58.913942 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (110 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:20:59.023283 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:20:59.128070 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:01.870230 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:04.585593 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:07.309762 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:10.039947 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13650 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14214 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 72) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:12.778579 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:21:12.902963 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:21:13.000123 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:13.129060 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:13.237619 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:13.342522 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:16.082043 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:18.796044 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:21.521119 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:24.252744 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2741 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13651 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14215 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 73) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:26.993901 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:21:27.118093 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:21:27.215006 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:27.343847 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:27.452544 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:27.557727 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:30.298696 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:33.012607 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8175 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:35.732376 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:38.458561 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13639 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14203 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 74) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:41.196310 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:21:41.320027 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:21:41.417277 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:41.546279 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:41.654664 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:41.760548 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:44.500694 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:47.215032 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:49.937486 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2724 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:52.662037 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2735 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13637 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14201 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 75) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:55.397872 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:21:55.521543 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:21:55.618417 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:21:55.747231 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:21:55.856096 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:21:55.960847 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:21:58.695684 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:01.410557 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8172 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:04.132800 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:06.857761 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2742 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13639 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14202 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 76) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:09.599891 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:22:09.723623 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:22:09.820677 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:09.949729 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:10.058187 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:10.163023 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:12.908381 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:15.622938 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8182 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:18.345719 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:21.072134 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 77) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:23.811228 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:22:23.934610 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:22:24.031679 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:24.160729 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:24.269292 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:24.374233 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:27.112658 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:29.827167 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8175 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:32.549950 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2734 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:35.283857 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14209 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 78) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:38.020359 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:22:38.141856 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:22:38.238750 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (347 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:38.367643 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:38.476200 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (561 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:38.581123 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:41.324097 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:44.038695 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:46.761126 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:49.487164 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13643 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14204 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 79) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:52.224475 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:22:52.348079 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:22:52.444975 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:22:52.574090 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:22:52.682639 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:22:52.787498 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:55.528075 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:22:58.242808 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:00.966380 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:03.692719 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13642 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14205 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 80) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:06.429414 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:23:06.553077 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:23:06.650141 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:06.778892 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:06.887444 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:06.993640 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:09.735122 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:12.450028 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:15.173966 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:17.900318 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13644 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14208 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 81) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:20.637369 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:23:20.761349 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:23:20.858819 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:20.987710 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (107 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:21.095016 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:21.200028 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:23.941263 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:26.864720 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8390 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:29.590205 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:32.315943 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13854 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14417 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 82) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:35.054072 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:23:35.177975 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:23:35.274732 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:35.403371 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:35.512215 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:35.618738 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:38.361254 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:41.075076 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8179 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:43.797600 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:46.523490 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13642 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14206 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 83) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:49.260294 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:23:49.383301 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:23:49.480432 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:49.609222 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:23:49.718346 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:23:49.823312 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:52.564937 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:23:55.278257 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:23:58.001042 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:00.726966 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13642 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14205 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 84) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:03.465669 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:24:03.589498 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:24:03.686719 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:03.815522 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:03.924101 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (104 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:04.028681 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:06.768326 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:09.485628 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:12.209496 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:14.935734 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13644 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14207 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 85) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:17.672562 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:24:17.796109 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:24:17.893056 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:18.021927 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:18.130671 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:18.235231 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:20.984061 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:23.907301 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8395 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:26.630216 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2724 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:29.354171 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2735 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13854 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14417 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 86) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:32.089598 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:24:32.213340 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:24:32.310549 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:32.439461 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:32.548563 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:32.654100 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:35.396471 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:38.115495 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8183 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:40.837889 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:43.562876 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14211 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 87) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:46.300469 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:24:46.423996 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:24:46.521170 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:46.650099 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:46.758745 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:24:46.863705 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:49.603634 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:24:52.318802 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:24:55.040951 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:24:57.768445 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13645 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14208 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 88) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:00.508136 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:25:00.632685 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:25:00.729765 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:00.858809 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:00.967527 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:01.072436 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:03.812587 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:06.737390 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8389 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:09.461117 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:12.187108 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13851 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14415 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 89) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:14.923653 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:25:15.047389 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:25:15.144505 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:15.273577 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:15.382282 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:15.487323 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:18.229351 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:20.951476 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8186 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:23.673939 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:26.403748 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13653 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14217 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 90) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:29.140543 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:25:29.264319 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:25:29.361510 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:29.490556 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:29.599344 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:29.704157 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:32.445060 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:35.159432 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:37.881599 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:40.612994 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 91) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:43.352833 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:25:43.476573 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:25:43.573698 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:43.702708 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:43.811332 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:43.916164 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:46.656641 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:25:49.370965 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8180 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:52.096055 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:54.824055 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13647 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14211 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 92) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:57.564013 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:25:57.688484 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:25:57.785689 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:25:57.914686 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:25:58.023159 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:25:58.128177 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:00.868364 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:03.582830 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8177 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:06.305460 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:09.031304 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2736 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13639 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14204 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 93) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:11.767899 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:26:11.891290 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:26:11.988407 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:12.117362 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:12.225894 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:12.330677 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:15.071115 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:17.783632 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8176 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:20.506583 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2731 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:23.237731 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2739 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13646 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14209 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 94) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:25.976771 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:26:26.100435 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:26:26.197538 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:26.326551 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:26.435003 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:26.539832 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:29.282025 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:31.995141 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:34.717638 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:37.443087 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13642 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14205 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 95) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:40.181951 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:26:40.306155 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:26:40.403390 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (351 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:40.532375 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:40.640923 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:40.745774 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:43.488454 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:46.414655 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8391 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:49.136615 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2725 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:51.861369 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13854 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14418 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 96) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:54.599114 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:26:54.723551 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:26:54.820689 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:26:54.949673 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:26:55.058187 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:26:55.164238 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:26:57.903964 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:00.619043 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8178 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:03.342120 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:06.070930 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2735 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13641 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14206 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 97) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:08.805820 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:27:08.929004 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:27:09.026154 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (349 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:09.155023 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (108 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:09.263554 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (563 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:09.368535 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:12.112524 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:14.826772 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8181 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:17.549365 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2726 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:20.275871 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2740 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13647 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14210 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 98) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:23.015390 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:27:23.139356 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:27:23.236583 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:23.365487 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:23.474241 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:23.579164 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:26.320143 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:29.242516 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8390 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:31.969722 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2730 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:34.699236 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13857 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14421 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 99) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:37.436697 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:27:37.560237 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:27:37.657835 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:37.786895 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:37.895637 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (106 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (565 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:38.001669 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:40.740727 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:43.473496 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8194 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:46.195152 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2728 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:48.923658 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2738 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13660 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14225 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 100) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:51.661904 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess.tflite I20210111 19:27:51.785621 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess.tflite I20210111 19:27:51.882833 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (350 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:27:52.011958 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFaceModel/0 (109 ms) [ RUN ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:27:52.120748 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet.tflite [ OK ] DetectionCpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (105 ms) [----------] 3 tests from DetectionCpuModelTest/DetectionModelTest (564 ms total) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 I20210111 19:27:52.225598 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:54.968080 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_coco_quant_postprocess_edgetpu.tflite I20210111 19:27:57.683197 3151723 test_utils.cc:146] Testing model: ssdlite_mobiledet_coco_qat_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestSSDModelsWithCat/0 (8184 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 I20210111 19:28:00.409117 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v2_face_quant_postprocess_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFaceModel/0 (2727 ms) [ RUN ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 I20210111 19:28:03.136124 3151723 test_utils.cc:146] Testing model: ssd_mobilenet_v1_fine_tuned_pet_edgetpu.tflite [ OK ] DetectionEdgeTpuModelTest/DetectionModelTest.TestFineTunedPetModel/0 (2737 ms) [----------] 3 tests from DetectionEdgeTpuModelTest/DetectionModelTest (13648 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (14212 ms total) [ PASSED ] 6 tests. ----------------------------------------------------- segmentation_models_test ----------------------------------------------------- Repeating all tests (iteration 1) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3132 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4207 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8514 ms) [----------] 4 tests from ModelCorrectnessTest (18762 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18762 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 2) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3330 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2917 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4179 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8518 ms) [----------] 4 tests from ModelCorrectnessTest (18944 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18944 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 3) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3331 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8522 ms) [----------] 4 tests from ModelCorrectnessTest (18931 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18931 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 4) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (3118 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4173 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8524 ms) [----------] 4 tests from ModelCorrectnessTest (18938 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18938 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 5) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2917 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8511 ms) [----------] 4 tests from ModelCorrectnessTest (18716 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18716 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 6) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3116 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4171 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8515 ms) [----------] 4 tests from ModelCorrectnessTest (18711 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18711 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 7) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18926 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18926 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 8) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4165 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18712 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18712 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 9) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4179 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8509 ms) [----------] 4 tests from ModelCorrectnessTest (18725 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18726 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 10) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2913 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8523 ms) [----------] 4 tests from ModelCorrectnessTest (18724 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18724 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 11) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8518 ms) [----------] 4 tests from ModelCorrectnessTest (18715 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18715 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 12) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18716 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18716 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 13) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4177 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18727 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18727 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 14) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4180 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8509 ms) [----------] 4 tests from ModelCorrectnessTest (18717 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18717 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 15) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2904 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8522 ms) [----------] 4 tests from ModelCorrectnessTest (18715 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18715 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 16) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18723 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18723 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 17) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18723 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18723 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 18) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2924 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8512 ms) [----------] 4 tests from ModelCorrectnessTest (18726 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18726 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 19) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2923 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8512 ms) [----------] 4 tests from ModelCorrectnessTest (18729 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18729 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 20) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2906 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8512 ms) [----------] 4 tests from ModelCorrectnessTest (18709 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18710 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 21) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2921 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18734 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18734 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 22) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8513 ms) [----------] 4 tests from ModelCorrectnessTest (18716 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18716 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 23) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3116 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18712 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18712 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 24) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4182 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8523 ms) [----------] 4 tests from ModelCorrectnessTest (18736 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18736 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 25) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8505 ms) [----------] 4 tests from ModelCorrectnessTest (18704 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18704 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 26) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8510 ms) [----------] 4 tests from ModelCorrectnessTest (18713 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18713 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 27) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8722 ms) [----------] 4 tests from ModelCorrectnessTest (18919 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18919 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 28) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8514 ms) [----------] 4 tests from ModelCorrectnessTest (18717 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18717 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 29) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3133 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2921 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4173 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8521 ms) [----------] 4 tests from ModelCorrectnessTest (18749 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18749 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 30) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8513 ms) [----------] 4 tests from ModelCorrectnessTest (18716 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18716 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 31) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2904 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4374 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18919 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18919 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 32) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (1 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3329 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8514 ms) [----------] 4 tests from ModelCorrectnessTest (18921 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18922 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 33) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8523 ms) [----------] 4 tests from ModelCorrectnessTest (18721 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 34) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8516 ms) [----------] 4 tests from ModelCorrectnessTest (18721 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 35) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3118 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2904 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8509 ms) [----------] 4 tests from ModelCorrectnessTest (18698 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18698 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 36) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18716 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18716 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 37) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2905 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18714 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18714 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 38) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2919 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8518 ms) [----------] 4 tests from ModelCorrectnessTest (18733 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18733 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 39) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2919 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8727 ms) [----------] 4 tests from ModelCorrectnessTest (18939 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18939 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 40) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8519 ms) [----------] 4 tests from ModelCorrectnessTest (18720 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18720 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 41) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4171 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8515 ms) [----------] 4 tests from ModelCorrectnessTest (18721 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 42) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2920 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8513 ms) [----------] 4 tests from ModelCorrectnessTest (18725 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18725 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 43) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8529 ms) [----------] 4 tests from ModelCorrectnessTest (18731 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18731 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 44) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8513 ms) [----------] 4 tests from ModelCorrectnessTest (18713 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18713 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 45) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8518 ms) [----------] 4 tests from ModelCorrectnessTest (18713 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18713 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 46) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2923 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4166 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8513 ms) [----------] 4 tests from ModelCorrectnessTest (18723 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18724 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 47) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3118 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18711 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18711 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 48) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4166 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8525 ms) [----------] 4 tests from ModelCorrectnessTest (18724 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18724 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 49) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2920 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18729 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18729 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 50) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3118 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4171 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18714 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18714 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 51) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3117 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2922 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4375 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8736 ms) [----------] 4 tests from ModelCorrectnessTest (19150 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (19151 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 52) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2923 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4175 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8527 ms) [----------] 4 tests from ModelCorrectnessTest (18748 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18748 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 53) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3127 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4176 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8521 ms) [----------] 4 tests from ModelCorrectnessTest (18732 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18732 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 54) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2920 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18733 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18733 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 55) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4175 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8515 ms) [----------] 4 tests from ModelCorrectnessTest (18724 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18724 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 56) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4171 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8723 ms) [----------] 4 tests from ModelCorrectnessTest (18928 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18928 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 57) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8516 ms) [----------] 4 tests from ModelCorrectnessTest (18716 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18716 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 58) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4176 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8518 ms) [----------] 4 tests from ModelCorrectnessTest (18728 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18728 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 59) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8509 ms) [----------] 4 tests from ModelCorrectnessTest (18708 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18709 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 60) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2902 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4171 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8507 ms) [----------] 4 tests from ModelCorrectnessTest (18705 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18705 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 61) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8512 ms) [----------] 4 tests from ModelCorrectnessTest (18706 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18706 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 62) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8511 ms) [----------] 4 tests from ModelCorrectnessTest (18711 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18711 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 63) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8522 ms) [----------] 4 tests from ModelCorrectnessTest (18724 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18724 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 64) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2912 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8522 ms) [----------] 4 tests from ModelCorrectnessTest (18729 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18729 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 65) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2913 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8516 ms) [----------] 4 tests from ModelCorrectnessTest (18721 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 66) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8527 ms) [----------] 4 tests from ModelCorrectnessTest (18736 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18736 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 67) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4175 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8524 ms) [----------] 4 tests from ModelCorrectnessTest (18732 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18732 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 68) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3331 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18933 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18933 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 69) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2920 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4171 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8523 ms) [----------] 4 tests from ModelCorrectnessTest (18734 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18734 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 70) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2919 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8519 ms) [----------] 4 tests from ModelCorrectnessTest (18733 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18733 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 71) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (1 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (1 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2922 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4183 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8511 ms) [----------] 4 tests from ModelCorrectnessTest (18742 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18743 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 72) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4373 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8524 ms) [----------] 4 tests from ModelCorrectnessTest (18929 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18929 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 73) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2912 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8516 ms) [----------] 4 tests from ModelCorrectnessTest (18721 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 74) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3120 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4166 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8506 ms) [----------] 4 tests from ModelCorrectnessTest (18703 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18703 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 75) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8505 ms) [----------] 4 tests from ModelCorrectnessTest (18703 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18703 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 76) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4165 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8709 ms) [----------] 4 tests from ModelCorrectnessTest (18909 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18909 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 77) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8506 ms) [----------] 4 tests from ModelCorrectnessTest (18704 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18704 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 78) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2916 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4178 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8506 ms) [----------] 4 tests from ModelCorrectnessTest (18721 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 79) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8509 ms) [----------] 4 tests from ModelCorrectnessTest (18711 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18711 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 80) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8510 ms) [----------] 4 tests from ModelCorrectnessTest (18925 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18925 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 81) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4175 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18719 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18719 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 82) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3125 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2907 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4183 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8513 ms) [----------] 4 tests from ModelCorrectnessTest (18728 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18728 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 83) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4167 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8512 ms) [----------] 4 tests from ModelCorrectnessTest (18711 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18711 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 84) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2915 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4176 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8518 ms) [----------] 4 tests from ModelCorrectnessTest (18733 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18733 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 85) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3123 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2921 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4173 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8730 ms) [----------] 4 tests from ModelCorrectnessTest (18947 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18947 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 86) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3118 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2915 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4173 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8525 ms) [----------] 4 tests from ModelCorrectnessTest (18731 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18731 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 87) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2912 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4175 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8529 ms) [----------] 4 tests from ModelCorrectnessTest (18740 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18740 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 88) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3127 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4181 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8537 ms) [----------] 4 tests from ModelCorrectnessTest (18969 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18969 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 89) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8526 ms) [----------] 4 tests from ModelCorrectnessTest (18729 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18729 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 90) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3129 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2911 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4175 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8525 ms) [----------] 4 tests from ModelCorrectnessTest (18740 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18740 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 91) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3126 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2915 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8522 ms) [----------] 4 tests from ModelCorrectnessTest (18731 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18731 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 92) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3128 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2920 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4179 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8521 ms) [----------] 4 tests from ModelCorrectnessTest (18748 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18748 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 93) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4174 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8526 ms) [----------] 4 tests from ModelCorrectnessTest (18733 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18733 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 94) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2905 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4169 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8509 ms) [----------] 4 tests from ModelCorrectnessTest (18707 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18707 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 95) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (1 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2910 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4174 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8517 ms) [----------] 4 tests from ModelCorrectnessTest (18720 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18721 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 96) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3124 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2908 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8519 ms) [----------] 4 tests from ModelCorrectnessTest (18719 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18719 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 97) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3119 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2915 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4172 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8519 ms) [----------] 4 tests from ModelCorrectnessTest (18725 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18725 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 98) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3117 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2909 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4168 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8520 ms) [----------] 4 tests from ModelCorrectnessTest (18714 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18714 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 99) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3122 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2922 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8519 ms) [----------] 4 tests from ModelCorrectnessTest (18733 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18733 ms total) [ PASSED ] 6 tests. Repeating all tests (iteration 100) . . . [==========] Running 6 tests from 2 test suites. [----------] Global test environment set-up. [----------] 2 tests from ModelCorrectnessUtilsTest [ RUN ] ModelCorrectnessUtilsTest.IntersectionOverUnion [ OK ] ModelCorrectnessUtilsTest.IntersectionOverUnion (0 ms) [ RUN ] ModelCorrectnessUtilsTest.Argmax [ OK ] ModelCorrectnessUtilsTest.Argmax (0 ms) [----------] 2 tests from ModelCorrectnessUtilsTest (0 ms total) [----------] 4 tests from ModelCorrectnessTest [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm1_WithArgMax (3121 ms) [ RUN ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax [ OK ] ModelCorrectnessTest.Deeplab513Mv2Dm05_WithArgMax (2905 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet128MobilenetV2 (4170 ms) [ RUN ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 [ OK ] ModelCorrectnessTest.Keras_PostTrainingQuantization_UNet256MobilenetV2 (8522 ms) [----------] 4 tests from ModelCorrectnessTest (18718 ms total) [----------] Global test environment tear-down [==========] 6 tests from 2 test suites ran. (18718 ms total) [ PASSED ] 6 tests. ----------------------------------------------------- models_benchmark ----------------------------------------------------- 2021-01-11 19:59:21 Running /tmp/CTS/models_benchmark Run on (72 X 3700 MHz CPU s) CPU Caches: L1 Data 32K (x36) L1 Instruction 32K (x36) L2 Unified 1024K (x36) L3 Unified 25344K (x2) ----------------------------------------------------------------------------------------------------------- Benchmark Time CPU Iterations ----------------------------------------------------------------------------------------------------------- BM_MobileNetV1 2338807 ns 140532 ns 8002 BM_MobileNetV1 47679390 ns 47673236 ns 14 BM_MobileNetV1_25 597991 ns 39381 ns 10000 BM_MobileNetV1_25 2398299 ns 2398000 ns 291 BM_MobileNetV1_50 957820 ns 43012 ns 10000 BM_MobileNetV1_50 8888364 ns 8887170 ns 78 BM_MobileNetV1_75 1426513 ns 129471 ns 5557 BM_MobileNetV1_75 22834388 ns 22831093 ns 30 BM_MobileNetV1_L2Norm 2973906 ns 905246 ns 775 BM_MobileNetV1_L2Norm 48030887 ns 48024650 ns 14 BM_MobileNetV2 2533560 ns 121805 ns 1000 BM_MobileNetV2 42571485 ns 42564157 ns 16 BM_MobileNetV2INatPlant 2638269 ns 123784 ns 1000 BM_MobileNetV2INatPlant 43182090 ns 43177308 ns 16 BM_MobileNetV2INatInsect 2575730 ns 143273 ns 1000 BM_MobileNetV2INatInsect 42486191 ns 42479600 ns 16 BM_MobileNetV2INatBird 2539071 ns 133488 ns 1000 BM_MobileNetV2INatBird 42581409 ns 42573567 ns 16 BM_SsdMobileNetV1 18530423 ns 12093140 ns 57 BM_SsdMobileNetV1 109655738 ns 109607785 ns 6 BM_SsdMobileNetV2 7220747 ns 779045 ns 904 BM_SsdMobileNetV2 90326990 ns 90312764 ns 7 BM_FaceSsd 7085972 ns 2363780 ns 297 BM_FaceSsd 99746874 ns 99732859 ns 7 BM_InceptionV1 3097711 ns 130748 ns 1000 BM_InceptionV1 81938624 ns 81925232 ns 8 BM_InceptionV2 12974356 ns 139022 ns 1000 BM_InceptionV2 122612953 ns 122602234 ns 6 BM_InceptionV3 42171278 ns 112189 ns 100 BM_InceptionV3 313334703 ns 313295493 ns 2 BM_InceptionV4 83874736 ns 116940 ns 100 BM_InceptionV4 660542965 ns 660431763 ns 1 BM_EfficientNetEdgeTpuSmall 4935102 ns 134566 ns 1000 BM_EfficientNetEdgeTpuSmall 5763185024 ns 5743204726 ns 1 BM_EfficientNetEdgeTpuMedium 8414843 ns 133387 ns 1000 BM_EfficientNetEdgeTpuMedium 8932189941 ns 8914819077 ns 1 BM_EfficientNetEdgeTpuLarge 24497787 ns 146759 ns 1000 BM_EfficientNetEdgeTpuLarge 23485907555 ns 23444604190 ns 1 BM_Deeplab513Mv2Dm1_WithArgMax 54424485 ns 38785682 ns 18 BM_Deeplab513Mv2Dm1_WithArgMax 341238141 ns 341190503 ns 2 BM_Deeplab513Mv2Dm05_WithArgMax 45729461 ns 36123021 ns 19 BM_Deeplab513Mv2Dm05_WithArgMax 155634403 ns 155618821 ns 5 BM_KerasPostTrainingQuantizedUnetMv2128 3481214 ns 702981 ns 1021 BM_KerasPostTrainingQuantizedUnetMv2128 1444486141 ns 1444449789 ns 1 BM_KerasPostTrainingQuantizedUnetMv2256 27631698 ns 128075 ns 100 BM_KerasPostTrainingQuantizedUnetMv2256 5745963573 ns 5745705716 ns 1 BM_SsdMobileNetV1FineTunedPet 11295847 ns 6339517 ns 110 BM_SsdMobileNetV1FineTunedPet 99707672 ns 99706532 ns 7 BM_PostTrainingQuantizedTf2KerasMobileNetV1 2374626 ns 138960 ns 5349 BM_PostTrainingQuantizedTf2KerasMobileNetV1 1386690378 ns 1386514087 ns 1 BM_PostTrainingQuantizedTf2KerasMobileNetV2 2615727 ns 127060 ns 1000 BM_PostTrainingQuantizedTf2KerasMobileNetV2 750860929 ns 750787661 ns 1 BM_PostTrainingQuantizedTf2KerasMobileNetV3EdgeTpu 2750455 ns 136613 ns 1000 BM_PostTrainingQuantizedTf2KerasMobileNetV3EdgeTpu 2451340199 ns 2451190996 ns 1 BM_SsdLiteMobileDet 7679901 ns 795927 ns 870 BM_SsdLiteMobileDet 123385708 ns 123368472 ns 6 BM_SsdMobileNetV1_NoNms 6689343 ns 509111 ns 977 BM_SsdMobileNetV1_NoNms 98150662 ns 98148012 ns 7 BM_SsdMobileNetV2_NoNms 7170026 ns 731973 ns 953 BM_SsdMobileNetV2_NoNms 92283555 ns 92280273 ns 7 BM_Tf2Resnet50ImagenetPtq 42542102 ns 132212 ns 100 BM_Tf2Resnet50ImagenetPtq 10041791201 ns 10041265948 ns 1