Namespace(accumulate=1, batch_norm=False, batch_size=8, clip_grad=0, crop_ratio=0.875, data_dir='/home/ubuntu/yizhu/data/kinetics400/kinetics400/train_256', dataset='kinetics400', dtype='float32', eval=False, fast_temporal_stride=2, hard_weight=0.5, hashtag='', input_5d=False, input_size=224, kvstore=None, label_smoothing=False, last_gamma=False, log_interval=50, logging_file='tsn_2d_rgb_res50_seg7_kinetics400_b8_g8_cosine_cleanv3.txt', lr=0.01, lr_decay=0.1, lr_decay_epoch='40,60', lr_decay_period=0, lr_mode='cosine', mixup=False, mixup_alpha=0.2, mixup_off_epoch=0, mode='hybrid', model='resnet50_v1b_kinetics400', momentum=0.9, new_height=256, new_length=1, new_step=1, new_width=340, no_wd=False, num_classes=400, num_crop=1, num_epochs=100, num_gpus=8, num_segments=7, num_workers=32, partial_bn=False, prefetch_ratio=1.0, resume_epoch=0, resume_params='', resume_states='', save_dir='/home/ubuntu/yizhu/logs/mxnet/kinetics400/2dresnet/tsn_2d_rgb_res50_seg7_kinetics400_b8_g8_cosine_cleanv3', save_frequency=20, scale_ratios='1.0,0.8', slow_temporal_stride=16, slowfast=False, teacher=None, temperature=20, train_list='/home/ubuntu/yizhu/data/kinetics400/kinetics400/k400_train_240618.txt', use_amp=False, use_decord=True, use_gn=False, use_pretrained=False, use_se=False, use_tsn=False, val_data_dir='/home/ubuntu/yizhu/data/kinetics400/kinetics400/val_256', val_list='/home/ubuntu/yizhu/code/gluon-cv/extra/kinetics400/k400_val_19761_cleanv3.txt', video_loader=True, warmup_epochs=0, warmup_lr=0.0, wd=0.0001) Total batch size is set to 64 on 8 GPUs ActionRecResNetV1b( (conv1): Conv2D(3 -> 64, kernel_size=(7, 7), stride=(2, 2), padding=(3, 3), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu): Activation(relu) (maxpool): MaxPool2D(size=(3, 3), stride=(2, 2), padding=(1, 1), ceil_mode=False, global_pool=False, pool_type=max, layout=NCHW) (layer1): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(64 -> 64, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu1): Activation(relu) (conv2): Conv2D(64 -> 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu2): Activation(relu) (conv3): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) ) ) (1): BottleneckV1b( (conv1): Conv2D(256 -> 64, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu1): Activation(relu) (conv2): Conv2D(64 -> 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu2): Activation(relu) (conv3): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(256 -> 64, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu1): Activation(relu) (conv2): Conv2D(64 -> 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu2): Activation(relu) (conv3): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu3): Activation(relu) ) ) (layer2): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(256 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(256 -> 512, kernel_size=(1, 1), stride=(2, 2), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) ) ) (1): BottleneckV1b( (conv1): Conv2D(512 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(512 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) ) (3): BottleneckV1b( (conv1): Conv2D(512 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) ) ) (layer3): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(512 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(512 -> 1024, kernel_size=(1, 1), stride=(2, 2), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) ) ) (1): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (3): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (4): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (5): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) ) (layer4): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(1024 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu1): Activation(relu) (conv2): Conv2D(512 -> 512, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu2): Activation(relu) (conv3): Conv2D(512 -> 2048, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(1024 -> 2048, kernel_size=(1, 1), stride=(2, 2), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) ) ) (1): BottleneckV1b( (conv1): Conv2D(2048 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu1): Activation(relu) (conv2): Conv2D(512 -> 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu2): Activation(relu) (conv3): Conv2D(512 -> 2048, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(2048 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu1): Activation(relu) (conv2): Conv2D(512 -> 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu2): Activation(relu) (conv3): Conv2D(512 -> 2048, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) (relu3): Activation(relu) ) ) (avgpool): GlobalAvgPool2D(size=(1, 1), stride=(1, 1), padding=(0, 0), ceil_mode=True, global_pool=True, pool_type=avg, layout=NCHW) (flat): Flatten (drop): Dropout(p = 0.5, axes=()) (output): Dense(2048 -> 400, linear) ) Load 240618 training samples and 19404 validation samples. Namespace(accumulate=1, batch_norm=False, batch_size=8, clip_grad=0, crop_ratio=0.875, data_dir='/home/ubuntu/yizhu/data/kinetics400/kinetics400/train_256', dataset='kinetics400', dtype='float32', eval=False, fast_temporal_stride=2, hard_weight=0.5, hashtag='', input_5d=False, input_size=224, kvstore=None, label_smoothing=False, last_gamma=False, log_interval=50, logging_file='tsn_2d_rgb_res50_seg7_kinetics400_b8_g8_cosine_cleanv3.txt', lr=0.01, lr_decay=0.1, lr_decay_epoch='40,60', lr_decay_period=0, lr_mode='cosine', mixup=False, mixup_alpha=0.2, mixup_off_epoch=0, mode='hybrid', model='resnet50_v1b_kinetics400', momentum=0.9, new_height=256, new_length=1, new_step=1, new_width=340, no_wd=False, num_classes=400, num_crop=1, num_epochs=100, num_gpus=8, num_segments=7, num_workers=32, partial_bn=False, prefetch_ratio=1.0, resume_epoch=0, resume_params='', resume_states='', save_dir='/home/ubuntu/yizhu/logs/mxnet/kinetics400/2dresnet/tsn_2d_rgb_res50_seg7_kinetics400_b8_g8_cosine_cleanv3', save_frequency=20, scale_ratios='1.0,0.8', slow_temporal_stride=16, slowfast=False, teacher=None, temperature=20, train_list='/home/ubuntu/yizhu/data/kinetics400/kinetics400/k400_train_240618.txt', use_amp=False, use_decord=True, use_gn=False, use_pretrained=False, use_se=False, use_tsn=False, val_data_dir='/home/ubuntu/yizhu/data/kinetics400/kinetics400/val_256', val_list='/home/ubuntu/yizhu/code/gluon-cv/extra/kinetics400/k400_val_19761_cleanv3.txt', video_loader=True, warmup_epochs=0, warmup_lr=0.0, wd=0.0001) Total batch size is set to 64 on 8 GPUs ActionRecResNetV1b( (conv1): Conv2D(3 -> 64, kernel_size=(7, 7), stride=(2, 2), padding=(3, 3), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu): Activation(relu) (maxpool): MaxPool2D(size=(3, 3), stride=(2, 2), padding=(1, 1), ceil_mode=False, global_pool=False, pool_type=max, layout=NCHW) (layer1): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(64 -> 64, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu1): Activation(relu) (conv2): Conv2D(64 -> 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu2): Activation(relu) (conv3): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) ) ) (1): BottleneckV1b( (conv1): Conv2D(256 -> 64, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu1): Activation(relu) (conv2): Conv2D(64 -> 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu2): Activation(relu) (conv3): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(256 -> 64, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu1): Activation(relu) (conv2): Conv2D(64 -> 64, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=64) (relu2): Activation(relu) (conv3): Conv2D(64 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu3): Activation(relu) ) ) (layer2): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(256 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(256 -> 512, kernel_size=(1, 1), stride=(2, 2), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) ) ) (1): BottleneckV1b( (conv1): Conv2D(512 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(512 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) ) (3): BottleneckV1b( (conv1): Conv2D(512 -> 128, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu1): Activation(relu) (conv2): Conv2D(128 -> 128, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=128) (relu2): Activation(relu) (conv3): Conv2D(128 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu3): Activation(relu) ) ) (layer3): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(512 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(512 -> 1024, kernel_size=(1, 1), stride=(2, 2), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) ) ) (1): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (3): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (4): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) (5): BottleneckV1b( (conv1): Conv2D(1024 -> 256, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu1): Activation(relu) (conv2): Conv2D(256 -> 256, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=256) (relu2): Activation(relu) (conv3): Conv2D(256 -> 1024, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=1024) (relu3): Activation(relu) ) ) (layer4): HybridSequential( (0): BottleneckV1b( (conv1): Conv2D(1024 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu1): Activation(relu) (conv2): Conv2D(512 -> 512, kernel_size=(3, 3), stride=(2, 2), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu2): Activation(relu) (conv3): Conv2D(512 -> 2048, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) (relu3): Activation(relu) (downsample): HybridSequential( (0): Conv2D(1024 -> 2048, kernel_size=(1, 1), stride=(2, 2), bias=False) (1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) ) ) (1): BottleneckV1b( (conv1): Conv2D(2048 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu1): Activation(relu) (conv2): Conv2D(512 -> 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu2): Activation(relu) (conv3): Conv2D(512 -> 2048, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) (relu3): Activation(relu) ) (2): BottleneckV1b( (conv1): Conv2D(2048 -> 512, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn1): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu1): Activation(relu) (conv2): Conv2D(512 -> 512, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), bias=False) (bn2): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=512) (relu2): Activation(relu) (conv3): Conv2D(512 -> 2048, kernel_size=(1, 1), stride=(1, 1), bias=False) (bn3): BatchNorm(axis=1, eps=1e-05, momentum=0.9, fix_gamma=False, use_global_stats=False, in_channels=2048) (relu3): Activation(relu) ) ) (avgpool): GlobalAvgPool2D(size=(1, 1), stride=(1, 1), padding=(0, 0), ceil_mode=True, global_pool=True, pool_type=avg, layout=NCHW) (flat): Flatten (drop): Dropout(p = 0.5, axes=()) (output): Dense(2048 -> 400, linear) ) Load 240618 training samples and 19404 validation samples. Epoch[000] Batch [0049]/[3759] Speed: 66.528629 samples/sec accuracy=1.937500 loss=5.849848 lr=0.010000 Epoch[000] Batch [0099]/[3759] Speed: 120.984220 samples/sec accuracy=4.562500 loss=5.572666 lr=0.010000 Epoch[000] Batch [0149]/[3759] Speed: 110.900913 samples/sec accuracy=6.802083 loss=5.250732 lr=0.010000 Epoch[000] Batch [0199]/[3759] Speed: 116.160234 samples/sec accuracy=9.179688 loss=4.983676 lr=0.010000 Epoch[000] Batch [0249]/[3759] Speed: 112.047143 samples/sec accuracy=11.187500 loss=4.769388 lr=0.010000 Epoch[000] Batch [0299]/[3759] Speed: 113.717374 samples/sec accuracy=13.187500 loss=4.582330 lr=0.010000 Epoch[000] Batch [0349]/[3759] Speed: 120.490677 samples/sec accuracy=14.687500 loss=4.437621 lr=0.010000 Epoch[000] Batch [0399]/[3759] Speed: 107.658020 samples/sec accuracy=16.167969 loss=4.311942 lr=0.010000 Epoch[000] Batch [0449]/[3759] Speed: 131.671280 samples/sec accuracy=17.229167 loss=4.212032 lr=0.010000 Epoch[000] Batch [0499]/[3759] Speed: 107.568154 samples/sec accuracy=18.421875 loss=4.118511 lr=0.010000 Epoch[000] Batch [0549]/[3759] Speed: 123.123226 samples/sec accuracy=19.292614 loss=4.041146 lr=0.010000 Epoch[000] Batch [0599]/[3759] Speed: 114.893224 samples/sec accuracy=20.117188 loss=3.967044 lr=0.010000 Epoch[000] Batch [0649]/[3759] Speed: 118.897904 samples/sec accuracy=21.019231 loss=3.898877 lr=0.010000 Epoch[000] Batch [0699]/[3759] Speed: 118.879344 samples/sec accuracy=21.792411 loss=3.842639 lr=0.010000 Epoch[000] Batch [0749]/[3759] Speed: 114.505526 samples/sec accuracy=22.435417 loss=3.790431 lr=0.010000 Epoch[000] Batch [0799]/[3759] Speed: 113.320756 samples/sec accuracy=23.142578 loss=3.739513 lr=0.010000 Epoch[000] Batch [0849]/[3759] Speed: 119.792571 samples/sec accuracy=23.762868 loss=3.693486 lr=0.010000 Epoch[000] Batch [0899]/[3759] Speed: 116.590229 samples/sec accuracy=24.342014 loss=3.651167 lr=0.010000 Epoch[000] Batch [0949]/[3759] Speed: 117.111420 samples/sec accuracy=24.855263 loss=3.614748 lr=0.010000 Epoch[000] Batch [0999]/[3759] Speed: 120.513359 samples/sec accuracy=25.343750 loss=3.578508 lr=0.010000 Epoch[000] Batch [1049]/[3759] Speed: 113.774822 samples/sec accuracy=25.805060 loss=3.547558 lr=0.010000 Epoch[000] Batch [1099]/[3759] Speed: 123.533003 samples/sec accuracy=26.210227 loss=3.515602 lr=0.010000 Epoch[000] Batch [1149]/[3759] Speed: 112.300179 samples/sec accuracy=26.625000 loss=3.486980 lr=0.010000 Epoch[000] Batch [1199]/[3759] Speed: 122.782072 samples/sec accuracy=27.005208 loss=3.460138 lr=0.010000 Epoch[000] Batch [1249]/[3759] Speed: 117.010473 samples/sec accuracy=27.431250 loss=3.432682 lr=0.010000 Epoch[000] Batch [1299]/[3759] Speed: 115.150733 samples/sec accuracy=27.903846 loss=3.403155 lr=0.010000 Epoch[000] Batch [1349]/[3759] Speed: 121.512623 samples/sec accuracy=28.244213 loss=3.380452 lr=0.010000 Epoch[000] Batch [1399]/[3759] Speed: 113.898270 samples/sec accuracy=28.606027 loss=3.355766 lr=0.010000 Epoch[000] Batch [1449]/[3759] Speed: 110.188646 samples/sec accuracy=28.906250 loss=3.334633 lr=0.010000 Epoch[000] Batch [1499]/[3759] Speed: 126.587034 samples/sec accuracy=29.185417 loss=3.315607 lr=0.010000 Epoch[000] Batch [1549]/[3759] Speed: 111.262393 samples/sec accuracy=29.507056 loss=3.294393 lr=0.010000 Epoch[000] Batch [1599]/[3759] Speed: 123.450840 samples/sec accuracy=29.820312 loss=3.274719 lr=0.010000 Epoch[000] Batch [1649]/[3759] Speed: 111.254392 samples/sec accuracy=30.098485 loss=3.255481 lr=0.010000 Epoch[000] Batch [1699]/[3759] Speed: 126.973900 samples/sec accuracy=30.398897 loss=3.236637 lr=0.009999 Epoch[000] Batch [1749]/[3759] Speed: 113.913855 samples/sec accuracy=30.656250 loss=3.220998 lr=0.009999 Epoch[000] Batch [1799]/[3759] Speed: 123.078685 samples/sec accuracy=30.881076 loss=3.203916 lr=0.009999 Epoch[000] Batch [1849]/[3759] Speed: 117.287563 samples/sec accuracy=31.103041 loss=3.188484 lr=0.009999 Epoch[000] Batch [1899]/[3759] Speed: 122.634504 samples/sec accuracy=31.303454 loss=3.173630 lr=0.009999 Epoch[000] Batch [1949]/[3759] Speed: 110.616426 samples/sec accuracy=31.573718 loss=3.157245 lr=0.009999 Epoch[000] Batch [1999]/[3759] Speed: 127.797253 samples/sec accuracy=31.765625 loss=3.143987 lr=0.009999 Epoch[000] Batch [2049]/[3759] Speed: 106.645671 samples/sec accuracy=32.004573 loss=3.130242 lr=0.009999 Epoch[000] Batch [2099]/[3759] Speed: 130.984584 samples/sec accuracy=32.186756 loss=3.118533 lr=0.009999 Epoch[000] Batch [2149]/[3759] Speed: 111.713054 samples/sec accuracy=32.397529 loss=3.106029 lr=0.009999 Epoch[000] Batch [2199]/[3759] Speed: 118.755824 samples/sec accuracy=32.564631 loss=3.094381 lr=0.009999 Epoch[000] Batch [2249]/[3759] Speed: 115.168319 samples/sec accuracy=32.771528 loss=3.082724 lr=0.009999 Epoch[000] Batch [2299]/[3759] Speed: 120.762281 samples/sec accuracy=32.954484 loss=3.070010 lr=0.009999 Epoch[000] Batch [2349]/[3759] Speed: 114.825340 samples/sec accuracy=33.147606 loss=3.057504 lr=0.009999 Epoch[000] Batch [2399]/[3759] Speed: 118.640596 samples/sec accuracy=33.319010 loss=3.047229 lr=0.009999 Epoch[000] Batch [2449]/[3759] Speed: 119.414909 samples/sec accuracy=33.508929 loss=3.036701 lr=0.009999 Epoch[000] Batch [2499]/[3759] Speed: 115.795282 samples/sec accuracy=33.692500 loss=3.025326 lr=0.009999 Epoch[000] Batch [2549]/[3759] Speed: 115.562185 samples/sec accuracy=33.875613 loss=3.014907 lr=0.009999 Epoch[000] Batch [2599]/[3759] Speed: 123.298098 samples/sec accuracy=34.048077 loss=3.004708 lr=0.009999 Epoch[000] Batch [2649]/[3759] Speed: 115.940628 samples/sec accuracy=34.205189 loss=2.994097 lr=0.009999 Epoch[000] Batch [2699]/[3759] Speed: 113.894325 samples/sec accuracy=34.388889 loss=2.983845 lr=0.009999 Epoch[000] Batch [2749]/[3759] Speed: 117.371933 samples/sec accuracy=34.568182 loss=2.973582 lr=0.009999 Epoch[000] Batch [2799]/[3759] Speed: 115.515300 samples/sec accuracy=34.728237 loss=2.964665 lr=0.009999 Epoch[000] Batch [2849]/[3759] Speed: 117.612988 samples/sec accuracy=34.872259 loss=2.955774 lr=0.009999 Epoch[000] Batch [2899]/[3759] Speed: 118.405496 samples/sec accuracy=35.040948 loss=2.946372 lr=0.009999 Epoch[000] Batch [2949]/[3759] Speed: 117.021348 samples/sec accuracy=35.208686 loss=2.936575 lr=0.009998 Epoch[000] Batch [2999]/[3759] Speed: 117.132409 samples/sec accuracy=35.347917 loss=2.928225 lr=0.009998 Epoch[000] Batch [3049]/[3759] Speed: 118.580238 samples/sec accuracy=35.491291 loss=2.919461 lr=0.009998 Epoch[000] Batch [3099]/[3759] Speed: 113.916615 samples/sec accuracy=35.640121 loss=2.910965 lr=0.009998 Epoch[000] Batch [3149]/[3759] Speed: 120.923980 samples/sec accuracy=35.776786 loss=2.902432 lr=0.009998 Epoch[000] Batch [3199]/[3759] Speed: 117.644875 samples/sec accuracy=35.910156 loss=2.894204 lr=0.009998 Epoch[000] Batch [3249]/[3759] Speed: 118.811454 samples/sec accuracy=36.041346 loss=2.886144 lr=0.009998 Epoch[000] Batch [3299]/[3759] Speed: 121.078801 samples/sec accuracy=36.184186 loss=2.878000 lr=0.009998 Epoch[000] Batch [3349]/[3759] Speed: 112.030012 samples/sec accuracy=36.321828 loss=2.869897 lr=0.009998 Epoch[000] Batch [3399]/[3759] Speed: 126.702617 samples/sec accuracy=36.450368 loss=2.862396 lr=0.009998 Epoch[000] Batch [3449]/[3759] Speed: 111.705137 samples/sec accuracy=36.598732 loss=2.854874 lr=0.009998 Epoch[000] Batch [3499]/[3759] Speed: 117.932108 samples/sec accuracy=36.719643 loss=2.847567 lr=0.009998 Epoch[000] Batch [3549]/[3759] Speed: 114.174836 samples/sec accuracy=36.831426 loss=2.840711 lr=0.009998 Epoch[000] Batch [3599]/[3759] Speed: 124.398013 samples/sec accuracy=36.960069 loss=2.833313 lr=0.009998 Epoch[000] Batch [3649]/[3759] Speed: 115.812195 samples/sec accuracy=37.085616 loss=2.826376 lr=0.009998 Epoch[000] Batch [3699]/[3759] Speed: 117.654987 samples/sec accuracy=37.192568 loss=2.819823 lr=0.009998 Epoch[000] Batch [3749]/[3759] Speed: 135.486970 samples/sec accuracy=37.329583 loss=2.812787 lr=0.009998 Batch [0049]/[0303]: acc-top1=43.875000 acc-top5=71.562500 Batch [0099]/[0303]: acc-top1=43.375000 acc-top5=71.609375 Batch [0149]/[0303]: acc-top1=43.166667 acc-top5=71.010417 Batch [0199]/[0303]: acc-top1=42.906250 acc-top5=70.906250 Batch [0249]/[0303]: acc-top1=43.062500 acc-top5=70.981250 Batch [0299]/[0303]: acc-top1=43.161458 acc-top5=71.015625 [Epoch 000] training: accuracy=37.352853 loss=2.811405 [Epoch 000] speed: 116 samples/sec time cost: 2263.623065 [Epoch 000] validation: acc-top1=43.141502 acc-top5=70.962252 loss=2.728099 Epoch[001] Batch [0049]/[3760] Speed: 87.521483 samples/sec accuracy=46.937500 loss=2.261549 lr=0.009997 Epoch[001] Batch [0099]/[3760] Speed: 122.497452 samples/sec accuracy=47.640625 loss=2.227268 lr=0.009997 Epoch[001] Batch [0149]/[3760] Speed: 117.584977 samples/sec accuracy=47.260417 loss=2.222113 lr=0.009997 Epoch[001] Batch [0199]/[3760] Speed: 125.249142 samples/sec accuracy=47.421875 loss=2.219075 lr=0.009997 Epoch[001] Batch [0249]/[3760] Speed: 124.004121 samples/sec accuracy=47.743750 loss=2.210798 lr=0.009997 Epoch[001] Batch [0299]/[3760] Speed: 119.388714 samples/sec accuracy=47.734375 loss=2.214438 lr=0.009997 Epoch[001] Batch [0349]/[3760] Speed: 121.617979 samples/sec accuracy=47.812500 loss=2.211164 lr=0.009997 Epoch[001] Batch [0399]/[3760] Speed: 121.145858 samples/sec accuracy=48.031250 loss=2.202132 lr=0.009997 Epoch[001] Batch [0449]/[3760] Speed: 122.588241 samples/sec accuracy=47.885417 loss=2.207986 lr=0.009997 Epoch[001] Batch [0499]/[3760] Speed: 119.696996 samples/sec accuracy=47.928125 loss=2.205619 lr=0.009997 Epoch[001] Batch [0549]/[3760] Speed: 124.395448 samples/sec accuracy=47.911932 loss=2.209285 lr=0.009997 Epoch[001] Batch [0599]/[3760] Speed: 120.073948 samples/sec accuracy=47.906250 loss=2.207175 lr=0.009997 Epoch[001] Batch [0649]/[3760] Speed: 121.007419 samples/sec accuracy=47.843750 loss=2.210253 lr=0.009997 Epoch[001] Batch [0699]/[3760] Speed: 122.450307 samples/sec accuracy=47.774554 loss=2.214356 lr=0.009997 Epoch[001] Batch [0749]/[3760] Speed: 124.043474 samples/sec accuracy=47.756250 loss=2.213478 lr=0.009996 Epoch[001] Batch [0799]/[3760] Speed: 116.880691 samples/sec accuracy=47.781250 loss=2.211528 lr=0.009996 Epoch[001] Batch [0849]/[3760] Speed: 126.018039 samples/sec accuracy=47.871324 loss=2.208383 lr=0.009996 Epoch[001] Batch [0899]/[3760] Speed: 121.665781 samples/sec accuracy=47.890625 loss=2.207497 lr=0.009996 Epoch[001] Batch [0949]/[3760] Speed: 119.823956 samples/sec accuracy=47.876645 loss=2.209595 lr=0.009996 Epoch[001] Batch [0999]/[3760] Speed: 124.559203 samples/sec accuracy=47.890625 loss=2.207627 lr=0.009996 Epoch[001] Batch [1049]/[3760] Speed: 118.827152 samples/sec accuracy=47.873512 loss=2.209313 lr=0.009996 Epoch[001] Batch [1099]/[3760] Speed: 120.472168 samples/sec accuracy=47.940341 loss=2.206869 lr=0.009996 Epoch[001] Batch [1149]/[3760] Speed: 123.572761 samples/sec accuracy=47.967391 loss=2.205939 lr=0.009996 Epoch[001] Batch [1199]/[3760] Speed: 120.192036 samples/sec accuracy=47.950521 loss=2.205139 lr=0.009996 Epoch[001] Batch [1249]/[3760] Speed: 120.838446 samples/sec accuracy=48.001250 loss=2.202264 lr=0.009996 Epoch[001] Batch [1299]/[3760] Speed: 122.025852 samples/sec accuracy=48.025240 loss=2.200029 lr=0.009996 Epoch[001] Batch [1349]/[3760] Speed: 120.882384 samples/sec accuracy=48.050926 loss=2.198214 lr=0.009995 Epoch[001] Batch [1399]/[3760] Speed: 119.280384 samples/sec accuracy=48.092634 loss=2.196832 lr=0.009995 Epoch[001] Batch [1449]/[3760] Speed: 126.409463 samples/sec accuracy=48.188578 loss=2.194228 lr=0.009995 Epoch[001] Batch [1499]/[3760] Speed: 117.749164 samples/sec accuracy=48.209375 loss=2.193799 lr=0.009995 Epoch[001] Batch [1549]/[3760] Speed: 126.887139 samples/sec accuracy=48.171371 loss=2.194502 lr=0.009995 Epoch[001] Batch [1599]/[3760] Speed: 122.784362 samples/sec accuracy=48.210938 loss=2.192237 lr=0.009995 Epoch[001] Batch [1649]/[3760] Speed: 121.099275 samples/sec accuracy=48.303977 loss=2.187244 lr=0.009995 Epoch[001] Batch [1699]/[3760] Speed: 118.896733 samples/sec accuracy=48.348346 loss=2.184394 lr=0.009995 Epoch[001] Batch [1749]/[3760] Speed: 125.386620 samples/sec accuracy=48.388393 loss=2.182676 lr=0.009995 Epoch[001] Batch [1799]/[3760] Speed: 121.648563 samples/sec accuracy=48.438368 loss=2.181139 lr=0.009995 Epoch[001] Batch [1849]/[3760] Speed: 126.728038 samples/sec accuracy=48.501689 loss=2.179610 lr=0.009995 Epoch[001] Batch [1899]/[3760] Speed: 116.533455 samples/sec accuracy=48.557566 loss=2.177699 lr=0.009994 Epoch[001] Batch [1949]/[3760] Speed: 124.255759 samples/sec accuracy=48.584936 loss=2.176593 lr=0.009994 Epoch[001] Batch [1999]/[3760] Speed: 120.948968 samples/sec accuracy=48.632812 loss=2.175760 lr=0.009994 Epoch[001] Batch [2049]/[3760] Speed: 120.790797 samples/sec accuracy=48.631860 loss=2.175331 lr=0.009994 Epoch[001] Batch [2099]/[3760] Speed: 128.480793 samples/sec accuracy=48.675595 loss=2.174409 lr=0.009994 Epoch[001] Batch [2149]/[3760] Speed: 114.049798 samples/sec accuracy=48.712209 loss=2.172677 lr=0.009994 Epoch[001] Batch [2199]/[3760] Speed: 126.202298 samples/sec accuracy=48.747869 loss=2.171618 lr=0.009994 Epoch[001] Batch [2249]/[3760] Speed: 122.366929 samples/sec accuracy=48.797222 loss=2.169532 lr=0.009994 Epoch[001] Batch [2299]/[3760] Speed: 119.166045 samples/sec accuracy=48.816576 loss=2.168517 lr=0.009994 Epoch[001] Batch [2349]/[3760] Speed: 125.934991 samples/sec accuracy=48.847739 loss=2.167340 lr=0.009993 Epoch[001] Batch [2399]/[3760] Speed: 119.483517 samples/sec accuracy=48.898438 loss=2.164842 lr=0.009993 Epoch[001] Batch [2449]/[3760] Speed: 120.525723 samples/sec accuracy=48.922194 loss=2.163626 lr=0.009993 Epoch[001] Batch [2499]/[3760] Speed: 126.918644 samples/sec accuracy=48.958750 loss=2.161440 lr=0.009993 Epoch[001] Batch [2549]/[3760] Speed: 116.686534 samples/sec accuracy=48.964461 loss=2.161327 lr=0.009993 Epoch[001] Batch [2599]/[3760] Speed: 126.870025 samples/sec accuracy=49.003606 loss=2.159646 lr=0.009993 Epoch[001] Batch [2649]/[3760] Speed: 113.830904 samples/sec accuracy=49.011792 loss=2.159309 lr=0.009993 Epoch[001] Batch [2699]/[3760] Speed: 131.137601 samples/sec accuracy=49.020255 loss=2.157772 lr=0.009993 Epoch[001] Batch [2749]/[3760] Speed: 123.782779 samples/sec accuracy=49.050568 loss=2.156804 lr=0.009993 Epoch[001] Batch [2799]/[3760] Speed: 115.674303 samples/sec accuracy=49.073661 loss=2.156376 lr=0.009992 Epoch[001] Batch [2849]/[3760] Speed: 132.212635 samples/sec accuracy=49.094298 loss=2.155427 lr=0.009992 Epoch[001] Batch [2899]/[3760] Speed: 117.273091 samples/sec accuracy=49.106142 loss=2.155304 lr=0.009992 Epoch[001] Batch [2949]/[3760] Speed: 119.740213 samples/sec accuracy=49.126589 loss=2.155171 lr=0.009992 Epoch[001] Batch [2999]/[3760] Speed: 125.724619 samples/sec accuracy=49.148438 loss=2.154629 lr=0.009992 Epoch[001] Batch [3049]/[3760] Speed: 115.003713 samples/sec accuracy=49.186475 loss=2.153161 lr=0.009992 Epoch[001] Batch [3099]/[3760] Speed: 129.113066 samples/sec accuracy=49.202621 loss=2.152559 lr=0.009992 Epoch[001] Batch [3149]/[3760] Speed: 113.705710 samples/sec accuracy=49.239087 loss=2.151303 lr=0.009992 Epoch[001] Batch [3199]/[3760] Speed: 127.462476 samples/sec accuracy=49.276855 loss=2.149592 lr=0.009992 Epoch[001] Batch [3249]/[3760] Speed: 117.893094 samples/sec accuracy=49.278846 loss=2.149730 lr=0.009991 Epoch[001] Batch [3299]/[3760] Speed: 126.266745 samples/sec accuracy=49.308712 loss=2.148217 lr=0.009991 Epoch[001] Batch [3349]/[3760] Speed: 124.484370 samples/sec accuracy=49.336287 loss=2.146761 lr=0.009991 Epoch[001] Batch [3399]/[3760] Speed: 117.609017 samples/sec accuracy=49.384651 loss=2.144276 lr=0.009991 Epoch[001] Batch [3449]/[3760] Speed: 129.590510 samples/sec accuracy=49.415761 loss=2.142715 lr=0.009991 Epoch[001] Batch [3499]/[3760] Speed: 115.584500 samples/sec accuracy=49.435268 loss=2.141708 lr=0.009991 Epoch[001] Batch [3549]/[3760] Speed: 126.776686 samples/sec accuracy=49.450264 loss=2.140984 lr=0.009991 Epoch[001] Batch [3599]/[3760] Speed: 116.601242 samples/sec accuracy=49.467448 loss=2.140398 lr=0.009991 Epoch[001] Batch [3649]/[3760] Speed: 121.855162 samples/sec accuracy=49.499144 loss=2.138741 lr=0.009990 Epoch[001] Batch [3699]/[3760] Speed: 127.912175 samples/sec accuracy=49.523649 loss=2.137975 lr=0.009990 Epoch[001] Batch [3749]/[3760] Speed: 132.420463 samples/sec accuracy=49.535417 loss=2.136540 lr=0.009990 Batch [0049]/[0303]: acc-top1=49.968750 acc-top5=75.875000 Batch [0099]/[0303]: acc-top1=50.171875 acc-top5=75.859375 Batch [0149]/[0303]: acc-top1=49.666667 acc-top5=75.437500 Batch [0199]/[0303]: acc-top1=49.414062 acc-top5=75.062500 Batch [0249]/[0303]: acc-top1=49.493750 acc-top5=75.062500 Batch [0299]/[0303]: acc-top1=49.609375 acc-top5=75.192708 [Epoch 001] training: accuracy=49.542470 loss=2.136068 [Epoch 001] speed: 121 samples/sec time cost: 2173.585055 [Epoch 001] validation: acc-top1=49.566832 acc-top5=75.149546 loss=2.536039 Epoch[002] Batch [0049]/[3759] Speed: 88.653368 samples/sec accuracy=53.812500 loss=1.945243 lr=0.009990 Epoch[002] Batch [0099]/[3759] Speed: 125.273960 samples/sec accuracy=53.531250 loss=1.945361 lr=0.009990 Epoch[002] Batch [0149]/[3759] Speed: 119.530061 samples/sec accuracy=53.187500 loss=1.948857 lr=0.009990 Epoch[002] Batch [0199]/[3759] Speed: 119.974787 samples/sec accuracy=53.242188 loss=1.941805 lr=0.009990 Epoch[002] Batch [0249]/[3759] Speed: 119.906620 samples/sec accuracy=53.350000 loss=1.939077 lr=0.009989 Epoch[002] Batch [0299]/[3759] Speed: 126.078211 samples/sec accuracy=53.286458 loss=1.939918 lr=0.009989 Epoch[002] Batch [0349]/[3759] Speed: 117.037163 samples/sec accuracy=53.450893 loss=1.936053 lr=0.009989 Epoch[002] Batch [0399]/[3759] Speed: 123.124276 samples/sec accuracy=53.343750 loss=1.941413 lr=0.009989 Epoch[002] Batch [0449]/[3759] Speed: 129.848731 samples/sec accuracy=53.173611 loss=1.944244 lr=0.009989 Epoch[002] Batch [0499]/[3759] Speed: 113.875667 samples/sec accuracy=53.031250 loss=1.948595 lr=0.009989 Epoch[002] Batch [0549]/[3759] Speed: 124.731757 samples/sec accuracy=53.113636 loss=1.947616 lr=0.009989 Epoch[002] Batch [0599]/[3759] Speed: 118.922801 samples/sec accuracy=53.203125 loss=1.946068 lr=0.009988 Epoch[002] Batch [0649]/[3759] Speed: 129.758596 samples/sec accuracy=53.201923 loss=1.947312 lr=0.009988 Epoch[002] Batch [0699]/[3759] Speed: 120.258639 samples/sec accuracy=53.267857 loss=1.945047 lr=0.009988 Epoch[002] Batch [0749]/[3759] Speed: 119.307804 samples/sec accuracy=53.272917 loss=1.946789 lr=0.009988 Epoch[002] Batch [0799]/[3759] Speed: 125.601216 samples/sec accuracy=53.251953 loss=1.947593 lr=0.009988 Epoch[002] Batch [0849]/[3759] Speed: 116.643063 samples/sec accuracy=53.240809 loss=1.947802 lr=0.009988 Epoch[002] Batch [0899]/[3759] Speed: 128.289094 samples/sec accuracy=53.189236 loss=1.947581 lr=0.009988 Epoch[002] Batch [0949]/[3759] Speed: 120.506565 samples/sec accuracy=53.148026 loss=1.950119 lr=0.009987 Epoch[002] Batch [0999]/[3759] Speed: 119.998621 samples/sec accuracy=53.071875 loss=1.952880 lr=0.009987 Epoch[002] Batch [1049]/[3759] Speed: 128.481426 samples/sec accuracy=53.096726 loss=1.952666 lr=0.009987 Epoch[002] Batch [1099]/[3759] Speed: 117.439852 samples/sec accuracy=53.153409 loss=1.949104 lr=0.009987 Epoch[002] Batch [1149]/[3759] Speed: 128.352802 samples/sec accuracy=53.130435 loss=1.950589 lr=0.009987 Epoch[002] Batch [1199]/[3759] Speed: 116.055862 samples/sec accuracy=53.144531 loss=1.949454 lr=0.009987 Epoch[002] Batch [1249]/[3759] Speed: 123.707295 samples/sec accuracy=53.180000 loss=1.948555 lr=0.009987 Epoch[002] Batch [1299]/[3759] Speed: 122.808696 samples/sec accuracy=53.185096 loss=1.947363 lr=0.009986 Epoch[002] Batch [1349]/[3759] Speed: 117.414805 samples/sec accuracy=53.180556 loss=1.948148 lr=0.009986 Epoch[002] Batch [1399]/[3759] Speed: 126.924162 samples/sec accuracy=53.193080 loss=1.947094 lr=0.009986 Epoch[002] Batch [1449]/[3759] Speed: 122.888369 samples/sec accuracy=53.188578 loss=1.946368 lr=0.009986 Epoch[002] Batch [1499]/[3759] Speed: 118.293747 samples/sec accuracy=53.215625 loss=1.946230 lr=0.009986 Epoch[002] Batch [1549]/[3759] Speed: 125.360405 samples/sec accuracy=53.222782 loss=1.946660 lr=0.009986 Epoch[002] Batch [1599]/[3759] Speed: 118.900357 samples/sec accuracy=53.201172 loss=1.946229 lr=0.009985 Epoch[002] Batch [1649]/[3759] Speed: 121.865175 samples/sec accuracy=53.164773 loss=1.947665 lr=0.009985 Epoch[002] Batch [1699]/[3759] Speed: 125.225364 samples/sec accuracy=53.125000 loss=1.948768 lr=0.009985 Epoch[002] Batch [1749]/[3759] Speed: 121.721123 samples/sec accuracy=53.150000 loss=1.947705 lr=0.009985 Epoch[002] Batch [1799]/[3759] Speed: 126.958847 samples/sec accuracy=53.176215 loss=1.947619 lr=0.009985 Epoch[002] Batch [1849]/[3759] Speed: 119.925757 samples/sec accuracy=53.184122 loss=1.947773 lr=0.009985 Epoch[002] Batch [1899]/[3759] Speed: 129.485672 samples/sec accuracy=53.230263 loss=1.945540 lr=0.009985 Epoch[002] Batch [1949]/[3759] Speed: 117.939382 samples/sec accuracy=53.274038 loss=1.944467 lr=0.009984 Epoch[002] Batch [1999]/[3759] Speed: 126.513909 samples/sec accuracy=53.283594 loss=1.944517 lr=0.009984 Epoch[002] Batch [2049]/[3759] Speed: 119.953935 samples/sec accuracy=53.281250 loss=1.944481 lr=0.009984 Epoch[002] Batch [2099]/[3759] Speed: 123.664646 samples/sec accuracy=53.263393 loss=1.945540 lr=0.009984 Epoch[002] Batch [2149]/[3759] Speed: 124.576458 samples/sec accuracy=53.316134 loss=1.944254 lr=0.009984 Epoch[002] Batch [2199]/[3759] Speed: 116.563512 samples/sec accuracy=53.349432 loss=1.942677 lr=0.009984 Epoch[002] Batch [2249]/[3759] Speed: 129.567301 samples/sec accuracy=53.363889 loss=1.942068 lr=0.009983 Epoch[002] Batch [2299]/[3759] Speed: 117.171664 samples/sec accuracy=53.403533 loss=1.940830 lr=0.009983 Epoch[002] Batch [2349]/[3759] Speed: 123.512584 samples/sec accuracy=53.456782 loss=1.939220 lr=0.009983 Epoch[002] Batch [2399]/[3759] Speed: 116.941515 samples/sec accuracy=53.469401 loss=1.938673 lr=0.009983 Epoch[002] Batch [2449]/[3759] Speed: 128.655947 samples/sec accuracy=53.511480 loss=1.936791 lr=0.009983 Epoch[002] Batch [2499]/[3759] Speed: 123.553588 samples/sec accuracy=53.546250 loss=1.936260 lr=0.009982 Epoch[002] Batch [2549]/[3759] Speed: 121.125793 samples/sec accuracy=53.585172 loss=1.934780 lr=0.009982 Epoch[002] Batch [2599]/[3759] Speed: 126.660991 samples/sec accuracy=53.567308 loss=1.935154 lr=0.009982 Epoch[002] Batch [2649]/[3759] Speed: 119.810028 samples/sec accuracy=53.575472 loss=1.935884 lr=0.009982 Epoch[002] Batch [2699]/[3759] Speed: 122.740764 samples/sec accuracy=53.587963 loss=1.934694 lr=0.009982 Epoch[002] Batch [2749]/[3759] Speed: 127.707248 samples/sec accuracy=53.579545 loss=1.935529 lr=0.009982 Epoch[002] Batch [2799]/[3759] Speed: 115.496012 samples/sec accuracy=53.550781 loss=1.936096 lr=0.009981 Epoch[002] Batch [2849]/[3759] Speed: 129.367429 samples/sec accuracy=53.588268 loss=1.934947 lr=0.009981 Epoch[002] Batch [2899]/[3759] Speed: 123.883180 samples/sec accuracy=53.617996 loss=1.934228 lr=0.009981 Epoch[002] Batch [2949]/[3759] Speed: 119.581215 samples/sec accuracy=53.618114 loss=1.933665 lr=0.009981 Epoch[002] Batch [2999]/[3759] Speed: 119.795050 samples/sec accuracy=53.627604 loss=1.933693 lr=0.009981 Epoch[002] Batch [3049]/[3759] Speed: 128.255020 samples/sec accuracy=53.630635 loss=1.933543 lr=0.009981 Epoch[002] Batch [3099]/[3759] Speed: 118.686184 samples/sec accuracy=53.634577 loss=1.933002 lr=0.009980 Epoch[002] Batch [3149]/[3759] Speed: 124.963742 samples/sec accuracy=53.675099 loss=1.931380 lr=0.009980 Epoch[002] Batch [3199]/[3759] Speed: 123.344663 samples/sec accuracy=53.674316 loss=1.930543 lr=0.009980 Epoch[002] Batch [3249]/[3759] Speed: 125.371917 samples/sec accuracy=53.657692 loss=1.930961 lr=0.009980 Epoch[002] Batch [3299]/[3759] Speed: 121.261763 samples/sec accuracy=53.667614 loss=1.930550 lr=0.009980 Epoch[002] Batch [3349]/[3759] Speed: 115.685041 samples/sec accuracy=53.685634 loss=1.930335 lr=0.009979 Epoch[002] Batch [3399]/[3759] Speed: 131.977458 samples/sec accuracy=53.710018 loss=1.929079 lr=0.009979 Epoch[002] Batch [3449]/[3759] Speed: 124.555468 samples/sec accuracy=53.706975 loss=1.928556 lr=0.009979 Epoch[002] Batch [3499]/[3759] Speed: 120.847944 samples/sec accuracy=53.716071 loss=1.928256 lr=0.009979 Epoch[002] Batch [3549]/[3759] Speed: 125.153245 samples/sec accuracy=53.744278 loss=1.927456 lr=0.009979 Epoch[002] Batch [3599]/[3759] Speed: 123.438589 samples/sec accuracy=53.774306 loss=1.926227 lr=0.009978 Epoch[002] Batch [3649]/[3759] Speed: 120.033285 samples/sec accuracy=53.800514 loss=1.925135 lr=0.009978 Epoch[002] Batch [3699]/[3759] Speed: 124.902423 samples/sec accuracy=53.821368 loss=1.923921 lr=0.009978 Epoch[002] Batch [3749]/[3759] Speed: 140.219368 samples/sec accuracy=53.802500 loss=1.924370 lr=0.009978 Batch [0049]/[0303]: acc-top1=53.687500 acc-top5=78.937500 Batch [0099]/[0303]: acc-top1=53.343750 acc-top5=78.734375 Batch [0149]/[0303]: acc-top1=52.885417 acc-top5=78.364583 Batch [0199]/[0303]: acc-top1=52.562500 acc-top5=78.007812 Batch [0249]/[0303]: acc-top1=52.956250 acc-top5=78.056250 Batch [0299]/[0303]: acc-top1=52.807292 acc-top5=77.947917 [Epoch 002] training: accuracy=53.805866 loss=1.924405 [Epoch 002] speed: 122 samples/sec time cost: 2160.085844 [Epoch 002] validation: acc-top1=52.805281 acc-top5=77.892946 loss=2.278875 Epoch[003] Batch [0049]/[3760] Speed: 86.228139 samples/sec accuracy=55.437500 loss=1.835170 lr=0.009978 Epoch[003] Batch [0099]/[3760] Speed: 125.716950 samples/sec accuracy=56.515625 loss=1.785070 lr=0.009977 Epoch[003] Batch [0149]/[3760] Speed: 125.189847 samples/sec accuracy=56.510417 loss=1.774458 lr=0.009977 Epoch[003] Batch [0199]/[3760] Speed: 120.852004 samples/sec accuracy=56.453125 loss=1.776910 lr=0.009977 Epoch[003] Batch [0249]/[3760] Speed: 124.097002 samples/sec accuracy=56.493750 loss=1.778780 lr=0.009977 Epoch[003] Batch [0299]/[3760] Speed: 123.949353 samples/sec accuracy=56.619792 loss=1.772379 lr=0.009977 Epoch[003] Batch [0349]/[3760] Speed: 123.335108 samples/sec accuracy=56.816964 loss=1.772381 lr=0.009976 Epoch[003] Batch [0399]/[3760] Speed: 124.957171 samples/sec accuracy=56.929688 loss=1.772401 lr=0.009976 Epoch[003] Batch [0449]/[3760] Speed: 125.239949 samples/sec accuracy=56.996528 loss=1.767455 lr=0.009976 Epoch[003] Batch [0499]/[3760] Speed: 116.897348 samples/sec accuracy=56.950000 loss=1.770495 lr=0.009976 Epoch[003] Batch [0549]/[3760] Speed: 129.367571 samples/sec accuracy=56.926136 loss=1.770013 lr=0.009976 Epoch[003] Batch [0599]/[3760] Speed: 117.610787 samples/sec accuracy=56.921875 loss=1.772249 lr=0.009975 Epoch[003] Batch [0649]/[3760] Speed: 121.528259 samples/sec accuracy=56.875000 loss=1.778375 lr=0.009975 Epoch[003] Batch [0699]/[3760] Speed: 125.132250 samples/sec accuracy=56.861607 loss=1.777438 lr=0.009975 Epoch[003] Batch [0749]/[3760] Speed: 124.481759 samples/sec accuracy=56.806250 loss=1.779035 lr=0.009975 Epoch[003] Batch [0799]/[3760] Speed: 122.337976 samples/sec accuracy=56.742188 loss=1.782616 lr=0.009975 Epoch[003] Batch [0849]/[3760] Speed: 121.578790 samples/sec accuracy=56.590074 loss=1.787992 lr=0.009974 Epoch[003] Batch [0899]/[3760] Speed: 130.382639 samples/sec accuracy=56.585069 loss=1.788578 lr=0.009974 Epoch[003] Batch [0949]/[3760] Speed: 117.919664 samples/sec accuracy=56.552632 loss=1.789011 lr=0.009974 Epoch[003] Batch [0999]/[3760] Speed: 123.504640 samples/sec accuracy=56.537500 loss=1.791269 lr=0.009974 Epoch[003] Batch [1049]/[3760] Speed: 127.371831 samples/sec accuracy=56.553571 loss=1.789068 lr=0.009973 Epoch[003] Batch [1099]/[3760] Speed: 118.660771 samples/sec accuracy=56.514205 loss=1.790066 lr=0.009973 Epoch[003] Batch [1149]/[3760] Speed: 125.941561 samples/sec accuracy=56.480978 loss=1.790114 lr=0.009973 Epoch[003] Batch [1199]/[3760] Speed: 118.630378 samples/sec accuracy=56.427083 loss=1.791677 lr=0.009973 Epoch[003] Batch [1249]/[3760] Speed: 127.913002 samples/sec accuracy=56.446250 loss=1.792649 lr=0.009973 Epoch[003] Batch [1299]/[3760] Speed: 120.496054 samples/sec accuracy=56.449519 loss=1.791932 lr=0.009972 Epoch[003] Batch [1349]/[3760] Speed: 124.979425 samples/sec accuracy=56.391204 loss=1.792201 lr=0.009972 Epoch[003] Batch [1399]/[3760] Speed: 131.052203 samples/sec accuracy=56.445312 loss=1.790201 lr=0.009972 Epoch[003] Batch [1449]/[3760] Speed: 118.429898 samples/sec accuracy=56.398707 loss=1.792200 lr=0.009972 Epoch[003] Batch [1499]/[3760] Speed: 124.683259 samples/sec accuracy=56.364583 loss=1.793712 lr=0.009972 Epoch[003] Batch [1549]/[3760] Speed: 125.351977 samples/sec accuracy=56.357863 loss=1.793184 lr=0.009971 Epoch[003] Batch [1599]/[3760] Speed: 120.015092 samples/sec accuracy=56.380859 loss=1.792228 lr=0.009971 Epoch[003] Batch [1649]/[3760] Speed: 127.892390 samples/sec accuracy=56.434659 loss=1.790807 lr=0.009971 Epoch[003] Batch [1699]/[3760] Speed: 121.813519 samples/sec accuracy=56.405331 loss=1.793566 lr=0.009971 Epoch[003] Batch [1749]/[3760] Speed: 119.733758 samples/sec accuracy=56.406250 loss=1.793668 lr=0.009970 Epoch[003] Batch [1799]/[3760] Speed: 129.408351 samples/sec accuracy=56.426215 loss=1.791920 lr=0.009970 Epoch[003] Batch [1849]/[3760] Speed: 118.563690 samples/sec accuracy=56.381757 loss=1.793328 lr=0.009970 Epoch[003] Batch [1899]/[3760] Speed: 127.352919 samples/sec accuracy=56.391447 loss=1.793583 lr=0.009970 Epoch[003] Batch [1949]/[3760] Speed: 118.680087 samples/sec accuracy=56.429487 loss=1.791703 lr=0.009969 Epoch[003] Batch [1999]/[3760] Speed: 128.368845 samples/sec accuracy=56.447656 loss=1.791276 lr=0.009969 Epoch[003] Batch [2049]/[3760] Speed: 115.651897 samples/sec accuracy=56.413872 loss=1.792690 lr=0.009969 Epoch[003] Batch [2099]/[3760] Speed: 128.351913 samples/sec accuracy=56.440476 loss=1.791586 lr=0.009969 Epoch[003] Batch [2149]/[3760] Speed: 119.558208 samples/sec accuracy=56.453488 loss=1.790961 lr=0.009969 Epoch[003] Batch [2199]/[3760] Speed: 119.281961 samples/sec accuracy=56.436080 loss=1.790883 lr=0.009968 Epoch[003] Batch [2249]/[3760] Speed: 127.032511 samples/sec accuracy=56.451389 loss=1.790370 lr=0.009968 Epoch[003] Batch [2299]/[3760] Speed: 127.484367 samples/sec accuracy=56.429348 loss=1.790744 lr=0.009968 Epoch[003] Batch [2349]/[3760] Speed: 118.597389 samples/sec accuracy=56.469415 loss=1.789474 lr=0.009968 Epoch[003] Batch [2399]/[3760] Speed: 125.320364 samples/sec accuracy=56.466146 loss=1.789342 lr=0.009967 Epoch[003] Batch [2449]/[3760] Speed: 122.290815 samples/sec accuracy=56.463010 loss=1.789416 lr=0.009967 Epoch[003] Batch [2499]/[3760] Speed: 129.046096 samples/sec accuracy=56.465000 loss=1.789992 lr=0.009967 Epoch[003] Batch [2549]/[3760] Speed: 120.546194 samples/sec accuracy=56.458333 loss=1.790585 lr=0.009967 Epoch[003] Batch [2599]/[3760] Speed: 125.648399 samples/sec accuracy=56.501803 loss=1.789311 lr=0.009966 Epoch[003] Batch [2649]/[3760] Speed: 118.254222 samples/sec accuracy=56.501769 loss=1.789488 lr=0.009966 Epoch[003] Batch [2699]/[3760] Speed: 127.749848 samples/sec accuracy=56.515046 loss=1.789123 lr=0.009966 Epoch[003] Batch [2749]/[3760] Speed: 116.667035 samples/sec accuracy=56.511932 loss=1.789229 lr=0.009966 Epoch[003] Batch [2799]/[3760] Speed: 130.951664 samples/sec accuracy=56.505580 loss=1.788970 lr=0.009965 Epoch[003] Batch [2849]/[3760] Speed: 128.783821 samples/sec accuracy=56.533443 loss=1.788202 lr=0.009965 Epoch[003] Batch [2899]/[3760] Speed: 119.718736 samples/sec accuracy=56.541487 loss=1.787935 lr=0.009965 Epoch[003] Batch [2949]/[3760] Speed: 121.567905 samples/sec accuracy=56.536017 loss=1.788098 lr=0.009965 Epoch[003] Batch [2999]/[3760] Speed: 127.461393 samples/sec accuracy=56.548958 loss=1.787929 lr=0.009964 Epoch[003] Batch [3049]/[3760] Speed: 121.042651 samples/sec accuracy=56.577357 loss=1.787185 lr=0.009964 Epoch[003] Batch [3099]/[3760] Speed: 122.559118 samples/sec accuracy=56.575605 loss=1.787985 lr=0.009964 Epoch[003] Batch [3149]/[3760] Speed: 120.218269 samples/sec accuracy=56.573909 loss=1.788016 lr=0.009964 Epoch[003] Batch [3199]/[3760] Speed: 128.649897 samples/sec accuracy=56.589844 loss=1.787783 lr=0.009963 Epoch[003] Batch [3249]/[3760] Speed: 127.023365 samples/sec accuracy=56.602404 loss=1.787491 lr=0.009963 Epoch[003] Batch [3299]/[3760] Speed: 116.651219 samples/sec accuracy=56.592803 loss=1.787653 lr=0.009963 Epoch[003] Batch [3349]/[3760] Speed: 124.359527 samples/sec accuracy=56.614272 loss=1.787492 lr=0.009963 Epoch[003] Batch [3399]/[3760] Speed: 126.903548 samples/sec accuracy=56.603401 loss=1.787869 lr=0.009962 Epoch[003] Batch [3449]/[3760] Speed: 121.308050 samples/sec accuracy=56.592844 loss=1.788062 lr=0.009962 Epoch[003] Batch [3499]/[3760] Speed: 118.844010 samples/sec accuracy=56.595089 loss=1.787639 lr=0.009962 Epoch[003] Batch [3549]/[3760] Speed: 124.174819 samples/sec accuracy=56.603433 loss=1.787077 lr=0.009962 Epoch[003] Batch [3599]/[3760] Speed: 123.908669 samples/sec accuracy=56.592882 loss=1.787684 lr=0.009961 Epoch[003] Batch [3649]/[3760] Speed: 123.123399 samples/sec accuracy=56.613014 loss=1.787146 lr=0.009961 Epoch[003] Batch [3699]/[3760] Speed: 130.051743 samples/sec accuracy=56.627534 loss=1.786394 lr=0.009961 Epoch[003] Batch [3749]/[3760] Speed: 133.543193 samples/sec accuracy=56.625417 loss=1.786407 lr=0.009961 Batch [0049]/[0303]: acc-top1=55.343750 acc-top5=80.093750 Batch [0099]/[0303]: acc-top1=54.656250 acc-top5=79.906250 Batch [0149]/[0303]: acc-top1=54.406250 acc-top5=79.510417 Batch [0199]/[0303]: acc-top1=53.851563 acc-top5=79.078125 Batch [0249]/[0303]: acc-top1=54.012500 acc-top5=79.081250 Batch [0299]/[0303]: acc-top1=54.031250 acc-top5=79.114583 [Epoch 003] training: accuracy=56.623172 loss=1.786309 [Epoch 003] speed: 122 samples/sec time cost: 2147.653273 [Epoch 003] validation: acc-top1=54.001650 acc-top5=79.053218 loss=2.272268 Epoch[004] Batch [0049]/[3760] Speed: 88.376548 samples/sec accuracy=60.093750 loss=1.624977 lr=0.009960 Epoch[004] Batch [0099]/[3760] Speed: 126.864680 samples/sec accuracy=59.484375 loss=1.664963 lr=0.009960 Epoch[004] Batch [0149]/[3760] Speed: 124.256639 samples/sec accuracy=59.156250 loss=1.669272 lr=0.009960 Epoch[004] Batch [0199]/[3760] Speed: 125.709273 samples/sec accuracy=59.046875 loss=1.666215 lr=0.009960 Epoch[004] Batch [0249]/[3760] Speed: 116.356394 samples/sec accuracy=58.962500 loss=1.676636 lr=0.009959 Epoch[004] Batch [0299]/[3760] Speed: 130.290788 samples/sec accuracy=58.796875 loss=1.677574 lr=0.009959 Epoch[004] Batch [0349]/[3760] Speed: 118.020413 samples/sec accuracy=58.723214 loss=1.673952 lr=0.009959 Epoch[004] Batch [0399]/[3760] Speed: 130.106886 samples/sec accuracy=58.746094 loss=1.673565 lr=0.009958 Epoch[004] Batch [0449]/[3760] Speed: 127.791085 samples/sec accuracy=58.642361 loss=1.678446 lr=0.009958 Epoch[004] Batch [0499]/[3760] Speed: 122.526417 samples/sec accuracy=58.671875 loss=1.678230 lr=0.009958 Epoch[004] Batch [0549]/[3760] Speed: 121.010530 samples/sec accuracy=58.693182 loss=1.678991 lr=0.009958 Epoch[004] Batch [0599]/[3760] Speed: 123.049400 samples/sec accuracy=58.786458 loss=1.676293 lr=0.009957 Epoch[004] Batch [0649]/[3760] Speed: 131.869899 samples/sec accuracy=58.774038 loss=1.677999 lr=0.009957 Epoch[004] Batch [0699]/[3760] Speed: 119.085673 samples/sec accuracy=58.799107 loss=1.678055 lr=0.009957 Epoch[004] Batch [0749]/[3760] Speed: 130.097934 samples/sec accuracy=58.754167 loss=1.680570 lr=0.009957 Epoch[004] Batch [0799]/[3760] Speed: 117.034027 samples/sec accuracy=58.740234 loss=1.681947 lr=0.009956 Epoch[004] Batch [0849]/[3760] Speed: 129.735126 samples/sec accuracy=58.731618 loss=1.680892 lr=0.009956 Epoch[004] Batch [0899]/[3760] Speed: 120.357240 samples/sec accuracy=58.701389 loss=1.681949 lr=0.009956 Epoch[004] Batch [0949]/[3760] Speed: 123.934757 samples/sec accuracy=58.756579 loss=1.680372 lr=0.009955 Epoch[004] Batch [0999]/[3760] Speed: 123.944659 samples/sec accuracy=58.745313 loss=1.680959 lr=0.009955 Epoch[004] Batch [1049]/[3760] Speed: 126.143504 samples/sec accuracy=58.659226 loss=1.682827 lr=0.009955 Epoch[004] Batch [1099]/[3760] Speed: 124.726282 samples/sec accuracy=58.666193 loss=1.684151 lr=0.009955 Epoch[004] Batch [1149]/[3760] Speed: 123.136097 samples/sec accuracy=58.653533 loss=1.685516 lr=0.009954 Epoch[004] Batch [1199]/[3760] Speed: 121.792895 samples/sec accuracy=58.674479 loss=1.685899 lr=0.009954 Epoch[004] Batch [1249]/[3760] Speed: 123.289257 samples/sec accuracy=58.722500 loss=1.684118 lr=0.009954 Epoch[004] Batch [1299]/[3760] Speed: 130.725473 samples/sec accuracy=58.697115 loss=1.685057 lr=0.009953 Epoch[004] Batch [1349]/[3760] Speed: 119.129018 samples/sec accuracy=58.645833 loss=1.687104 lr=0.009953 Epoch[004] Batch [1399]/[3760] Speed: 122.819763 samples/sec accuracy=58.666295 loss=1.685789 lr=0.009953 Epoch[004] Batch [1449]/[3760] Speed: 118.986345 samples/sec accuracy=58.650862 loss=1.685781 lr=0.009953 Epoch[004] Batch [1499]/[3760] Speed: 130.397623 samples/sec accuracy=58.708333 loss=1.684478 lr=0.009952 Epoch[004] Batch [1549]/[3760] Speed: 121.766091 samples/sec accuracy=58.723790 loss=1.684183 lr=0.009952 Epoch[004] Batch [1599]/[3760] Speed: 126.021153 samples/sec accuracy=58.736328 loss=1.683154 lr=0.009952 Epoch[004] Batch [1649]/[3760] Speed: 119.035583 samples/sec accuracy=58.678977 loss=1.684842 lr=0.009951 Epoch[004] Batch [1699]/[3760] Speed: 129.042340 samples/sec accuracy=58.635110 loss=1.686461 lr=0.009951 Epoch[004] Batch [1749]/[3760] Speed: 128.927600 samples/sec accuracy=58.657143 loss=1.685399 lr=0.009951 Epoch[004] Batch [1799]/[3760] Speed: 119.105393 samples/sec accuracy=58.651910 loss=1.685427 lr=0.009951 Epoch[004] Batch [1849]/[3760] Speed: 129.353233 samples/sec accuracy=58.657095 loss=1.685999 lr=0.009950 Epoch[004] Batch [1899]/[3760] Speed: 116.091801 samples/sec accuracy=58.634868 loss=1.687124 lr=0.009950 Epoch[004] Batch [1949]/[3760] Speed: 128.085649 samples/sec accuracy=58.641026 loss=1.687447 lr=0.009950 Epoch[004] Batch [1999]/[3760] Speed: 127.624287 samples/sec accuracy=58.582813 loss=1.689936 lr=0.009949 Epoch[004] Batch [2049]/[3760] Speed: 119.835750 samples/sec accuracy=58.545732 loss=1.692063 lr=0.009949 Epoch[004] Batch [2099]/[3760] Speed: 123.221503 samples/sec accuracy=58.542411 loss=1.692315 lr=0.009949 Epoch[004] Batch [2149]/[3760] Speed: 127.736446 samples/sec accuracy=58.536337 loss=1.692965 lr=0.009949 Epoch[004] Batch [2199]/[3760] Speed: 125.374260 samples/sec accuracy=58.549006 loss=1.693461 lr=0.009948 Epoch[004] Batch [2249]/[3760] Speed: 124.450624 samples/sec accuracy=58.548611 loss=1.693762 lr=0.009948 Epoch[004] Batch [2299]/[3760] Speed: 119.567514 samples/sec accuracy=58.543478 loss=1.693976 lr=0.009948 Epoch[004] Batch [2349]/[3760] Speed: 126.569853 samples/sec accuracy=58.521941 loss=1.694659 lr=0.009947 Epoch[004] Batch [2399]/[3760] Speed: 122.671737 samples/sec accuracy=58.513021 loss=1.695075 lr=0.009947 Epoch[004] Batch [2449]/[3760] Speed: 128.392270 samples/sec accuracy=58.508929 loss=1.695194 lr=0.009947 Epoch[004] Batch [2499]/[3760] Speed: 121.764960 samples/sec accuracy=58.487500 loss=1.695938 lr=0.009946 Epoch[004] Batch [2549]/[3760] Speed: 127.338682 samples/sec accuracy=58.463235 loss=1.696527 lr=0.009946 Epoch[004] Batch [2599]/[3760] Speed: 125.555066 samples/sec accuracy=58.484976 loss=1.696316 lr=0.009946 Epoch[004] Batch [2649]/[3760] Speed: 119.290130 samples/sec accuracy=58.499410 loss=1.694998 lr=0.009945 Epoch[004] Batch [2699]/[3760] Speed: 124.673409 samples/sec accuracy=58.500579 loss=1.694011 lr=0.009945 Epoch[004] Batch [2749]/[3760] Speed: 124.155115 samples/sec accuracy=58.488636 loss=1.694471 lr=0.009945 Epoch[004] Batch [2799]/[3760] Speed: 121.231100 samples/sec accuracy=58.483817 loss=1.694389 lr=0.009945 Epoch[004] Batch [2849]/[3760] Speed: 125.885363 samples/sec accuracy=58.491776 loss=1.693860 lr=0.009944 Epoch[004] Batch [2899]/[3760] Speed: 119.599501 samples/sec accuracy=58.485453 loss=1.694054 lr=0.009944 Epoch[004] Batch [2949]/[3760] Speed: 129.506524 samples/sec accuracy=58.503178 loss=1.693974 lr=0.009944 Epoch[004] Batch [2999]/[3760] Speed: 116.335248 samples/sec accuracy=58.513542 loss=1.693796 lr=0.009943 Epoch[004] Batch [3049]/[3760] Speed: 129.395669 samples/sec accuracy=58.515881 loss=1.693337 lr=0.009943 Epoch[004] Batch [3099]/[3760] Speed: 121.920222 samples/sec accuracy=58.536794 loss=1.692794 lr=0.009943 Epoch[004] Batch [3149]/[3760] Speed: 128.136475 samples/sec accuracy=58.552083 loss=1.691833 lr=0.009942 Epoch[004] Batch [3199]/[3760] Speed: 123.660950 samples/sec accuracy=58.563965 loss=1.691478 lr=0.009942 Epoch[004] Batch [3249]/[3760] Speed: 122.424835 samples/sec accuracy=58.553365 loss=1.692282 lr=0.009942 Epoch[004] Batch [3299]/[3760] Speed: 125.575321 samples/sec accuracy=58.537405 loss=1.693025 lr=0.009941 Epoch[004] Batch [3349]/[3760] Speed: 120.914880 samples/sec accuracy=58.534981 loss=1.693439 lr=0.009941 Epoch[004] Batch [3399]/[3760] Speed: 126.753144 samples/sec accuracy=58.545496 loss=1.693224 lr=0.009941 Epoch[004] Batch [3449]/[3760] Speed: 118.266483 samples/sec accuracy=58.546649 loss=1.693297 lr=0.009940 Epoch[004] Batch [3499]/[3760] Speed: 129.129600 samples/sec accuracy=58.559821 loss=1.692665 lr=0.009940 Epoch[004] Batch [3549]/[3760] Speed: 121.803895 samples/sec accuracy=58.571743 loss=1.692723 lr=0.009940 Epoch[004] Batch [3599]/[3760] Speed: 125.658393 samples/sec accuracy=58.556858 loss=1.693050 lr=0.009939 Epoch[004] Batch [3649]/[3760] Speed: 122.105309 samples/sec accuracy=58.522260 loss=1.694193 lr=0.009939 Epoch[004] Batch [3699]/[3760] Speed: 118.256855 samples/sec accuracy=58.524071 loss=1.694297 lr=0.009939 Epoch[004] Batch [3749]/[3760] Speed: 144.651352 samples/sec accuracy=58.534167 loss=1.694315 lr=0.009938 Batch [0049]/[0303]: acc-top1=57.093750 acc-top5=81.750000 Batch [0099]/[0303]: acc-top1=56.921875 acc-top5=81.187500 Batch [0149]/[0303]: acc-top1=56.552083 acc-top5=80.791667 Batch [0199]/[0303]: acc-top1=55.882812 acc-top5=80.421875 Batch [0249]/[0303]: acc-top1=56.187500 acc-top5=80.506250 Batch [0299]/[0303]: acc-top1=56.067708 acc-top5=80.520833 [Epoch 004] training: accuracy=58.535987 loss=1.694084 [Epoch 004] speed: 123 samples/sec time cost: 2136.566777 [Epoch 004] validation: acc-top1=56.028259 acc-top5=80.466172 loss=2.154614 Epoch[005] Batch [0049]/[3759] Speed: 89.270685 samples/sec accuracy=60.750000 loss=1.593964 lr=0.009938 Epoch[005] Batch [0099]/[3759] Speed: 134.451655 samples/sec accuracy=61.296875 loss=1.563365 lr=0.009938 Epoch[005] Batch [0149]/[3759] Speed: 119.296006 samples/sec accuracy=60.885417 loss=1.577283 lr=0.009937 Epoch[005] Batch [0199]/[3759] Speed: 119.917845 samples/sec accuracy=60.664063 loss=1.590306 lr=0.009937 Epoch[005] Batch [0249]/[3759] Speed: 131.821431 samples/sec accuracy=60.656250 loss=1.595060 lr=0.009937 Epoch[005] Batch [0299]/[3759] Speed: 116.140466 samples/sec accuracy=60.614583 loss=1.601085 lr=0.009936 Epoch[005] Batch [0349]/[3759] Speed: 130.853436 samples/sec accuracy=60.901786 loss=1.586031 lr=0.009936 Epoch[005] Batch [0399]/[3759] Speed: 120.999695 samples/sec accuracy=60.910156 loss=1.587713 lr=0.009936 Epoch[005] Batch [0449]/[3759] Speed: 129.431235 samples/sec accuracy=60.722222 loss=1.591808 lr=0.009935 Epoch[005] Batch [0499]/[3759] Speed: 118.462465 samples/sec accuracy=60.609375 loss=1.593821 lr=0.009935 Epoch[005] Batch [0549]/[3759] Speed: 128.962489 samples/sec accuracy=60.457386 loss=1.601002 lr=0.009935 Epoch[005] Batch [0599]/[3759] Speed: 124.933152 samples/sec accuracy=60.523438 loss=1.598753 lr=0.009934 Epoch[005] Batch [0649]/[3759] Speed: 122.424429 samples/sec accuracy=60.346154 loss=1.609341 lr=0.009934 Epoch[005] Batch [0699]/[3759] Speed: 129.627702 samples/sec accuracy=60.397321 loss=1.606622 lr=0.009934 Epoch[005] Batch [0749]/[3759] Speed: 117.934558 samples/sec accuracy=60.470833 loss=1.604003 lr=0.009933 Epoch[005] Batch [0799]/[3759] Speed: 130.770960 samples/sec accuracy=60.429687 loss=1.606428 lr=0.009933 Epoch[005] Batch [0849]/[3759] Speed: 117.921580 samples/sec accuracy=60.431985 loss=1.604759 lr=0.009933 Epoch[005] Batch [0899]/[3759] Speed: 123.155594 samples/sec accuracy=60.388889 loss=1.605841 lr=0.009932 Epoch[005] Batch [0949]/[3759] Speed: 127.471447 samples/sec accuracy=60.343750 loss=1.605476 lr=0.009932 Epoch[005] Batch [0999]/[3759] Speed: 115.886364 samples/sec accuracy=60.279688 loss=1.607563 lr=0.009932 Epoch[005] Batch [1049]/[3759] Speed: 129.019083 samples/sec accuracy=60.308036 loss=1.607204 lr=0.009931 Epoch[005] Batch [1099]/[3759] Speed: 125.456332 samples/sec accuracy=60.282670 loss=1.607720 lr=0.009931 Epoch[005] Batch [1149]/[3759] Speed: 123.848754 samples/sec accuracy=60.243207 loss=1.608586 lr=0.009931 Epoch[005] Batch [1199]/[3759] Speed: 124.376836 samples/sec accuracy=60.223958 loss=1.608943 lr=0.009930 Epoch[005] Batch [1249]/[3759] Speed: 122.615909 samples/sec accuracy=60.215000 loss=1.610074 lr=0.009930 Epoch[005] Batch [1299]/[3759] Speed: 124.043794 samples/sec accuracy=60.240385 loss=1.609516 lr=0.009930 Epoch[005] Batch [1349]/[3759] Speed: 129.181599 samples/sec accuracy=60.222222 loss=1.609124 lr=0.009929 Epoch[005] Batch [1399]/[3759] Speed: 124.841969 samples/sec accuracy=60.252232 loss=1.608854 lr=0.009929 Epoch[005] Batch [1449]/[3759] Speed: 122.550685 samples/sec accuracy=60.312500 loss=1.607109 lr=0.009929 Epoch[005] Batch [1499]/[3759] Speed: 126.610271 samples/sec accuracy=60.287500 loss=1.607644 lr=0.009928 Epoch[005] Batch [1549]/[3759] Speed: 123.535087 samples/sec accuracy=60.258065 loss=1.609819 lr=0.009928 Epoch[005] Batch [1599]/[3759] Speed: 125.666593 samples/sec accuracy=60.278320 loss=1.609885 lr=0.009928 Epoch[005] Batch [1649]/[3759] Speed: 120.018417 samples/sec accuracy=60.291667 loss=1.608048 lr=0.009927 Epoch[005] Batch [1699]/[3759] Speed: 131.471223 samples/sec accuracy=60.306985 loss=1.608066 lr=0.009927 Epoch[005] Batch [1749]/[3759] Speed: 122.181548 samples/sec accuracy=60.267857 loss=1.608790 lr=0.009926 Epoch[005] Batch [1799]/[3759] Speed: 121.430732 samples/sec accuracy=60.289062 loss=1.608227 lr=0.009926 Epoch[005] Batch [1849]/[3759] Speed: 132.209009 samples/sec accuracy=60.295608 loss=1.607672 lr=0.009926 Epoch[005] Batch [1899]/[3759] Speed: 119.265814 samples/sec accuracy=60.348684 loss=1.606604 lr=0.009925 Epoch[005] Batch [1949]/[3759] Speed: 126.957779 samples/sec accuracy=60.383013 loss=1.606499 lr=0.009925 Epoch[005] Batch [1999]/[3759] Speed: 124.499873 samples/sec accuracy=60.400000 loss=1.606452 lr=0.009925 Epoch[005] Batch [2049]/[3759] Speed: 122.479885 samples/sec accuracy=60.410823 loss=1.606770 lr=0.009924 Epoch[005] Batch [2099]/[3759] Speed: 131.942011 samples/sec accuracy=60.409226 loss=1.606870 lr=0.009924 Epoch[005] Batch [2149]/[3759] Speed: 120.711910 samples/sec accuracy=60.376453 loss=1.608134 lr=0.009924 Epoch[005] Batch [2199]/[3759] Speed: 125.587080 samples/sec accuracy=60.394176 loss=1.607781 lr=0.009923 Epoch[005] Batch [2249]/[3759] Speed: 124.117164 samples/sec accuracy=60.385417 loss=1.607748 lr=0.009923 Epoch[005] Batch [2299]/[3759] Speed: 124.985796 samples/sec accuracy=60.362772 loss=1.608706 lr=0.009922 Epoch[005] Batch [2349]/[3759] Speed: 124.424312 samples/sec accuracy=60.333777 loss=1.609712 lr=0.009922 Epoch[005] Batch [2399]/[3759] Speed: 126.769153 samples/sec accuracy=60.345052 loss=1.608670 lr=0.009922 Epoch[005] Batch [2449]/[3759] Speed: 120.622115 samples/sec accuracy=60.300383 loss=1.610136 lr=0.009921 Epoch[005] Batch [2499]/[3759] Speed: 124.228258 samples/sec accuracy=60.310625 loss=1.609836 lr=0.009921 Epoch[005] Batch [2549]/[3759] Speed: 126.816807 samples/sec accuracy=60.305147 loss=1.610450 lr=0.009921 Epoch[005] Batch [2599]/[3759] Speed: 122.696661 samples/sec accuracy=60.280649 loss=1.611673 lr=0.009920 Epoch[005] Batch [2649]/[3759] Speed: 130.349217 samples/sec accuracy=60.287146 loss=1.611897 lr=0.009920 Epoch[005] Batch [2699]/[3759] Speed: 115.684975 samples/sec accuracy=60.299190 loss=1.611900 lr=0.009920 Epoch[005] Batch [2749]/[3759] Speed: 129.430313 samples/sec accuracy=60.302841 loss=1.612112 lr=0.009919 Epoch[005] Batch [2799]/[3759] Speed: 127.101951 samples/sec accuracy=60.286830 loss=1.612875 lr=0.009919 Epoch[005] Batch [2849]/[3759] Speed: 115.888077 samples/sec accuracy=60.254934 loss=1.614607 lr=0.009918 Epoch[005] Batch [2899]/[3759] Speed: 134.563848 samples/sec accuracy=60.257543 loss=1.614147 lr=0.009918 Epoch[005] Batch [2949]/[3759] Speed: 125.544388 samples/sec accuracy=60.251059 loss=1.614253 lr=0.009918 Epoch[005] Batch [2999]/[3759] Speed: 117.957839 samples/sec accuracy=60.234375 loss=1.614882 lr=0.009917 Epoch[005] Batch [3049]/[3759] Speed: 132.705794 samples/sec accuracy=60.225410 loss=1.614973 lr=0.009917 Epoch[005] Batch [3099]/[3759] Speed: 116.853436 samples/sec accuracy=60.236391 loss=1.614906 lr=0.009916 Epoch[005] Batch [3149]/[3759] Speed: 128.563370 samples/sec accuracy=60.222718 loss=1.614830 lr=0.009916 Epoch[005] Batch [3199]/[3759] Speed: 129.227826 samples/sec accuracy=60.213379 loss=1.614914 lr=0.009916 Epoch[005] Batch [3249]/[3759] Speed: 115.954929 samples/sec accuracy=60.198077 loss=1.615567 lr=0.009915 Epoch[005] Batch [3299]/[3759] Speed: 132.518893 samples/sec accuracy=60.199811 loss=1.615308 lr=0.009915 Epoch[005] Batch [3349]/[3759] Speed: 118.057851 samples/sec accuracy=60.181903 loss=1.615738 lr=0.009915 Epoch[005] Batch [3399]/[3759] Speed: 129.260685 samples/sec accuracy=60.178309 loss=1.615765 lr=0.009914 Epoch[005] Batch [3449]/[3759] Speed: 124.774996 samples/sec accuracy=60.173460 loss=1.615960 lr=0.009914 Epoch[005] Batch [3499]/[3759] Speed: 120.905792 samples/sec accuracy=60.163839 loss=1.616170 lr=0.009913 Epoch[005] Batch [3549]/[3759] Speed: 127.486238 samples/sec accuracy=60.165493 loss=1.616130 lr=0.009913 Epoch[005] Batch [3599]/[3759] Speed: 121.315154 samples/sec accuracy=60.176649 loss=1.615519 lr=0.009913 Epoch[005] Batch [3649]/[3759] Speed: 124.235501 samples/sec accuracy=60.176370 loss=1.615292 lr=0.009912 Epoch[005] Batch [3699]/[3759] Speed: 129.345981 samples/sec accuracy=60.172720 loss=1.615476 lr=0.009912 Epoch[005] Batch [3749]/[3759] Speed: 143.972673 samples/sec accuracy=60.166667 loss=1.616324 lr=0.009911 Batch [0049]/[0303]: acc-top1=56.750000 acc-top5=81.843750 Batch [0099]/[0303]: acc-top1=56.671875 acc-top5=81.234375 Batch [0149]/[0303]: acc-top1=56.750000 acc-top5=80.843750 Batch [0199]/[0303]: acc-top1=56.375000 acc-top5=80.523438 Batch [0249]/[0303]: acc-top1=56.618750 acc-top5=80.481250 Batch [0299]/[0303]: acc-top1=56.677083 acc-top5=80.588542 [Epoch 005] training: accuracy=60.166018 loss=1.616256 [Epoch 005] speed: 124 samples/sec time cost: 2125.860551 [Epoch 005] validation: acc-top1=56.605817 acc-top5=80.543523 loss=2.158839 Epoch[006] Batch [0049]/[3760] Speed: 88.416319 samples/sec accuracy=62.656250 loss=1.481146 lr=0.009911 Epoch[006] Batch [0099]/[3760] Speed: 128.505103 samples/sec accuracy=63.234375 loss=1.485399 lr=0.009911 Epoch[006] Batch [0149]/[3760] Speed: 122.215788 samples/sec accuracy=63.322917 loss=1.477473 lr=0.009910 Epoch[006] Batch [0199]/[3760] Speed: 131.054611 samples/sec accuracy=63.335937 loss=1.485264 lr=0.009910 Epoch[006] Batch [0249]/[3760] Speed: 118.559665 samples/sec accuracy=62.962500 loss=1.502470 lr=0.009909 Epoch[006] Batch [0299]/[3760] Speed: 132.098416 samples/sec accuracy=62.828125 loss=1.503141 lr=0.009909 Epoch[006] Batch [0349]/[3760] Speed: 121.138361 samples/sec accuracy=62.816964 loss=1.508464 lr=0.009909 Epoch[006] Batch [0399]/[3760] Speed: 125.530845 samples/sec accuracy=62.453125 loss=1.517638 lr=0.009908 Epoch[006] Batch [0449]/[3760] Speed: 127.006863 samples/sec accuracy=62.302083 loss=1.518224 lr=0.009908 Epoch[006] Batch [0499]/[3760] Speed: 123.539698 samples/sec accuracy=62.296875 loss=1.517913 lr=0.009907 Epoch[006] Batch [0549]/[3760] Speed: 124.787475 samples/sec accuracy=62.301136 loss=1.518623 lr=0.009907 Epoch[006] Batch [0599]/[3760] Speed: 124.887917 samples/sec accuracy=62.244792 loss=1.522717 lr=0.009907 Epoch[006] Batch [0649]/[3760] Speed: 120.662386 samples/sec accuracy=62.264423 loss=1.523762 lr=0.009906 Epoch[006] Batch [0699]/[3760] Speed: 127.934789 samples/sec accuracy=62.207589 loss=1.527720 lr=0.009906 Epoch[006] Batch [0749]/[3760] Speed: 125.727391 samples/sec accuracy=62.133333 loss=1.530831 lr=0.009905 Epoch[006] Batch [0799]/[3760] Speed: 122.252274 samples/sec accuracy=62.080078 loss=1.530392 lr=0.009905 Epoch[006] Batch [0849]/[3760] Speed: 129.285246 samples/sec accuracy=62.051471 loss=1.531793 lr=0.009905 Epoch[006] Batch [0899]/[3760] Speed: 117.530583 samples/sec accuracy=62.055556 loss=1.531648 lr=0.009904 Epoch[006] Batch [0949]/[3760] Speed: 133.519299 samples/sec accuracy=62.011513 loss=1.533144 lr=0.009904 Epoch[006] Batch [0999]/[3760] Speed: 121.875816 samples/sec accuracy=61.995312 loss=1.533990 lr=0.009903 Epoch[006] Batch [1049]/[3760] Speed: 127.895182 samples/sec accuracy=61.988095 loss=1.534315 lr=0.009903 Epoch[006] Batch [1099]/[3760] Speed: 127.438288 samples/sec accuracy=62.019886 loss=1.531628 lr=0.009903 Epoch[006] Batch [1149]/[3760] Speed: 124.347917 samples/sec accuracy=62.023098 loss=1.532636 lr=0.009902 Epoch[006] Batch [1199]/[3760] Speed: 122.693617 samples/sec accuracy=62.035156 loss=1.532116 lr=0.009902 Epoch[006] Batch [1249]/[3760] Speed: 130.235599 samples/sec accuracy=62.021250 loss=1.532680 lr=0.009901 Epoch[006] Batch [1299]/[3760] Speed: 118.849636 samples/sec accuracy=61.987981 loss=1.533342 lr=0.009901 Epoch[006] Batch [1349]/[3760] Speed: 131.221434 samples/sec accuracy=61.927083 loss=1.534820 lr=0.009901 Epoch[006] Batch [1399]/[3760] Speed: 115.592238 samples/sec accuracy=61.858259 loss=1.538260 lr=0.009900 Epoch[006] Batch [1449]/[3760] Speed: 132.029523 samples/sec accuracy=61.859914 loss=1.538450 lr=0.009900 Epoch[006] Batch [1499]/[3760] Speed: 120.243870 samples/sec accuracy=61.864583 loss=1.538108 lr=0.009899 Epoch[006] Batch [1549]/[3760] Speed: 130.712334 samples/sec accuracy=61.906250 loss=1.535128 lr=0.009899 Epoch[006] Batch [1599]/[3760] Speed: 117.176793 samples/sec accuracy=61.863281 loss=1.537061 lr=0.009898 Epoch[006] Batch [1649]/[3760] Speed: 131.907552 samples/sec accuracy=61.873106 loss=1.536876 lr=0.009898 Epoch[006] Batch [1699]/[3760] Speed: 125.016686 samples/sec accuracy=61.861213 loss=1.538230 lr=0.009898 Epoch[006] Batch [1749]/[3760] Speed: 120.963902 samples/sec accuracy=61.826786 loss=1.539625 lr=0.009897 Epoch[006] Batch [1799]/[3760] Speed: 131.287440 samples/sec accuracy=61.782986 loss=1.541680 lr=0.009897 Epoch[006] Batch [1849]/[3760] Speed: 118.139664 samples/sec accuracy=61.753378 loss=1.542902 lr=0.009896 Epoch[006] Batch [1899]/[3760] Speed: 127.918018 samples/sec accuracy=61.733553 loss=1.544074 lr=0.009896 Epoch[006] Batch [1949]/[3760] Speed: 129.250239 samples/sec accuracy=61.729167 loss=1.544614 lr=0.009895 Epoch[006] Batch [1999]/[3760] Speed: 117.868919 samples/sec accuracy=61.730469 loss=1.544691 lr=0.009895 Epoch[006] Batch [2049]/[3760] Speed: 127.032681 samples/sec accuracy=61.693598 loss=1.546095 lr=0.009895 Epoch[006] Batch [2099]/[3760] Speed: 127.483603 samples/sec accuracy=61.703125 loss=1.546781 lr=0.009894 Epoch[006] Batch [2149]/[3760] Speed: 119.188967 samples/sec accuracy=61.700581 loss=1.546761 lr=0.009894 Epoch[006] Batch [2199]/[3760] Speed: 129.715980 samples/sec accuracy=61.724432 loss=1.545896 lr=0.009893 Epoch[006] Batch [2249]/[3760] Speed: 124.867884 samples/sec accuracy=61.720833 loss=1.546127 lr=0.009893 Epoch[006] Batch [2299]/[3760] Speed: 121.884977 samples/sec accuracy=61.682065 loss=1.546946 lr=0.009892 Epoch[006] Batch [2349]/[3760] Speed: 126.068029 samples/sec accuracy=61.660904 loss=1.548843 lr=0.009892 Epoch[006] Batch [2399]/[3760] Speed: 120.782483 samples/sec accuracy=61.645182 loss=1.549577 lr=0.009892 Epoch[006] Batch [2449]/[3760] Speed: 128.657725 samples/sec accuracy=61.630740 loss=1.550100 lr=0.009891 Epoch[006] Batch [2499]/[3760] Speed: 119.335634 samples/sec accuracy=61.606875 loss=1.551172 lr=0.009891 Epoch[006] Batch [2549]/[3760] Speed: 133.015068 samples/sec accuracy=61.596201 loss=1.551927 lr=0.009890 Epoch[006] Batch [2599]/[3760] Speed: 126.012313 samples/sec accuracy=61.575120 loss=1.552176 lr=0.009890 Epoch[006] Batch [2649]/[3760] Speed: 121.654213 samples/sec accuracy=61.536557 loss=1.553614 lr=0.009889 Epoch[006] Batch [2699]/[3760] Speed: 127.824733 samples/sec accuracy=61.549190 loss=1.553264 lr=0.009889 Epoch[006] Batch [2749]/[3760] Speed: 130.640210 samples/sec accuracy=61.519318 loss=1.554427 lr=0.009889 Epoch[006] Batch [2799]/[3760] Speed: 112.883074 samples/sec accuracy=61.508371 loss=1.555123 lr=0.009888 Epoch[006] Batch [2849]/[3760] Speed: 132.152761 samples/sec accuracy=61.524123 loss=1.554851 lr=0.009888 Epoch[006] Batch [2899]/[3760] Speed: 126.443209 samples/sec accuracy=61.524784 loss=1.555203 lr=0.009887 Epoch[006] Batch [2949]/[3760] Speed: 123.555963 samples/sec accuracy=61.512712 loss=1.556279 lr=0.009887 Epoch[006] Batch [2999]/[3760] Speed: 126.677816 samples/sec accuracy=61.495312 loss=1.556313 lr=0.009886 Epoch[006] Batch [3049]/[3760] Speed: 120.241020 samples/sec accuracy=61.492316 loss=1.555950 lr=0.009886 Epoch[006] Batch [3099]/[3760] Speed: 134.747385 samples/sec accuracy=61.512097 loss=1.555463 lr=0.009885 Epoch[006] Batch [3149]/[3760] Speed: 118.396642 samples/sec accuracy=61.516369 loss=1.555187 lr=0.009885 Epoch[006] Batch [3199]/[3760] Speed: 129.600212 samples/sec accuracy=61.505859 loss=1.555125 lr=0.009885 Epoch[006] Batch [3249]/[3760] Speed: 121.102020 samples/sec accuracy=61.487500 loss=1.555745 lr=0.009884 Epoch[006] Batch [3299]/[3760] Speed: 128.070616 samples/sec accuracy=61.473485 loss=1.555705 lr=0.009884 Epoch[006] Batch [3349]/[3760] Speed: 121.987593 samples/sec accuracy=61.466418 loss=1.556137 lr=0.009883 Epoch[006] Batch [3399]/[3760] Speed: 124.088573 samples/sec accuracy=61.453125 loss=1.556862 lr=0.009883 Epoch[006] Batch [3449]/[3760] Speed: 129.182678 samples/sec accuracy=61.472373 loss=1.556313 lr=0.009882 Epoch[006] Batch [3499]/[3760] Speed: 129.076545 samples/sec accuracy=61.460268 loss=1.557080 lr=0.009882 Epoch[006] Batch [3549]/[3760] Speed: 117.435649 samples/sec accuracy=61.477993 loss=1.556567 lr=0.009881 Epoch[006] Batch [3599]/[3760] Speed: 123.072407 samples/sec accuracy=61.470920 loss=1.557258 lr=0.009881 Epoch[006] Batch [3649]/[3760] Speed: 131.675231 samples/sec accuracy=61.477312 loss=1.557284 lr=0.009881 Epoch[006] Batch [3699]/[3760] Speed: 120.194513 samples/sec accuracy=61.485220 loss=1.557313 lr=0.009880 Epoch[006] Batch [3749]/[3760] Speed: 142.302133 samples/sec accuracy=61.508750 loss=1.556952 lr=0.009880 Batch [0049]/[0303]: acc-top1=57.250000 acc-top5=82.687500 Batch [0099]/[0303]: acc-top1=57.500000 acc-top5=81.812500 Batch [0149]/[0303]: acc-top1=57.187500 acc-top5=81.395833 Batch [0199]/[0303]: acc-top1=56.718750 acc-top5=81.187500 Batch [0249]/[0303]: acc-top1=56.968750 acc-top5=81.143750 Batch [0299]/[0303]: acc-top1=56.916667 acc-top5=81.177083 [Epoch 006] training: accuracy=61.504322 loss=1.557009 [Epoch 006] speed: 124 samples/sec time cost: 2120.897037 [Epoch 006] validation: acc-top1=56.899752 acc-top5=81.115924 loss=2.188856 Epoch[007] Batch [0049]/[3760] Speed: 89.333584 samples/sec accuracy=64.625000 loss=1.435004 lr=0.009879 Epoch[007] Batch [0099]/[3760] Speed: 129.999743 samples/sec accuracy=64.625000 loss=1.429528 lr=0.009879 Epoch[007] Batch [0149]/[3760] Speed: 122.270867 samples/sec accuracy=64.208333 loss=1.437589 lr=0.009878 Epoch[007] Batch [0199]/[3760] Speed: 128.076435 samples/sec accuracy=63.640625 loss=1.451143 lr=0.009878 Epoch[007] Batch [0249]/[3760] Speed: 117.791452 samples/sec accuracy=63.575000 loss=1.447102 lr=0.009877 Epoch[007] Batch [0299]/[3760] Speed: 130.937308 samples/sec accuracy=63.572917 loss=1.454778 lr=0.009877 Epoch[007] Batch [0349]/[3760] Speed: 118.220861 samples/sec accuracy=63.339286 loss=1.461690 lr=0.009876 Epoch[007] Batch [0399]/[3760] Speed: 133.503032 samples/sec accuracy=63.363281 loss=1.463582 lr=0.009876 Epoch[007] Batch [0449]/[3760] Speed: 129.534051 samples/sec accuracy=63.215278 loss=1.467965 lr=0.009875 Epoch[007] Batch [0499]/[3760] Speed: 117.608541 samples/sec accuracy=63.153125 loss=1.470584 lr=0.009875 Epoch[007] Batch [0549]/[3760] Speed: 132.354767 samples/sec accuracy=63.051136 loss=1.475633 lr=0.009874 Epoch[007] Batch [0599]/[3760] Speed: 122.478672 samples/sec accuracy=63.033854 loss=1.474740 lr=0.009874 Epoch[007] Batch [0649]/[3760] Speed: 125.574804 samples/sec accuracy=63.084135 loss=1.476706 lr=0.009874 Epoch[007] Batch [0699]/[3760] Speed: 122.167710 samples/sec accuracy=63.133929 loss=1.476092 lr=0.009873 Epoch[007] Batch [0749]/[3760] Speed: 129.702182 samples/sec accuracy=63.077083 loss=1.476547 lr=0.009873 Epoch[007] Batch [0799]/[3760] Speed: 125.043602 samples/sec accuracy=63.076172 loss=1.475856 lr=0.009872 Epoch[007] Batch [0849]/[3760] Speed: 119.362898 samples/sec accuracy=63.097426 loss=1.474814 lr=0.009872 Epoch[007] Batch [0899]/[3760] Speed: 132.170095 samples/sec accuracy=63.131944 loss=1.472503 lr=0.009871 Epoch[007] Batch [0949]/[3760] Speed: 120.283117 samples/sec accuracy=63.129934 loss=1.472281 lr=0.009871 Epoch[007] Batch [0999]/[3760] Speed: 126.432291 samples/sec accuracy=63.048437 loss=1.476471 lr=0.009870 Epoch[007] Batch [1049]/[3760] Speed: 128.400635 samples/sec accuracy=63.044643 loss=1.476741 lr=0.009870 Epoch[007] Batch [1099]/[3760] Speed: 123.298324 samples/sec accuracy=63.061080 loss=1.476756 lr=0.009869 Epoch[007] Batch [1149]/[3760] Speed: 130.292237 samples/sec accuracy=63.048913 loss=1.478517 lr=0.009869 Epoch[007] Batch [1199]/[3760] Speed: 116.534974 samples/sec accuracy=63.053385 loss=1.478735 lr=0.009868 Epoch[007] Batch [1249]/[3760] Speed: 129.123687 samples/sec accuracy=63.052500 loss=1.479497 lr=0.009868 Epoch[007] Batch [1299]/[3760] Speed: 124.182713 samples/sec accuracy=62.945913 loss=1.485247 lr=0.009867 Epoch[007] Batch [1349]/[3760] Speed: 124.987692 samples/sec accuracy=62.956019 loss=1.486663 lr=0.009867 Epoch[007] Batch [1399]/[3760] Speed: 121.227198 samples/sec accuracy=62.966518 loss=1.487386 lr=0.009866 Epoch[007] Batch [1449]/[3760] Speed: 127.905453 samples/sec accuracy=62.947198 loss=1.488073 lr=0.009866 Epoch[007] Batch [1499]/[3760] Speed: 121.268987 samples/sec accuracy=62.917708 loss=1.488879 lr=0.009865 Epoch[007] Batch [1549]/[3760] Speed: 130.575709 samples/sec accuracy=62.956653 loss=1.487985 lr=0.009865 Epoch[007] Batch [1599]/[3760] Speed: 128.582046 samples/sec accuracy=62.927734 loss=1.490025 lr=0.009865 Epoch[007] Batch [1649]/[3760] Speed: 119.927618 samples/sec accuracy=62.907197 loss=1.491599 lr=0.009864 Epoch[007] Batch [1699]/[3760] Speed: 131.440474 samples/sec accuracy=62.853860 loss=1.493254 lr=0.009864 Epoch[007] Batch [1749]/[3760] Speed: 120.711508 samples/sec accuracy=62.848214 loss=1.494332 lr=0.009863 Epoch[007] Batch [1799]/[3760] Speed: 131.049156 samples/sec accuracy=62.843750 loss=1.494148 lr=0.009863 Epoch[007] Batch [1849]/[3760] Speed: 123.466922 samples/sec accuracy=62.822635 loss=1.494272 lr=0.009862 Epoch[007] Batch [1899]/[3760] Speed: 122.343070 samples/sec accuracy=62.792763 loss=1.496006 lr=0.009862 Epoch[007] Batch [1949]/[3760] Speed: 129.183728 samples/sec accuracy=62.745192 loss=1.498387 lr=0.009861 Epoch[007] Batch [1999]/[3760] Speed: 120.130085 samples/sec accuracy=62.798438 loss=1.497236 lr=0.009861 Epoch[007] Batch [2049]/[3760] Speed: 128.036662 samples/sec accuracy=62.780488 loss=1.498593 lr=0.009860 Epoch[007] Batch [2099]/[3760] Speed: 125.554192 samples/sec accuracy=62.760417 loss=1.499456 lr=0.009860 Epoch[007] Batch [2149]/[3760] Speed: 123.253360 samples/sec accuracy=62.745640 loss=1.500005 lr=0.009859 Epoch[007] Batch [2199]/[3760] Speed: 125.200334 samples/sec accuracy=62.754261 loss=1.499700 lr=0.009859 Epoch[007] Batch [2249]/[3760] Speed: 127.413363 samples/sec accuracy=62.732639 loss=1.500447 lr=0.009858 Epoch[007] Batch [2299]/[3760] Speed: 118.716055 samples/sec accuracy=62.722147 loss=1.501033 lr=0.009858 Epoch[007] Batch [2349]/[3760] Speed: 131.017739 samples/sec accuracy=62.706117 loss=1.501607 lr=0.009857 Epoch[007] Batch [2399]/[3760] Speed: 125.060406 samples/sec accuracy=62.694010 loss=1.501934 lr=0.009857 Epoch[007] Batch [2449]/[3760] Speed: 120.171276 samples/sec accuracy=62.688776 loss=1.502401 lr=0.009856 Epoch[007] Batch [2499]/[3760] Speed: 134.175203 samples/sec accuracy=62.670000 loss=1.502474 lr=0.009856 Epoch[007] Batch [2549]/[3760] Speed: 116.571542 samples/sec accuracy=62.659314 loss=1.503657 lr=0.009855 Epoch[007] Batch [2599]/[3760] Speed: 134.728637 samples/sec accuracy=62.642428 loss=1.503513 lr=0.009855 Epoch[007] Batch [2649]/[3760] Speed: 129.231154 samples/sec accuracy=62.620283 loss=1.504476 lr=0.009854 Epoch[007] Batch [2699]/[3760] Speed: 116.942709 samples/sec accuracy=62.619792 loss=1.504228 lr=0.009854 Epoch[007] Batch [2749]/[3760] Speed: 126.296042 samples/sec accuracy=62.613068 loss=1.504527 lr=0.009853 Epoch[007] Batch [2799]/[3760] Speed: 126.690034 samples/sec accuracy=62.618304 loss=1.504365 lr=0.009853 Epoch[007] Batch [2849]/[3760] Speed: 120.590761 samples/sec accuracy=62.616228 loss=1.504365 lr=0.009852 Epoch[007] Batch [2899]/[3760] Speed: 130.269937 samples/sec accuracy=62.593211 loss=1.505126 lr=0.009852 Epoch[007] Batch [2949]/[3760] Speed: 121.678268 samples/sec accuracy=62.595869 loss=1.505132 lr=0.009851 Epoch[007] Batch [2999]/[3760] Speed: 130.413986 samples/sec accuracy=62.603646 loss=1.504543 lr=0.009851 Epoch[007] Batch [3049]/[3760] Speed: 119.557138 samples/sec accuracy=62.582992 loss=1.505427 lr=0.009850 Epoch[007] Batch [3099]/[3760] Speed: 128.205162 samples/sec accuracy=62.592238 loss=1.505015 lr=0.009850 Epoch[007] Batch [3149]/[3760] Speed: 125.487967 samples/sec accuracy=62.585317 loss=1.505428 lr=0.009849 Epoch[007] Batch [3199]/[3760] Speed: 124.811500 samples/sec accuracy=62.589355 loss=1.505365 lr=0.009849 Epoch[007] Batch [3249]/[3760] Speed: 131.009094 samples/sec accuracy=62.584135 loss=1.505435 lr=0.009848 Epoch[007] Batch [3299]/[3760] Speed: 119.407877 samples/sec accuracy=62.595170 loss=1.504974 lr=0.009848 Epoch[007] Batch [3349]/[3760] Speed: 129.815048 samples/sec accuracy=62.591884 loss=1.505368 lr=0.009847 Epoch[007] Batch [3399]/[3760] Speed: 124.763724 samples/sec accuracy=62.584559 loss=1.505593 lr=0.009847 Epoch[007] Batch [3449]/[3760] Speed: 121.572885 samples/sec accuracy=62.553895 loss=1.507022 lr=0.009846 Epoch[007] Batch [3499]/[3760] Speed: 125.623278 samples/sec accuracy=62.532589 loss=1.508125 lr=0.009846 Epoch[007] Batch [3549]/[3760] Speed: 125.252001 samples/sec accuracy=62.520246 loss=1.508821 lr=0.009845 Epoch[007] Batch [3599]/[3760] Speed: 122.185107 samples/sec accuracy=62.513021 loss=1.508871 lr=0.009845 Epoch[007] Batch [3649]/[3760] Speed: 128.805422 samples/sec accuracy=62.493151 loss=1.509682 lr=0.009844 Epoch[007] Batch [3699]/[3760] Speed: 129.462677 samples/sec accuracy=62.480997 loss=1.510101 lr=0.009843 Epoch[007] Batch [3749]/[3760] Speed: 138.076472 samples/sec accuracy=62.460833 loss=1.511048 lr=0.009843 Batch [0049]/[0303]: acc-top1=57.968750 acc-top5=82.500000 Batch [0099]/[0303]: acc-top1=58.109375 acc-top5=81.968750 Batch [0149]/[0303]: acc-top1=58.510417 acc-top5=81.895833 Batch [0199]/[0303]: acc-top1=57.968750 acc-top5=81.617188 Batch [0249]/[0303]: acc-top1=58.037500 acc-top5=81.600000 Batch [0299]/[0303]: acc-top1=57.921875 acc-top5=81.619792 [Epoch 007] training: accuracy=62.465924 loss=1.510939 [Epoch 007] speed: 124 samples/sec time cost: 2118.053125 [Epoch 007] validation: acc-top1=57.869224 acc-top5=81.585190 loss=2.202508 Epoch[008] Batch [0049]/[3759] Speed: 90.461841 samples/sec accuracy=64.906250 loss=1.400651 lr=0.009842 Epoch[008] Batch [0099]/[3759] Speed: 129.639231 samples/sec accuracy=65.296875 loss=1.391834 lr=0.009842 Epoch[008] Batch [0149]/[3759] Speed: 120.785250 samples/sec accuracy=64.916667 loss=1.403305 lr=0.009841 Epoch[008] Batch [0199]/[3759] Speed: 124.586172 samples/sec accuracy=64.562500 loss=1.416362 lr=0.009841 Epoch[008] Batch [0249]/[3759] Speed: 127.897611 samples/sec accuracy=64.487500 loss=1.421600 lr=0.009840 Epoch[008] Batch [0299]/[3759] Speed: 124.097723 samples/sec accuracy=64.500000 loss=1.424124 lr=0.009840 Epoch[008] Batch [0349]/[3759] Speed: 125.393829 samples/sec accuracy=64.535714 loss=1.419029 lr=0.009839 Epoch[008] Batch [0399]/[3759] Speed: 124.311488 samples/sec accuracy=64.675781 loss=1.413832 lr=0.009839 Epoch[008] Batch [0449]/[3759] Speed: 120.129322 samples/sec accuracy=64.618056 loss=1.415142 lr=0.009838 Epoch[008] Batch [0499]/[3759] Speed: 126.260335 samples/sec accuracy=64.487500 loss=1.423938 lr=0.009838 Epoch[008] Batch [0549]/[3759] Speed: 131.877553 samples/sec accuracy=64.380682 loss=1.428724 lr=0.009837 Epoch[008] Batch [0599]/[3759] Speed: 115.841258 samples/sec accuracy=64.325521 loss=1.429096 lr=0.009837 Epoch[008] Batch [0649]/[3759] Speed: 134.666895 samples/sec accuracy=64.262019 loss=1.433581 lr=0.009836 Epoch[008] Batch [0699]/[3759] Speed: 119.971936 samples/sec accuracy=64.274554 loss=1.433166 lr=0.009836 Epoch[008] Batch [0749]/[3759] Speed: 128.869982 samples/sec accuracy=64.185417 loss=1.434539 lr=0.009835 Epoch[008] Batch [0799]/[3759] Speed: 120.688821 samples/sec accuracy=64.224609 loss=1.434636 lr=0.009834 Epoch[008] Batch [0849]/[3759] Speed: 127.951360 samples/sec accuracy=64.215074 loss=1.434468 lr=0.009834 Epoch[008] Batch [0899]/[3759] Speed: 125.476998 samples/sec accuracy=64.223958 loss=1.433913 lr=0.009833 Epoch[008] Batch [0949]/[3759] Speed: 125.824897 samples/sec accuracy=64.149671 loss=1.437601 lr=0.009833 Epoch[008] Batch [0999]/[3759] Speed: 117.655116 samples/sec accuracy=64.089063 loss=1.439753 lr=0.009832 Epoch[008] Batch [1049]/[3759] Speed: 134.086148 samples/sec accuracy=64.061012 loss=1.440427 lr=0.009832 Epoch[008] Batch [1099]/[3759] Speed: 122.636917 samples/sec accuracy=64.053977 loss=1.439338 lr=0.009831 Epoch[008] Batch [1149]/[3759] Speed: 124.049828 samples/sec accuracy=64.028533 loss=1.439640 lr=0.009831 Epoch[008] Batch [1199]/[3759] Speed: 126.069306 samples/sec accuracy=64.024740 loss=1.440472 lr=0.009830 Epoch[008] Batch [1249]/[3759] Speed: 125.339468 samples/sec accuracy=64.050000 loss=1.440536 lr=0.009830 Epoch[008] Batch [1299]/[3759] Speed: 132.293789 samples/sec accuracy=64.076923 loss=1.441197 lr=0.009829 Epoch[008] Batch [1349]/[3759] Speed: 118.749128 samples/sec accuracy=64.059028 loss=1.440825 lr=0.009829 Epoch[008] Batch [1399]/[3759] Speed: 125.895903 samples/sec accuracy=64.022321 loss=1.441699 lr=0.009828 Epoch[008] Batch [1449]/[3759] Speed: 126.315614 samples/sec accuracy=63.978448 loss=1.442744 lr=0.009827 Epoch[008] Batch [1499]/[3759] Speed: 127.018376 samples/sec accuracy=63.935417 loss=1.445281 lr=0.009827 Epoch[008] Batch [1549]/[3759] Speed: 125.067167 samples/sec accuracy=63.933468 loss=1.444574 lr=0.009826 Epoch[008] Batch [1599]/[3759] Speed: 122.047928 samples/sec accuracy=63.918945 loss=1.443910 lr=0.009826 Epoch[008] Batch [1649]/[3759] Speed: 126.812092 samples/sec accuracy=63.880682 loss=1.445864 lr=0.009825 Epoch[008] Batch [1699]/[3759] Speed: 128.117409 samples/sec accuracy=63.922794 loss=1.443950 lr=0.009825 Epoch[008] Batch [1749]/[3759] Speed: 124.319499 samples/sec accuracy=63.900000 loss=1.444608 lr=0.009824 Epoch[008] Batch [1799]/[3759] Speed: 122.104985 samples/sec accuracy=63.882812 loss=1.444904 lr=0.009824 Epoch[008] Batch [1849]/[3759] Speed: 123.879549 samples/sec accuracy=63.821791 loss=1.446040 lr=0.009823 Epoch[008] Batch [1899]/[3759] Speed: 129.997317 samples/sec accuracy=63.810033 loss=1.446566 lr=0.009823 Epoch[008] Batch [1949]/[3759] Speed: 126.380815 samples/sec accuracy=63.761218 loss=1.449239 lr=0.009822 Epoch[008] Batch [1999]/[3759] Speed: 122.155976 samples/sec accuracy=63.757031 loss=1.449324 lr=0.009821 Epoch[008] Batch [2049]/[3759] Speed: 127.778968 samples/sec accuracy=63.733994 loss=1.450222 lr=0.009821 Epoch[008] Batch [2099]/[3759] Speed: 122.224550 samples/sec accuracy=63.680060 loss=1.451759 lr=0.009820 Epoch[008] Batch [2149]/[3759] Speed: 130.899185 samples/sec accuracy=63.669331 loss=1.452497 lr=0.009820 Epoch[008] Batch [2199]/[3759] Speed: 117.475202 samples/sec accuracy=63.637074 loss=1.453870 lr=0.009819 Epoch[008] Batch [2249]/[3759] Speed: 126.626349 samples/sec accuracy=63.661806 loss=1.452863 lr=0.009819 Epoch[008] Batch [2299]/[3759] Speed: 128.277826 samples/sec accuracy=63.641304 loss=1.453679 lr=0.009818 Epoch[008] Batch [2349]/[3759] Speed: 123.888046 samples/sec accuracy=63.646277 loss=1.453807 lr=0.009818 Epoch[008] Batch [2399]/[3759] Speed: 131.080306 samples/sec accuracy=63.606120 loss=1.455141 lr=0.009817 Epoch[008] Batch [2449]/[3759] Speed: 119.299861 samples/sec accuracy=63.611607 loss=1.455438 lr=0.009816 Epoch[008] Batch [2499]/[3759] Speed: 128.160592 samples/sec accuracy=63.594375 loss=1.455947 lr=0.009816 Epoch[008] Batch [2549]/[3759] Speed: 120.726962 samples/sec accuracy=63.584559 loss=1.456881 lr=0.009815 Epoch[008] Batch [2599]/[3759] Speed: 131.252387 samples/sec accuracy=63.557692 loss=1.457734 lr=0.009815 Epoch[008] Batch [2649]/[3759] Speed: 116.212547 samples/sec accuracy=63.556014 loss=1.457184 lr=0.009814 Epoch[008] Batch [2699]/[3759] Speed: 132.954638 samples/sec accuracy=63.544560 loss=1.458023 lr=0.009814 Epoch[008] Batch [2749]/[3759] Speed: 128.470945 samples/sec accuracy=63.535795 loss=1.457993 lr=0.009813 Epoch[008] Batch [2799]/[3759] Speed: 118.392080 samples/sec accuracy=63.529576 loss=1.458692 lr=0.009812 Epoch[008] Batch [2849]/[3759] Speed: 132.288518 samples/sec accuracy=63.546601 loss=1.458287 lr=0.009812 Epoch[008] Batch [2899]/[3759] Speed: 116.773986 samples/sec accuracy=63.552263 loss=1.458271 lr=0.009811 Epoch[008] Batch [2949]/[3759] Speed: 130.380744 samples/sec accuracy=63.536547 loss=1.459349 lr=0.009811 Epoch[008] Batch [2999]/[3759] Speed: 125.572818 samples/sec accuracy=63.514583 loss=1.460260 lr=0.009810 Epoch[008] Batch [3049]/[3759] Speed: 122.988518 samples/sec accuracy=63.509221 loss=1.460303 lr=0.009810 Epoch[008] Batch [3099]/[3759] Speed: 128.013487 samples/sec accuracy=63.510081 loss=1.460441 lr=0.009809 Epoch[008] Batch [3149]/[3759] Speed: 124.900242 samples/sec accuracy=63.513889 loss=1.460112 lr=0.009808 Epoch[008] Batch [3199]/[3759] Speed: 127.900884 samples/sec accuracy=63.524414 loss=1.459828 lr=0.009808 Epoch[008] Batch [3249]/[3759] Speed: 119.031683 samples/sec accuracy=63.519712 loss=1.459745 lr=0.009807 Epoch[008] Batch [3299]/[3759] Speed: 132.168431 samples/sec accuracy=63.513258 loss=1.459780 lr=0.009807 Epoch[008] Batch [3349]/[3759] Speed: 125.030696 samples/sec accuracy=63.511194 loss=1.459883 lr=0.009806 Epoch[008] Batch [3399]/[3759] Speed: 125.488661 samples/sec accuracy=63.488971 loss=1.460596 lr=0.009806 Epoch[008] Batch [3449]/[3759] Speed: 126.374427 samples/sec accuracy=63.468750 loss=1.461741 lr=0.009805 Epoch[008] Batch [3499]/[3759] Speed: 119.093236 samples/sec accuracy=63.472768 loss=1.461767 lr=0.009804 Epoch[008] Batch [3549]/[3759] Speed: 132.521604 samples/sec accuracy=63.466109 loss=1.461718 lr=0.009804 Epoch[008] Batch [3599]/[3759] Speed: 127.501560 samples/sec accuracy=63.463976 loss=1.461530 lr=0.009803 Epoch[008] Batch [3649]/[3759] Speed: 120.048743 samples/sec accuracy=63.454195 loss=1.462091 lr=0.009803 Epoch[008] Batch [3699]/[3759] Speed: 124.419808 samples/sec accuracy=63.440878 loss=1.462509 lr=0.009802 Epoch[008] Batch [3749]/[3759] Speed: 146.491709 samples/sec accuracy=63.447500 loss=1.462420 lr=0.009802 Batch [0049]/[0303]: acc-top1=58.281250 acc-top5=82.281250 Batch [0099]/[0303]: acc-top1=58.828125 acc-top5=82.734375 Batch [0149]/[0303]: acc-top1=58.760417 acc-top5=82.229167 Batch [0199]/[0303]: acc-top1=58.328125 acc-top5=81.867188 Batch [0249]/[0303]: acc-top1=58.387500 acc-top5=81.843750 Batch [0299]/[0303]: acc-top1=58.437500 acc-top5=81.848958 [Epoch 008] training: accuracy=63.444400 loss=1.462471 [Epoch 008] speed: 124 samples/sec time cost: 2114.476884 [Epoch 008] validation: acc-top1=58.390058 acc-top5=81.781147 loss=2.126194 Epoch[009] Batch [0049]/[3760] Speed: 90.519215 samples/sec accuracy=65.093750 loss=1.385439 lr=0.009801 Epoch[009] Batch [0099]/[3760] Speed: 123.936664 samples/sec accuracy=65.453125 loss=1.379829 lr=0.009800 Epoch[009] Batch [0149]/[3760] Speed: 128.387282 samples/sec accuracy=65.593750 loss=1.377798 lr=0.009800 Epoch[009] Batch [0199]/[3760] Speed: 122.367062 samples/sec accuracy=65.406250 loss=1.384034 lr=0.009799 Epoch[009] Batch [0249]/[3760] Speed: 130.508131 samples/sec accuracy=65.181250 loss=1.386238 lr=0.009798 Epoch[009] Batch [0299]/[3760] Speed: 117.546917 samples/sec accuracy=65.177083 loss=1.386738 lr=0.009798 Epoch[009] Batch [0349]/[3760] Speed: 129.942885 samples/sec accuracy=65.232143 loss=1.383889 lr=0.009797 Epoch[009] Batch [0399]/[3760] Speed: 123.527821 samples/sec accuracy=65.246094 loss=1.391627 lr=0.009797 Epoch[009] Batch [0449]/[3760] Speed: 126.465387 samples/sec accuracy=65.131944 loss=1.389814 lr=0.009796 Epoch[009] Batch [0499]/[3760] Speed: 126.620283 samples/sec accuracy=65.056250 loss=1.391280 lr=0.009796 Epoch[009] Batch [0549]/[3760] Speed: 127.464520 samples/sec accuracy=65.051136 loss=1.392501 lr=0.009795 Epoch[009] Batch [0599]/[3760] Speed: 116.727180 samples/sec accuracy=65.135417 loss=1.391065 lr=0.009794 Epoch[009] Batch [0649]/[3760] Speed: 133.060918 samples/sec accuracy=65.091346 loss=1.391588 lr=0.009794 Epoch[009] Batch [0699]/[3760] Speed: 116.944079 samples/sec accuracy=65.087054 loss=1.390606 lr=0.009793 Epoch[009] Batch [0749]/[3760] Speed: 132.274589 samples/sec accuracy=65.060417 loss=1.390104 lr=0.009793 Epoch[009] Batch [0799]/[3760] Speed: 118.401669 samples/sec accuracy=64.927734 loss=1.393526 lr=0.009792 Epoch[009] Batch [0849]/[3760] Speed: 128.823960 samples/sec accuracy=64.948529 loss=1.393576 lr=0.009791 Epoch[009] Batch [0899]/[3760] Speed: 128.674346 samples/sec accuracy=64.937500 loss=1.395378 lr=0.009791 Epoch[009] Batch [0949]/[3760] Speed: 121.088185 samples/sec accuracy=64.899671 loss=1.396148 lr=0.009790 Epoch[009] Batch [0999]/[3760] Speed: 132.793106 samples/sec accuracy=64.904688 loss=1.396724 lr=0.009790 Epoch[009] Batch [1049]/[3760] Speed: 117.884239 samples/sec accuracy=64.947917 loss=1.395410 lr=0.009789 Epoch[009] Batch [1099]/[3760] Speed: 130.142613 samples/sec accuracy=65.007102 loss=1.392025 lr=0.009788 Epoch[009] Batch [1149]/[3760] Speed: 125.776952 samples/sec accuracy=65.016304 loss=1.392655 lr=0.009788 Epoch[009] Batch [1199]/[3760] Speed: 125.663556 samples/sec accuracy=64.970052 loss=1.393572 lr=0.009787 Epoch[009] Batch [1249]/[3760] Speed: 125.827695 samples/sec accuracy=64.946250 loss=1.393530 lr=0.009787 Epoch[009] Batch [1299]/[3760] Speed: 117.563136 samples/sec accuracy=64.957933 loss=1.394828 lr=0.009786 Epoch[009] Batch [1349]/[3760] Speed: 132.666951 samples/sec accuracy=64.961806 loss=1.394505 lr=0.009785 Epoch[009] Batch [1399]/[3760] Speed: 118.775789 samples/sec accuracy=64.941964 loss=1.395701 lr=0.009785 Epoch[009] Batch [1449]/[3760] Speed: 134.876215 samples/sec accuracy=64.941810 loss=1.396424 lr=0.009784 Epoch[009] Batch [1499]/[3760] Speed: 123.570849 samples/sec accuracy=64.920833 loss=1.398058 lr=0.009784 Epoch[009] Batch [1549]/[3760] Speed: 123.951524 samples/sec accuracy=64.886089 loss=1.399624 lr=0.009783 Epoch[009] Batch [1599]/[3760] Speed: 129.298876 samples/sec accuracy=64.894531 loss=1.399756 lr=0.009782 Epoch[009] Batch [1649]/[3760] Speed: 121.164105 samples/sec accuracy=64.858902 loss=1.401568 lr=0.009782 Epoch[009] Batch [1699]/[3760] Speed: 125.213687 samples/sec accuracy=64.792279 loss=1.402731 lr=0.009781 Epoch[009] Batch [1749]/[3760] Speed: 128.274707 samples/sec accuracy=64.783929 loss=1.403124 lr=0.009780 Epoch[009] Batch [1799]/[3760] Speed: 122.138609 samples/sec accuracy=64.809896 loss=1.403123 lr=0.009780 Epoch[009] Batch [1849]/[3760] Speed: 124.877477 samples/sec accuracy=64.788007 loss=1.403747 lr=0.009779 Epoch[009] Batch [1899]/[3760] Speed: 125.101804 samples/sec accuracy=64.796053 loss=1.403048 lr=0.009779 Epoch[009] Batch [1949]/[3760] Speed: 128.768563 samples/sec accuracy=64.761218 loss=1.404452 lr=0.009778 Epoch[009] Batch [1999]/[3760] Speed: 128.356336 samples/sec accuracy=64.754688 loss=1.404529 lr=0.009777 Epoch[009] Batch [2049]/[3760] Speed: 122.757714 samples/sec accuracy=64.694360 loss=1.406352 lr=0.009777 Epoch[009] Batch [2099]/[3760] Speed: 125.619942 samples/sec accuracy=64.680060 loss=1.406850 lr=0.009776 Epoch[009] Batch [2149]/[3760] Speed: 125.273804 samples/sec accuracy=64.667151 loss=1.406611 lr=0.009776 Epoch[009] Batch [2199]/[3760] Speed: 124.087393 samples/sec accuracy=64.642045 loss=1.407577 lr=0.009775 Epoch[009] Batch [2249]/[3760] Speed: 130.312498 samples/sec accuracy=64.657639 loss=1.407304 lr=0.009774 Epoch[009] Batch [2299]/[3760] Speed: 127.033490 samples/sec accuracy=64.642663 loss=1.407931 lr=0.009774 Epoch[009] Batch [2349]/[3760] Speed: 119.775971 samples/sec accuracy=64.646941 loss=1.408123 lr=0.009773 Epoch[009] Batch [2399]/[3760] Speed: 124.347646 samples/sec accuracy=64.635417 loss=1.408882 lr=0.009772 Epoch[009] Batch [2449]/[3760] Speed: 126.306344 samples/sec accuracy=64.605867 loss=1.409820 lr=0.009772 Epoch[009] Batch [2499]/[3760] Speed: 126.363221 samples/sec accuracy=64.581875 loss=1.410607 lr=0.009771 Epoch[009] Batch [2549]/[3760] Speed: 121.116010 samples/sec accuracy=64.575368 loss=1.410825 lr=0.009771 Epoch[009] Batch [2599]/[3760] Speed: 131.572238 samples/sec accuracy=64.563702 loss=1.411875 lr=0.009770 Epoch[009] Batch [2649]/[3760] Speed: 119.643125 samples/sec accuracy=64.583726 loss=1.411418 lr=0.009769 Epoch[009] Batch [2699]/[3760] Speed: 130.088575 samples/sec accuracy=64.566551 loss=1.411728 lr=0.009769 Epoch[009] Batch [2749]/[3760] Speed: 123.444001 samples/sec accuracy=64.535227 loss=1.412278 lr=0.009768 Epoch[009] Batch [2799]/[3760] Speed: 123.292159 samples/sec accuracy=64.509487 loss=1.412879 lr=0.009767 Epoch[009] Batch [2849]/[3760] Speed: 128.548235 samples/sec accuracy=64.489035 loss=1.413643 lr=0.009767 Epoch[009] Batch [2899]/[3760] Speed: 123.349653 samples/sec accuracy=64.466595 loss=1.414178 lr=0.009766 Epoch[009] Batch [2949]/[3760] Speed: 123.986598 samples/sec accuracy=64.469809 loss=1.413429 lr=0.009766 Epoch[009] Batch [2999]/[3760] Speed: 129.825100 samples/sec accuracy=64.465104 loss=1.413722 lr=0.009765 Epoch[009] Batch [3049]/[3760] Speed: 123.255688 samples/sec accuracy=64.466189 loss=1.414233 lr=0.009764 Epoch[009] Batch [3099]/[3760] Speed: 124.952458 samples/sec accuracy=64.458165 loss=1.414230 lr=0.009764 Epoch[009] Batch [3149]/[3760] Speed: 127.263457 samples/sec accuracy=64.423115 loss=1.415044 lr=0.009763 Epoch[009] Batch [3199]/[3760] Speed: 128.406478 samples/sec accuracy=64.415039 loss=1.415494 lr=0.009762 Epoch[009] Batch [3249]/[3760] Speed: 119.587152 samples/sec accuracy=64.400962 loss=1.416191 lr=0.009762 Epoch[009] Batch [3299]/[3760] Speed: 126.361134 samples/sec accuracy=64.389678 loss=1.416857 lr=0.009761 Epoch[009] Batch [3349]/[3760] Speed: 122.630751 samples/sec accuracy=64.386660 loss=1.417367 lr=0.009760 Epoch[009] Batch [3399]/[3760] Speed: 131.815681 samples/sec accuracy=64.363971 loss=1.418978 lr=0.009760 Epoch[009] Batch [3449]/[3760] Speed: 123.053002 samples/sec accuracy=64.344656 loss=1.420226 lr=0.009759 Epoch[009] Batch [3499]/[3760] Speed: 117.087974 samples/sec accuracy=64.337500 loss=1.420933 lr=0.009759 Epoch[009] Batch [3549]/[3760] Speed: 135.100666 samples/sec accuracy=64.323944 loss=1.421662 lr=0.009758 Epoch[009] Batch [3599]/[3760] Speed: 117.402239 samples/sec accuracy=64.323785 loss=1.422249 lr=0.009757 Epoch[009] Batch [3649]/[3760] Speed: 132.416362 samples/sec accuracy=64.322774 loss=1.422529 lr=0.009757 Epoch[009] Batch [3699]/[3760] Speed: 128.242740 samples/sec accuracy=64.334459 loss=1.422568 lr=0.009756 Epoch[009] Batch [3749]/[3760] Speed: 140.522949 samples/sec accuracy=64.306250 loss=1.423355 lr=0.009755 Batch [0049]/[0303]: acc-top1=59.062500 acc-top5=83.187500 Batch [0099]/[0303]: acc-top1=59.578125 acc-top5=83.062500 Batch [0149]/[0303]: acc-top1=59.593750 acc-top5=82.739583 Batch [0199]/[0303]: acc-top1=59.234375 acc-top5=82.429688 Batch [0249]/[0303]: acc-top1=59.375000 acc-top5=82.418750 Batch [0299]/[0303]: acc-top1=59.234375 acc-top5=82.463542 [Epoch 009] training: accuracy=64.306017 loss=1.423421 [Epoch 009] speed: 124 samples/sec time cost: 2113.790076 [Epoch 009] validation: acc-top1=59.204827 acc-top5=82.420586 loss=2.199577 Epoch[010] Batch [0049]/[3760] Speed: 87.148463 samples/sec accuracy=65.562500 loss=1.357753 lr=0.009755 Epoch[010] Batch [0099]/[3760] Speed: 132.469148 samples/sec accuracy=65.843750 loss=1.359405 lr=0.009754 Epoch[010] Batch [0149]/[3760] Speed: 123.759926 samples/sec accuracy=65.875000 loss=1.359177 lr=0.009753 Epoch[010] Batch [0199]/[3760] Speed: 122.385086 samples/sec accuracy=65.945312 loss=1.345405 lr=0.009753 Epoch[010] Batch [0249]/[3760] Speed: 128.548115 samples/sec accuracy=66.106250 loss=1.343125 lr=0.009752 Epoch[010] Batch [0299]/[3760] Speed: 119.745256 samples/sec accuracy=66.026042 loss=1.340921 lr=0.009751 Epoch[010] Batch [0349]/[3760] Speed: 133.306898 samples/sec accuracy=65.888393 loss=1.344593 lr=0.009751 Epoch[010] Batch [0399]/[3760] Speed: 123.774108 samples/sec accuracy=65.964844 loss=1.345062 lr=0.009750 Epoch[010] Batch [0449]/[3760] Speed: 124.487712 samples/sec accuracy=65.958333 loss=1.343882 lr=0.009749 Epoch[010] Batch [0499]/[3760] Speed: 124.825026 samples/sec accuracy=65.993750 loss=1.344378 lr=0.009749 Epoch[010] Batch [0549]/[3760] Speed: 124.220723 samples/sec accuracy=65.926136 loss=1.348055 lr=0.009748 Epoch[010] Batch [0599]/[3760] Speed: 126.649953 samples/sec accuracy=65.958333 loss=1.347183 lr=0.009747 Epoch[010] Batch [0649]/[3760] Speed: 124.101033 samples/sec accuracy=65.757212 loss=1.352917 lr=0.009747 Epoch[010] Batch [0699]/[3760] Speed: 129.011385 samples/sec accuracy=65.645089 loss=1.356042 lr=0.009746 Epoch[010] Batch [0749]/[3760] Speed: 119.129987 samples/sec accuracy=65.620833 loss=1.358720 lr=0.009745 Epoch[010] Batch [0799]/[3760] Speed: 131.623784 samples/sec accuracy=65.591797 loss=1.361619 lr=0.009745 Epoch[010] Batch [0849]/[3760] Speed: 126.729752 samples/sec accuracy=65.549632 loss=1.362041 lr=0.009744 Epoch[010] Batch [0899]/[3760] Speed: 123.066097 samples/sec accuracy=65.512153 loss=1.361823 lr=0.009743 Epoch[010] Batch [0949]/[3760] Speed: 125.129734 samples/sec accuracy=65.519737 loss=1.361812 lr=0.009743 Epoch[010] Batch [0999]/[3760] Speed: 126.710345 samples/sec accuracy=65.528125 loss=1.361371 lr=0.009742 Epoch[010] Batch [1049]/[3760] Speed: 126.259905 samples/sec accuracy=65.471726 loss=1.363306 lr=0.009741 Epoch[010] Batch [1099]/[3760] Speed: 124.170490 samples/sec accuracy=65.450284 loss=1.364230 lr=0.009741 Epoch[010] Batch [1149]/[3760] Speed: 126.541874 samples/sec accuracy=65.365489 loss=1.367165 lr=0.009740 Epoch[010] Batch [1199]/[3760] Speed: 118.979689 samples/sec accuracy=65.381510 loss=1.367081 lr=0.009739 Epoch[010] Batch [1249]/[3760] Speed: 133.574274 samples/sec accuracy=65.387500 loss=1.367065 lr=0.009739 Epoch[010] Batch [1299]/[3760] Speed: 119.127774 samples/sec accuracy=65.402644 loss=1.366487 lr=0.009738 Epoch[010] Batch [1349]/[3760] Speed: 129.890060 samples/sec accuracy=65.356481 loss=1.368245 lr=0.009737 Epoch[010] Batch [1399]/[3760] Speed: 121.917238 samples/sec accuracy=65.356027 loss=1.367234 lr=0.009737 Epoch[010] Batch [1449]/[3760] Speed: 126.434618 samples/sec accuracy=65.345905 loss=1.368936 lr=0.009736 Epoch[010] Batch [1499]/[3760] Speed: 128.714406 samples/sec accuracy=65.401042 loss=1.368495 lr=0.009735 Epoch[010] Batch [1549]/[3760] Speed: 118.499964 samples/sec accuracy=65.387097 loss=1.369264 lr=0.009735 Epoch[010] Batch [1599]/[3760] Speed: 132.095504 samples/sec accuracy=65.402344 loss=1.369891 lr=0.009734 Epoch[010] Batch [1649]/[3760] Speed: 120.983399 samples/sec accuracy=65.406250 loss=1.370545 lr=0.009733 Epoch[010] Batch [1699]/[3760] Speed: 128.157641 samples/sec accuracy=65.390625 loss=1.372218 lr=0.009733 Epoch[010] Batch [1749]/[3760] Speed: 129.154219 samples/sec accuracy=65.334821 loss=1.373481 lr=0.009732 Epoch[010] Batch [1799]/[3760] Speed: 120.283679 samples/sec accuracy=65.282118 loss=1.375256 lr=0.009731 Epoch[010] Batch [1849]/[3760] Speed: 129.765941 samples/sec accuracy=65.228041 loss=1.376596 lr=0.009731 Epoch[010] Batch [1899]/[3760] Speed: 122.878718 samples/sec accuracy=65.192434 loss=1.377769 lr=0.009730 Epoch[010] Batch [1949]/[3760] Speed: 121.790820 samples/sec accuracy=65.205128 loss=1.378615 lr=0.009729 Epoch[010] Batch [1999]/[3760] Speed: 134.420582 samples/sec accuracy=65.227344 loss=1.378758 lr=0.009729 Epoch[010] Batch [2049]/[3760] Speed: 115.437269 samples/sec accuracy=65.252287 loss=1.378654 lr=0.009728 Epoch[010] Batch [2099]/[3760] Speed: 130.901663 samples/sec accuracy=65.253720 loss=1.378742 lr=0.009727 Epoch[010] Batch [2149]/[3760] Speed: 126.722550 samples/sec accuracy=65.257994 loss=1.378775 lr=0.009727 Epoch[010] Batch [2199]/[3760] Speed: 124.054872 samples/sec accuracy=65.246449 loss=1.379275 lr=0.009726 Epoch[010] Batch [2249]/[3760] Speed: 129.179573 samples/sec accuracy=65.205556 loss=1.380707 lr=0.009725 Epoch[010] Batch [2299]/[3760] Speed: 121.657123 samples/sec accuracy=65.196332 loss=1.380801 lr=0.009725 Epoch[010] Batch [2349]/[3760] Speed: 124.160976 samples/sec accuracy=65.181516 loss=1.380874 lr=0.009724 Epoch[010] Batch [2399]/[3760] Speed: 128.805027 samples/sec accuracy=65.174479 loss=1.381540 lr=0.009723 Epoch[010] Batch [2449]/[3760] Speed: 121.033470 samples/sec accuracy=65.187500 loss=1.381149 lr=0.009723 Epoch[010] Batch [2499]/[3760] Speed: 130.129710 samples/sec accuracy=65.176250 loss=1.381639 lr=0.009722 Epoch[010] Batch [2549]/[3760] Speed: 120.627004 samples/sec accuracy=65.172794 loss=1.381746 lr=0.009721 Epoch[010] Batch [2599]/[3760] Speed: 127.388744 samples/sec accuracy=65.178486 loss=1.381272 lr=0.009721 Epoch[010] Batch [2649]/[3760] Speed: 126.318682 samples/sec accuracy=65.145047 loss=1.382210 lr=0.009720 Epoch[010] Batch [2699]/[3760] Speed: 123.780058 samples/sec accuracy=65.119213 loss=1.383220 lr=0.009719 Epoch[010] Batch [2749]/[3760] Speed: 129.883912 samples/sec accuracy=65.130114 loss=1.382732 lr=0.009718 Epoch[010] Batch [2799]/[3760] Speed: 119.812783 samples/sec accuracy=65.120536 loss=1.382669 lr=0.009718 Epoch[010] Batch [2849]/[3760] Speed: 126.739641 samples/sec accuracy=65.149671 loss=1.381772 lr=0.009717 Epoch[010] Batch [2899]/[3760] Speed: 127.177497 samples/sec accuracy=65.137392 loss=1.382616 lr=0.009716 Epoch[010] Batch [2949]/[3760] Speed: 122.247307 samples/sec accuracy=65.126059 loss=1.382948 lr=0.009716 Epoch[010] Batch [2999]/[3760] Speed: 125.237192 samples/sec accuracy=65.098958 loss=1.384463 lr=0.009715 Epoch[010] Batch [3049]/[3760] Speed: 128.798725 samples/sec accuracy=65.093238 loss=1.385037 lr=0.009714 Epoch[010] Batch [3099]/[3760] Speed: 126.830495 samples/sec accuracy=65.111391 loss=1.385150 lr=0.009714 Epoch[010] Batch [3149]/[3760] Speed: 123.359598 samples/sec accuracy=65.109127 loss=1.385275 lr=0.009713 Epoch[010] Batch [3199]/[3760] Speed: 125.508557 samples/sec accuracy=65.113770 loss=1.386224 lr=0.009712 Epoch[010] Batch [3249]/[3760] Speed: 124.842967 samples/sec accuracy=65.093269 loss=1.387391 lr=0.009711 Epoch[010] Batch [3299]/[3760] Speed: 127.136449 samples/sec accuracy=65.070076 loss=1.388608 lr=0.009711 Epoch[010] Batch [3349]/[3760] Speed: 123.692951 samples/sec accuracy=65.063899 loss=1.388913 lr=0.009710 Epoch[010] Batch [3399]/[3760] Speed: 125.736049 samples/sec accuracy=65.084559 loss=1.388272 lr=0.009709 Epoch[010] Batch [3449]/[3760] Speed: 122.313572 samples/sec accuracy=65.055707 loss=1.389082 lr=0.009709 Epoch[010] Batch [3499]/[3760] Speed: 124.421550 samples/sec accuracy=65.051339 loss=1.388932 lr=0.009708 Epoch[010] Batch [3549]/[3760] Speed: 129.595067 samples/sec accuracy=65.036972 loss=1.389414 lr=0.009707 Epoch[010] Batch [3599]/[3760] Speed: 124.700580 samples/sec accuracy=65.028212 loss=1.389914 lr=0.009707 Epoch[010] Batch [3649]/[3760] Speed: 125.425491 samples/sec accuracy=65.008562 loss=1.390580 lr=0.009706 Epoch[010] Batch [3699]/[3760] Speed: 118.132413 samples/sec accuracy=64.984375 loss=1.391401 lr=0.009705 Epoch[010] Batch [3749]/[3760] Speed: 149.131919 samples/sec accuracy=64.977917 loss=1.391916 lr=0.009704 Batch [0049]/[0303]: acc-top1=60.187500 acc-top5=83.843750 Batch [0099]/[0303]: acc-top1=59.968750 acc-top5=83.359375 Batch [0149]/[0303]: acc-top1=59.875000 acc-top5=83.052083 Batch [0199]/[0303]: acc-top1=59.546875 acc-top5=82.906250 Batch [0249]/[0303]: acc-top1=59.612500 acc-top5=82.768750 Batch [0299]/[0303]: acc-top1=59.442708 acc-top5=82.755208 [Epoch 010] training: accuracy=64.978807 loss=1.391939 [Epoch 010] speed: 124 samples/sec time cost: 2115.135321 [Epoch 010] validation: acc-top1=59.395627 acc-top5=82.724835 loss=2.136660 Epoch[011] Batch [0049]/[3759] Speed: 87.519238 samples/sec accuracy=67.218750 loss=1.262774 lr=0.009704 Epoch[011] Batch [0099]/[3759] Speed: 133.783185 samples/sec accuracy=67.937500 loss=1.266394 lr=0.009703 Epoch[011] Batch [0149]/[3759] Speed: 116.329490 samples/sec accuracy=67.822917 loss=1.263055 lr=0.009702 Epoch[011] Batch [0199]/[3759] Speed: 131.460838 samples/sec accuracy=67.484375 loss=1.274670 lr=0.009701 Epoch[011] Batch [0249]/[3759] Speed: 124.080234 samples/sec accuracy=67.468750 loss=1.279863 lr=0.009701 Epoch[011] Batch [0299]/[3759] Speed: 123.954865 samples/sec accuracy=67.390625 loss=1.285680 lr=0.009700 Epoch[011] Batch [0349]/[3759] Speed: 125.005674 samples/sec accuracy=67.084821 loss=1.298715 lr=0.009699 Epoch[011] Batch [0399]/[3759] Speed: 124.550401 samples/sec accuracy=66.722656 loss=1.307582 lr=0.009699 Epoch[011] Batch [0449]/[3759] Speed: 126.074341 samples/sec accuracy=66.590278 loss=1.310185 lr=0.009698 Epoch[011] Batch [0499]/[3759] Speed: 127.360748 samples/sec accuracy=66.450000 loss=1.315805 lr=0.009697 Epoch[011] Batch [0549]/[3759] Speed: 123.008594 samples/sec accuracy=66.539773 loss=1.313210 lr=0.009696 Epoch[011] Batch [0599]/[3759] Speed: 126.001950 samples/sec accuracy=66.585938 loss=1.311952 lr=0.009696 Epoch[011] Batch [0649]/[3759] Speed: 126.359809 samples/sec accuracy=66.673077 loss=1.311066 lr=0.009695 Epoch[011] Batch [0699]/[3759] Speed: 121.206013 samples/sec accuracy=66.712054 loss=1.310757 lr=0.009694 Epoch[011] Batch [0749]/[3759] Speed: 131.001532 samples/sec accuracy=66.685417 loss=1.313072 lr=0.009694 Epoch[011] Batch [0799]/[3759] Speed: 120.612803 samples/sec accuracy=66.640625 loss=1.314464 lr=0.009693 Epoch[011] Batch [0849]/[3759] Speed: 127.722482 samples/sec accuracy=66.606618 loss=1.317519 lr=0.009692 Epoch[011] Batch [0899]/[3759] Speed: 129.062800 samples/sec accuracy=66.555556 loss=1.320390 lr=0.009691 Epoch[011] Batch [0949]/[3759] Speed: 121.889635 samples/sec accuracy=66.577303 loss=1.320100 lr=0.009691 Epoch[011] Batch [0999]/[3759] Speed: 128.291821 samples/sec accuracy=66.550000 loss=1.321222 lr=0.009690 Epoch[011] Batch [1049]/[3759] Speed: 119.784603 samples/sec accuracy=66.456845 loss=1.323896 lr=0.009689 Epoch[011] Batch [1099]/[3759] Speed: 130.495447 samples/sec accuracy=66.433239 loss=1.325304 lr=0.009689 Epoch[011] Batch [1149]/[3759] Speed: 119.854770 samples/sec accuracy=66.354620 loss=1.327864 lr=0.009688 Epoch[011] Batch [1199]/[3759] Speed: 128.798199 samples/sec accuracy=66.324219 loss=1.330249 lr=0.009687 Epoch[011] Batch [1249]/[3759] Speed: 122.230061 samples/sec accuracy=66.288750 loss=1.332206 lr=0.009686 Epoch[011] Batch [1299]/[3759] Speed: 129.206540 samples/sec accuracy=66.272837 loss=1.334545 lr=0.009686 Epoch[011] Batch [1349]/[3759] Speed: 125.460649 samples/sec accuracy=66.252315 loss=1.335317 lr=0.009685 Epoch[011] Batch [1399]/[3759] Speed: 119.110126 samples/sec accuracy=66.266741 loss=1.335101 lr=0.009684 Epoch[011] Batch [1449]/[3759] Speed: 130.409050 samples/sec accuracy=66.262931 loss=1.334897 lr=0.009683 Epoch[011] Batch [1499]/[3759] Speed: 121.436943 samples/sec accuracy=66.228125 loss=1.335932 lr=0.009683 Epoch[011] Batch [1549]/[3759] Speed: 126.747420 samples/sec accuracy=66.193548 loss=1.336966 lr=0.009682 Epoch[011] Batch [1599]/[3759] Speed: 122.128297 samples/sec accuracy=66.168945 loss=1.338445 lr=0.009681 Epoch[011] Batch [1649]/[3759] Speed: 132.633942 samples/sec accuracy=66.161932 loss=1.339290 lr=0.009680 Epoch[011] Batch [1699]/[3759] Speed: 127.075855 samples/sec accuracy=66.182904 loss=1.338482 lr=0.009680 Epoch[011] Batch [1749]/[3759] Speed: 117.949098 samples/sec accuracy=66.172321 loss=1.338358 lr=0.009679 Epoch[011] Batch [1799]/[3759] Speed: 130.878215 samples/sec accuracy=66.155382 loss=1.338610 lr=0.009678 Epoch[011] Batch [1849]/[3759] Speed: 119.620007 samples/sec accuracy=66.126689 loss=1.339463 lr=0.009678 Epoch[011] Batch [1899]/[3759] Speed: 130.180652 samples/sec accuracy=66.069901 loss=1.341753 lr=0.009677 Epoch[011] Batch [1949]/[3759] Speed: 124.551236 samples/sec accuracy=66.029647 loss=1.343283 lr=0.009676 Epoch[011] Batch [1999]/[3759] Speed: 121.241286 samples/sec accuracy=66.004688 loss=1.344197 lr=0.009675 Epoch[011] Batch [2049]/[3759] Speed: 132.230970 samples/sec accuracy=66.003811 loss=1.344746 lr=0.009675 Epoch[011] Batch [2099]/[3759] Speed: 116.914030 samples/sec accuracy=66.002976 loss=1.345168 lr=0.009674 Epoch[011] Batch [2149]/[3759] Speed: 133.504466 samples/sec accuracy=65.965843 loss=1.346642 lr=0.009673 Epoch[011] Batch [2199]/[3759] Speed: 118.874424 samples/sec accuracy=65.915483 loss=1.347975 lr=0.009672 Epoch[011] Batch [2249]/[3759] Speed: 131.988676 samples/sec accuracy=65.884028 loss=1.349026 lr=0.009672 Epoch[011] Batch [2299]/[3759] Speed: 117.811769 samples/sec accuracy=65.878397 loss=1.349340 lr=0.009671 Epoch[011] Batch [2349]/[3759] Speed: 132.101326 samples/sec accuracy=65.859707 loss=1.350053 lr=0.009670 Epoch[011] Batch [2399]/[3759] Speed: 127.160738 samples/sec accuracy=65.856771 loss=1.350749 lr=0.009669 Epoch[011] Batch [2449]/[3759] Speed: 117.945285 samples/sec accuracy=65.837372 loss=1.351569 lr=0.009669 Epoch[011] Batch [2499]/[3759] Speed: 129.383578 samples/sec accuracy=65.830625 loss=1.352356 lr=0.009668 Epoch[011] Batch [2549]/[3759] Speed: 124.943456 samples/sec accuracy=65.805147 loss=1.353817 lr=0.009667 Epoch[011] Batch [2599]/[3759] Speed: 128.687359 samples/sec accuracy=65.820312 loss=1.353584 lr=0.009666 Epoch[011] Batch [2649]/[3759] Speed: 126.289294 samples/sec accuracy=65.795991 loss=1.354779 lr=0.009666 Epoch[011] Batch [2699]/[3759] Speed: 122.913371 samples/sec accuracy=65.784722 loss=1.355403 lr=0.009665 Epoch[011] Batch [2749]/[3759] Speed: 126.140199 samples/sec accuracy=65.797159 loss=1.354741 lr=0.009664 Epoch[011] Batch [2799]/[3759] Speed: 126.201989 samples/sec accuracy=65.804129 loss=1.354841 lr=0.009663 Epoch[011] Batch [2849]/[3759] Speed: 125.246896 samples/sec accuracy=65.807018 loss=1.355259 lr=0.009663 Epoch[011] Batch [2899]/[3759] Speed: 121.883545 samples/sec accuracy=65.815194 loss=1.354744 lr=0.009662 Epoch[011] Batch [2949]/[3759] Speed: 130.187644 samples/sec accuracy=65.803496 loss=1.355212 lr=0.009661 Epoch[011] Batch [2999]/[3759] Speed: 122.888577 samples/sec accuracy=65.777083 loss=1.356375 lr=0.009660 Epoch[011] Batch [3049]/[3759] Speed: 122.188411 samples/sec accuracy=65.790471 loss=1.355960 lr=0.009660 Epoch[011] Batch [3099]/[3759] Speed: 123.158859 samples/sec accuracy=65.792339 loss=1.356064 lr=0.009659 Epoch[011] Batch [3149]/[3759] Speed: 132.130712 samples/sec accuracy=65.780754 loss=1.356168 lr=0.009658 Epoch[011] Batch [3199]/[3759] Speed: 128.537647 samples/sec accuracy=65.765137 loss=1.356695 lr=0.009657 Epoch[011] Batch [3249]/[3759] Speed: 119.227607 samples/sec accuracy=65.758173 loss=1.357713 lr=0.009657 Epoch[011] Batch [3299]/[3759] Speed: 125.550954 samples/sec accuracy=65.751894 loss=1.357939 lr=0.009656 Epoch[011] Batch [3349]/[3759] Speed: 124.297142 samples/sec accuracy=65.732276 loss=1.358478 lr=0.009655 Epoch[011] Batch [3399]/[3759] Speed: 124.729618 samples/sec accuracy=65.729320 loss=1.358495 lr=0.009654 Epoch[011] Batch [3449]/[3759] Speed: 125.701955 samples/sec accuracy=65.678442 loss=1.360569 lr=0.009654 Epoch[011] Batch [3499]/[3759] Speed: 123.382037 samples/sec accuracy=65.674554 loss=1.360753 lr=0.009653 Epoch[011] Batch [3549]/[3759] Speed: 127.726835 samples/sec accuracy=65.685299 loss=1.360625 lr=0.009652 Epoch[011] Batch [3599]/[3759] Speed: 120.796730 samples/sec accuracy=65.699653 loss=1.360439 lr=0.009651 Epoch[011] Batch [3649]/[3759] Speed: 123.705254 samples/sec accuracy=65.694349 loss=1.361159 lr=0.009650 Epoch[011] Batch [3699]/[3759] Speed: 129.758744 samples/sec accuracy=65.682855 loss=1.361592 lr=0.009650 Epoch[011] Batch [3749]/[3759] Speed: 143.949445 samples/sec accuracy=65.680833 loss=1.361528 lr=0.009649 Batch [0049]/[0303]: acc-top1=59.968750 acc-top5=83.218750 Batch [0099]/[0303]: acc-top1=59.843750 acc-top5=82.828125 Batch [0149]/[0303]: acc-top1=59.531250 acc-top5=82.812500 Batch [0199]/[0303]: acc-top1=59.054688 acc-top5=82.570312 Batch [0249]/[0303]: acc-top1=59.143750 acc-top5=82.568750 Batch [0299]/[0303]: acc-top1=59.208333 acc-top5=82.473958 [Epoch 011] training: accuracy=65.674049 loss=1.361699 [Epoch 011] speed: 124 samples/sec time cost: 2116.361083 [Epoch 011] validation: acc-top1=59.184200 acc-top5=82.420586 loss=2.267251 Epoch[012] Batch [0049]/[3760] Speed: 86.676238 samples/sec accuracy=67.406250 loss=1.307009 lr=0.009648 Epoch[012] Batch [0099]/[3760] Speed: 136.323380 samples/sec accuracy=67.015625 loss=1.315398 lr=0.009647 Epoch[012] Batch [0149]/[3760] Speed: 123.420517 samples/sec accuracy=67.062500 loss=1.305909 lr=0.009646 Epoch[012] Batch [0199]/[3760] Speed: 121.022436 samples/sec accuracy=67.015625 loss=1.307451 lr=0.009646 Epoch[012] Batch [0249]/[3760] Speed: 130.761085 samples/sec accuracy=67.200000 loss=1.295295 lr=0.009645 Epoch[012] Batch [0299]/[3760] Speed: 119.335731 samples/sec accuracy=67.015625 loss=1.302177 lr=0.009644 Epoch[012] Batch [0349]/[3760] Speed: 132.079675 samples/sec accuracy=66.991071 loss=1.303400 lr=0.009643 Epoch[012] Batch [0399]/[3760] Speed: 120.431443 samples/sec accuracy=66.945312 loss=1.305148 lr=0.009643 Epoch[012] Batch [0449]/[3760] Speed: 128.257939 samples/sec accuracy=67.149306 loss=1.298386 lr=0.009642 Epoch[012] Batch [0499]/[3760] Speed: 118.309911 samples/sec accuracy=67.125000 loss=1.296488 lr=0.009641 Epoch[012] Batch [0549]/[3760] Speed: 130.371488 samples/sec accuracy=67.105114 loss=1.294930 lr=0.009640 Epoch[012] Batch [0599]/[3760] Speed: 125.456416 samples/sec accuracy=67.145833 loss=1.297081 lr=0.009639 Epoch[012] Batch [0649]/[3760] Speed: 116.884324 samples/sec accuracy=67.052885 loss=1.300451 lr=0.009639 Epoch[012] Batch [0699]/[3760] Speed: 131.598477 samples/sec accuracy=67.129464 loss=1.296735 lr=0.009638 Epoch[012] Batch [0749]/[3760] Speed: 132.102111 samples/sec accuracy=67.035417 loss=1.299799 lr=0.009637 Epoch[012] Batch [0799]/[3760] Speed: 118.172368 samples/sec accuracy=66.984375 loss=1.299857 lr=0.009636 Epoch[012] Batch [0849]/[3760] Speed: 133.006312 samples/sec accuracy=66.979779 loss=1.300717 lr=0.009636 Epoch[012] Batch [0899]/[3760] Speed: 116.927048 samples/sec accuracy=66.904514 loss=1.303598 lr=0.009635 Epoch[012] Batch [0949]/[3760] Speed: 129.274561 samples/sec accuracy=66.878289 loss=1.305360 lr=0.009634 Epoch[012] Batch [0999]/[3760] Speed: 122.969595 samples/sec accuracy=66.840625 loss=1.307238 lr=0.009633 Epoch[012] Batch [1049]/[3760] Speed: 125.280589 samples/sec accuracy=66.849702 loss=1.306127 lr=0.009632 Epoch[012] Batch [1099]/[3760] Speed: 130.892159 samples/sec accuracy=66.840909 loss=1.305982 lr=0.009632 Epoch[012] Batch [1149]/[3760] Speed: 117.303344 samples/sec accuracy=66.811141 loss=1.307373 lr=0.009631 Epoch[012] Batch [1199]/[3760] Speed: 130.134952 samples/sec accuracy=66.820312 loss=1.307917 lr=0.009630 Epoch[012] Batch [1249]/[3760] Speed: 117.305286 samples/sec accuracy=66.778750 loss=1.308932 lr=0.009629 Epoch[012] Batch [1299]/[3760] Speed: 132.842124 samples/sec accuracy=66.768029 loss=1.309803 lr=0.009628 Epoch[012] Batch [1349]/[3760] Speed: 124.540234 samples/sec accuracy=66.744213 loss=1.310640 lr=0.009628 Epoch[012] Batch [1399]/[3760] Speed: 121.971857 samples/sec accuracy=66.706473 loss=1.312702 lr=0.009627 Epoch[012] Batch [1449]/[3760] Speed: 126.195373 samples/sec accuracy=66.670259 loss=1.313291 lr=0.009626 Epoch[012] Batch [1499]/[3760] Speed: 127.614390 samples/sec accuracy=66.678125 loss=1.314592 lr=0.009625 Epoch[012] Batch [1549]/[3760] Speed: 125.542788 samples/sec accuracy=66.675403 loss=1.315873 lr=0.009625 Epoch[012] Batch [1599]/[3760] Speed: 122.796637 samples/sec accuracy=66.659180 loss=1.316898 lr=0.009624 Epoch[012] Batch [1649]/[3760] Speed: 124.690601 samples/sec accuracy=66.631629 loss=1.318478 lr=0.009623 Epoch[012] Batch [1699]/[3760] Speed: 130.613893 samples/sec accuracy=66.615809 loss=1.320372 lr=0.009622 Epoch[012] Batch [1749]/[3760] Speed: 122.865717 samples/sec accuracy=66.602679 loss=1.320957 lr=0.009621 Epoch[012] Batch [1799]/[3760] Speed: 125.104010 samples/sec accuracy=66.595486 loss=1.321002 lr=0.009621 Epoch[012] Batch [1849]/[3760] Speed: 126.546521 samples/sec accuracy=66.569257 loss=1.321718 lr=0.009620 Epoch[012] Batch [1899]/[3760] Speed: 120.980568 samples/sec accuracy=66.562500 loss=1.322465 lr=0.009619 Epoch[012] Batch [1949]/[3760] Speed: 132.091876 samples/sec accuracy=66.522436 loss=1.322807 lr=0.009618 Epoch[012] Batch [1999]/[3760] Speed: 118.559315 samples/sec accuracy=66.528125 loss=1.322993 lr=0.009617 Epoch[012] Batch [2049]/[3760] Speed: 129.102388 samples/sec accuracy=66.533537 loss=1.323119 lr=0.009617 Epoch[012] Batch [2099]/[3760] Speed: 122.480771 samples/sec accuracy=66.519345 loss=1.323368 lr=0.009616 Epoch[012] Batch [2149]/[3760] Speed: 125.991963 samples/sec accuracy=66.522529 loss=1.323441 lr=0.009615 Epoch[012] Batch [2199]/[3760] Speed: 130.397296 samples/sec accuracy=66.495028 loss=1.324048 lr=0.009614 Epoch[012] Batch [2249]/[3760] Speed: 121.930780 samples/sec accuracy=66.444444 loss=1.325958 lr=0.009613 Epoch[012] Batch [2299]/[3760] Speed: 124.750462 samples/sec accuracy=66.447690 loss=1.326619 lr=0.009613 Epoch[012] Batch [2349]/[3760] Speed: 121.449327 samples/sec accuracy=66.455452 loss=1.326905 lr=0.009612 Epoch[012] Batch [2399]/[3760] Speed: 130.442243 samples/sec accuracy=66.453125 loss=1.326803 lr=0.009611 Epoch[012] Batch [2449]/[3760] Speed: 122.396246 samples/sec accuracy=66.461097 loss=1.326762 lr=0.009610 Epoch[012] Batch [2499]/[3760] Speed: 128.992790 samples/sec accuracy=66.426875 loss=1.327242 lr=0.009609 Epoch[012] Batch [2549]/[3760] Speed: 120.301676 samples/sec accuracy=66.428922 loss=1.326979 lr=0.009608 Epoch[012] Batch [2599]/[3760] Speed: 127.076392 samples/sec accuracy=66.408654 loss=1.327836 lr=0.009608 Epoch[012] Batch [2649]/[3760] Speed: 128.031871 samples/sec accuracy=66.387382 loss=1.329167 lr=0.009607 Epoch[012] Batch [2699]/[3760] Speed: 120.620241 samples/sec accuracy=66.353588 loss=1.330125 lr=0.009606 Epoch[012] Batch [2749]/[3760] Speed: 131.388159 samples/sec accuracy=66.347159 loss=1.330980 lr=0.009605 Epoch[012] Batch [2799]/[3760] Speed: 125.674428 samples/sec accuracy=66.329799 loss=1.331541 lr=0.009604 Epoch[012] Batch [2849]/[3760] Speed: 124.417580 samples/sec accuracy=66.302632 loss=1.332127 lr=0.009604 Epoch[012] Batch [2899]/[3760] Speed: 120.738814 samples/sec accuracy=66.313578 loss=1.332099 lr=0.009603 Epoch[012] Batch [2949]/[3760] Speed: 130.643321 samples/sec accuracy=66.304555 loss=1.332430 lr=0.009602 Epoch[012] Batch [2999]/[3760] Speed: 122.394476 samples/sec accuracy=66.291667 loss=1.332570 lr=0.009601 Epoch[012] Batch [3049]/[3760] Speed: 126.002545 samples/sec accuracy=66.299180 loss=1.332750 lr=0.009600 Epoch[012] Batch [3099]/[3760] Speed: 124.499417 samples/sec accuracy=66.283266 loss=1.333551 lr=0.009600 Epoch[012] Batch [3149]/[3760] Speed: 124.233014 samples/sec accuracy=66.311012 loss=1.332603 lr=0.009599 Epoch[012] Batch [3199]/[3760] Speed: 126.477532 samples/sec accuracy=66.326172 loss=1.332202 lr=0.009598 Epoch[012] Batch [3249]/[3760] Speed: 122.858294 samples/sec accuracy=66.312981 loss=1.332908 lr=0.009597 Epoch[012] Batch [3299]/[3760] Speed: 129.645479 samples/sec accuracy=66.305871 loss=1.333054 lr=0.009596 Epoch[012] Batch [3349]/[3760] Speed: 126.101533 samples/sec accuracy=66.290578 loss=1.333764 lr=0.009595 Epoch[012] Batch [3399]/[3760] Speed: 126.996070 samples/sec accuracy=66.272518 loss=1.334494 lr=0.009595 Epoch[012] Batch [3449]/[3760] Speed: 119.976235 samples/sec accuracy=66.278533 loss=1.334911 lr=0.009594 Epoch[012] Batch [3499]/[3760] Speed: 129.557755 samples/sec accuracy=66.272768 loss=1.335527 lr=0.009593 Epoch[012] Batch [3549]/[3760] Speed: 124.143291 samples/sec accuracy=66.284331 loss=1.335807 lr=0.009592 Epoch[012] Batch [3599]/[3760] Speed: 124.014537 samples/sec accuracy=66.279514 loss=1.335884 lr=0.009591 Epoch[012] Batch [3649]/[3760] Speed: 122.843218 samples/sec accuracy=66.270120 loss=1.335987 lr=0.009590 Epoch[012] Batch [3699]/[3760] Speed: 124.641321 samples/sec accuracy=66.281672 loss=1.335429 lr=0.009590 Epoch[012] Batch [3749]/[3760] Speed: 146.582069 samples/sec accuracy=66.300000 loss=1.334992 lr=0.009589 Batch [0049]/[0303]: acc-top1=61.531250 acc-top5=84.218750 Batch [0099]/[0303]: acc-top1=60.937500 acc-top5=83.578125 Batch [0149]/[0303]: acc-top1=60.833333 acc-top5=83.218750 Batch [0199]/[0303]: acc-top1=60.414062 acc-top5=83.007812 Batch [0249]/[0303]: acc-top1=60.225000 acc-top5=82.968750 Batch [0299]/[0303]: acc-top1=60.286458 acc-top5=82.994792 [Epoch 012] training: accuracy=66.301114 loss=1.335221 [Epoch 012] speed: 124 samples/sec time cost: 2117.465056 [Epoch 012] validation: acc-top1=60.200083 acc-top5=82.941419 loss=2.159275 Epoch[013] Batch [0049]/[3760] Speed: 89.293246 samples/sec accuracy=67.875000 loss=1.259469 lr=0.009588 Epoch[013] Batch [0099]/[3760] Speed: 130.091952 samples/sec accuracy=67.437500 loss=1.283071 lr=0.009587 Epoch[013] Batch [0149]/[3760] Speed: 120.604714 samples/sec accuracy=67.312500 loss=1.290503 lr=0.009586 Epoch[013] Batch [0199]/[3760] Speed: 127.950512 samples/sec accuracy=67.398438 loss=1.289091 lr=0.009585 Epoch[013] Batch [0249]/[3760] Speed: 122.462490 samples/sec accuracy=67.331250 loss=1.288653 lr=0.009584 Epoch[013] Batch [0299]/[3760] Speed: 130.885190 samples/sec accuracy=67.421875 loss=1.284014 lr=0.009584 Epoch[013] Batch [0349]/[3760] Speed: 120.314414 samples/sec accuracy=67.589286 loss=1.278798 lr=0.009583 Epoch[013] Batch [0399]/[3760] Speed: 127.601924 samples/sec accuracy=67.632812 loss=1.277130 lr=0.009582 Epoch[013] Batch [0449]/[3760] Speed: 121.876854 samples/sec accuracy=67.718750 loss=1.273903 lr=0.009581 Epoch[013] Batch [0499]/[3760] Speed: 131.332676 samples/sec accuracy=67.868750 loss=1.270827 lr=0.009580 Epoch[013] Batch [0549]/[3760] Speed: 121.963846 samples/sec accuracy=67.920455 loss=1.267179 lr=0.009579 Epoch[013] Batch [0599]/[3760] Speed: 124.607749 samples/sec accuracy=67.809896 loss=1.269471 lr=0.009579 Epoch[013] Batch [0649]/[3760] Speed: 124.742833 samples/sec accuracy=67.788462 loss=1.270360 lr=0.009578 Epoch[013] Batch [0699]/[3760] Speed: 128.108992 samples/sec accuracy=67.729911 loss=1.273432 lr=0.009577 Epoch[013] Batch [0749]/[3760] Speed: 119.194009 samples/sec accuracy=67.677083 loss=1.273926 lr=0.009576 Epoch[013] Batch [0799]/[3760] Speed: 124.127864 samples/sec accuracy=67.666016 loss=1.274274 lr=0.009575 Epoch[013] Batch [0849]/[3760] Speed: 129.568818 samples/sec accuracy=67.588235 loss=1.276615 lr=0.009574 Epoch[013] Batch [0899]/[3760] Speed: 124.318088 samples/sec accuracy=67.559028 loss=1.277365 lr=0.009574 Epoch[013] Batch [0949]/[3760] Speed: 124.176333 samples/sec accuracy=67.463816 loss=1.280113 lr=0.009573 Epoch[013] Batch [0999]/[3760] Speed: 122.849799 samples/sec accuracy=67.426563 loss=1.281314 lr=0.009572 Epoch[013] Batch [1049]/[3760] Speed: 128.349996 samples/sec accuracy=67.322917 loss=1.283500 lr=0.009571 Epoch[013] Batch [1099]/[3760] Speed: 124.856023 samples/sec accuracy=67.370739 loss=1.282446 lr=0.009570 Epoch[013] Batch [1149]/[3760] Speed: 123.642870 samples/sec accuracy=67.342391 loss=1.283021 lr=0.009569 Epoch[013] Batch [1199]/[3760] Speed: 130.569715 samples/sec accuracy=67.390625 loss=1.282447 lr=0.009568 Epoch[013] Batch [1249]/[3760] Speed: 125.122747 samples/sec accuracy=67.331250 loss=1.284507 lr=0.009568 Epoch[013] Batch [1299]/[3760] Speed: 120.629093 samples/sec accuracy=67.323317 loss=1.285660 lr=0.009567 Epoch[013] Batch [1349]/[3760] Speed: 131.883072 samples/sec accuracy=67.320602 loss=1.286894 lr=0.009566 Epoch[013] Batch [1399]/[3760] Speed: 117.741311 samples/sec accuracy=67.347098 loss=1.286710 lr=0.009565 Epoch[013] Batch [1449]/[3760] Speed: 131.921252 samples/sec accuracy=67.316810 loss=1.288517 lr=0.009564 Epoch[013] Batch [1499]/[3760] Speed: 124.797399 samples/sec accuracy=67.291667 loss=1.288966 lr=0.009563 Epoch[013] Batch [1549]/[3760] Speed: 126.079769 samples/sec accuracy=67.333669 loss=1.288173 lr=0.009563 Epoch[013] Batch [1599]/[3760] Speed: 123.817384 samples/sec accuracy=67.328125 loss=1.288274 lr=0.009562 Epoch[013] Batch [1649]/[3760] Speed: 128.724690 samples/sec accuracy=67.304924 loss=1.288604 lr=0.009561 Epoch[013] Batch [1699]/[3760] Speed: 116.028310 samples/sec accuracy=67.288603 loss=1.289720 lr=0.009560 Epoch[013] Batch [1749]/[3760] Speed: 134.134894 samples/sec accuracy=67.216964 loss=1.291153 lr=0.009559 Epoch[013] Batch [1799]/[3760] Speed: 127.132975 samples/sec accuracy=67.235243 loss=1.290327 lr=0.009558 Epoch[013] Batch [1849]/[3760] Speed: 124.738391 samples/sec accuracy=67.225507 loss=1.290590 lr=0.009557 Epoch[013] Batch [1899]/[3760] Speed: 125.200073 samples/sec accuracy=67.184211 loss=1.292636 lr=0.009557 Epoch[013] Batch [1949]/[3760] Speed: 122.621202 samples/sec accuracy=67.189103 loss=1.292803 lr=0.009556 Epoch[013] Batch [1999]/[3760] Speed: 128.537951 samples/sec accuracy=67.200000 loss=1.292650 lr=0.009555 Epoch[013] Batch [2049]/[3760] Speed: 127.697436 samples/sec accuracy=67.169207 loss=1.293197 lr=0.009554 Epoch[013] Batch [2099]/[3760] Speed: 127.928270 samples/sec accuracy=67.144345 loss=1.293872 lr=0.009553 Epoch[013] Batch [2149]/[3760] Speed: 114.482416 samples/sec accuracy=67.110465 loss=1.295395 lr=0.009552 Epoch[013] Batch [2199]/[3760] Speed: 134.970920 samples/sec accuracy=67.091619 loss=1.296326 lr=0.009551 Epoch[013] Batch [2249]/[3760] Speed: 121.725354 samples/sec accuracy=67.100000 loss=1.296405 lr=0.009550 Epoch[013] Batch [2299]/[3760] Speed: 126.120563 samples/sec accuracy=67.104620 loss=1.295984 lr=0.009550 Epoch[013] Batch [2349]/[3760] Speed: 124.869166 samples/sec accuracy=67.072473 loss=1.297304 lr=0.009549 Epoch[013] Batch [2399]/[3760] Speed: 126.855545 samples/sec accuracy=67.063802 loss=1.297624 lr=0.009548 Epoch[013] Batch [2449]/[3760] Speed: 122.508347 samples/sec accuracy=67.036990 loss=1.298485 lr=0.009547 Epoch[013] Batch [2499]/[3760] Speed: 131.841420 samples/sec accuracy=67.014375 loss=1.299710 lr=0.009546 Epoch[013] Batch [2549]/[3760] Speed: 122.434602 samples/sec accuracy=67.009804 loss=1.300039 lr=0.009545 Epoch[013] Batch [2599]/[3760] Speed: 122.346282 samples/sec accuracy=66.985577 loss=1.301109 lr=0.009544 Epoch[013] Batch [2649]/[3760] Speed: 129.068989 samples/sec accuracy=66.972288 loss=1.301115 lr=0.009544 Epoch[013] Batch [2699]/[3760] Speed: 121.492399 samples/sec accuracy=66.972801 loss=1.301756 lr=0.009543 Epoch[013] Batch [2749]/[3760] Speed: 126.233590 samples/sec accuracy=66.934091 loss=1.302312 lr=0.009542 Epoch[013] Batch [2799]/[3760] Speed: 123.360186 samples/sec accuracy=66.926897 loss=1.302943 lr=0.009541 Epoch[013] Batch [2849]/[3760] Speed: 129.949241 samples/sec accuracy=66.898575 loss=1.303198 lr=0.009540 Epoch[013] Batch [2899]/[3760] Speed: 125.331023 samples/sec accuracy=66.894935 loss=1.303173 lr=0.009539 Epoch[013] Batch [2949]/[3760] Speed: 121.801692 samples/sec accuracy=66.890360 loss=1.303423 lr=0.009538 Epoch[013] Batch [2999]/[3760] Speed: 129.637728 samples/sec accuracy=66.880729 loss=1.304153 lr=0.009537 Epoch[013] Batch [3049]/[3760] Speed: 123.174653 samples/sec accuracy=66.880635 loss=1.305059 lr=0.009537 Epoch[013] Batch [3099]/[3760] Speed: 126.505728 samples/sec accuracy=66.857359 loss=1.306254 lr=0.009536 Epoch[013] Batch [3149]/[3760] Speed: 123.226919 samples/sec accuracy=66.853671 loss=1.306895 lr=0.009535 Epoch[013] Batch [3199]/[3760] Speed: 128.140722 samples/sec accuracy=66.842773 loss=1.306697 lr=0.009534 Epoch[013] Batch [3249]/[3760] Speed: 125.380845 samples/sec accuracy=66.826442 loss=1.307574 lr=0.009533 Epoch[013] Batch [3299]/[3760] Speed: 124.418339 samples/sec accuracy=66.824811 loss=1.308296 lr=0.009532 Epoch[013] Batch [3349]/[3760] Speed: 123.015034 samples/sec accuracy=66.827892 loss=1.308511 lr=0.009531 Epoch[013] Batch [3399]/[3760] Speed: 123.119983 samples/sec accuracy=66.838695 loss=1.308343 lr=0.009530 Epoch[013] Batch [3449]/[3760] Speed: 122.611978 samples/sec accuracy=66.836051 loss=1.308570 lr=0.009529 Epoch[013] Batch [3499]/[3760] Speed: 131.523709 samples/sec accuracy=66.840179 loss=1.308586 lr=0.009529 Epoch[013] Batch [3549]/[3760] Speed: 125.800189 samples/sec accuracy=66.833627 loss=1.309133 lr=0.009528 Epoch[013] Batch [3599]/[3760] Speed: 122.482575 samples/sec accuracy=66.836806 loss=1.309203 lr=0.009527 Epoch[013] Batch [3649]/[3760] Speed: 122.417560 samples/sec accuracy=66.818921 loss=1.309741 lr=0.009526 Epoch[013] Batch [3699]/[3760] Speed: 125.190084 samples/sec accuracy=66.830659 loss=1.309430 lr=0.009525 Epoch[013] Batch [3749]/[3760] Speed: 143.975314 samples/sec accuracy=66.822917 loss=1.310194 lr=0.009524 Batch [0049]/[0303]: acc-top1=60.687500 acc-top5=83.312500 Batch [0099]/[0303]: acc-top1=60.765625 acc-top5=82.859375 Batch [0149]/[0303]: acc-top1=60.416667 acc-top5=82.687500 Batch [0199]/[0303]: acc-top1=60.039062 acc-top5=82.382812 Batch [0249]/[0303]: acc-top1=60.006250 acc-top5=82.475000 Batch [0299]/[0303]: acc-top1=59.880208 acc-top5=82.489583 [Epoch 013] training: accuracy=66.823471 loss=1.310312 [Epoch 013] speed: 124 samples/sec time cost: 2115.660940 [Epoch 013] validation: acc-top1=59.813325 acc-top5=82.446370 loss=2.247133 Epoch[014] Batch [0049]/[3759] Speed: 88.993560 samples/sec accuracy=67.843750 loss=1.245882 lr=0.009523 Epoch[014] Batch [0099]/[3759] Speed: 131.238955 samples/sec accuracy=67.812500 loss=1.245231 lr=0.009522 Epoch[014] Batch [0149]/[3759] Speed: 122.216376 samples/sec accuracy=67.729167 loss=1.252110 lr=0.009521 Epoch[014] Batch [0199]/[3759] Speed: 123.012691 samples/sec accuracy=67.718750 loss=1.250788 lr=0.009520 Epoch[014] Batch [0249]/[3759] Speed: 127.464842 samples/sec accuracy=67.768750 loss=1.251784 lr=0.009520 Epoch[014] Batch [0299]/[3759] Speed: 124.139798 samples/sec accuracy=67.875000 loss=1.245831 lr=0.009519 Epoch[014] Batch [0349]/[3759] Speed: 122.799392 samples/sec accuracy=68.107143 loss=1.238112 lr=0.009518 Epoch[014] Batch [0399]/[3759] Speed: 131.618675 samples/sec accuracy=68.214844 loss=1.233787 lr=0.009517 Epoch[014] Batch [0449]/[3759] Speed: 120.790959 samples/sec accuracy=68.156250 loss=1.236337 lr=0.009516 Epoch[014] Batch [0499]/[3759] Speed: 126.937439 samples/sec accuracy=68.128125 loss=1.237285 lr=0.009515 Epoch[014] Batch [0549]/[3759] Speed: 117.968106 samples/sec accuracy=68.235795 loss=1.235197 lr=0.009514 Epoch[014] Batch [0599]/[3759] Speed: 133.879149 samples/sec accuracy=68.229167 loss=1.238719 lr=0.009513 Epoch[014] Batch [0649]/[3759] Speed: 122.560085 samples/sec accuracy=68.192308 loss=1.239522 lr=0.009512 Epoch[014] Batch [0699]/[3759] Speed: 123.953622 samples/sec accuracy=68.080357 loss=1.246850 lr=0.009511 Epoch[014] Batch [0749]/[3759] Speed: 130.481912 samples/sec accuracy=68.093750 loss=1.247631 lr=0.009511 Epoch[014] Batch [0799]/[3759] Speed: 118.294104 samples/sec accuracy=68.140625 loss=1.248243 lr=0.009510 Epoch[014] Batch [0849]/[3759] Speed: 129.960087 samples/sec accuracy=68.169118 loss=1.249457 lr=0.009509 Epoch[014] Batch [0899]/[3759] Speed: 127.662597 samples/sec accuracy=68.102431 loss=1.250415 lr=0.009508 Epoch[014] Batch [0949]/[3759] Speed: 119.805038 samples/sec accuracy=68.136513 loss=1.250843 lr=0.009507 Epoch[014] Batch [0999]/[3759] Speed: 127.786359 samples/sec accuracy=68.139063 loss=1.249826 lr=0.009506 Epoch[014] Batch [1049]/[3759] Speed: 124.027166 samples/sec accuracy=68.063988 loss=1.252654 lr=0.009505 Epoch[014] Batch [1099]/[3759] Speed: 126.389746 samples/sec accuracy=68.046875 loss=1.252846 lr=0.009504 Epoch[014] Batch [1149]/[3759] Speed: 124.180691 samples/sec accuracy=67.975543 loss=1.255809 lr=0.009503 Epoch[014] Batch [1199]/[3759] Speed: 131.325324 samples/sec accuracy=67.938802 loss=1.257689 lr=0.009502 Epoch[014] Batch [1249]/[3759] Speed: 120.232616 samples/sec accuracy=67.932500 loss=1.257558 lr=0.009501 Epoch[014] Batch [1299]/[3759] Speed: 124.892278 samples/sec accuracy=67.844952 loss=1.259484 lr=0.009501 Epoch[014] Batch [1349]/[3759] Speed: 131.040229 samples/sec accuracy=67.871528 loss=1.258484 lr=0.009500 Epoch[014] Batch [1399]/[3759] Speed: 120.988984 samples/sec accuracy=67.831473 loss=1.260388 lr=0.009499 Epoch[014] Batch [1449]/[3759] Speed: 129.174883 samples/sec accuracy=67.811422 loss=1.261283 lr=0.009498 Epoch[014] Batch [1499]/[3759] Speed: 118.419582 samples/sec accuracy=67.757292 loss=1.262972 lr=0.009497 Epoch[014] Batch [1549]/[3759] Speed: 130.915707 samples/sec accuracy=67.766129 loss=1.262286 lr=0.009496 Epoch[014] Batch [1599]/[3759] Speed: 123.333926 samples/sec accuracy=67.757812 loss=1.263886 lr=0.009495 Epoch[014] Batch [1649]/[3759] Speed: 125.785615 samples/sec accuracy=67.737689 loss=1.265259 lr=0.009494 Epoch[014] Batch [1699]/[3759] Speed: 130.790435 samples/sec accuracy=67.754596 loss=1.265586 lr=0.009493 Epoch[014] Batch [1749]/[3759] Speed: 122.792859 samples/sec accuracy=67.744643 loss=1.266886 lr=0.009492 Epoch[014] Batch [1799]/[3759] Speed: 121.486572 samples/sec accuracy=67.723090 loss=1.267648 lr=0.009491 Epoch[014] Batch [1849]/[3759] Speed: 125.166681 samples/sec accuracy=67.695946 loss=1.268537 lr=0.009491 Epoch[014] Batch [1899]/[3759] Speed: 128.907118 samples/sec accuracy=67.677632 loss=1.269045 lr=0.009490 Epoch[014] Batch [1949]/[3759] Speed: 121.838018 samples/sec accuracy=67.635417 loss=1.270356 lr=0.009489 Epoch[014] Batch [1999]/[3759] Speed: 126.011517 samples/sec accuracy=67.618750 loss=1.270516 lr=0.009488 Epoch[014] Batch [2049]/[3759] Speed: 126.954965 samples/sec accuracy=67.588415 loss=1.271622 lr=0.009487 Epoch[014] Batch [2099]/[3759] Speed: 124.369307 samples/sec accuracy=67.603423 loss=1.271096 lr=0.009486 Epoch[014] Batch [2149]/[3759] Speed: 127.244159 samples/sec accuracy=67.577035 loss=1.272282 lr=0.009485 Epoch[014] Batch [2199]/[3759] Speed: 127.374560 samples/sec accuracy=67.578835 loss=1.271880 lr=0.009484 Epoch[014] Batch [2249]/[3759] Speed: 120.912810 samples/sec accuracy=67.544444 loss=1.272818 lr=0.009483 Epoch[014] Batch [2299]/[3759] Speed: 122.478357 samples/sec accuracy=67.549592 loss=1.272655 lr=0.009482 Epoch[014] Batch [2349]/[3759] Speed: 130.462833 samples/sec accuracy=67.561170 loss=1.272493 lr=0.009481 Epoch[014] Batch [2399]/[3759] Speed: 121.596659 samples/sec accuracy=67.557943 loss=1.273174 lr=0.009480 Epoch[014] Batch [2449]/[3759] Speed: 124.004406 samples/sec accuracy=67.561224 loss=1.273387 lr=0.009479 Epoch[014] Batch [2499]/[3759] Speed: 125.655972 samples/sec accuracy=67.547500 loss=1.273993 lr=0.009479 Epoch[014] Batch [2549]/[3759] Speed: 130.810398 samples/sec accuracy=67.537990 loss=1.274473 lr=0.009478 Epoch[014] Batch [2599]/[3759] Speed: 118.823683 samples/sec accuracy=67.522837 loss=1.275233 lr=0.009477 Epoch[014] Batch [2649]/[3759] Speed: 126.130063 samples/sec accuracy=67.479363 loss=1.276651 lr=0.009476 Epoch[014] Batch [2699]/[3759] Speed: 126.661747 samples/sec accuracy=67.485532 loss=1.276544 lr=0.009475 Epoch[014] Batch [2749]/[3759] Speed: 120.662353 samples/sec accuracy=67.489205 loss=1.276811 lr=0.009474 Epoch[014] Batch [2799]/[3759] Speed: 130.304345 samples/sec accuracy=67.462054 loss=1.277339 lr=0.009473 Epoch[014] Batch [2849]/[3759] Speed: 127.639486 samples/sec accuracy=67.464364 loss=1.277477 lr=0.009472 Epoch[014] Batch [2899]/[3759] Speed: 124.092091 samples/sec accuracy=67.460129 loss=1.277371 lr=0.009471 Epoch[014] Batch [2949]/[3759] Speed: 123.838361 samples/sec accuracy=67.442267 loss=1.278141 lr=0.009470 Epoch[014] Batch [2999]/[3759] Speed: 129.211342 samples/sec accuracy=67.415104 loss=1.278857 lr=0.009469 Epoch[014] Batch [3049]/[3759] Speed: 120.122439 samples/sec accuracy=67.394980 loss=1.279999 lr=0.009468 Epoch[014] Batch [3099]/[3759] Speed: 133.512536 samples/sec accuracy=67.406250 loss=1.280330 lr=0.009467 Epoch[014] Batch [3149]/[3759] Speed: 117.697186 samples/sec accuracy=67.441468 loss=1.279256 lr=0.009466 Epoch[014] Batch [3199]/[3759] Speed: 131.627592 samples/sec accuracy=67.431641 loss=1.279898 lr=0.009465 Epoch[014] Batch [3249]/[3759] Speed: 117.618038 samples/sec accuracy=67.422115 loss=1.279921 lr=0.009464 Epoch[014] Batch [3299]/[3759] Speed: 130.767863 samples/sec accuracy=67.424242 loss=1.280572 lr=0.009464 Epoch[014] Batch [3349]/[3759] Speed: 125.507905 samples/sec accuracy=67.411381 loss=1.281785 lr=0.009463 Epoch[014] Batch [3399]/[3759] Speed: 122.085958 samples/sec accuracy=67.412684 loss=1.282172 lr=0.009462 Epoch[014] Batch [3449]/[3759] Speed: 133.710820 samples/sec accuracy=67.399457 loss=1.282811 lr=0.009461 Epoch[014] Batch [3499]/[3759] Speed: 118.154372 samples/sec accuracy=67.371875 loss=1.283642 lr=0.009460 Epoch[014] Batch [3549]/[3759] Speed: 130.232882 samples/sec accuracy=67.362236 loss=1.284105 lr=0.009459 Epoch[014] Batch [3599]/[3759] Speed: 119.313903 samples/sec accuracy=67.361979 loss=1.284808 lr=0.009458 Epoch[014] Batch [3649]/[3759] Speed: 126.930820 samples/sec accuracy=67.345462 loss=1.285244 lr=0.009457 Epoch[014] Batch [3699]/[3759] Speed: 125.431179 samples/sec accuracy=67.310389 loss=1.286390 lr=0.009456 Epoch[014] Batch [3749]/[3759] Speed: 144.236826 samples/sec accuracy=67.324167 loss=1.285926 lr=0.009455 Batch [0049]/[0303]: acc-top1=60.218750 acc-top5=83.500000 Batch [0099]/[0303]: acc-top1=60.390625 acc-top5=83.312500 Batch [0149]/[0303]: acc-top1=60.364583 acc-top5=83.187500 Batch [0199]/[0303]: acc-top1=60.085938 acc-top5=83.054688 Batch [0249]/[0303]: acc-top1=60.318750 acc-top5=83.087500 Batch [0299]/[0303]: acc-top1=60.244792 acc-top5=83.036458 [Epoch 014] training: accuracy=67.322592 loss=1.285932 [Epoch 014] speed: 124 samples/sec time cost: 2115.492483 [Epoch 014] validation: acc-top1=60.225866 acc-top5=82.998144 loss=2.202926 Epoch[015] Batch [0049]/[3760] Speed: 89.516154 samples/sec accuracy=68.468750 loss=1.234257 lr=0.009454 Epoch[015] Batch [0099]/[3760] Speed: 132.020120 samples/sec accuracy=68.578125 loss=1.230949 lr=0.009453 Epoch[015] Batch [0149]/[3760] Speed: 114.777331 samples/sec accuracy=69.218750 loss=1.209218 lr=0.009452 Epoch[015] Batch [0199]/[3760] Speed: 131.710128 samples/sec accuracy=69.132812 loss=1.196613 lr=0.009451 Epoch[015] Batch [0249]/[3760] Speed: 127.616474 samples/sec accuracy=68.993750 loss=1.203478 lr=0.009450 Epoch[015] Batch [0299]/[3760] Speed: 119.873643 samples/sec accuracy=69.000000 loss=1.206790 lr=0.009449 Epoch[015] Batch [0349]/[3760] Speed: 131.673566 samples/sec accuracy=68.848214 loss=1.218066 lr=0.009448 Epoch[015] Batch [0399]/[3760] Speed: 120.062708 samples/sec accuracy=68.816406 loss=1.219646 lr=0.009447 Epoch[015] Batch [0449]/[3760] Speed: 131.635869 samples/sec accuracy=68.881944 loss=1.218959 lr=0.009446 Epoch[015] Batch [0499]/[3760] Speed: 122.929213 samples/sec accuracy=68.853125 loss=1.218785 lr=0.009445 Epoch[015] Batch [0549]/[3760] Speed: 124.740943 samples/sec accuracy=68.696023 loss=1.223588 lr=0.009444 Epoch[015] Batch [0599]/[3760] Speed: 126.734852 samples/sec accuracy=68.713542 loss=1.224160 lr=0.009443 Epoch[015] Batch [0649]/[3760] Speed: 122.850035 samples/sec accuracy=68.733173 loss=1.226179 lr=0.009442 Epoch[015] Batch [0699]/[3760] Speed: 117.984226 samples/sec accuracy=68.595982 loss=1.229028 lr=0.009442 Epoch[015] Batch [0749]/[3760] Speed: 133.070395 samples/sec accuracy=68.650000 loss=1.228673 lr=0.009441 Epoch[015] Batch [0799]/[3760] Speed: 132.590098 samples/sec accuracy=68.574219 loss=1.230691 lr=0.009440 Epoch[015] Batch [0849]/[3760] Speed: 117.273000 samples/sec accuracy=68.555147 loss=1.231095 lr=0.009439 Epoch[015] Batch [0899]/[3760] Speed: 132.105076 samples/sec accuracy=68.545139 loss=1.229890 lr=0.009438 Epoch[015] Batch [0949]/[3760] Speed: 119.541939 samples/sec accuracy=68.476974 loss=1.232413 lr=0.009437 Epoch[015] Batch [0999]/[3760] Speed: 128.861359 samples/sec accuracy=68.451562 loss=1.233193 lr=0.009436 Epoch[015] Batch [1049]/[3760] Speed: 124.855333 samples/sec accuracy=68.467262 loss=1.233062 lr=0.009435 Epoch[015] Batch [1099]/[3760] Speed: 124.232130 samples/sec accuracy=68.465909 loss=1.233428 lr=0.009434 Epoch[015] Batch [1149]/[3760] Speed: 125.593915 samples/sec accuracy=68.419837 loss=1.236015 lr=0.009433 Epoch[015] Batch [1199]/[3760] Speed: 126.351843 samples/sec accuracy=68.390625 loss=1.237419 lr=0.009432 Epoch[015] Batch [1249]/[3760] Speed: 122.207757 samples/sec accuracy=68.358750 loss=1.238900 lr=0.009431 Epoch[015] Batch [1299]/[3760] Speed: 126.588342 samples/sec accuracy=68.367788 loss=1.239098 lr=0.009430 Epoch[015] Batch [1349]/[3760] Speed: 125.470936 samples/sec accuracy=68.325231 loss=1.240515 lr=0.009429 Epoch[015] Batch [1399]/[3760] Speed: 124.425016 samples/sec accuracy=68.313616 loss=1.241457 lr=0.009428 Epoch[015] Batch [1449]/[3760] Speed: 126.494803 samples/sec accuracy=68.259698 loss=1.242987 lr=0.009427 Epoch[015] Batch [1499]/[3760] Speed: 126.143196 samples/sec accuracy=68.211458 loss=1.243896 lr=0.009426 Epoch[015] Batch [1549]/[3760] Speed: 123.096317 samples/sec accuracy=68.248992 loss=1.243099 lr=0.009425 Epoch[015] Batch [1599]/[3760] Speed: 129.426646 samples/sec accuracy=68.259766 loss=1.242710 lr=0.009424 Epoch[015] Batch [1649]/[3760] Speed: 124.656982 samples/sec accuracy=68.232008 loss=1.243520 lr=0.009423 Epoch[015] Batch [1699]/[3760] Speed: 124.795196 samples/sec accuracy=68.215993 loss=1.245500 lr=0.009422 Epoch[015] Batch [1749]/[3760] Speed: 124.365807 samples/sec accuracy=68.233929 loss=1.245329 lr=0.009421 Epoch[015] Batch [1799]/[3760] Speed: 126.707191 samples/sec accuracy=68.197917 loss=1.245795 lr=0.009420 Epoch[015] Batch [1849]/[3760] Speed: 125.854582 samples/sec accuracy=68.244088 loss=1.244332 lr=0.009419 Epoch[015] Batch [1899]/[3760] Speed: 119.846744 samples/sec accuracy=68.212993 loss=1.244960 lr=0.009418 Epoch[015] Batch [1949]/[3760] Speed: 132.730781 samples/sec accuracy=68.200321 loss=1.245742 lr=0.009417 Epoch[015] Batch [1999]/[3760] Speed: 117.238700 samples/sec accuracy=68.187500 loss=1.246160 lr=0.009416 Epoch[015] Batch [2049]/[3760] Speed: 131.803537 samples/sec accuracy=68.187500 loss=1.246762 lr=0.009415 Epoch[015] Batch [2099]/[3760] Speed: 125.906597 samples/sec accuracy=68.154762 loss=1.248041 lr=0.009414 Epoch[015] Batch [2149]/[3760] Speed: 120.019953 samples/sec accuracy=68.117733 loss=1.248947 lr=0.009413 Epoch[015] Batch [2199]/[3760] Speed: 130.608681 samples/sec accuracy=68.099432 loss=1.250416 lr=0.009412 Epoch[015] Batch [2249]/[3760] Speed: 120.457467 samples/sec accuracy=68.067361 loss=1.251765 lr=0.009411 Epoch[015] Batch [2299]/[3760] Speed: 129.170810 samples/sec accuracy=68.062500 loss=1.252834 lr=0.009410 Epoch[015] Batch [2349]/[3760] Speed: 123.863550 samples/sec accuracy=68.037234 loss=1.254597 lr=0.009409 Epoch[015] Batch [2399]/[3760] Speed: 125.403412 samples/sec accuracy=68.027995 loss=1.255818 lr=0.009408 Epoch[015] Batch [2449]/[3760] Speed: 130.076201 samples/sec accuracy=67.985969 loss=1.256717 lr=0.009407 Epoch[015] Batch [2499]/[3760] Speed: 120.360319 samples/sec accuracy=67.943750 loss=1.258026 lr=0.009406 Epoch[015] Batch [2549]/[3760] Speed: 129.305762 samples/sec accuracy=67.936887 loss=1.257788 lr=0.009405 Epoch[015] Batch [2599]/[3760] Speed: 121.989567 samples/sec accuracy=67.911659 loss=1.259318 lr=0.009404 Epoch[015] Batch [2649]/[3760] Speed: 125.075010 samples/sec accuracy=67.891509 loss=1.260674 lr=0.009403 Epoch[015] Batch [2699]/[3760] Speed: 128.423930 samples/sec accuracy=67.873264 loss=1.261270 lr=0.009402 Epoch[015] Batch [2749]/[3760] Speed: 121.611758 samples/sec accuracy=67.882955 loss=1.261415 lr=0.009402 Epoch[015] Batch [2799]/[3760] Speed: 130.623121 samples/sec accuracy=67.856585 loss=1.262323 lr=0.009401 Epoch[015] Batch [2849]/[3760] Speed: 121.673432 samples/sec accuracy=67.852522 loss=1.262553 lr=0.009400 Epoch[015] Batch [2899]/[3760] Speed: 130.995135 samples/sec accuracy=67.823276 loss=1.263707 lr=0.009399 Epoch[015] Batch [2949]/[3760] Speed: 117.331350 samples/sec accuracy=67.825742 loss=1.263271 lr=0.009398 Epoch[015] Batch [2999]/[3760] Speed: 130.887906 samples/sec accuracy=67.821875 loss=1.263861 lr=0.009397 Epoch[015] Batch [3049]/[3760] Speed: 122.672068 samples/sec accuracy=67.809426 loss=1.264484 lr=0.009396 Epoch[015] Batch [3099]/[3760] Speed: 126.719458 samples/sec accuracy=67.813508 loss=1.264685 lr=0.009395 Epoch[015] Batch [3149]/[3760] Speed: 127.864266 samples/sec accuracy=67.823909 loss=1.264523 lr=0.009394 Epoch[015] Batch [3199]/[3760] Speed: 120.552012 samples/sec accuracy=67.819336 loss=1.265173 lr=0.009393 Epoch[015] Batch [3249]/[3760] Speed: 130.324359 samples/sec accuracy=67.827885 loss=1.265188 lr=0.009392 Epoch[015] Batch [3299]/[3760] Speed: 121.210234 samples/sec accuracy=67.814394 loss=1.265536 lr=0.009391 Epoch[015] Batch [3349]/[3760] Speed: 127.449032 samples/sec accuracy=67.805037 loss=1.266150 lr=0.009390 Epoch[015] Batch [3399]/[3760] Speed: 125.337295 samples/sec accuracy=67.818015 loss=1.265912 lr=0.009389 Epoch[015] Batch [3449]/[3760] Speed: 120.953166 samples/sec accuracy=67.792572 loss=1.266562 lr=0.009388 Epoch[015] Batch [3499]/[3760] Speed: 128.533196 samples/sec accuracy=67.791964 loss=1.266733 lr=0.009387 Epoch[015] Batch [3549]/[3760] Speed: 123.870906 samples/sec accuracy=67.781690 loss=1.267118 lr=0.009386 Epoch[015] Batch [3599]/[3760] Speed: 122.262509 samples/sec accuracy=67.765625 loss=1.268282 lr=0.009385 Epoch[015] Batch [3649]/[3760] Speed: 130.179221 samples/sec accuracy=67.773545 loss=1.268156 lr=0.009384 Epoch[015] Batch [3699]/[3760] Speed: 123.810141 samples/sec accuracy=67.757601 loss=1.268538 lr=0.009383 Epoch[015] Batch [3749]/[3760] Speed: 141.289179 samples/sec accuracy=67.753750 loss=1.269173 lr=0.009382 Batch [0049]/[0303]: acc-top1=61.000000 acc-top5=84.000000 Batch [0099]/[0303]: acc-top1=60.734375 acc-top5=83.906250 Batch [0149]/[0303]: acc-top1=60.343750 acc-top5=83.687500 Batch [0199]/[0303]: acc-top1=60.070312 acc-top5=83.539062 Batch [0249]/[0303]: acc-top1=60.143750 acc-top5=83.500000 Batch [0299]/[0303]: acc-top1=60.218750 acc-top5=83.515625 [Epoch 015] training: accuracy=67.747257 loss=1.269143 [Epoch 015] speed: 124 samples/sec time cost: 2114.575840 [Epoch 015] validation: acc-top1=60.179455 acc-top5=83.462252 loss=2.235204 Epoch[016] Batch [0049]/[3760] Speed: 91.000228 samples/sec accuracy=69.531250 loss=1.200458 lr=0.009380 Epoch[016] Batch [0099]/[3760] Speed: 131.348228 samples/sec accuracy=69.718750 loss=1.186152 lr=0.009379 Epoch[016] Batch [0149]/[3760] Speed: 119.242650 samples/sec accuracy=69.177083 loss=1.200445 lr=0.009378 Epoch[016] Batch [0199]/[3760] Speed: 124.282084 samples/sec accuracy=69.132812 loss=1.198621 lr=0.009377 Epoch[016] Batch [0249]/[3760] Speed: 127.237883 samples/sec accuracy=69.331250 loss=1.201525 lr=0.009376 Epoch[016] Batch [0299]/[3760] Speed: 124.010427 samples/sec accuracy=69.333333 loss=1.204545 lr=0.009375 Epoch[016] Batch [0349]/[3760] Speed: 125.524006 samples/sec accuracy=69.071429 loss=1.213397 lr=0.009374 Epoch[016] Batch [0399]/[3760] Speed: 124.682835 samples/sec accuracy=69.226562 loss=1.207843 lr=0.009373 Epoch[016] Batch [0449]/[3760] Speed: 123.226005 samples/sec accuracy=69.347222 loss=1.205980 lr=0.009372 Epoch[016] Batch [0499]/[3760] Speed: 133.271433 samples/sec accuracy=69.340625 loss=1.205580 lr=0.009371 Epoch[016] Batch [0549]/[3760] Speed: 123.239432 samples/sec accuracy=69.281250 loss=1.210155 lr=0.009370 Epoch[016] Batch [0599]/[3760] Speed: 122.556238 samples/sec accuracy=69.153646 loss=1.211651 lr=0.009369 Epoch[016] Batch [0649]/[3760] Speed: 129.149829 samples/sec accuracy=69.062500 loss=1.214596 lr=0.009368 Epoch[016] Batch [0699]/[3760] Speed: 124.032987 samples/sec accuracy=69.156250 loss=1.211214 lr=0.009367 Epoch[016] Batch [0749]/[3760] Speed: 127.785086 samples/sec accuracy=69.141667 loss=1.211409 lr=0.009366 Epoch[016] Batch [0799]/[3760] Speed: 127.068858 samples/sec accuracy=69.138672 loss=1.211827 lr=0.009365 Epoch[016] Batch [0849]/[3760] Speed: 122.235402 samples/sec accuracy=69.093750 loss=1.212354 lr=0.009364 Epoch[016] Batch [0899]/[3760] Speed: 123.293097 samples/sec accuracy=69.071181 loss=1.213018 lr=0.009363 Epoch[016] Batch [0949]/[3760] Speed: 124.907654 samples/sec accuracy=69.113487 loss=1.211394 lr=0.009362 Epoch[016] Batch [0999]/[3760] Speed: 126.636011 samples/sec accuracy=69.085938 loss=1.214924 lr=0.009361 Epoch[016] Batch [1049]/[3760] Speed: 122.484698 samples/sec accuracy=69.053571 loss=1.216522 lr=0.009360 Epoch[016] Batch [1099]/[3760] Speed: 127.192972 samples/sec accuracy=69.089489 loss=1.215905 lr=0.009359 Epoch[016] Batch [1149]/[3760] Speed: 118.604139 samples/sec accuracy=69.031250 loss=1.216620 lr=0.009358 Epoch[016] Batch [1199]/[3760] Speed: 134.733766 samples/sec accuracy=68.997396 loss=1.217888 lr=0.009357 Epoch[016] Batch [1249]/[3760] Speed: 114.392323 samples/sec accuracy=68.956250 loss=1.217827 lr=0.009356 Epoch[016] Batch [1299]/[3760] Speed: 128.948407 samples/sec accuracy=68.907452 loss=1.219209 lr=0.009355 Epoch[016] Batch [1349]/[3760] Speed: 127.743327 samples/sec accuracy=68.893519 loss=1.220207 lr=0.009354 Epoch[016] Batch [1399]/[3760] Speed: 119.397269 samples/sec accuracy=68.908482 loss=1.220126 lr=0.009353 Epoch[016] Batch [1449]/[3760] Speed: 128.079516 samples/sec accuracy=68.954741 loss=1.217503 lr=0.009352 Epoch[016] Batch [1499]/[3760] Speed: 131.610444 samples/sec accuracy=68.954167 loss=1.218044 lr=0.009351 Epoch[016] Batch [1549]/[3760] Speed: 121.562090 samples/sec accuracy=68.939516 loss=1.217623 lr=0.009350 Epoch[016] Batch [1599]/[3760] Speed: 123.754127 samples/sec accuracy=68.943359 loss=1.218216 lr=0.009349 Epoch[016] Batch [1649]/[3760] Speed: 128.388524 samples/sec accuracy=68.941288 loss=1.218560 lr=0.009348 Epoch[016] Batch [1699]/[3760] Speed: 124.223605 samples/sec accuracy=68.957721 loss=1.218407 lr=0.009347 Epoch[016] Batch [1749]/[3760] Speed: 124.949764 samples/sec accuracy=68.907143 loss=1.220266 lr=0.009346 Epoch[016] Batch [1799]/[3760] Speed: 125.528398 samples/sec accuracy=68.900174 loss=1.221091 lr=0.009345 Epoch[016] Batch [1849]/[3760] Speed: 126.910514 samples/sec accuracy=68.884291 loss=1.222231 lr=0.009344 Epoch[016] Batch [1899]/[3760] Speed: 123.600309 samples/sec accuracy=68.847862 loss=1.223497 lr=0.009343 Epoch[016] Batch [1949]/[3760] Speed: 127.543279 samples/sec accuracy=68.794872 loss=1.225274 lr=0.009341 Epoch[016] Batch [1999]/[3760] Speed: 124.614140 samples/sec accuracy=68.763281 loss=1.226647 lr=0.009340 Epoch[016] Batch [2049]/[3760] Speed: 121.666146 samples/sec accuracy=68.745427 loss=1.227241 lr=0.009339 Epoch[016] Batch [2099]/[3760] Speed: 129.378278 samples/sec accuracy=68.732887 loss=1.227166 lr=0.009338 Epoch[016] Batch [2149]/[3760] Speed: 122.171218 samples/sec accuracy=68.684593 loss=1.228898 lr=0.009337 Epoch[016] Batch [2199]/[3760] Speed: 128.996636 samples/sec accuracy=68.671165 loss=1.229089 lr=0.009336 Epoch[016] Batch [2249]/[3760] Speed: 123.626977 samples/sec accuracy=68.624306 loss=1.231021 lr=0.009335 Epoch[016] Batch [2299]/[3760] Speed: 125.286970 samples/sec accuracy=68.646739 loss=1.230452 lr=0.009334 Epoch[016] Batch [2349]/[3760] Speed: 125.799271 samples/sec accuracy=68.646277 loss=1.230800 lr=0.009333 Epoch[016] Batch [2399]/[3760] Speed: 123.226019 samples/sec accuracy=68.643880 loss=1.230924 lr=0.009332 Epoch[016] Batch [2449]/[3760] Speed: 128.354517 samples/sec accuracy=68.626913 loss=1.231538 lr=0.009331 Epoch[016] Batch [2499]/[3760] Speed: 128.084278 samples/sec accuracy=68.621250 loss=1.231971 lr=0.009330 Epoch[016] Batch [2549]/[3760] Speed: 119.788037 samples/sec accuracy=68.598039 loss=1.232886 lr=0.009329 Epoch[016] Batch [2599]/[3760] Speed: 133.416730 samples/sec accuracy=68.554087 loss=1.234452 lr=0.009328 Epoch[016] Batch [2649]/[3760] Speed: 118.628189 samples/sec accuracy=68.536557 loss=1.235089 lr=0.009327 Epoch[016] Batch [2699]/[3760] Speed: 129.277903 samples/sec accuracy=68.511574 loss=1.236255 lr=0.009326 Epoch[016] Batch [2749]/[3760] Speed: 121.265425 samples/sec accuracy=68.518750 loss=1.236216 lr=0.009325 Epoch[016] Batch [2799]/[3760] Speed: 125.037854 samples/sec accuracy=68.487723 loss=1.237286 lr=0.009324 Epoch[016] Batch [2849]/[3760] Speed: 132.275768 samples/sec accuracy=68.446820 loss=1.238902 lr=0.009323 Epoch[016] Batch [2899]/[3760] Speed: 119.313601 samples/sec accuracy=68.430496 loss=1.239495 lr=0.009322 Epoch[016] Batch [2949]/[3760] Speed: 125.496837 samples/sec accuracy=68.417373 loss=1.240097 lr=0.009321 Epoch[016] Batch [2999]/[3760] Speed: 119.955966 samples/sec accuracy=68.420833 loss=1.239871 lr=0.009320 Epoch[016] Batch [3049]/[3760] Speed: 134.487145 samples/sec accuracy=68.413934 loss=1.241072 lr=0.009319 Epoch[016] Batch [3099]/[3760] Speed: 120.295174 samples/sec accuracy=68.423387 loss=1.240806 lr=0.009317 Epoch[016] Batch [3149]/[3760] Speed: 130.430368 samples/sec accuracy=68.394345 loss=1.241868 lr=0.009316 Epoch[016] Batch [3199]/[3760] Speed: 129.235866 samples/sec accuracy=68.363281 loss=1.242501 lr=0.009315 Epoch[016] Batch [3249]/[3760] Speed: 118.443037 samples/sec accuracy=68.337500 loss=1.243321 lr=0.009314 Epoch[016] Batch [3299]/[3760] Speed: 131.340797 samples/sec accuracy=68.325284 loss=1.243992 lr=0.009313 Epoch[016] Batch [3349]/[3760] Speed: 118.524032 samples/sec accuracy=68.319030 loss=1.244016 lr=0.009312 Epoch[016] Batch [3399]/[3760] Speed: 129.310995 samples/sec accuracy=68.295037 loss=1.245195 lr=0.009311 Epoch[016] Batch [3449]/[3760] Speed: 125.399780 samples/sec accuracy=68.263134 loss=1.245788 lr=0.009310 Epoch[016] Batch [3499]/[3760] Speed: 126.352289 samples/sec accuracy=68.236607 loss=1.247003 lr=0.009309 Epoch[016] Batch [3549]/[3760] Speed: 125.163523 samples/sec accuracy=68.214789 loss=1.248092 lr=0.009308 Epoch[016] Batch [3599]/[3760] Speed: 123.524996 samples/sec accuracy=68.189236 loss=1.249486 lr=0.009307 Epoch[016] Batch [3649]/[3760] Speed: 123.130486 samples/sec accuracy=68.197774 loss=1.249328 lr=0.009306 Epoch[016] Batch [3699]/[3760] Speed: 131.998203 samples/sec accuracy=68.181166 loss=1.250127 lr=0.009305 Epoch[016] Batch [3749]/[3760] Speed: 139.132926 samples/sec accuracy=68.179167 loss=1.250597 lr=0.009304 Batch [0049]/[0303]: acc-top1=61.781250 acc-top5=84.656250 Batch [0099]/[0303]: acc-top1=61.640625 acc-top5=84.234375 Batch [0149]/[0303]: acc-top1=61.375000 acc-top5=84.104167 Batch [0199]/[0303]: acc-top1=60.867188 acc-top5=83.718750 Batch [0249]/[0303]: acc-top1=60.987500 acc-top5=83.581250 Batch [0299]/[0303]: acc-top1=60.963542 acc-top5=83.630208 [Epoch 016] training: accuracy=68.176945 loss=1.250795 [Epoch 016] speed: 124 samples/sec time cost: 2114.402180 [Epoch 016] validation: acc-top1=60.880776 acc-top5=83.586015 loss=2.153248 Epoch[017] Batch [0049]/[3759] Speed: 90.632969 samples/sec accuracy=69.406250 loss=1.183532 lr=0.009302 Epoch[017] Batch [0099]/[3759] Speed: 130.080921 samples/sec accuracy=69.718750 loss=1.176366 lr=0.009301 Epoch[017] Batch [0149]/[3759] Speed: 121.779916 samples/sec accuracy=69.625000 loss=1.178404 lr=0.009300 Epoch[017] Batch [0199]/[3759] Speed: 123.900398 samples/sec accuracy=69.867188 loss=1.173309 lr=0.009299 Epoch[017] Batch [0249]/[3759] Speed: 123.263590 samples/sec accuracy=69.743750 loss=1.181732 lr=0.009298 Epoch[017] Batch [0299]/[3759] Speed: 126.476687 samples/sec accuracy=69.703125 loss=1.183987 lr=0.009297 Epoch[017] Batch [0349]/[3759] Speed: 123.696509 samples/sec accuracy=69.678571 loss=1.183172 lr=0.009296 Epoch[017] Batch [0399]/[3759] Speed: 131.301282 samples/sec accuracy=69.632812 loss=1.181733 lr=0.009295 Epoch[017] Batch [0449]/[3759] Speed: 122.623777 samples/sec accuracy=69.576389 loss=1.184239 lr=0.009294 Epoch[017] Batch [0499]/[3759] Speed: 120.683755 samples/sec accuracy=69.531250 loss=1.188641 lr=0.009293 Epoch[017] Batch [0549]/[3759] Speed: 131.207806 samples/sec accuracy=69.599432 loss=1.183807 lr=0.009292 Epoch[017] Batch [0599]/[3759] Speed: 126.166354 samples/sec accuracy=69.684896 loss=1.183683 lr=0.009291 Epoch[017] Batch [0649]/[3759] Speed: 119.998020 samples/sec accuracy=69.649038 loss=1.183752 lr=0.009290 Epoch[017] Batch [0699]/[3759] Speed: 122.130675 samples/sec accuracy=69.616071 loss=1.184154 lr=0.009289 Epoch[017] Batch [0749]/[3759] Speed: 132.471507 samples/sec accuracy=69.575000 loss=1.185221 lr=0.009287 Epoch[017] Batch [0799]/[3759] Speed: 119.722772 samples/sec accuracy=69.572266 loss=1.184961 lr=0.009286 Epoch[017] Batch [0849]/[3759] Speed: 130.606757 samples/sec accuracy=69.511029 loss=1.187342 lr=0.009285 Epoch[017] Batch [0899]/[3759] Speed: 120.994339 samples/sec accuracy=69.486111 loss=1.186941 lr=0.009284 Epoch[017] Batch [0949]/[3759] Speed: 124.308007 samples/sec accuracy=69.536184 loss=1.185455 lr=0.009283 Epoch[017] Batch [0999]/[3759] Speed: 131.638453 samples/sec accuracy=69.543750 loss=1.186693 lr=0.009282 Epoch[017] Batch [1049]/[3759] Speed: 115.104987 samples/sec accuracy=69.489583 loss=1.188825 lr=0.009281 Epoch[017] Batch [1099]/[3759] Speed: 133.576434 samples/sec accuracy=69.430398 loss=1.191045 lr=0.009280 Epoch[017] Batch [1149]/[3759] Speed: 118.930220 samples/sec accuracy=69.403533 loss=1.191684 lr=0.009279 Epoch[017] Batch [1199]/[3759] Speed: 129.693237 samples/sec accuracy=69.355469 loss=1.194097 lr=0.009278 Epoch[017] Batch [1249]/[3759] Speed: 131.884935 samples/sec accuracy=69.291250 loss=1.196315 lr=0.009277 Epoch[017] Batch [1299]/[3759] Speed: 116.039194 samples/sec accuracy=69.298077 loss=1.196904 lr=0.009276 Epoch[017] Batch [1349]/[3759] Speed: 129.892381 samples/sec accuracy=69.293981 loss=1.195708 lr=0.009274 Epoch[017] Batch [1399]/[3759] Speed: 126.326189 samples/sec accuracy=69.311384 loss=1.194655 lr=0.009273 Epoch[017] Batch [1449]/[3759] Speed: 123.051773 samples/sec accuracy=69.256466 loss=1.196096 lr=0.009272 Epoch[017] Batch [1499]/[3759] Speed: 128.527528 samples/sec accuracy=69.304167 loss=1.195270 lr=0.009271 Epoch[017] Batch [1549]/[3759] Speed: 129.367960 samples/sec accuracy=69.281250 loss=1.195779 lr=0.009270 Epoch[017] Batch [1599]/[3759] Speed: 122.721075 samples/sec accuracy=69.272461 loss=1.197003 lr=0.009269 Epoch[017] Batch [1649]/[3759] Speed: 127.232699 samples/sec accuracy=69.258523 loss=1.197375 lr=0.009268 Epoch[017] Batch [1699]/[3759] Speed: 121.333454 samples/sec accuracy=69.211397 loss=1.199003 lr=0.009267 Epoch[017] Batch [1749]/[3759] Speed: 131.044385 samples/sec accuracy=69.173214 loss=1.199778 lr=0.009266 Epoch[017] Batch [1799]/[3759] Speed: 118.873013 samples/sec accuracy=69.120660 loss=1.201362 lr=0.009265 Epoch[017] Batch [1849]/[3759] Speed: 127.284525 samples/sec accuracy=69.043074 loss=1.203979 lr=0.009264 Epoch[017] Batch [1899]/[3759] Speed: 131.114880 samples/sec accuracy=69.023026 loss=1.204835 lr=0.009263 Epoch[017] Batch [1949]/[3759] Speed: 121.060946 samples/sec accuracy=68.984776 loss=1.207046 lr=0.009261 Epoch[017] Batch [1999]/[3759] Speed: 122.005114 samples/sec accuracy=68.968750 loss=1.208773 lr=0.009260 Epoch[017] Batch [2049]/[3759] Speed: 131.357216 samples/sec accuracy=68.961890 loss=1.209860 lr=0.009259 Epoch[017] Batch [2099]/[3759] Speed: 129.658376 samples/sec accuracy=68.941964 loss=1.210825 lr=0.009258 Epoch[017] Batch [2149]/[3759] Speed: 119.410159 samples/sec accuracy=68.944041 loss=1.210932 lr=0.009257 Epoch[017] Batch [2199]/[3759] Speed: 132.217971 samples/sec accuracy=68.925426 loss=1.211937 lr=0.009256 Epoch[017] Batch [2249]/[3759] Speed: 119.283984 samples/sec accuracy=68.913194 loss=1.212179 lr=0.009255 Epoch[017] Batch [2299]/[3759] Speed: 128.380587 samples/sec accuracy=68.870245 loss=1.214679 lr=0.009254 Epoch[017] Batch [2349]/[3759] Speed: 119.722225 samples/sec accuracy=68.849069 loss=1.215714 lr=0.009253 Epoch[017] Batch [2399]/[3759] Speed: 128.910060 samples/sec accuracy=68.822266 loss=1.216362 lr=0.009252 Epoch[017] Batch [2449]/[3759] Speed: 124.728794 samples/sec accuracy=68.781888 loss=1.218463 lr=0.009250 Epoch[017] Batch [2499]/[3759] Speed: 125.652695 samples/sec accuracy=68.747500 loss=1.219609 lr=0.009249 Epoch[017] Batch [2549]/[3759] Speed: 129.304131 samples/sec accuracy=68.724877 loss=1.220188 lr=0.009248 Epoch[017] Batch [2599]/[3759] Speed: 123.275673 samples/sec accuracy=68.711538 loss=1.220974 lr=0.009247 Epoch[017] Batch [2649]/[3759] Speed: 124.985030 samples/sec accuracy=68.676297 loss=1.222757 lr=0.009246 Epoch[017] Batch [2699]/[3759] Speed: 121.946772 samples/sec accuracy=68.668403 loss=1.222852 lr=0.009245 Epoch[017] Batch [2749]/[3759] Speed: 128.044947 samples/sec accuracy=68.653409 loss=1.223566 lr=0.009244 Epoch[017] Batch [2799]/[3759] Speed: 131.958153 samples/sec accuracy=68.690848 loss=1.222571 lr=0.009243 Epoch[017] Batch [2849]/[3759] Speed: 118.538575 samples/sec accuracy=68.692434 loss=1.222780 lr=0.009242 Epoch[017] Batch [2899]/[3759] Speed: 129.087281 samples/sec accuracy=68.693966 loss=1.223396 lr=0.009241 Epoch[017] Batch [2949]/[3759] Speed: 121.627259 samples/sec accuracy=68.676907 loss=1.223666 lr=0.009239 Epoch[017] Batch [2999]/[3759] Speed: 127.546149 samples/sec accuracy=68.648958 loss=1.224837 lr=0.009238 Epoch[017] Batch [3049]/[3759] Speed: 122.839143 samples/sec accuracy=68.642930 loss=1.225019 lr=0.009237 Epoch[017] Batch [3099]/[3759] Speed: 129.305966 samples/sec accuracy=68.608871 loss=1.226652 lr=0.009236 Epoch[017] Batch [3149]/[3759] Speed: 123.126500 samples/sec accuracy=68.587302 loss=1.227746 lr=0.009235 Epoch[017] Batch [3199]/[3759] Speed: 131.066306 samples/sec accuracy=68.584961 loss=1.228213 lr=0.009234 Epoch[017] Batch [3249]/[3759] Speed: 115.076667 samples/sec accuracy=68.571154 loss=1.229006 lr=0.009233 Epoch[017] Batch [3299]/[3759] Speed: 135.130709 samples/sec accuracy=68.552557 loss=1.229744 lr=0.009232 Epoch[017] Batch [3349]/[3759] Speed: 119.388402 samples/sec accuracy=68.555970 loss=1.229788 lr=0.009231 Epoch[017] Batch [3399]/[3759] Speed: 125.751052 samples/sec accuracy=68.556985 loss=1.229440 lr=0.009229 Epoch[017] Batch [3449]/[3759] Speed: 130.588271 samples/sec accuracy=68.569293 loss=1.228859 lr=0.009228 Epoch[017] Batch [3499]/[3759] Speed: 121.654031 samples/sec accuracy=68.579018 loss=1.228698 lr=0.009227 Epoch[017] Batch [3549]/[3759] Speed: 130.428586 samples/sec accuracy=68.562500 loss=1.229219 lr=0.009226 Epoch[017] Batch [3599]/[3759] Speed: 121.270542 samples/sec accuracy=68.569010 loss=1.229186 lr=0.009225 Epoch[017] Batch [3649]/[3759] Speed: 126.232462 samples/sec accuracy=68.571490 loss=1.229219 lr=0.009224 Epoch[017] Batch [3699]/[3759] Speed: 131.148080 samples/sec accuracy=68.551943 loss=1.230675 lr=0.009223 Epoch[017] Batch [3749]/[3759] Speed: 139.427152 samples/sec accuracy=68.545000 loss=1.230939 lr=0.009222 Batch [0049]/[0303]: acc-top1=62.062500 acc-top5=84.437500 Batch [0099]/[0303]: acc-top1=61.906250 acc-top5=83.843750 Batch [0149]/[0303]: acc-top1=61.854167 acc-top5=83.750000 Batch [0199]/[0303]: acc-top1=61.289062 acc-top5=83.492188 Batch [0249]/[0303]: acc-top1=61.206250 acc-top5=83.475000 Batch [0299]/[0303]: acc-top1=61.166667 acc-top5=83.546875 [Epoch 017] training: accuracy=68.541750 loss=1.230919 [Epoch 017] speed: 125 samples/sec time cost: 2112.598503 [Epoch 017] validation: acc-top1=61.112830 acc-top5=83.488036 loss=2.128437 Epoch[018] Batch [0049]/[3760] Speed: 87.652833 samples/sec accuracy=70.281250 loss=1.178788 lr=0.009220 Epoch[018] Batch [0099]/[3760] Speed: 128.031375 samples/sec accuracy=69.968750 loss=1.191841 lr=0.009219 Epoch[018] Batch [0149]/[3760] Speed: 127.182386 samples/sec accuracy=69.906250 loss=1.190491 lr=0.009218 Epoch[018] Batch [0199]/[3760] Speed: 123.603364 samples/sec accuracy=69.804688 loss=1.190640 lr=0.009217 Epoch[018] Batch [0249]/[3760] Speed: 125.817697 samples/sec accuracy=69.781250 loss=1.192062 lr=0.009216 Epoch[018] Batch [0299]/[3760] Speed: 126.467682 samples/sec accuracy=69.552083 loss=1.195881 lr=0.009215 Epoch[018] Batch [0349]/[3760] Speed: 122.315712 samples/sec accuracy=69.723214 loss=1.189786 lr=0.009214 Epoch[018] Batch [0399]/[3760] Speed: 127.814532 samples/sec accuracy=69.863281 loss=1.182385 lr=0.009212 Epoch[018] Batch [0449]/[3760] Speed: 124.187677 samples/sec accuracy=69.885417 loss=1.177782 lr=0.009211 Epoch[018] Batch [0499]/[3760] Speed: 125.505606 samples/sec accuracy=69.756250 loss=1.179872 lr=0.009210 Epoch[018] Batch [0549]/[3760] Speed: 126.311569 samples/sec accuracy=69.715909 loss=1.179913 lr=0.009209 Epoch[018] Batch [0599]/[3760] Speed: 127.133167 samples/sec accuracy=69.765625 loss=1.179841 lr=0.009208 Epoch[018] Batch [0649]/[3760] Speed: 118.111360 samples/sec accuracy=69.757212 loss=1.182349 lr=0.009207 Epoch[018] Batch [0699]/[3760] Speed: 133.600975 samples/sec accuracy=69.779018 loss=1.182050 lr=0.009206 Epoch[018] Batch [0749]/[3760] Speed: 122.881721 samples/sec accuracy=69.793750 loss=1.180089 lr=0.009205 Epoch[018] Batch [0799]/[3760] Speed: 127.914279 samples/sec accuracy=69.839844 loss=1.179251 lr=0.009203 Epoch[018] Batch [0849]/[3760] Speed: 120.632506 samples/sec accuracy=69.860294 loss=1.179892 lr=0.009202 Epoch[018] Batch [0899]/[3760] Speed: 129.085095 samples/sec accuracy=69.869792 loss=1.180700 lr=0.009201 Epoch[018] Batch [0949]/[3760] Speed: 127.993070 samples/sec accuracy=69.893092 loss=1.180097 lr=0.009200 Epoch[018] Batch [0999]/[3760] Speed: 124.391758 samples/sec accuracy=69.900000 loss=1.179881 lr=0.009199 Epoch[018] Batch [1049]/[3760] Speed: 117.677181 samples/sec accuracy=69.885417 loss=1.180409 lr=0.009198 Epoch[018] Batch [1099]/[3760] Speed: 132.912257 samples/sec accuracy=69.892045 loss=1.179863 lr=0.009197 Epoch[018] Batch [1149]/[3760] Speed: 122.812211 samples/sec accuracy=69.798913 loss=1.182490 lr=0.009195 Epoch[018] Batch [1199]/[3760] Speed: 123.732227 samples/sec accuracy=69.798177 loss=1.182770 lr=0.009194 Epoch[018] Batch [1249]/[3760] Speed: 125.132118 samples/sec accuracy=69.793750 loss=1.183117 lr=0.009193 Epoch[018] Batch [1299]/[3760] Speed: 126.175248 samples/sec accuracy=69.760817 loss=1.184346 lr=0.009192 Epoch[018] Batch [1349]/[3760] Speed: 120.019365 samples/sec accuracy=69.725694 loss=1.185974 lr=0.009191 Epoch[018] Batch [1399]/[3760] Speed: 126.284387 samples/sec accuracy=69.755580 loss=1.184612 lr=0.009190 Epoch[018] Batch [1449]/[3760] Speed: 126.145773 samples/sec accuracy=69.717672 loss=1.185591 lr=0.009189 Epoch[018] Batch [1499]/[3760] Speed: 126.620466 samples/sec accuracy=69.675000 loss=1.187468 lr=0.009187 Epoch[018] Batch [1549]/[3760] Speed: 132.087722 samples/sec accuracy=69.626008 loss=1.188603 lr=0.009186 Epoch[018] Batch [1599]/[3760] Speed: 121.708865 samples/sec accuracy=69.613281 loss=1.189646 lr=0.009185 Epoch[018] Batch [1649]/[3760] Speed: 127.796839 samples/sec accuracy=69.627841 loss=1.188895 lr=0.009184 Epoch[018] Batch [1699]/[3760] Speed: 121.664053 samples/sec accuracy=69.596507 loss=1.190272 lr=0.009183 Epoch[018] Batch [1749]/[3760] Speed: 125.244377 samples/sec accuracy=69.578571 loss=1.191063 lr=0.009182 Epoch[018] Batch [1799]/[3760] Speed: 127.423692 samples/sec accuracy=69.594618 loss=1.190393 lr=0.009181 Epoch[018] Batch [1849]/[3760] Speed: 120.446535 samples/sec accuracy=69.575169 loss=1.191583 lr=0.009179 Epoch[018] Batch [1899]/[3760] Speed: 130.694479 samples/sec accuracy=69.510691 loss=1.192613 lr=0.009178 Epoch[018] Batch [1949]/[3760] Speed: 124.179573 samples/sec accuracy=69.479968 loss=1.193918 lr=0.009177 Epoch[018] Batch [1999]/[3760] Speed: 124.997524 samples/sec accuracy=69.432812 loss=1.197110 lr=0.009176 Epoch[018] Batch [2049]/[3760] Speed: 121.233933 samples/sec accuracy=69.406250 loss=1.197721 lr=0.009175 Epoch[018] Batch [2099]/[3760] Speed: 133.382458 samples/sec accuracy=69.325149 loss=1.200128 lr=0.009174 Epoch[018] Batch [2149]/[3760] Speed: 121.043865 samples/sec accuracy=69.298692 loss=1.200721 lr=0.009173 Epoch[018] Batch [2199]/[3760] Speed: 123.244678 samples/sec accuracy=69.270597 loss=1.201519 lr=0.009171 Epoch[018] Batch [2249]/[3760] Speed: 129.453529 samples/sec accuracy=69.273611 loss=1.201782 lr=0.009170 Epoch[018] Batch [2299]/[3760] Speed: 127.845054 samples/sec accuracy=69.250000 loss=1.202385 lr=0.009169 Epoch[018] Batch [2349]/[3760] Speed: 120.660253 samples/sec accuracy=69.253989 loss=1.202485 lr=0.009168 Epoch[018] Batch [2399]/[3760] Speed: 128.828201 samples/sec accuracy=69.205729 loss=1.202994 lr=0.009167 Epoch[018] Batch [2449]/[3760] Speed: 120.297629 samples/sec accuracy=69.177934 loss=1.204031 lr=0.009166 Epoch[018] Batch [2499]/[3760] Speed: 129.309641 samples/sec accuracy=69.161875 loss=1.204976 lr=0.009164 Epoch[018] Batch [2549]/[3760] Speed: 127.047908 samples/sec accuracy=69.142770 loss=1.205810 lr=0.009163 Epoch[018] Batch [2599]/[3760] Speed: 121.590026 samples/sec accuracy=69.137620 loss=1.206653 lr=0.009162 Epoch[018] Batch [2649]/[3760] Speed: 128.944021 samples/sec accuracy=69.135613 loss=1.207179 lr=0.009161 Epoch[018] Batch [2699]/[3760] Speed: 119.947218 samples/sec accuracy=69.120949 loss=1.207713 lr=0.009160 Epoch[018] Batch [2749]/[3760] Speed: 129.867642 samples/sec accuracy=69.118750 loss=1.207916 lr=0.009159 Epoch[018] Batch [2799]/[3760] Speed: 122.593625 samples/sec accuracy=69.133371 loss=1.207899 lr=0.009158 Epoch[018] Batch [2849]/[3760] Speed: 129.682379 samples/sec accuracy=69.100877 loss=1.209331 lr=0.009156 Epoch[018] Batch [2899]/[3760] Speed: 122.909788 samples/sec accuracy=69.067888 loss=1.210373 lr=0.009155 Epoch[018] Batch [2949]/[3760] Speed: 125.662339 samples/sec accuracy=69.055085 loss=1.210484 lr=0.009154 Epoch[018] Batch [2999]/[3760] Speed: 131.975308 samples/sec accuracy=69.045833 loss=1.210531 lr=0.009153 Epoch[018] Batch [3049]/[3760] Speed: 116.095011 samples/sec accuracy=69.056352 loss=1.210380 lr=0.009152 Epoch[018] Batch [3099]/[3760] Speed: 129.228142 samples/sec accuracy=69.032762 loss=1.211237 lr=0.009151 Epoch[018] Batch [3149]/[3760] Speed: 124.669671 samples/sec accuracy=69.031250 loss=1.211537 lr=0.009149 Epoch[018] Batch [3199]/[3760] Speed: 121.022476 samples/sec accuracy=69.004883 loss=1.212081 lr=0.009148 Epoch[018] Batch [3249]/[3760] Speed: 131.309354 samples/sec accuracy=68.981250 loss=1.212877 lr=0.009147 Epoch[018] Batch [3299]/[3760] Speed: 125.078975 samples/sec accuracy=68.984848 loss=1.212695 lr=0.009146 Epoch[018] Batch [3349]/[3760] Speed: 123.516491 samples/sec accuracy=68.969683 loss=1.213276 lr=0.009145 Epoch[018] Batch [3399]/[3760] Speed: 125.232997 samples/sec accuracy=68.958180 loss=1.213742 lr=0.009144 Epoch[018] Batch [3449]/[3760] Speed: 126.924821 samples/sec accuracy=68.958786 loss=1.213907 lr=0.009142 Epoch[018] Batch [3499]/[3760] Speed: 125.768041 samples/sec accuracy=68.954911 loss=1.214226 lr=0.009141 Epoch[018] Batch [3549]/[3760] Speed: 122.827270 samples/sec accuracy=68.943222 loss=1.215242 lr=0.009140 Epoch[018] Batch [3599]/[3760] Speed: 124.872747 samples/sec accuracy=68.923611 loss=1.215892 lr=0.009139 Epoch[018] Batch [3649]/[3760] Speed: 122.772590 samples/sec accuracy=68.914384 loss=1.215936 lr=0.009138 Epoch[018] Batch [3699]/[3760] Speed: 133.851482 samples/sec accuracy=68.904983 loss=1.216680 lr=0.009137 Epoch[018] Batch [3749]/[3760] Speed: 137.467981 samples/sec accuracy=68.903333 loss=1.216523 lr=0.009135 Batch [0049]/[0303]: acc-top1=61.656250 acc-top5=85.031250 Batch [0099]/[0303]: acc-top1=61.453125 acc-top5=84.218750 Batch [0149]/[0303]: acc-top1=61.281250 acc-top5=84.104167 Batch [0199]/[0303]: acc-top1=60.765625 acc-top5=83.742188 Batch [0249]/[0303]: acc-top1=60.831250 acc-top5=83.612500 Batch [0299]/[0303]: acc-top1=60.958333 acc-top5=83.666667 [Epoch 018] training: accuracy=68.906666 loss=1.216362 [Epoch 018] speed: 124 samples/sec time cost: 2114.716777 [Epoch 018] validation: acc-top1=60.891089 acc-top5=83.591172 loss=2.172243 Epoch[019] Batch [0049]/[3760] Speed: 89.780353 samples/sec accuracy=70.906250 loss=1.100774 lr=0.009134 Epoch[019] Batch [0099]/[3760] Speed: 131.226496 samples/sec accuracy=70.281250 loss=1.139236 lr=0.009133 Epoch[019] Batch [0149]/[3760] Speed: 120.093103 samples/sec accuracy=70.854167 loss=1.122230 lr=0.009132 Epoch[019] Batch [0199]/[3760] Speed: 125.247357 samples/sec accuracy=70.507812 loss=1.133552 lr=0.009130 Epoch[019] Batch [0249]/[3760] Speed: 125.129439 samples/sec accuracy=70.331250 loss=1.137933 lr=0.009129 Epoch[019] Batch [0299]/[3760] Speed: 123.660250 samples/sec accuracy=70.421875 loss=1.134290 lr=0.009128 Epoch[019] Batch [0349]/[3760] Speed: 127.318893 samples/sec accuracy=70.334821 loss=1.141683 lr=0.009127 Epoch[019] Batch [0399]/[3760] Speed: 118.244360 samples/sec accuracy=70.386719 loss=1.141158 lr=0.009126 Epoch[019] Batch [0449]/[3760] Speed: 130.476411 samples/sec accuracy=70.399306 loss=1.139815 lr=0.009125 Epoch[019] Batch [0499]/[3760] Speed: 121.226347 samples/sec accuracy=70.334375 loss=1.145105 lr=0.009123 Epoch[019] Batch [0549]/[3760] Speed: 130.496848 samples/sec accuracy=70.332386 loss=1.145602 lr=0.009122 Epoch[019] Batch [0599]/[3760] Speed: 122.940657 samples/sec accuracy=70.210938 loss=1.149022 lr=0.009121 Epoch[019] Batch [0649]/[3760] Speed: 125.678131 samples/sec accuracy=70.115385 loss=1.152668 lr=0.009120 Epoch[019] Batch [0699]/[3760] Speed: 126.867991 samples/sec accuracy=70.111607 loss=1.156596 lr=0.009119 Epoch[019] Batch [0749]/[3760] Speed: 124.458964 samples/sec accuracy=70.070833 loss=1.159756 lr=0.009117 Epoch[019] Batch [0799]/[3760] Speed: 123.612329 samples/sec accuracy=70.021484 loss=1.162008 lr=0.009116 Epoch[019] Batch [0849]/[3760] Speed: 132.559143 samples/sec accuracy=69.992647 loss=1.163618 lr=0.009115 Epoch[019] Batch [0899]/[3760] Speed: 119.907976 samples/sec accuracy=69.968750 loss=1.166468 lr=0.009114 Epoch[019] Batch [0949]/[3760] Speed: 125.616976 samples/sec accuracy=69.911184 loss=1.168460 lr=0.009113 Epoch[019] Batch [0999]/[3760] Speed: 130.019116 samples/sec accuracy=69.867188 loss=1.171232 lr=0.009111 Epoch[019] Batch [1049]/[3760] Speed: 119.574899 samples/sec accuracy=69.854167 loss=1.171958 lr=0.009110 Epoch[019] Batch [1099]/[3760] Speed: 132.766487 samples/sec accuracy=69.778409 loss=1.174073 lr=0.009109 Epoch[019] Batch [1149]/[3760] Speed: 119.492377 samples/sec accuracy=69.750000 loss=1.174439 lr=0.009108 Epoch[019] Batch [1199]/[3760] Speed: 130.698768 samples/sec accuracy=69.699219 loss=1.175833 lr=0.009107 Epoch[019] Batch [1249]/[3760] Speed: 121.117342 samples/sec accuracy=69.663750 loss=1.176476 lr=0.009106 Epoch[019] Batch [1299]/[3760] Speed: 127.508811 samples/sec accuracy=69.638221 loss=1.177352 lr=0.009104 Epoch[019] Batch [1349]/[3760] Speed: 132.303269 samples/sec accuracy=69.641204 loss=1.176463 lr=0.009103 Epoch[019] Batch [1399]/[3760] Speed: 117.064073 samples/sec accuracy=69.641741 loss=1.176806 lr=0.009102 Epoch[019] Batch [1449]/[3760] Speed: 131.354020 samples/sec accuracy=69.600216 loss=1.178788 lr=0.009101 Epoch[019] Batch [1499]/[3760] Speed: 116.180514 samples/sec accuracy=69.616667 loss=1.179681 lr=0.009100 Epoch[019] Batch [1549]/[3760] Speed: 132.723834 samples/sec accuracy=69.571573 loss=1.180374 lr=0.009098 Epoch[019] Batch [1599]/[3760] Speed: 124.217524 samples/sec accuracy=69.529297 loss=1.183159 lr=0.009097 Epoch[019] Batch [1649]/[3760] Speed: 124.547351 samples/sec accuracy=69.539773 loss=1.183570 lr=0.009096 Epoch[019] Batch [1699]/[3760] Speed: 124.304891 samples/sec accuracy=69.581801 loss=1.182853 lr=0.009095 Epoch[019] Batch [1749]/[3760] Speed: 129.761800 samples/sec accuracy=69.564286 loss=1.183999 lr=0.009094 Epoch[019] Batch [1799]/[3760] Speed: 125.755474 samples/sec accuracy=69.528646 loss=1.185506 lr=0.009092 Epoch[019] Batch [1849]/[3760] Speed: 125.093771 samples/sec accuracy=69.526182 loss=1.185991 lr=0.009091 Epoch[019] Batch [1899]/[3760] Speed: 123.025266 samples/sec accuracy=69.529605 loss=1.186343 lr=0.009090 Epoch[019] Batch [1949]/[3760] Speed: 124.216754 samples/sec accuracy=69.530449 loss=1.186468 lr=0.009089 Epoch[019] Batch [1999]/[3760] Speed: 129.682178 samples/sec accuracy=69.521094 loss=1.187402 lr=0.009088 Epoch[019] Batch [2049]/[3760] Speed: 122.478313 samples/sec accuracy=69.467988 loss=1.189381 lr=0.009086 Epoch[019] Batch [2099]/[3760] Speed: 129.246495 samples/sec accuracy=69.453869 loss=1.190220 lr=0.009085 Epoch[019] Batch [2149]/[3760] Speed: 119.629529 samples/sec accuracy=69.462209 loss=1.189890 lr=0.009084 Epoch[019] Batch [2199]/[3760] Speed: 127.835216 samples/sec accuracy=69.446023 loss=1.191404 lr=0.009083 Epoch[019] Batch [2249]/[3760] Speed: 129.919958 samples/sec accuracy=69.431944 loss=1.192039 lr=0.009082 Epoch[019] Batch [2299]/[3760] Speed: 119.384120 samples/sec accuracy=69.417799 loss=1.192910 lr=0.009080 Epoch[019] Batch [2349]/[3760] Speed: 129.738325 samples/sec accuracy=69.426862 loss=1.193063 lr=0.009079 Epoch[019] Batch [2399]/[3760] Speed: 120.697134 samples/sec accuracy=69.426432 loss=1.192962 lr=0.009078 Epoch[019] Batch [2449]/[3760] Speed: 125.950312 samples/sec accuracy=69.417730 loss=1.192695 lr=0.009077 Epoch[019] Batch [2499]/[3760] Speed: 125.470630 samples/sec accuracy=69.403750 loss=1.192620 lr=0.009075 Epoch[019] Batch [2549]/[3760] Speed: 125.531531 samples/sec accuracy=69.392770 loss=1.193690 lr=0.009074 Epoch[019] Batch [2599]/[3760] Speed: 121.890508 samples/sec accuracy=69.378606 loss=1.194089 lr=0.009073 Epoch[019] Batch [2649]/[3760] Speed: 131.701687 samples/sec accuracy=69.382075 loss=1.194561 lr=0.009072 Epoch[019] Batch [2699]/[3760] Speed: 115.754399 samples/sec accuracy=69.362847 loss=1.195172 lr=0.009071 Epoch[019] Batch [2749]/[3760] Speed: 131.537679 samples/sec accuracy=69.352841 loss=1.195969 lr=0.009069 Epoch[019] Batch [2799]/[3760] Speed: 121.392070 samples/sec accuracy=69.344866 loss=1.196372 lr=0.009068 Epoch[019] Batch [2849]/[3760] Speed: 128.931059 samples/sec accuracy=69.328947 loss=1.197019 lr=0.009067 Epoch[019] Batch [2899]/[3760] Speed: 123.513836 samples/sec accuracy=69.330280 loss=1.196713 lr=0.009066 Epoch[019] Batch [2949]/[3760] Speed: 129.145950 samples/sec accuracy=69.336335 loss=1.197214 lr=0.009065 Epoch[019] Batch [2999]/[3760] Speed: 119.387365 samples/sec accuracy=69.318229 loss=1.197770 lr=0.009063 Epoch[019] Batch [3049]/[3760] Speed: 132.154174 samples/sec accuracy=69.303279 loss=1.198031 lr=0.009062 Epoch[019] Batch [3099]/[3760] Speed: 116.365143 samples/sec accuracy=69.270161 loss=1.198627 lr=0.009061 Epoch[019] Batch [3149]/[3760] Speed: 128.050392 samples/sec accuracy=69.275298 loss=1.198649 lr=0.009060 Epoch[019] Batch [3199]/[3760] Speed: 127.962757 samples/sec accuracy=69.252441 loss=1.199704 lr=0.009058 Epoch[019] Batch [3249]/[3760] Speed: 122.812727 samples/sec accuracy=69.209615 loss=1.201062 lr=0.009057 Epoch[019] Batch [3299]/[3760] Speed: 125.708050 samples/sec accuracy=69.178030 loss=1.201896 lr=0.009056 Epoch[019] Batch [3349]/[3760] Speed: 129.855538 samples/sec accuracy=69.180037 loss=1.201699 lr=0.009055 Epoch[019] Batch [3399]/[3760] Speed: 121.138826 samples/sec accuracy=69.176930 loss=1.202117 lr=0.009054 Epoch[019] Batch [3449]/[3760] Speed: 123.863439 samples/sec accuracy=69.161232 loss=1.202837 lr=0.009052 Epoch[019] Batch [3499]/[3760] Speed: 133.462429 samples/sec accuracy=69.168750 loss=1.202992 lr=0.009051 Epoch[019] Batch [3549]/[3760] Speed: 117.070420 samples/sec accuracy=69.161092 loss=1.203285 lr=0.009050 Epoch[019] Batch [3599]/[3760] Speed: 133.183104 samples/sec accuracy=69.130642 loss=1.203940 lr=0.009049 Epoch[019] Batch [3649]/[3760] Speed: 117.946897 samples/sec accuracy=69.132277 loss=1.203956 lr=0.009047 Epoch[019] Batch [3699]/[3760] Speed: 128.249676 samples/sec accuracy=69.110642 loss=1.204599 lr=0.009046 Epoch[019] Batch [3749]/[3760] Speed: 143.527109 samples/sec accuracy=69.099167 loss=1.204832 lr=0.009045 Batch [0049]/[0303]: acc-top1=61.656250 acc-top5=83.218750 Batch [0099]/[0303]: acc-top1=61.656250 acc-top5=83.453125 Batch [0149]/[0303]: acc-top1=61.104167 acc-top5=83.239583 Batch [0199]/[0303]: acc-top1=60.507812 acc-top5=83.101562 Batch [0249]/[0303]: acc-top1=60.687500 acc-top5=83.225000 Batch [0299]/[0303]: acc-top1=60.750000 acc-top5=83.312500 [Epoch 019] training: accuracy=69.103225 loss=1.204801 [Epoch 019] speed: 124 samples/sec time cost: 2116.587983 [Epoch 019] validation: acc-top1=60.679662 acc-top5=83.297236 loss=2.206302 Epoch[020] Batch [0049]/[3759] Speed: 90.550123 samples/sec accuracy=71.312500 loss=1.124664 lr=0.009044 Epoch[020] Batch [0099]/[3759] Speed: 128.193788 samples/sec accuracy=70.953125 loss=1.136722 lr=0.009042 Epoch[020] Batch [0149]/[3759] Speed: 122.924231 samples/sec accuracy=71.000000 loss=1.128384 lr=0.009041 Epoch[020] Batch [0199]/[3759] Speed: 121.118643 samples/sec accuracy=70.953125 loss=1.130939 lr=0.009040 Epoch[020] Batch [0249]/[3759] Speed: 132.629648 samples/sec accuracy=71.131250 loss=1.125068 lr=0.009039 Epoch[020] Batch [0299]/[3759] Speed: 118.755785 samples/sec accuracy=71.218750 loss=1.115244 lr=0.009037 Epoch[020] Batch [0349]/[3759] Speed: 125.060739 samples/sec accuracy=71.241071 loss=1.111621 lr=0.009036 Epoch[020] Batch [0399]/[3759] Speed: 129.105803 samples/sec accuracy=71.226562 loss=1.113657 lr=0.009035 Epoch[020] Batch [0449]/[3759] Speed: 122.980721 samples/sec accuracy=71.086806 loss=1.118090 lr=0.009034 Epoch[020] Batch [0499]/[3759] Speed: 129.508152 samples/sec accuracy=71.012500 loss=1.120864 lr=0.009032 Epoch[020] Batch [0549]/[3759] Speed: 117.382143 samples/sec accuracy=71.048295 loss=1.121296 lr=0.009031 Epoch[020] Batch [0599]/[3759] Speed: 133.287297 samples/sec accuracy=70.911458 loss=1.124241 lr=0.009030 Epoch[020] Batch [0649]/[3759] Speed: 118.326640 samples/sec accuracy=70.790865 loss=1.131154 lr=0.009029 Epoch[020] Batch [0699]/[3759] Speed: 126.776445 samples/sec accuracy=70.716518 loss=1.134877 lr=0.009027 Epoch[020] Batch [0749]/[3759] Speed: 130.721774 samples/sec accuracy=70.620833 loss=1.138768 lr=0.009026 Epoch[020] Batch [0799]/[3759] Speed: 120.173219 samples/sec accuracy=70.572266 loss=1.141973 lr=0.009025 Epoch[020] Batch [0849]/[3759] Speed: 132.859480 samples/sec accuracy=70.446691 loss=1.146956 lr=0.009024 Epoch[020] Batch [0899]/[3759] Speed: 120.200801 samples/sec accuracy=70.328125 loss=1.151407 lr=0.009023 Epoch[020] Batch [0949]/[3759] Speed: 129.360809 samples/sec accuracy=70.268092 loss=1.152641 lr=0.009021 Epoch[020] Batch [0999]/[3759] Speed: 124.179569 samples/sec accuracy=70.350000 loss=1.150866 lr=0.009020 Epoch[020] Batch [1049]/[3759] Speed: 121.550654 samples/sec accuracy=70.336310 loss=1.152012 lr=0.009019 Epoch[020] Batch [1099]/[3759] Speed: 131.013118 samples/sec accuracy=70.295455 loss=1.154000 lr=0.009018 Epoch[020] Batch [1149]/[3759] Speed: 115.577526 samples/sec accuracy=70.286685 loss=1.155617 lr=0.009016 Epoch[020] Batch [1199]/[3759] Speed: 132.106553 samples/sec accuracy=70.272135 loss=1.157122 lr=0.009015 Epoch[020] Batch [1249]/[3759] Speed: 129.614018 samples/sec accuracy=70.283750 loss=1.156261 lr=0.009014 Epoch[020] Batch [1299]/[3759] Speed: 117.269557 samples/sec accuracy=70.296875 loss=1.156036 lr=0.009013 Epoch[020] Batch [1349]/[3759] Speed: 130.243430 samples/sec accuracy=70.268519 loss=1.157446 lr=0.009011 Epoch[020] Batch [1399]/[3759] Speed: 121.431799 samples/sec accuracy=70.212054 loss=1.161163 lr=0.009010 Epoch[020] Batch [1449]/[3759] Speed: 125.082255 samples/sec accuracy=70.260776 loss=1.160159 lr=0.009009 Epoch[020] Batch [1499]/[3759] Speed: 126.278575 samples/sec accuracy=70.194792 loss=1.162098 lr=0.009008 Epoch[020] Batch [1549]/[3759] Speed: 127.038224 samples/sec accuracy=70.153226 loss=1.163841 lr=0.009006 Epoch[020] Batch [1599]/[3759] Speed: 128.132160 samples/sec accuracy=70.164062 loss=1.164353 lr=0.009005 Epoch[020] Batch [1649]/[3759] Speed: 120.504564 samples/sec accuracy=70.176136 loss=1.164864 lr=0.009004 Epoch[020] Batch [1699]/[3759] Speed: 126.215229 samples/sec accuracy=70.159926 loss=1.165911 lr=0.009003 Epoch[020] Batch [1749]/[3759] Speed: 123.271110 samples/sec accuracy=70.172321 loss=1.165887 lr=0.009001 Epoch[020] Batch [1799]/[3759] Speed: 130.631959 samples/sec accuracy=70.155382 loss=1.167308 lr=0.009000 Epoch[020] Batch [1849]/[3759] Speed: 127.200096 samples/sec accuracy=70.148649 loss=1.167578 lr=0.008999 Epoch[020] Batch [1899]/[3759] Speed: 123.672364 samples/sec accuracy=70.153783 loss=1.167768 lr=0.008998 Epoch[020] Batch [1949]/[3759] Speed: 127.071206 samples/sec accuracy=70.141827 loss=1.167933 lr=0.008996 Epoch[020] Batch [1999]/[3759] Speed: 119.746402 samples/sec accuracy=70.126563 loss=1.168095 lr=0.008995 Epoch[020] Batch [2049]/[3759] Speed: 132.762540 samples/sec accuracy=70.092226 loss=1.169608 lr=0.008994 Epoch[020] Batch [2099]/[3759] Speed: 117.908201 samples/sec accuracy=70.098958 loss=1.168959 lr=0.008993 Epoch[020] Batch [2149]/[3759] Speed: 129.852373 samples/sec accuracy=70.109738 loss=1.168789 lr=0.008991 Epoch[020] Batch [2199]/[3759] Speed: 123.298617 samples/sec accuracy=70.130682 loss=1.168700 lr=0.008990 Epoch[020] Batch [2249]/[3759] Speed: 127.079530 samples/sec accuracy=70.107639 loss=1.169408 lr=0.008989 Epoch[020] Batch [2299]/[3759] Speed: 129.656805 samples/sec accuracy=70.086957 loss=1.169988 lr=0.008988 Epoch[020] Batch [2349]/[3759] Speed: 125.874597 samples/sec accuracy=70.045878 loss=1.171400 lr=0.008986 Epoch[020] Batch [2399]/[3759] Speed: 121.520048 samples/sec accuracy=70.033203 loss=1.171995 lr=0.008985 Epoch[020] Batch [2449]/[3759] Speed: 127.746644 samples/sec accuracy=70.017857 loss=1.172131 lr=0.008984 Epoch[020] Batch [2499]/[3759] Speed: 119.053845 samples/sec accuracy=70.007500 loss=1.172656 lr=0.008982 Epoch[020] Batch [2549]/[3759] Speed: 132.653122 samples/sec accuracy=70.009804 loss=1.172902 lr=0.008981 Epoch[020] Batch [2599]/[3759] Speed: 117.442307 samples/sec accuracy=69.996394 loss=1.173866 lr=0.008980 Epoch[020] Batch [2649]/[3759] Speed: 131.950842 samples/sec accuracy=69.967571 loss=1.174975 lr=0.008979 Epoch[020] Batch [2699]/[3759] Speed: 126.689498 samples/sec accuracy=69.953125 loss=1.176157 lr=0.008977 Epoch[020] Batch [2749]/[3759] Speed: 121.520141 samples/sec accuracy=69.960227 loss=1.176482 lr=0.008976 Epoch[020] Batch [2799]/[3759] Speed: 124.905454 samples/sec accuracy=69.959263 loss=1.175747 lr=0.008975 Epoch[020] Batch [2849]/[3759] Speed: 126.726355 samples/sec accuracy=69.935307 loss=1.176702 lr=0.008974 Epoch[020] Batch [2899]/[3759] Speed: 122.273827 samples/sec accuracy=69.921336 loss=1.176885 lr=0.008972 Epoch[020] Batch [2949]/[3759] Speed: 128.197830 samples/sec accuracy=69.928496 loss=1.177357 lr=0.008971 Epoch[020] Batch [2999]/[3759] Speed: 120.734778 samples/sec accuracy=69.906771 loss=1.178029 lr=0.008970 Epoch[020] Batch [3049]/[3759] Speed: 132.880784 samples/sec accuracy=69.879611 loss=1.179009 lr=0.008969 Epoch[020] Batch [3099]/[3759] Speed: 120.530738 samples/sec accuracy=69.873488 loss=1.179011 lr=0.008967 Epoch[020] Batch [3149]/[3759] Speed: 125.188847 samples/sec accuracy=69.873016 loss=1.179082 lr=0.008966 Epoch[020] Batch [3199]/[3759] Speed: 129.450837 samples/sec accuracy=69.853516 loss=1.179938 lr=0.008965 Epoch[020] Batch [3249]/[3759] Speed: 118.430930 samples/sec accuracy=69.842788 loss=1.180160 lr=0.008963 Epoch[020] Batch [3299]/[3759] Speed: 129.419221 samples/sec accuracy=69.827178 loss=1.180450 lr=0.008962 Epoch[020] Batch [3349]/[3759] Speed: 127.532507 samples/sec accuracy=69.823228 loss=1.180425 lr=0.008961 Epoch[020] Batch [3399]/[3759] Speed: 125.033893 samples/sec accuracy=69.792279 loss=1.181626 lr=0.008960 Epoch[020] Batch [3449]/[3759] Speed: 125.335316 samples/sec accuracy=69.758152 loss=1.182650 lr=0.008958 Epoch[020] Batch [3499]/[3759] Speed: 124.836281 samples/sec accuracy=69.749107 loss=1.183460 lr=0.008957 Epoch[020] Batch [3549]/[3759] Speed: 126.362893 samples/sec accuracy=69.744718 loss=1.183999 lr=0.008956 Epoch[020] Batch [3599]/[3759] Speed: 126.150415 samples/sec accuracy=69.731771 loss=1.184423 lr=0.008955 Epoch[020] Batch [3649]/[3759] Speed: 123.151835 samples/sec accuracy=69.729024 loss=1.184790 lr=0.008953 Epoch[020] Batch [3699]/[3759] Speed: 123.550556 samples/sec accuracy=69.721284 loss=1.184925 lr=0.008952 Epoch[020] Batch [3749]/[3759] Speed: 146.086309 samples/sec accuracy=69.712917 loss=1.185418 lr=0.008951 Batch [0049]/[0303]: acc-top1=61.906250 acc-top5=83.562500 Batch [0099]/[0303]: acc-top1=61.656250 acc-top5=83.406250 Batch [0149]/[0303]: acc-top1=61.489583 acc-top5=83.197917 Batch [0199]/[0303]: acc-top1=60.968750 acc-top5=83.054688 Batch [0249]/[0303]: acc-top1=61.150000 acc-top5=83.031250 Batch [0299]/[0303]: acc-top1=61.109375 acc-top5=83.156250 [Epoch 020] training: accuracy=69.709364 loss=1.185479 [Epoch 020] speed: 124 samples/sec time cost: 2114.330677 [Epoch 020] validation: acc-top1=61.087046 acc-top5=83.147690 loss=2.142885 Epoch[021] Batch [0049]/[3760] Speed: 91.018785 samples/sec accuracy=71.500000 loss=1.128092 lr=0.008949 Epoch[021] Batch [0099]/[3760] Speed: 127.681436 samples/sec accuracy=70.843750 loss=1.139206 lr=0.008948 Epoch[021] Batch [0149]/[3760] Speed: 121.186220 samples/sec accuracy=71.135417 loss=1.121678 lr=0.008947 Epoch[021] Batch [0199]/[3760] Speed: 125.600103 samples/sec accuracy=70.859375 loss=1.127286 lr=0.008945 Epoch[021] Batch [0249]/[3760] Speed: 124.680530 samples/sec accuracy=70.700000 loss=1.134333 lr=0.008944 Epoch[021] Batch [0299]/[3760] Speed: 131.612903 samples/sec accuracy=70.609375 loss=1.133956 lr=0.008943 Epoch[021] Batch [0349]/[3760] Speed: 121.663549 samples/sec accuracy=70.883929 loss=1.127930 lr=0.008941 Epoch[021] Batch [0399]/[3760] Speed: 123.988227 samples/sec accuracy=70.597656 loss=1.137475 lr=0.008940 Epoch[021] Batch [0449]/[3760] Speed: 124.211674 samples/sec accuracy=70.576389 loss=1.132782 lr=0.008939 Epoch[021] Batch [0499]/[3760] Speed: 123.294065 samples/sec accuracy=70.553125 loss=1.135445 lr=0.008938 Epoch[021] Batch [0549]/[3760] Speed: 127.170473 samples/sec accuracy=70.548295 loss=1.135540 lr=0.008936 Epoch[021] Batch [0599]/[3760] Speed: 120.907062 samples/sec accuracy=70.533854 loss=1.138929 lr=0.008935 Epoch[021] Batch [0649]/[3760] Speed: 130.372855 samples/sec accuracy=70.569712 loss=1.138669 lr=0.008934 Epoch[021] Batch [0699]/[3760] Speed: 124.567191 samples/sec accuracy=70.511161 loss=1.140853 lr=0.008932 Epoch[021] Batch [0749]/[3760] Speed: 124.436716 samples/sec accuracy=70.493750 loss=1.142810 lr=0.008931 Epoch[021] Batch [0799]/[3760] Speed: 124.552912 samples/sec accuracy=70.482422 loss=1.143203 lr=0.008930 Epoch[021] Batch [0849]/[3760] Speed: 125.157211 samples/sec accuracy=70.426471 loss=1.144196 lr=0.008929 Epoch[021] Batch [0899]/[3760] Speed: 131.976996 samples/sec accuracy=70.467014 loss=1.142984 lr=0.008927 Epoch[021] Batch [0949]/[3760] Speed: 116.198214 samples/sec accuracy=70.452303 loss=1.143528 lr=0.008926 Epoch[021] Batch [0999]/[3760] Speed: 133.787902 samples/sec accuracy=70.409375 loss=1.144004 lr=0.008925 Epoch[021] Batch [1049]/[3760] Speed: 119.697548 samples/sec accuracy=70.377976 loss=1.145964 lr=0.008923 Epoch[021] Batch [1099]/[3760] Speed: 131.467446 samples/sec accuracy=70.376420 loss=1.145476 lr=0.008922 Epoch[021] Batch [1149]/[3760] Speed: 130.996828 samples/sec accuracy=70.300272 loss=1.148421 lr=0.008921 Epoch[021] Batch [1199]/[3760] Speed: 118.202101 samples/sec accuracy=70.302083 loss=1.148182 lr=0.008919 Epoch[021] Batch [1249]/[3760] Speed: 130.367011 samples/sec accuracy=70.306250 loss=1.149691 lr=0.008918 Epoch[021] Batch [1299]/[3760] Speed: 120.882639 samples/sec accuracy=70.326923 loss=1.149543 lr=0.008917 Epoch[021] Batch [1349]/[3760] Speed: 130.729475 samples/sec accuracy=70.300926 loss=1.150532 lr=0.008916 Epoch[021] Batch [1399]/[3760] Speed: 124.153652 samples/sec accuracy=70.322545 loss=1.149954 lr=0.008914 Epoch[021] Batch [1449]/[3760] Speed: 119.343767 samples/sec accuracy=70.295259 loss=1.152288 lr=0.008913 Epoch[021] Batch [1499]/[3760] Speed: 129.563615 samples/sec accuracy=70.269792 loss=1.154042 lr=0.008912 Epoch[021] Batch [1549]/[3760] Speed: 126.361331 samples/sec accuracy=70.259073 loss=1.155336 lr=0.008910 Epoch[021] Batch [1599]/[3760] Speed: 124.514233 samples/sec accuracy=70.254883 loss=1.154978 lr=0.008909 Epoch[021] Batch [1649]/[3760] Speed: 123.403049 samples/sec accuracy=70.193182 loss=1.157714 lr=0.008908 Epoch[021] Batch [1699]/[3760] Speed: 130.479534 samples/sec accuracy=70.217831 loss=1.157231 lr=0.008906 Epoch[021] Batch [1749]/[3760] Speed: 120.236111 samples/sec accuracy=70.239286 loss=1.155991 lr=0.008905 Epoch[021] Batch [1799]/[3760] Speed: 125.112178 samples/sec accuracy=70.263021 loss=1.154480 lr=0.008904 Epoch[021] Batch [1849]/[3760] Speed: 127.838048 samples/sec accuracy=70.267736 loss=1.155141 lr=0.008903 Epoch[021] Batch [1899]/[3760] Speed: 124.200089 samples/sec accuracy=70.253289 loss=1.155339 lr=0.008901 Epoch[021] Batch [1949]/[3760] Speed: 119.812959 samples/sec accuracy=70.241186 loss=1.155803 lr=0.008900 Epoch[021] Batch [1999]/[3760] Speed: 132.222689 samples/sec accuracy=70.214062 loss=1.156088 lr=0.008899 Epoch[021] Batch [2049]/[3760] Speed: 115.534127 samples/sec accuracy=70.259909 loss=1.155854 lr=0.008897 Epoch[021] Batch [2099]/[3760] Speed: 129.761575 samples/sec accuracy=70.247768 loss=1.156391 lr=0.008896 Epoch[021] Batch [2149]/[3760] Speed: 131.190301 samples/sec accuracy=70.291424 loss=1.155591 lr=0.008895 Epoch[021] Batch [2199]/[3760] Speed: 123.485464 samples/sec accuracy=70.296165 loss=1.155338 lr=0.008893 Epoch[021] Batch [2249]/[3760] Speed: 123.872278 samples/sec accuracy=70.282639 loss=1.155610 lr=0.008892 Epoch[021] Batch [2299]/[3760] Speed: 123.907418 samples/sec accuracy=70.245924 loss=1.156676 lr=0.008891 Epoch[021] Batch [2349]/[3760] Speed: 121.839823 samples/sec accuracy=70.290559 loss=1.155779 lr=0.008889 Epoch[021] Batch [2399]/[3760] Speed: 132.049316 samples/sec accuracy=70.258464 loss=1.156801 lr=0.008888 Epoch[021] Batch [2449]/[3760] Speed: 119.269423 samples/sec accuracy=70.248087 loss=1.157570 lr=0.008887 Epoch[021] Batch [2499]/[3760] Speed: 126.870603 samples/sec accuracy=70.225000 loss=1.157623 lr=0.008886 Epoch[021] Batch [2549]/[3760] Speed: 129.308933 samples/sec accuracy=70.226103 loss=1.158159 lr=0.008884 Epoch[021] Batch [2599]/[3760] Speed: 118.905971 samples/sec accuracy=70.210938 loss=1.158440 lr=0.008883 Epoch[021] Batch [2649]/[3760] Speed: 131.964381 samples/sec accuracy=70.182783 loss=1.159723 lr=0.008882 Epoch[021] Batch [2699]/[3760] Speed: 126.960538 samples/sec accuracy=70.157986 loss=1.160653 lr=0.008880 Epoch[021] Batch [2749]/[3760] Speed: 125.384805 samples/sec accuracy=70.145455 loss=1.161263 lr=0.008879 Epoch[021] Batch [2799]/[3760] Speed: 118.299253 samples/sec accuracy=70.127790 loss=1.161764 lr=0.008878 Epoch[021] Batch [2849]/[3760] Speed: 125.573652 samples/sec accuracy=70.118969 loss=1.162749 lr=0.008876 Epoch[021] Batch [2899]/[3760] Speed: 131.835429 samples/sec accuracy=70.099677 loss=1.163547 lr=0.008875 Epoch[021] Batch [2949]/[3760] Speed: 124.637121 samples/sec accuracy=70.062500 loss=1.164428 lr=0.008874 Epoch[021] Batch [2999]/[3760] Speed: 122.345899 samples/sec accuracy=70.070833 loss=1.164348 lr=0.008872 Epoch[021] Batch [3049]/[3760] Speed: 126.426197 samples/sec accuracy=70.053791 loss=1.165149 lr=0.008871 Epoch[021] Batch [3099]/[3760] Speed: 131.309076 samples/sec accuracy=70.054940 loss=1.165638 lr=0.008870 Epoch[021] Batch [3149]/[3760] Speed: 120.186890 samples/sec accuracy=70.055556 loss=1.165650 lr=0.008868 Epoch[021] Batch [3199]/[3760] Speed: 125.344935 samples/sec accuracy=70.043457 loss=1.166183 lr=0.008867 Epoch[021] Batch [3249]/[3760] Speed: 122.403940 samples/sec accuracy=70.027404 loss=1.166969 lr=0.008866 Epoch[021] Batch [3299]/[3760] Speed: 131.524729 samples/sec accuracy=70.019886 loss=1.167181 lr=0.008864 Epoch[021] Batch [3349]/[3760] Speed: 119.693053 samples/sec accuracy=70.016791 loss=1.167131 lr=0.008863 Epoch[021] Batch [3399]/[3760] Speed: 124.652866 samples/sec accuracy=70.000919 loss=1.167339 lr=0.008862 Epoch[021] Batch [3449]/[3760] Speed: 128.895011 samples/sec accuracy=69.979620 loss=1.167930 lr=0.008860 Epoch[021] Batch [3499]/[3760] Speed: 124.664320 samples/sec accuracy=69.971875 loss=1.168582 lr=0.008859 Epoch[021] Batch [3549]/[3760] Speed: 121.349572 samples/sec accuracy=69.968310 loss=1.168778 lr=0.008858 Epoch[021] Batch [3599]/[3760] Speed: 127.784273 samples/sec accuracy=69.971788 loss=1.168347 lr=0.008856 Epoch[021] Batch [3649]/[3760] Speed: 122.889237 samples/sec accuracy=69.966182 loss=1.168757 lr=0.008855 Epoch[021] Batch [3699]/[3760] Speed: 126.623302 samples/sec accuracy=69.957770 loss=1.168913 lr=0.008854 Epoch[021] Batch [3749]/[3760] Speed: 144.464521 samples/sec accuracy=69.943333 loss=1.169404 lr=0.008852 Batch [0049]/[0303]: acc-top1=61.875000 acc-top5=85.093750 Batch [0099]/[0303]: acc-top1=62.171875 acc-top5=84.609375 Batch [0149]/[0303]: acc-top1=62.250000 acc-top5=84.187500 Batch [0199]/[0303]: acc-top1=61.820312 acc-top5=83.781250 Batch [0249]/[0303]: acc-top1=61.831250 acc-top5=83.750000 Batch [0299]/[0303]: acc-top1=61.656250 acc-top5=83.692708 [Epoch 021] training: accuracy=69.940160 loss=1.169753 [Epoch 021] speed: 124 samples/sec time cost: 2115.270414 [Epoch 021] validation: acc-top1=61.592409 acc-top5=83.632426 loss=2.137051 Epoch[022] Batch [0049]/[3760] Speed: 87.574066 samples/sec accuracy=70.218750 loss=1.148836 lr=0.008851 Epoch[022] Batch [0099]/[3760] Speed: 133.155861 samples/sec accuracy=70.609375 loss=1.131799 lr=0.008850 Epoch[022] Batch [0149]/[3760] Speed: 121.542789 samples/sec accuracy=71.166667 loss=1.116056 lr=0.008848 Epoch[022] Batch [0199]/[3760] Speed: 125.528048 samples/sec accuracy=71.492188 loss=1.110595 lr=0.008847 Epoch[022] Batch [0249]/[3760] Speed: 125.726661 samples/sec accuracy=71.437500 loss=1.111833 lr=0.008846 Epoch[022] Batch [0299]/[3760] Speed: 122.271958 samples/sec accuracy=71.328125 loss=1.115094 lr=0.008844 Epoch[022] Batch [0349]/[3760] Speed: 123.803612 samples/sec accuracy=71.348214 loss=1.115700 lr=0.008843 Epoch[022] Batch [0399]/[3760] Speed: 119.896334 samples/sec accuracy=71.273438 loss=1.121126 lr=0.008842 Epoch[022] Batch [0449]/[3760] Speed: 129.413588 samples/sec accuracy=71.208333 loss=1.120661 lr=0.008840 Epoch[022] Batch [0499]/[3760] Speed: 126.254992 samples/sec accuracy=71.196875 loss=1.119564 lr=0.008839 Epoch[022] Batch [0549]/[3760] Speed: 126.789729 samples/sec accuracy=71.150568 loss=1.121013 lr=0.008837 Epoch[022] Batch [0599]/[3760] Speed: 116.733986 samples/sec accuracy=71.140625 loss=1.121839 lr=0.008836 Epoch[022] Batch [0649]/[3760] Speed: 133.436121 samples/sec accuracy=71.057692 loss=1.125404 lr=0.008835 Epoch[022] Batch [0699]/[3760] Speed: 125.082817 samples/sec accuracy=71.031250 loss=1.124936 lr=0.008833 Epoch[022] Batch [0749]/[3760] Speed: 124.179032 samples/sec accuracy=71.012500 loss=1.126294 lr=0.008832 Epoch[022] Batch [0799]/[3760] Speed: 125.589199 samples/sec accuracy=70.923828 loss=1.129553 lr=0.008831 Epoch[022] Batch [0849]/[3760] Speed: 120.604064 samples/sec accuracy=70.961397 loss=1.129110 lr=0.008829 Epoch[022] Batch [0899]/[3760] Speed: 129.631524 samples/sec accuracy=71.000000 loss=1.128222 lr=0.008828 Epoch[022] Batch [0949]/[3760] Speed: 126.068495 samples/sec accuracy=70.985197 loss=1.129319 lr=0.008827 Epoch[022] Batch [0999]/[3760] Speed: 122.808274 samples/sec accuracy=71.045313 loss=1.127696 lr=0.008825 Epoch[022] Batch [1049]/[3760] Speed: 129.007498 samples/sec accuracy=71.069940 loss=1.126798 lr=0.008824 Epoch[022] Batch [1099]/[3760] Speed: 116.248637 samples/sec accuracy=71.035511 loss=1.127682 lr=0.008823 Epoch[022] Batch [1149]/[3760] Speed: 132.149522 samples/sec accuracy=70.989130 loss=1.128588 lr=0.008821 Epoch[022] Batch [1199]/[3760] Speed: 128.109000 samples/sec accuracy=70.962240 loss=1.128465 lr=0.008820 Epoch[022] Batch [1249]/[3760] Speed: 120.368433 samples/sec accuracy=70.947500 loss=1.128839 lr=0.008819 Epoch[022] Batch [1299]/[3760] Speed: 132.505675 samples/sec accuracy=70.971154 loss=1.128749 lr=0.008817 Epoch[022] Batch [1349]/[3760] Speed: 116.677717 samples/sec accuracy=70.954861 loss=1.130140 lr=0.008816 Epoch[022] Batch [1399]/[3760] Speed: 133.922759 samples/sec accuracy=70.956473 loss=1.129749 lr=0.008815 Epoch[022] Batch [1449]/[3760] Speed: 122.779465 samples/sec accuracy=70.908405 loss=1.132046 lr=0.008813 Epoch[022] Batch [1499]/[3760] Speed: 125.053852 samples/sec accuracy=70.929167 loss=1.131857 lr=0.008812 Epoch[022] Batch [1549]/[3760] Speed: 127.314123 samples/sec accuracy=70.948589 loss=1.132195 lr=0.008811 Epoch[022] Batch [1599]/[3760] Speed: 122.654182 samples/sec accuracy=70.927734 loss=1.131911 lr=0.008809 Epoch[022] Batch [1649]/[3760] Speed: 128.289944 samples/sec accuracy=70.859848 loss=1.133652 lr=0.008808 Epoch[022] Batch [1699]/[3760] Speed: 125.957787 samples/sec accuracy=70.830882 loss=1.135157 lr=0.008807 Epoch[022] Batch [1749]/[3760] Speed: 124.504551 samples/sec accuracy=70.802679 loss=1.134918 lr=0.008805 Epoch[022] Batch [1799]/[3760] Speed: 128.642862 samples/sec accuracy=70.782118 loss=1.135571 lr=0.008804 Epoch[022] Batch [1849]/[3760] Speed: 126.047429 samples/sec accuracy=70.760980 loss=1.135855 lr=0.008802 Epoch[022] Batch [1899]/[3760] Speed: 125.671098 samples/sec accuracy=70.759046 loss=1.136719 lr=0.008801 Epoch[022] Batch [1949]/[3760] Speed: 119.223243 samples/sec accuracy=70.773237 loss=1.136860 lr=0.008800 Epoch[022] Batch [1999]/[3760] Speed: 132.466152 samples/sec accuracy=70.731250 loss=1.137275 lr=0.008798 Epoch[022] Batch [2049]/[3760] Speed: 122.839135 samples/sec accuracy=70.716463 loss=1.137380 lr=0.008797 Epoch[022] Batch [2099]/[3760] Speed: 123.595802 samples/sec accuracy=70.712054 loss=1.137629 lr=0.008796 Epoch[022] Batch [2149]/[3760] Speed: 127.835680 samples/sec accuracy=70.712209 loss=1.137848 lr=0.008794 Epoch[022] Batch [2199]/[3760] Speed: 121.667409 samples/sec accuracy=70.674716 loss=1.139061 lr=0.008793 Epoch[022] Batch [2249]/[3760] Speed: 130.217880 samples/sec accuracy=70.653472 loss=1.140202 lr=0.008792 Epoch[022] Batch [2299]/[3760] Speed: 119.922580 samples/sec accuracy=70.676630 loss=1.139627 lr=0.008790 Epoch[022] Batch [2349]/[3760] Speed: 130.677793 samples/sec accuracy=70.640957 loss=1.139916 lr=0.008789 Epoch[022] Batch [2399]/[3760] Speed: 122.241516 samples/sec accuracy=70.617839 loss=1.140899 lr=0.008787 Epoch[022] Batch [2449]/[3760] Speed: 123.963155 samples/sec accuracy=70.606505 loss=1.141756 lr=0.008786 Epoch[022] Batch [2499]/[3760] Speed: 131.639474 samples/sec accuracy=70.587500 loss=1.142536 lr=0.008785 Epoch[022] Batch [2549]/[3760] Speed: 117.704322 samples/sec accuracy=70.572917 loss=1.143241 lr=0.008783 Epoch[022] Batch [2599]/[3760] Speed: 133.481166 samples/sec accuracy=70.577524 loss=1.143093 lr=0.008782 Epoch[022] Batch [2649]/[3760] Speed: 119.517756 samples/sec accuracy=70.570755 loss=1.143052 lr=0.008781 Epoch[022] Batch [2699]/[3760] Speed: 124.799001 samples/sec accuracy=70.548611 loss=1.143654 lr=0.008779 Epoch[022] Batch [2749]/[3760] Speed: 132.045937 samples/sec accuracy=70.513068 loss=1.144824 lr=0.008778 Epoch[022] Batch [2799]/[3760] Speed: 118.520168 samples/sec accuracy=70.510045 loss=1.145098 lr=0.008777 Epoch[022] Batch [2849]/[3760] Speed: 132.255653 samples/sec accuracy=70.504386 loss=1.145396 lr=0.008775 Epoch[022] Batch [2899]/[3760] Speed: 117.659383 samples/sec accuracy=70.493534 loss=1.145970 lr=0.008774 Epoch[022] Batch [2949]/[3760] Speed: 128.339089 samples/sec accuracy=70.482521 loss=1.146085 lr=0.008772 Epoch[022] Batch [2999]/[3760] Speed: 125.099803 samples/sec accuracy=70.456771 loss=1.146760 lr=0.008771 Epoch[022] Batch [3049]/[3760] Speed: 127.204522 samples/sec accuracy=70.433402 loss=1.147637 lr=0.008770 Epoch[022] Batch [3099]/[3760] Speed: 126.598950 samples/sec accuracy=70.389617 loss=1.148609 lr=0.008768 Epoch[022] Batch [3149]/[3760] Speed: 125.570970 samples/sec accuracy=70.384425 loss=1.149322 lr=0.008767 Epoch[022] Batch [3199]/[3760] Speed: 126.700622 samples/sec accuracy=70.362793 loss=1.149710 lr=0.008766 Epoch[022] Batch [3249]/[3760] Speed: 121.169792 samples/sec accuracy=70.362500 loss=1.150056 lr=0.008764 Epoch[022] Batch [3299]/[3760] Speed: 129.335676 samples/sec accuracy=70.337121 loss=1.150731 lr=0.008763 Epoch[022] Batch [3349]/[3760] Speed: 119.212533 samples/sec accuracy=70.326959 loss=1.151147 lr=0.008761 Epoch[022] Batch [3399]/[3760] Speed: 129.955301 samples/sec accuracy=70.306526 loss=1.151919 lr=0.008760 Epoch[022] Batch [3449]/[3760] Speed: 123.726931 samples/sec accuracy=70.279891 loss=1.152773 lr=0.008759 Epoch[022] Batch [3499]/[3760] Speed: 122.909562 samples/sec accuracy=70.265179 loss=1.153708 lr=0.008757 Epoch[022] Batch [3549]/[3760] Speed: 130.798933 samples/sec accuracy=70.248680 loss=1.154055 lr=0.008756 Epoch[022] Batch [3599]/[3760] Speed: 118.227583 samples/sec accuracy=70.230469 loss=1.154897 lr=0.008755 Epoch[022] Batch [3649]/[3760] Speed: 130.131972 samples/sec accuracy=70.214469 loss=1.155714 lr=0.008753 Epoch[022] Batch [3699]/[3760] Speed: 122.971256 samples/sec accuracy=70.203547 loss=1.156177 lr=0.008752 Epoch[022] Batch [3749]/[3760] Speed: 142.213221 samples/sec accuracy=70.204583 loss=1.156654 lr=0.008750 Batch [0049]/[0303]: acc-top1=61.468750 acc-top5=85.625000 Batch [0099]/[0303]: acc-top1=61.468750 acc-top5=84.828125 Batch [0149]/[0303]: acc-top1=61.593750 acc-top5=84.437500 Batch [0199]/[0303]: acc-top1=61.343750 acc-top5=84.156250 Batch [0249]/[0303]: acc-top1=61.537500 acc-top5=84.131250 Batch [0299]/[0303]: acc-top1=61.567708 acc-top5=84.203125 [Epoch 022] training: accuracy=70.206533 loss=1.156652 [Epoch 022] speed: 124 samples/sec time cost: 2116.123441 [Epoch 022] validation: acc-top1=61.530528 acc-top5=84.132632 loss=2.123213 Epoch[023] Batch [0049]/[3759] Speed: 89.671064 samples/sec accuracy=71.093750 loss=1.126439 lr=0.008749 Epoch[023] Batch [0099]/[3759] Speed: 127.922153 samples/sec accuracy=71.218750 loss=1.115628 lr=0.008747 Epoch[023] Batch [0149]/[3759] Speed: 123.953970 samples/sec accuracy=71.645833 loss=1.101351 lr=0.008746 Epoch[023] Batch [0199]/[3759] Speed: 125.395554 samples/sec accuracy=72.007812 loss=1.097012 lr=0.008745 Epoch[023] Batch [0249]/[3759] Speed: 128.676125 samples/sec accuracy=71.931250 loss=1.091000 lr=0.008743 Epoch[023] Batch [0299]/[3759] Speed: 119.325618 samples/sec accuracy=72.052083 loss=1.088064 lr=0.008742 Epoch[023] Batch [0349]/[3759] Speed: 130.211642 samples/sec accuracy=72.008929 loss=1.092022 lr=0.008740 Epoch[023] Batch [0399]/[3759] Speed: 120.991414 samples/sec accuracy=71.933594 loss=1.091390 lr=0.008739 Epoch[023] Batch [0449]/[3759] Speed: 128.306055 samples/sec accuracy=72.072917 loss=1.087617 lr=0.008738 Epoch[023] Batch [0499]/[3759] Speed: 126.088455 samples/sec accuracy=72.031250 loss=1.087423 lr=0.008736 Epoch[023] Batch [0549]/[3759] Speed: 121.033999 samples/sec accuracy=72.019886 loss=1.086287 lr=0.008735 Epoch[023] Batch [0599]/[3759] Speed: 132.174601 samples/sec accuracy=71.934896 loss=1.089407 lr=0.008734 Epoch[023] Batch [0649]/[3759] Speed: 120.337405 samples/sec accuracy=71.805288 loss=1.092665 lr=0.008732 Epoch[023] Batch [0699]/[3759] Speed: 131.799567 samples/sec accuracy=71.761161 loss=1.092404 lr=0.008731 Epoch[023] Batch [0749]/[3759] Speed: 120.418937 samples/sec accuracy=71.658333 loss=1.095346 lr=0.008729 Epoch[023] Batch [0799]/[3759] Speed: 126.889250 samples/sec accuracy=71.605469 loss=1.099773 lr=0.008728 Epoch[023] Batch [0849]/[3759] Speed: 131.645443 samples/sec accuracy=71.511029 loss=1.102363 lr=0.008727 Epoch[023] Batch [0899]/[3759] Speed: 120.281652 samples/sec accuracy=71.475694 loss=1.104099 lr=0.008725 Epoch[023] Batch [0949]/[3759] Speed: 127.211107 samples/sec accuracy=71.432566 loss=1.106342 lr=0.008724 Epoch[023] Batch [0999]/[3759] Speed: 120.557097 samples/sec accuracy=71.412500 loss=1.106843 lr=0.008722 Epoch[023] Batch [1049]/[3759] Speed: 132.504665 samples/sec accuracy=71.306548 loss=1.110634 lr=0.008721 Epoch[023] Batch [1099]/[3759] Speed: 112.748797 samples/sec accuracy=71.251420 loss=1.113204 lr=0.008720 Epoch[023] Batch [1149]/[3759] Speed: 133.654011 samples/sec accuracy=71.222826 loss=1.113502 lr=0.008718 Epoch[023] Batch [1199]/[3759] Speed: 132.262939 samples/sec accuracy=71.201823 loss=1.114512 lr=0.008717 Epoch[023] Batch [1249]/[3759] Speed: 114.532381 samples/sec accuracy=71.205000 loss=1.114346 lr=0.008715 Epoch[023] Batch [1299]/[3759] Speed: 134.350364 samples/sec accuracy=71.161058 loss=1.116264 lr=0.008714 Epoch[023] Batch [1349]/[3759] Speed: 116.631176 samples/sec accuracy=71.148148 loss=1.116123 lr=0.008713 Epoch[023] Batch [1399]/[3759] Speed: 130.536554 samples/sec accuracy=71.098214 loss=1.117688 lr=0.008711 Epoch[023] Batch [1449]/[3759] Speed: 124.789808 samples/sec accuracy=71.075431 loss=1.118828 lr=0.008710 Epoch[023] Batch [1499]/[3759] Speed: 122.279209 samples/sec accuracy=71.095833 loss=1.118322 lr=0.008708 Epoch[023] Batch [1549]/[3759] Speed: 129.913327 samples/sec accuracy=71.053427 loss=1.120410 lr=0.008707 Epoch[023] Batch [1599]/[3759] Speed: 124.838157 samples/sec accuracy=71.068359 loss=1.120696 lr=0.008706 Epoch[023] Batch [1649]/[3759] Speed: 123.842013 samples/sec accuracy=71.052083 loss=1.121389 lr=0.008704 Epoch[023] Batch [1699]/[3759] Speed: 133.542605 samples/sec accuracy=71.026654 loss=1.123600 lr=0.008703 Epoch[023] Batch [1749]/[3759] Speed: 113.450657 samples/sec accuracy=71.029464 loss=1.123038 lr=0.008701 Epoch[023] Batch [1799]/[3759] Speed: 136.306310 samples/sec accuracy=71.010417 loss=1.123422 lr=0.008700 Epoch[023] Batch [1849]/[3759] Speed: 129.143443 samples/sec accuracy=70.952703 loss=1.124800 lr=0.008699 Epoch[023] Batch [1899]/[3759] Speed: 120.351846 samples/sec accuracy=70.958882 loss=1.126054 lr=0.008697 Epoch[023] Batch [1949]/[3759] Speed: 129.987211 samples/sec accuracy=70.963141 loss=1.125738 lr=0.008696 Epoch[023] Batch [1999]/[3759] Speed: 124.700009 samples/sec accuracy=70.954688 loss=1.126395 lr=0.008694 Epoch[023] Batch [2049]/[3759] Speed: 121.239245 samples/sec accuracy=70.950457 loss=1.127632 lr=0.008693 Epoch[023] Batch [2099]/[3759] Speed: 127.279797 samples/sec accuracy=70.950893 loss=1.127407 lr=0.008692 Epoch[023] Batch [2149]/[3759] Speed: 132.275444 samples/sec accuracy=70.924419 loss=1.128797 lr=0.008690 Epoch[023] Batch [2199]/[3759] Speed: 122.621604 samples/sec accuracy=70.898438 loss=1.129675 lr=0.008689 Epoch[023] Batch [2249]/[3759] Speed: 123.977130 samples/sec accuracy=70.902778 loss=1.130182 lr=0.008687 Epoch[023] Batch [2299]/[3759] Speed: 126.340580 samples/sec accuracy=70.894022 loss=1.130498 lr=0.008686 Epoch[023] Batch [2349]/[3759] Speed: 125.528192 samples/sec accuracy=70.878324 loss=1.131692 lr=0.008684 Epoch[023] Batch [2399]/[3759] Speed: 119.105785 samples/sec accuracy=70.865885 loss=1.132045 lr=0.008683 Epoch[023] Batch [2449]/[3759] Speed: 134.008435 samples/sec accuracy=70.876276 loss=1.131899 lr=0.008682 Epoch[023] Batch [2499]/[3759] Speed: 121.382097 samples/sec accuracy=70.851875 loss=1.132919 lr=0.008680 Epoch[023] Batch [2549]/[3759] Speed: 125.301060 samples/sec accuracy=70.813113 loss=1.133967 lr=0.008679 Epoch[023] Batch [2599]/[3759] Speed: 130.689934 samples/sec accuracy=70.832933 loss=1.133184 lr=0.008677 Epoch[023] Batch [2649]/[3759] Speed: 120.986825 samples/sec accuracy=70.818986 loss=1.133902 lr=0.008676 Epoch[023] Batch [2699]/[3759] Speed: 128.768984 samples/sec accuracy=70.789352 loss=1.134825 lr=0.008675 Epoch[023] Batch [2749]/[3759] Speed: 128.622399 samples/sec accuracy=70.773864 loss=1.136014 lr=0.008673 Epoch[023] Batch [2799]/[3759] Speed: 121.850278 samples/sec accuracy=70.757812 loss=1.136626 lr=0.008672 Epoch[023] Batch [2849]/[3759] Speed: 125.990681 samples/sec accuracy=70.717654 loss=1.137518 lr=0.008670 Epoch[023] Batch [2899]/[3759] Speed: 131.194516 samples/sec accuracy=70.696659 loss=1.137977 lr=0.008669 Epoch[023] Batch [2949]/[3759] Speed: 122.629086 samples/sec accuracy=70.682203 loss=1.138493 lr=0.008667 Epoch[023] Batch [2999]/[3759] Speed: 126.219365 samples/sec accuracy=70.649479 loss=1.139689 lr=0.008666 Epoch[023] Batch [3049]/[3759] Speed: 124.270288 samples/sec accuracy=70.661885 loss=1.139645 lr=0.008665 Epoch[023] Batch [3099]/[3759] Speed: 122.708497 samples/sec accuracy=70.644153 loss=1.140381 lr=0.008663 Epoch[023] Batch [3149]/[3759] Speed: 131.226944 samples/sec accuracy=70.625000 loss=1.140850 lr=0.008662 Epoch[023] Batch [3199]/[3759] Speed: 123.745007 samples/sec accuracy=70.608398 loss=1.141972 lr=0.008660 Epoch[023] Batch [3249]/[3759] Speed: 126.624591 samples/sec accuracy=70.582692 loss=1.143101 lr=0.008659 Epoch[023] Batch [3299]/[3759] Speed: 131.208253 samples/sec accuracy=70.553977 loss=1.144667 lr=0.008658 Epoch[023] Batch [3349]/[3759] Speed: 114.351375 samples/sec accuracy=70.527519 loss=1.145862 lr=0.008656 Epoch[023] Batch [3399]/[3759] Speed: 132.011400 samples/sec accuracy=70.512868 loss=1.145984 lr=0.008655 Epoch[023] Batch [3449]/[3759] Speed: 123.329985 samples/sec accuracy=70.480072 loss=1.147302 lr=0.008653 Epoch[023] Batch [3499]/[3759] Speed: 129.783988 samples/sec accuracy=70.477232 loss=1.147551 lr=0.008652 Epoch[023] Batch [3549]/[3759] Speed: 123.282528 samples/sec accuracy=70.470070 loss=1.147868 lr=0.008650 Epoch[023] Batch [3599]/[3759] Speed: 126.948449 samples/sec accuracy=70.442274 loss=1.149247 lr=0.008649 Epoch[023] Batch [3649]/[3759] Speed: 129.788381 samples/sec accuracy=70.431507 loss=1.149617 lr=0.008648 Epoch[023] Batch [3699]/[3759] Speed: 119.859115 samples/sec accuracy=70.416385 loss=1.150246 lr=0.008646 Epoch[023] Batch [3749]/[3759] Speed: 147.577388 samples/sec accuracy=70.414583 loss=1.150387 lr=0.008645 Batch [0049]/[0303]: acc-top1=61.281250 acc-top5=84.500000 Batch [0099]/[0303]: acc-top1=61.750000 acc-top5=84.187500 Batch [0149]/[0303]: acc-top1=61.593750 acc-top5=84.083333 Batch [0199]/[0303]: acc-top1=61.078125 acc-top5=83.750000 Batch [0249]/[0303]: acc-top1=61.193750 acc-top5=83.837500 Batch [0299]/[0303]: acc-top1=61.052083 acc-top5=83.750000 [Epoch 023] training: accuracy=70.416833 loss=1.150143 [Epoch 023] speed: 125 samples/sec time cost: 2109.746668 [Epoch 023] validation: acc-top1=61.025165 acc-top5=83.683993 loss=2.255448 Epoch[024] Batch [0049]/[3760] Speed: 89.545919 samples/sec accuracy=72.531250 loss=1.056427 lr=0.008643 Epoch[024] Batch [0099]/[3760] Speed: 129.427595 samples/sec accuracy=71.937500 loss=1.078401 lr=0.008642 Epoch[024] Batch [0149]/[3760] Speed: 125.265258 samples/sec accuracy=71.333333 loss=1.099436 lr=0.008640 Epoch[024] Batch [0199]/[3760] Speed: 119.569578 samples/sec accuracy=71.359375 loss=1.092287 lr=0.008639 Epoch[024] Batch [0249]/[3760] Speed: 131.869862 samples/sec accuracy=71.262500 loss=1.097186 lr=0.008637 Epoch[024] Batch [0299]/[3760] Speed: 122.279547 samples/sec accuracy=71.572917 loss=1.092753 lr=0.008636 Epoch[024] Batch [0349]/[3760] Speed: 124.787447 samples/sec accuracy=71.607143 loss=1.090864 lr=0.008634 Epoch[024] Batch [0399]/[3760] Speed: 129.614082 samples/sec accuracy=71.601562 loss=1.090943 lr=0.008633 Epoch[024] Batch [0449]/[3760] Speed: 121.071121 samples/sec accuracy=71.607639 loss=1.091781 lr=0.008632 Epoch[024] Batch [0499]/[3760] Speed: 126.514944 samples/sec accuracy=71.800000 loss=1.088573 lr=0.008630 Epoch[024] Batch [0549]/[3760] Speed: 126.665897 samples/sec accuracy=71.710227 loss=1.091239 lr=0.008629 Epoch[024] Batch [0599]/[3760] Speed: 123.496998 samples/sec accuracy=71.778646 loss=1.090332 lr=0.008627 Epoch[024] Batch [0649]/[3760] Speed: 126.069593 samples/sec accuracy=71.764423 loss=1.091166 lr=0.008626 Epoch[024] Batch [0699]/[3760] Speed: 125.826510 samples/sec accuracy=71.752232 loss=1.090456 lr=0.008624 Epoch[024] Batch [0749]/[3760] Speed: 126.523524 samples/sec accuracy=71.662500 loss=1.090994 lr=0.008623 Epoch[024] Batch [0799]/[3760] Speed: 126.480294 samples/sec accuracy=71.601562 loss=1.093758 lr=0.008621 Epoch[024] Batch [0849]/[3760] Speed: 124.967866 samples/sec accuracy=71.628676 loss=1.092516 lr=0.008620 Epoch[024] Batch [0899]/[3760] Speed: 127.567076 samples/sec accuracy=71.470486 loss=1.098194 lr=0.008619 Epoch[024] Batch [0949]/[3760] Speed: 123.097066 samples/sec accuracy=71.430921 loss=1.099128 lr=0.008617 Epoch[024] Batch [0999]/[3760] Speed: 133.384446 samples/sec accuracy=71.410938 loss=1.099541 lr=0.008616 Epoch[024] Batch [1049]/[3760] Speed: 120.223128 samples/sec accuracy=71.370536 loss=1.100716 lr=0.008614 Epoch[024] Batch [1099]/[3760] Speed: 126.863553 samples/sec accuracy=71.356534 loss=1.101882 lr=0.008613 Epoch[024] Batch [1149]/[3760] Speed: 121.368058 samples/sec accuracy=71.433424 loss=1.101121 lr=0.008611 Epoch[024] Batch [1199]/[3760] Speed: 128.019787 samples/sec accuracy=71.398438 loss=1.102486 lr=0.008610 Epoch[024] Batch [1249]/[3760] Speed: 129.326574 samples/sec accuracy=71.397500 loss=1.103328 lr=0.008608 Epoch[024] Batch [1299]/[3760] Speed: 122.591496 samples/sec accuracy=71.425481 loss=1.103322 lr=0.008607 Epoch[024] Batch [1349]/[3760] Speed: 127.581011 samples/sec accuracy=71.413194 loss=1.103081 lr=0.008606 Epoch[024] Batch [1399]/[3760] Speed: 123.580282 samples/sec accuracy=71.360491 loss=1.104543 lr=0.008604 Epoch[024] Batch [1449]/[3760] Speed: 126.549436 samples/sec accuracy=71.315733 loss=1.106677 lr=0.008603 Epoch[024] Batch [1499]/[3760] Speed: 130.708480 samples/sec accuracy=71.329167 loss=1.107113 lr=0.008601 Epoch[024] Batch [1549]/[3760] Speed: 127.805589 samples/sec accuracy=71.295363 loss=1.108623 lr=0.008600 Epoch[024] Batch [1599]/[3760] Speed: 124.876988 samples/sec accuracy=71.277344 loss=1.109237 lr=0.008598 Epoch[024] Batch [1649]/[3760] Speed: 121.668154 samples/sec accuracy=71.265152 loss=1.109882 lr=0.008597 Epoch[024] Batch [1699]/[3760] Speed: 126.945898 samples/sec accuracy=71.259191 loss=1.109909 lr=0.008595 Epoch[024] Batch [1749]/[3760] Speed: 132.007109 samples/sec accuracy=71.231250 loss=1.111234 lr=0.008594 Epoch[024] Batch [1799]/[3760] Speed: 118.560994 samples/sec accuracy=71.198785 loss=1.113078 lr=0.008592 Epoch[024] Batch [1849]/[3760] Speed: 130.675802 samples/sec accuracy=71.187500 loss=1.113427 lr=0.008591 Epoch[024] Batch [1899]/[3760] Speed: 126.779876 samples/sec accuracy=71.144737 loss=1.114869 lr=0.008590 Epoch[024] Batch [1949]/[3760] Speed: 127.728385 samples/sec accuracy=71.147436 loss=1.115234 lr=0.008588 Epoch[024] Batch [1999]/[3760] Speed: 123.116272 samples/sec accuracy=71.113281 loss=1.116043 lr=0.008587 Epoch[024] Batch [2049]/[3760] Speed: 132.208799 samples/sec accuracy=71.056402 loss=1.117992 lr=0.008585 Epoch[024] Batch [2099]/[3760] Speed: 118.427184 samples/sec accuracy=71.037202 loss=1.119009 lr=0.008584 Epoch[024] Batch [2149]/[3760] Speed: 128.456771 samples/sec accuracy=70.981105 loss=1.120732 lr=0.008582 Epoch[024] Batch [2199]/[3760] Speed: 120.973690 samples/sec accuracy=70.983665 loss=1.121072 lr=0.008581 Epoch[024] Batch [2249]/[3760] Speed: 126.902822 samples/sec accuracy=70.979167 loss=1.120784 lr=0.008579 Epoch[024] Batch [2299]/[3760] Speed: 125.324083 samples/sec accuracy=70.984375 loss=1.121561 lr=0.008578 Epoch[024] Batch [2349]/[3760] Speed: 121.987183 samples/sec accuracy=70.983378 loss=1.121832 lr=0.008576 Epoch[024] Batch [2399]/[3760] Speed: 136.180377 samples/sec accuracy=70.970052 loss=1.122527 lr=0.008575 Epoch[024] Batch [2449]/[3760] Speed: 115.772995 samples/sec accuracy=70.961735 loss=1.123271 lr=0.008574 Epoch[024] Batch [2499]/[3760] Speed: 131.841447 samples/sec accuracy=70.956875 loss=1.124491 lr=0.008572 Epoch[024] Batch [2549]/[3760] Speed: 129.311938 samples/sec accuracy=70.940564 loss=1.125438 lr=0.008571 Epoch[024] Batch [2599]/[3760] Speed: 118.994777 samples/sec accuracy=70.935697 loss=1.125787 lr=0.008569 Epoch[024] Batch [2649]/[3760] Speed: 129.750852 samples/sec accuracy=70.899764 loss=1.127147 lr=0.008568 Epoch[024] Batch [2699]/[3760] Speed: 120.943026 samples/sec accuracy=70.892940 loss=1.127975 lr=0.008566 Epoch[024] Batch [2749]/[3760] Speed: 130.429829 samples/sec accuracy=70.842045 loss=1.129828 lr=0.008565 Epoch[024] Batch [2799]/[3760] Speed: 126.565658 samples/sec accuracy=70.853795 loss=1.129800 lr=0.008563 Epoch[024] Batch [2849]/[3760] Speed: 121.036941 samples/sec accuracy=70.826206 loss=1.130379 lr=0.008562 Epoch[024] Batch [2899]/[3760] Speed: 129.862120 samples/sec accuracy=70.836746 loss=1.129808 lr=0.008560 Epoch[024] Batch [2949]/[3760] Speed: 124.318321 samples/sec accuracy=70.831568 loss=1.129634 lr=0.008559 Epoch[024] Batch [2999]/[3760] Speed: 125.052455 samples/sec accuracy=70.831771 loss=1.129568 lr=0.008557 Epoch[024] Batch [3049]/[3760] Speed: 118.471882 samples/sec accuracy=70.831455 loss=1.129946 lr=0.008556 Epoch[024] Batch [3099]/[3760] Speed: 133.481468 samples/sec accuracy=70.837702 loss=1.130060 lr=0.008555 Epoch[024] Batch [3149]/[3760] Speed: 122.332729 samples/sec accuracy=70.819444 loss=1.130850 lr=0.008553 Epoch[024] Batch [3199]/[3760] Speed: 125.936538 samples/sec accuracy=70.816406 loss=1.131632 lr=0.008552 Epoch[024] Batch [3249]/[3760] Speed: 129.775146 samples/sec accuracy=70.816346 loss=1.132150 lr=0.008550 Epoch[024] Batch [3299]/[3760] Speed: 117.397639 samples/sec accuracy=70.807292 loss=1.132692 lr=0.008549 Epoch[024] Batch [3349]/[3760] Speed: 134.371251 samples/sec accuracy=70.812500 loss=1.132712 lr=0.008547 Epoch[024] Batch [3399]/[3760] Speed: 121.761619 samples/sec accuracy=70.813419 loss=1.133123 lr=0.008546 Epoch[024] Batch [3449]/[3760] Speed: 125.724754 samples/sec accuracy=70.803442 loss=1.133412 lr=0.008544 Epoch[024] Batch [3499]/[3760] Speed: 129.127063 samples/sec accuracy=70.783482 loss=1.133632 lr=0.008543 Epoch[024] Batch [3549]/[3760] Speed: 118.925524 samples/sec accuracy=70.775528 loss=1.133948 lr=0.008541 Epoch[024] Batch [3599]/[3760] Speed: 127.848231 samples/sec accuracy=70.760851 loss=1.134488 lr=0.008540 Epoch[024] Batch [3649]/[3760] Speed: 121.653874 samples/sec accuracy=70.754281 loss=1.134690 lr=0.008538 Epoch[024] Batch [3699]/[3760] Speed: 133.328908 samples/sec accuracy=70.754223 loss=1.135264 lr=0.008537 Epoch[024] Batch [3749]/[3760] Speed: 140.059556 samples/sec accuracy=70.753750 loss=1.135407 lr=0.008535 Batch [0049]/[0303]: acc-top1=61.875000 acc-top5=84.750000 Batch [0099]/[0303]: acc-top1=62.078125 acc-top5=84.140625 Batch [0149]/[0303]: acc-top1=62.239583 acc-top5=84.052083 Batch [0199]/[0303]: acc-top1=61.765625 acc-top5=83.914062 Batch [0249]/[0303]: acc-top1=61.937500 acc-top5=83.850000 Batch [0299]/[0303]: acc-top1=61.776042 acc-top5=83.927083 [Epoch 024] training: accuracy=70.755485 loss=1.135474 [Epoch 024] speed: 125 samples/sec time cost: 2107.908149 [Epoch 024] validation: acc-top1=61.741955 acc-top5=83.869637 loss=2.097334 Epoch[025] Batch [0049]/[3760] Speed: 89.582358 samples/sec accuracy=74.093750 loss=1.041403 lr=0.008534 Epoch[025] Batch [0099]/[3760] Speed: 134.848031 samples/sec accuracy=73.796875 loss=1.028748 lr=0.008532 Epoch[025] Batch [0149]/[3760] Speed: 114.808227 samples/sec accuracy=73.520833 loss=1.027128 lr=0.008531 Epoch[025] Batch [0199]/[3760] Speed: 134.048920 samples/sec accuracy=73.031250 loss=1.044056 lr=0.008529 Epoch[025] Batch [0249]/[3760] Speed: 123.361644 samples/sec accuracy=72.762500 loss=1.052314 lr=0.008528 Epoch[025] Batch [0299]/[3760] Speed: 129.150918 samples/sec accuracy=72.515625 loss=1.058264 lr=0.008526 Epoch[025] Batch [0349]/[3760] Speed: 122.218699 samples/sec accuracy=72.375000 loss=1.064959 lr=0.008525 Epoch[025] Batch [0399]/[3760] Speed: 125.960461 samples/sec accuracy=72.582031 loss=1.060524 lr=0.008523 Epoch[025] Batch [0449]/[3760] Speed: 130.706849 samples/sec accuracy=72.548611 loss=1.064363 lr=0.008522 Epoch[025] Batch [0499]/[3760] Speed: 119.424841 samples/sec accuracy=72.593750 loss=1.064327 lr=0.008520 Epoch[025] Batch [0549]/[3760] Speed: 127.639207 samples/sec accuracy=72.602273 loss=1.063320 lr=0.008519 Epoch[025] Batch [0599]/[3760] Speed: 127.515275 samples/sec accuracy=72.554688 loss=1.066827 lr=0.008517 Epoch[025] Batch [0649]/[3760] Speed: 123.346902 samples/sec accuracy=72.346154 loss=1.073274 lr=0.008516 Epoch[025] Batch [0699]/[3760] Speed: 126.278475 samples/sec accuracy=72.296875 loss=1.073504 lr=0.008514 Epoch[025] Batch [0749]/[3760] Speed: 123.884552 samples/sec accuracy=72.214583 loss=1.075970 lr=0.008513 Epoch[025] Batch [0799]/[3760] Speed: 130.097153 samples/sec accuracy=72.232422 loss=1.077958 lr=0.008511 Epoch[025] Batch [0849]/[3760] Speed: 124.076046 samples/sec accuracy=72.169118 loss=1.079807 lr=0.008510 Epoch[025] Batch [0899]/[3760] Speed: 126.342893 samples/sec accuracy=72.182292 loss=1.079482 lr=0.008508 Epoch[025] Batch [0949]/[3760] Speed: 120.636782 samples/sec accuracy=72.189145 loss=1.080387 lr=0.008507 Epoch[025] Batch [0999]/[3760] Speed: 133.708062 samples/sec accuracy=72.165625 loss=1.081490 lr=0.008505 Epoch[025] Batch [1049]/[3760] Speed: 125.928213 samples/sec accuracy=72.095238 loss=1.083685 lr=0.008504 Epoch[025] Batch [1099]/[3760] Speed: 120.790809 samples/sec accuracy=72.098011 loss=1.082896 lr=0.008502 Epoch[025] Batch [1149]/[3760] Speed: 132.715882 samples/sec accuracy=72.061141 loss=1.085345 lr=0.008501 Epoch[025] Batch [1199]/[3760] Speed: 124.232056 samples/sec accuracy=71.976562 loss=1.088003 lr=0.008499 Epoch[025] Batch [1249]/[3760] Speed: 119.052573 samples/sec accuracy=71.971250 loss=1.088002 lr=0.008498 Epoch[025] Batch [1299]/[3760] Speed: 129.301987 samples/sec accuracy=71.974760 loss=1.088429 lr=0.008496 Epoch[025] Batch [1349]/[3760] Speed: 121.515676 samples/sec accuracy=71.878472 loss=1.090832 lr=0.008495 Epoch[025] Batch [1399]/[3760] Speed: 134.299131 samples/sec accuracy=71.805804 loss=1.092862 lr=0.008493 Epoch[025] Batch [1449]/[3760] Speed: 127.346677 samples/sec accuracy=71.779095 loss=1.094923 lr=0.008492 Epoch[025] Batch [1499]/[3760] Speed: 119.909767 samples/sec accuracy=71.773958 loss=1.094732 lr=0.008490 Epoch[025] Batch [1549]/[3760] Speed: 128.154468 samples/sec accuracy=71.750000 loss=1.095081 lr=0.008489 Epoch[025] Batch [1599]/[3760] Speed: 123.884035 samples/sec accuracy=71.753906 loss=1.094800 lr=0.008487 Epoch[025] Batch [1649]/[3760] Speed: 128.927112 samples/sec accuracy=71.714015 loss=1.095399 lr=0.008486 Epoch[025] Batch [1699]/[3760] Speed: 125.877569 samples/sec accuracy=71.683824 loss=1.096332 lr=0.008484 Epoch[025] Batch [1749]/[3760] Speed: 123.384025 samples/sec accuracy=71.659821 loss=1.098027 lr=0.008483 Epoch[025] Batch [1799]/[3760] Speed: 124.359997 samples/sec accuracy=71.647569 loss=1.098775 lr=0.008481 Epoch[025] Batch [1849]/[3760] Speed: 128.420105 samples/sec accuracy=71.600507 loss=1.099572 lr=0.008480 Epoch[025] Batch [1899]/[3760] Speed: 127.145152 samples/sec accuracy=71.596217 loss=1.099819 lr=0.008478 Epoch[025] Batch [1949]/[3760] Speed: 126.270363 samples/sec accuracy=71.562500 loss=1.101094 lr=0.008477 Epoch[025] Batch [1999]/[3760] Speed: 122.426683 samples/sec accuracy=71.518750 loss=1.102659 lr=0.008475 Epoch[025] Batch [2049]/[3760] Speed: 125.461894 samples/sec accuracy=71.530488 loss=1.102383 lr=0.008474 Epoch[025] Batch [2099]/[3760] Speed: 131.491794 samples/sec accuracy=71.531250 loss=1.102636 lr=0.008472 Epoch[025] Batch [2149]/[3760] Speed: 115.671384 samples/sec accuracy=71.500000 loss=1.103947 lr=0.008471 Epoch[025] Batch [2199]/[3760] Speed: 132.739516 samples/sec accuracy=71.458097 loss=1.105299 lr=0.008469 Epoch[025] Batch [2249]/[3760] Speed: 121.738512 samples/sec accuracy=71.411111 loss=1.106451 lr=0.008468 Epoch[025] Batch [2299]/[3760] Speed: 127.633994 samples/sec accuracy=71.394701 loss=1.107165 lr=0.008466 Epoch[025] Batch [2349]/[3760] Speed: 124.332199 samples/sec accuracy=71.349069 loss=1.108592 lr=0.008465 Epoch[025] Batch [2399]/[3760] Speed: 129.290271 samples/sec accuracy=71.342448 loss=1.109125 lr=0.008463 Epoch[025] Batch [2449]/[3760] Speed: 123.054170 samples/sec accuracy=71.315051 loss=1.109795 lr=0.008462 Epoch[025] Batch [2499]/[3760] Speed: 122.847735 samples/sec accuracy=71.290000 loss=1.110674 lr=0.008460 Epoch[025] Batch [2549]/[3760] Speed: 131.396067 samples/sec accuracy=71.311887 loss=1.110738 lr=0.008459 Epoch[025] Batch [2599]/[3760] Speed: 122.548180 samples/sec accuracy=71.319111 loss=1.110524 lr=0.008457 Epoch[025] Batch [2649]/[3760] Speed: 125.961677 samples/sec accuracy=71.317807 loss=1.110954 lr=0.008456 Epoch[025] Batch [2699]/[3760] Speed: 124.402969 samples/sec accuracy=71.307870 loss=1.112240 lr=0.008454 Epoch[025] Batch [2749]/[3760] Speed: 132.538649 samples/sec accuracy=71.290909 loss=1.112282 lr=0.008453 Epoch[025] Batch [2799]/[3760] Speed: 124.727592 samples/sec accuracy=71.271205 loss=1.113236 lr=0.008451 Epoch[025] Batch [2849]/[3760] Speed: 126.198783 samples/sec accuracy=71.285636 loss=1.112799 lr=0.008450 Epoch[025] Batch [2899]/[3760] Speed: 115.534291 samples/sec accuracy=71.269397 loss=1.113007 lr=0.008448 Epoch[025] Batch [2949]/[3760] Speed: 132.440603 samples/sec accuracy=71.270657 loss=1.113069 lr=0.008447 Epoch[025] Batch [2999]/[3760] Speed: 131.678725 samples/sec accuracy=71.261979 loss=1.114082 lr=0.008445 Epoch[025] Batch [3049]/[3760] Speed: 119.831510 samples/sec accuracy=71.263832 loss=1.114169 lr=0.008444 Epoch[025] Batch [3099]/[3760] Speed: 130.245541 samples/sec accuracy=71.260585 loss=1.114351 lr=0.008442 Epoch[025] Batch [3149]/[3760] Speed: 123.698456 samples/sec accuracy=71.263393 loss=1.114287 lr=0.008441 Epoch[025] Batch [3199]/[3760] Speed: 123.394453 samples/sec accuracy=71.247559 loss=1.114855 lr=0.008439 Epoch[025] Batch [3249]/[3760] Speed: 129.554698 samples/sec accuracy=71.240865 loss=1.115371 lr=0.008438 Epoch[025] Batch [3299]/[3760] Speed: 124.854710 samples/sec accuracy=71.225379 loss=1.116253 lr=0.008436 Epoch[025] Batch [3349]/[3760] Speed: 130.138856 samples/sec accuracy=71.227146 loss=1.116457 lr=0.008435 Epoch[025] Batch [3399]/[3760] Speed: 116.521903 samples/sec accuracy=71.195772 loss=1.117399 lr=0.008433 Epoch[025] Batch [3449]/[3760] Speed: 129.140175 samples/sec accuracy=71.166214 loss=1.118192 lr=0.008432 Epoch[025] Batch [3499]/[3760] Speed: 124.944908 samples/sec accuracy=71.162054 loss=1.118123 lr=0.008430 Epoch[025] Batch [3549]/[3760] Speed: 131.371194 samples/sec accuracy=71.134243 loss=1.119710 lr=0.008429 Epoch[025] Batch [3599]/[3760] Speed: 119.098938 samples/sec accuracy=71.120226 loss=1.120235 lr=0.008427 Epoch[025] Batch [3649]/[3760] Speed: 126.761450 samples/sec accuracy=71.095034 loss=1.121360 lr=0.008426 Epoch[025] Batch [3699]/[3760] Speed: 123.600700 samples/sec accuracy=71.085726 loss=1.121721 lr=0.008424 Epoch[025] Batch [3749]/[3760] Speed: 145.362532 samples/sec accuracy=71.070000 loss=1.122709 lr=0.008423 Batch [0049]/[0303]: acc-top1=62.406250 acc-top5=84.562500 Batch [0099]/[0303]: acc-top1=62.328125 acc-top5=84.359375 Batch [0149]/[0303]: acc-top1=62.208333 acc-top5=84.343750 Batch [0199]/[0303]: acc-top1=61.953125 acc-top5=84.054688 Batch [0249]/[0303]: acc-top1=62.056250 acc-top5=84.075000 Batch [0299]/[0303]: acc-top1=61.973958 acc-top5=84.020833 [Epoch 025] training: accuracy=71.065076 loss=1.122872 [Epoch 025] speed: 125 samples/sec time cost: 2108.600548 [Epoch 025] validation: acc-top1=61.927599 acc-top5=83.952145 loss=2.165723 Epoch[026] Batch [0049]/[3759] Speed: 91.112764 samples/sec accuracy=73.281250 loss=1.050282 lr=0.008421 Epoch[026] Batch [0099]/[3759] Speed: 130.163159 samples/sec accuracy=73.468750 loss=1.031732 lr=0.008419 Epoch[026] Batch [0149]/[3759] Speed: 122.736557 samples/sec accuracy=72.791667 loss=1.046855 lr=0.008418 Epoch[026] Batch [0199]/[3759] Speed: 127.443325 samples/sec accuracy=72.703125 loss=1.052976 lr=0.008416 Epoch[026] Batch [0249]/[3759] Speed: 123.002301 samples/sec accuracy=72.668750 loss=1.055606 lr=0.008415 Epoch[026] Batch [0299]/[3759] Speed: 126.028411 samples/sec accuracy=72.723958 loss=1.052493 lr=0.008413 Epoch[026] Batch [0349]/[3759] Speed: 130.613742 samples/sec accuracy=72.562500 loss=1.057815 lr=0.008412 Epoch[026] Batch [0399]/[3759] Speed: 118.471444 samples/sec accuracy=72.679688 loss=1.053368 lr=0.008410 Epoch[026] Batch [0449]/[3759] Speed: 134.028290 samples/sec accuracy=72.809028 loss=1.050104 lr=0.008408 Epoch[026] Batch [0499]/[3759] Speed: 119.160662 samples/sec accuracy=72.790625 loss=1.049865 lr=0.008407 Epoch[026] Batch [0549]/[3759] Speed: 128.417952 samples/sec accuracy=72.627841 loss=1.052252 lr=0.008405 Epoch[026] Batch [0599]/[3759] Speed: 127.521993 samples/sec accuracy=72.447917 loss=1.056865 lr=0.008404 Epoch[026] Batch [0649]/[3759] Speed: 127.695538 samples/sec accuracy=72.343750 loss=1.061946 lr=0.008402 Epoch[026] Batch [0699]/[3759] Speed: 122.996155 samples/sec accuracy=72.256696 loss=1.065125 lr=0.008401 Epoch[026] Batch [0749]/[3759] Speed: 129.696682 samples/sec accuracy=72.152083 loss=1.068270 lr=0.008399 Epoch[026] Batch [0799]/[3759] Speed: 121.651776 samples/sec accuracy=72.160156 loss=1.068465 lr=0.008398 Epoch[026] Batch [0849]/[3759] Speed: 126.136592 samples/sec accuracy=72.130515 loss=1.070239 lr=0.008396 Epoch[026] Batch [0899]/[3759] Speed: 130.832886 samples/sec accuracy=72.085069 loss=1.071900 lr=0.008395 Epoch[026] Batch [0949]/[3759] Speed: 116.957735 samples/sec accuracy=72.044408 loss=1.074670 lr=0.008393 Epoch[026] Batch [0999]/[3759] Speed: 134.781144 samples/sec accuracy=71.943750 loss=1.078387 lr=0.008392 Epoch[026] Batch [1049]/[3759] Speed: 119.204314 samples/sec accuracy=72.002976 loss=1.078429 lr=0.008390 Epoch[026] Batch [1099]/[3759] Speed: 130.642773 samples/sec accuracy=71.934659 loss=1.080152 lr=0.008389 Epoch[026] Batch [1149]/[3759] Speed: 125.730360 samples/sec accuracy=72.019022 loss=1.078065 lr=0.008387 Epoch[026] Batch [1199]/[3759] Speed: 124.057092 samples/sec accuracy=72.003906 loss=1.079729 lr=0.008385 Epoch[026] Batch [1249]/[3759] Speed: 129.284382 samples/sec accuracy=71.935000 loss=1.082092 lr=0.008384 Epoch[026] Batch [1299]/[3759] Speed: 117.476629 samples/sec accuracy=71.966346 loss=1.080794 lr=0.008382 Epoch[026] Batch [1349]/[3759] Speed: 137.491250 samples/sec accuracy=72.012731 loss=1.079462 lr=0.008381 Epoch[026] Batch [1399]/[3759] Speed: 127.067720 samples/sec accuracy=72.006696 loss=1.080214 lr=0.008379 Epoch[026] Batch [1449]/[3759] Speed: 119.459352 samples/sec accuracy=71.981681 loss=1.081799 lr=0.008378 Epoch[026] Batch [1499]/[3759] Speed: 130.599828 samples/sec accuracy=71.936458 loss=1.083725 lr=0.008376 Epoch[026] Batch [1549]/[3759] Speed: 116.290909 samples/sec accuracy=71.908266 loss=1.084253 lr=0.008375 Epoch[026] Batch [1599]/[3759] Speed: 132.686718 samples/sec accuracy=71.930664 loss=1.083809 lr=0.008373 Epoch[026] Batch [1649]/[3759] Speed: 124.533859 samples/sec accuracy=71.860795 loss=1.086015 lr=0.008372 Epoch[026] Batch [1699]/[3759] Speed: 122.921854 samples/sec accuracy=71.829963 loss=1.086282 lr=0.008370 Epoch[026] Batch [1749]/[3759] Speed: 130.622092 samples/sec accuracy=71.813393 loss=1.087453 lr=0.008369 Epoch[026] Batch [1799]/[3759] Speed: 120.238851 samples/sec accuracy=71.793403 loss=1.088384 lr=0.008367 Epoch[026] Batch [1849]/[3759] Speed: 133.543519 samples/sec accuracy=71.802365 loss=1.088717 lr=0.008365 Epoch[026] Batch [1899]/[3759] Speed: 120.490412 samples/sec accuracy=71.785362 loss=1.089193 lr=0.008364 Epoch[026] Batch [1949]/[3759] Speed: 128.458979 samples/sec accuracy=71.769231 loss=1.089928 lr=0.008362 Epoch[026] Batch [1999]/[3759] Speed: 126.557859 samples/sec accuracy=71.777344 loss=1.090442 lr=0.008361 Epoch[026] Batch [2049]/[3759] Speed: 120.980683 samples/sec accuracy=71.759909 loss=1.090922 lr=0.008359 Epoch[026] Batch [2099]/[3759] Speed: 130.678861 samples/sec accuracy=71.751488 loss=1.091588 lr=0.008358 Epoch[026] Batch [2149]/[3759] Speed: 118.369984 samples/sec accuracy=71.736919 loss=1.092004 lr=0.008356 Epoch[026] Batch [2199]/[3759] Speed: 133.544418 samples/sec accuracy=71.716619 loss=1.093361 lr=0.008355 Epoch[026] Batch [2249]/[3759] Speed: 123.114069 samples/sec accuracy=71.704861 loss=1.093351 lr=0.008353 Epoch[026] Batch [2299]/[3759] Speed: 126.207422 samples/sec accuracy=71.641984 loss=1.095591 lr=0.008352 Epoch[026] Batch [2349]/[3759] Speed: 126.192910 samples/sec accuracy=71.607048 loss=1.096694 lr=0.008350 Epoch[026] Batch [2399]/[3759] Speed: 124.001894 samples/sec accuracy=71.604167 loss=1.097092 lr=0.008348 Epoch[026] Batch [2449]/[3759] Speed: 127.147521 samples/sec accuracy=71.621173 loss=1.096886 lr=0.008347 Epoch[026] Batch [2499]/[3759] Speed: 129.531324 samples/sec accuracy=71.608125 loss=1.097388 lr=0.008345 Epoch[026] Batch [2549]/[3759] Speed: 120.534269 samples/sec accuracy=71.613358 loss=1.097413 lr=0.008344 Epoch[026] Batch [2599]/[3759] Speed: 127.326731 samples/sec accuracy=71.588341 loss=1.097457 lr=0.008342 Epoch[026] Batch [2649]/[3759] Speed: 126.971462 samples/sec accuracy=71.583726 loss=1.097797 lr=0.008341 Epoch[026] Batch [2699]/[3759] Speed: 124.828623 samples/sec accuracy=71.565972 loss=1.098792 lr=0.008339 Epoch[026] Batch [2749]/[3759] Speed: 123.441056 samples/sec accuracy=71.555682 loss=1.099097 lr=0.008338 Epoch[026] Batch [2799]/[3759] Speed: 127.488803 samples/sec accuracy=71.533482 loss=1.099896 lr=0.008336 Epoch[026] Batch [2849]/[3759] Speed: 132.533462 samples/sec accuracy=71.515351 loss=1.100095 lr=0.008334 Epoch[026] Batch [2899]/[3759] Speed: 118.462776 samples/sec accuracy=71.524784 loss=1.099750 lr=0.008333 Epoch[026] Batch [2949]/[3759] Speed: 133.521203 samples/sec accuracy=71.515890 loss=1.100098 lr=0.008331 Epoch[026] Batch [2999]/[3759] Speed: 116.896442 samples/sec accuracy=71.493750 loss=1.100714 lr=0.008330 Epoch[026] Batch [3049]/[3759] Speed: 133.479611 samples/sec accuracy=71.507172 loss=1.100218 lr=0.008328 Epoch[026] Batch [3099]/[3759] Speed: 121.094953 samples/sec accuracy=71.484375 loss=1.100825 lr=0.008327 Epoch[026] Batch [3149]/[3759] Speed: 122.183290 samples/sec accuracy=71.455853 loss=1.102219 lr=0.008325 Epoch[026] Batch [3199]/[3759] Speed: 132.965786 samples/sec accuracy=71.411621 loss=1.103786 lr=0.008324 Epoch[026] Batch [3249]/[3759] Speed: 124.734468 samples/sec accuracy=71.396154 loss=1.104487 lr=0.008322 Epoch[026] Batch [3299]/[3759] Speed: 122.757470 samples/sec accuracy=71.388731 loss=1.104626 lr=0.008320 Epoch[026] Batch [3349]/[3759] Speed: 125.733533 samples/sec accuracy=71.364739 loss=1.105161 lr=0.008319 Epoch[026] Batch [3399]/[3759] Speed: 126.255508 samples/sec accuracy=71.348346 loss=1.105616 lr=0.008317 Epoch[026] Batch [3449]/[3759] Speed: 122.597057 samples/sec accuracy=71.338768 loss=1.106434 lr=0.008316 Epoch[026] Batch [3499]/[3759] Speed: 125.338603 samples/sec accuracy=71.319196 loss=1.107116 lr=0.008314 Epoch[026] Batch [3549]/[3759] Speed: 129.194918 samples/sec accuracy=71.303257 loss=1.107117 lr=0.008313 Epoch[026] Batch [3599]/[3759] Speed: 126.358570 samples/sec accuracy=71.299913 loss=1.107333 lr=0.008311 Epoch[026] Batch [3649]/[3759] Speed: 122.556641 samples/sec accuracy=71.283390 loss=1.107942 lr=0.008309 Epoch[026] Batch [3699]/[3759] Speed: 130.356611 samples/sec accuracy=71.271115 loss=1.108530 lr=0.008308 Epoch[026] Batch [3749]/[3759] Speed: 138.373441 samples/sec accuracy=71.262500 loss=1.108971 lr=0.008306 Batch [0049]/[0303]: acc-top1=62.937500 acc-top5=85.312500 Batch [0099]/[0303]: acc-top1=62.640625 acc-top5=84.984375 Batch [0149]/[0303]: acc-top1=62.281250 acc-top5=84.677083 Batch [0199]/[0303]: acc-top1=62.210938 acc-top5=84.539062 Batch [0249]/[0303]: acc-top1=62.306250 acc-top5=84.543750 Batch [0299]/[0303]: acc-top1=62.255208 acc-top5=84.552083 [Epoch 026] training: accuracy=71.259810 loss=1.108964 [Epoch 026] speed: 125 samples/sec time cost: 2107.971162 [Epoch 026] validation: acc-top1=62.206064 acc-top5=84.519389 loss=2.139735 Epoch[027] Batch [0049]/[3760] Speed: 87.591801 samples/sec accuracy=72.250000 loss=1.057707 lr=0.008304 Epoch[027] Batch [0099]/[3760] Speed: 129.463187 samples/sec accuracy=72.765625 loss=1.051186 lr=0.008303 Epoch[027] Batch [0149]/[3760] Speed: 130.181231 samples/sec accuracy=72.781250 loss=1.036880 lr=0.008301 Epoch[027] Batch [0199]/[3760] Speed: 121.598769 samples/sec accuracy=73.007812 loss=1.033703 lr=0.008300 Epoch[027] Batch [0249]/[3760] Speed: 128.067847 samples/sec accuracy=72.756250 loss=1.039473 lr=0.008298 Epoch[027] Batch [0299]/[3760] Speed: 130.443321 samples/sec accuracy=72.671875 loss=1.044539 lr=0.008297 Epoch[027] Batch [0349]/[3760] Speed: 116.465258 samples/sec accuracy=72.500000 loss=1.053013 lr=0.008295 Epoch[027] Batch [0399]/[3760] Speed: 132.247647 samples/sec accuracy=72.558594 loss=1.053582 lr=0.008293 Epoch[027] Batch [0449]/[3760] Speed: 116.851420 samples/sec accuracy=72.482639 loss=1.059941 lr=0.008292 Epoch[027] Batch [0499]/[3760] Speed: 134.135912 samples/sec accuracy=72.384375 loss=1.063231 lr=0.008290 Epoch[027] Batch [0549]/[3760] Speed: 118.682551 samples/sec accuracy=72.468750 loss=1.060447 lr=0.008289 Epoch[027] Batch [0599]/[3760] Speed: 132.249623 samples/sec accuracy=72.507812 loss=1.059181 lr=0.008287 Epoch[027] Batch [0649]/[3760] Speed: 115.284895 samples/sec accuracy=72.451923 loss=1.062938 lr=0.008286 Epoch[027] Batch [0699]/[3760] Speed: 133.990425 samples/sec accuracy=72.468750 loss=1.061836 lr=0.008284 Epoch[027] Batch [0749]/[3760] Speed: 119.418822 samples/sec accuracy=72.406250 loss=1.064788 lr=0.008282 Epoch[027] Batch [0799]/[3760] Speed: 129.339749 samples/sec accuracy=72.439453 loss=1.062249 lr=0.008281 Epoch[027] Batch [0849]/[3760] Speed: 132.565345 samples/sec accuracy=72.476103 loss=1.063908 lr=0.008279 Epoch[027] Batch [0899]/[3760] Speed: 116.441035 samples/sec accuracy=72.439236 loss=1.065153 lr=0.008278 Epoch[027] Batch [0949]/[3760] Speed: 132.877841 samples/sec accuracy=72.435855 loss=1.066704 lr=0.008276 Epoch[027] Batch [0999]/[3760] Speed: 117.391720 samples/sec accuracy=72.437500 loss=1.066120 lr=0.008275 Epoch[027] Batch [1049]/[3760] Speed: 132.339119 samples/sec accuracy=72.431548 loss=1.065405 lr=0.008273 Epoch[027] Batch [1099]/[3760] Speed: 117.629729 samples/sec accuracy=72.417614 loss=1.066138 lr=0.008271 Epoch[027] Batch [1149]/[3760] Speed: 132.559008 samples/sec accuracy=72.345109 loss=1.068313 lr=0.008270 Epoch[027] Batch [1199]/[3760] Speed: 131.139603 samples/sec accuracy=72.283854 loss=1.070248 lr=0.008268 Epoch[027] Batch [1249]/[3760] Speed: 117.899008 samples/sec accuracy=72.281250 loss=1.070119 lr=0.008267 Epoch[027] Batch [1299]/[3760] Speed: 132.725228 samples/sec accuracy=72.272837 loss=1.071430 lr=0.008265 Epoch[027] Batch [1349]/[3760] Speed: 119.615398 samples/sec accuracy=72.256944 loss=1.072453 lr=0.008263 Epoch[027] Batch [1399]/[3760] Speed: 133.194910 samples/sec accuracy=72.261161 loss=1.072297 lr=0.008262 Epoch[027] Batch [1449]/[3760] Speed: 118.205534 samples/sec accuracy=72.264009 loss=1.073072 lr=0.008260 Epoch[027] Batch [1499]/[3760] Speed: 133.186833 samples/sec accuracy=72.266667 loss=1.073354 lr=0.008259 Epoch[027] Batch [1549]/[3760] Speed: 120.384301 samples/sec accuracy=72.243952 loss=1.073527 lr=0.008257 Epoch[027] Batch [1599]/[3760] Speed: 131.219820 samples/sec accuracy=72.235352 loss=1.073939 lr=0.008256 Epoch[027] Batch [1649]/[3760] Speed: 119.020642 samples/sec accuracy=72.238636 loss=1.074549 lr=0.008254 Epoch[027] Batch [1699]/[3760] Speed: 124.392173 samples/sec accuracy=72.233456 loss=1.075263 lr=0.008252 Epoch[027] Batch [1749]/[3760] Speed: 123.266426 samples/sec accuracy=72.210714 loss=1.075233 lr=0.008251 Epoch[027] Batch [1799]/[3760] Speed: 130.751109 samples/sec accuracy=72.208333 loss=1.074764 lr=0.008249 Epoch[027] Batch [1849]/[3760] Speed: 129.357116 samples/sec accuracy=72.190878 loss=1.075622 lr=0.008248 Epoch[027] Batch [1899]/[3760] Speed: 122.406012 samples/sec accuracy=72.131579 loss=1.077506 lr=0.008246 Epoch[027] Batch [1949]/[3760] Speed: 124.188589 samples/sec accuracy=72.096955 loss=1.078237 lr=0.008244 Epoch[027] Batch [1999]/[3760] Speed: 127.235402 samples/sec accuracy=72.063281 loss=1.079784 lr=0.008243 Epoch[027] Batch [2049]/[3760] Speed: 127.527995 samples/sec accuracy=72.022866 loss=1.081085 lr=0.008241 Epoch[027] Batch [2099]/[3760] Speed: 119.751907 samples/sec accuracy=71.991815 loss=1.082252 lr=0.008240 Epoch[027] Batch [2149]/[3760] Speed: 132.615569 samples/sec accuracy=71.968023 loss=1.083890 lr=0.008238 Epoch[027] Batch [2199]/[3760] Speed: 123.489100 samples/sec accuracy=71.969460 loss=1.084166 lr=0.008236 Epoch[027] Batch [2249]/[3760] Speed: 124.075952 samples/sec accuracy=71.935417 loss=1.084829 lr=0.008235 Epoch[027] Batch [2299]/[3760] Speed: 128.282851 samples/sec accuracy=71.918478 loss=1.085878 lr=0.008233 Epoch[027] Batch [2349]/[3760] Speed: 127.501774 samples/sec accuracy=71.930851 loss=1.085851 lr=0.008232 Epoch[027] Batch [2399]/[3760] Speed: 121.998420 samples/sec accuracy=71.901042 loss=1.087028 lr=0.008230 Epoch[027] Batch [2449]/[3760] Speed: 133.773813 samples/sec accuracy=71.871811 loss=1.087839 lr=0.008229 Epoch[027] Batch [2499]/[3760] Speed: 118.204996 samples/sec accuracy=71.865625 loss=1.087921 lr=0.008227 Epoch[027] Batch [2549]/[3760] Speed: 127.800213 samples/sec accuracy=71.865196 loss=1.088185 lr=0.008225 Epoch[027] Batch [2599]/[3760] Speed: 126.134381 samples/sec accuracy=71.875601 loss=1.087873 lr=0.008224 Epoch[027] Batch [2649]/[3760] Speed: 122.497510 samples/sec accuracy=71.851415 loss=1.088581 lr=0.008222 Epoch[027] Batch [2699]/[3760] Speed: 129.556601 samples/sec accuracy=71.839120 loss=1.088433 lr=0.008221 Epoch[027] Batch [2749]/[3760] Speed: 124.905233 samples/sec accuracy=71.834091 loss=1.088731 lr=0.008219 Epoch[027] Batch [2799]/[3760] Speed: 126.919007 samples/sec accuracy=71.841518 loss=1.088967 lr=0.008217 Epoch[027] Batch [2849]/[3760] Speed: 123.921051 samples/sec accuracy=71.821272 loss=1.090000 lr=0.008216 Epoch[027] Batch [2899]/[3760] Speed: 120.957241 samples/sec accuracy=71.800108 loss=1.090832 lr=0.008214 Epoch[027] Batch [2949]/[3760] Speed: 129.969253 samples/sec accuracy=71.772246 loss=1.091389 lr=0.008213 Epoch[027] Batch [2999]/[3760] Speed: 125.155248 samples/sec accuracy=71.753125 loss=1.092046 lr=0.008211 Epoch[027] Batch [3049]/[3760] Speed: 122.142228 samples/sec accuracy=71.746926 loss=1.092235 lr=0.008209 Epoch[027] Batch [3099]/[3760] Speed: 127.686449 samples/sec accuracy=71.768649 loss=1.092103 lr=0.008208 Epoch[027] Batch [3149]/[3760] Speed: 125.665524 samples/sec accuracy=71.752480 loss=1.092846 lr=0.008206 Epoch[027] Batch [3199]/[3760] Speed: 130.360879 samples/sec accuracy=71.758301 loss=1.093202 lr=0.008205 Epoch[027] Batch [3249]/[3760] Speed: 114.345935 samples/sec accuracy=71.758173 loss=1.093028 lr=0.008203 Epoch[027] Batch [3299]/[3760] Speed: 133.840585 samples/sec accuracy=71.726326 loss=1.094394 lr=0.008201 Epoch[027] Batch [3349]/[3760] Speed: 124.596034 samples/sec accuracy=71.688899 loss=1.095365 lr=0.008200 Epoch[027] Batch [3399]/[3760] Speed: 128.514528 samples/sec accuracy=71.680607 loss=1.096159 lr=0.008198 Epoch[027] Batch [3449]/[3760] Speed: 128.881968 samples/sec accuracy=71.650815 loss=1.097037 lr=0.008197 Epoch[027] Batch [3499]/[3760] Speed: 117.665396 samples/sec accuracy=71.625446 loss=1.097972 lr=0.008195 Epoch[027] Batch [3549]/[3760] Speed: 131.745065 samples/sec accuracy=71.620158 loss=1.098040 lr=0.008193 Epoch[027] Batch [3599]/[3760] Speed: 126.325593 samples/sec accuracy=71.606771 loss=1.098306 lr=0.008192 Epoch[027] Batch [3649]/[3760] Speed: 122.905734 samples/sec accuracy=71.601027 loss=1.098748 lr=0.008190 Epoch[027] Batch [3699]/[3760] Speed: 127.974793 samples/sec accuracy=71.589105 loss=1.099360 lr=0.008188 Epoch[027] Batch [3749]/[3760] Speed: 142.226917 samples/sec accuracy=71.586667 loss=1.099839 lr=0.008187 Batch [0049]/[0303]: acc-top1=62.812500 acc-top5=84.500000 Batch [0099]/[0303]: acc-top1=62.250000 acc-top5=84.203125 Batch [0149]/[0303]: acc-top1=62.062500 acc-top5=84.375000 Batch [0199]/[0303]: acc-top1=61.718750 acc-top5=84.054688 Batch [0249]/[0303]: acc-top1=61.568750 acc-top5=83.950000 Batch [0299]/[0303]: acc-top1=61.671875 acc-top5=83.968750 [Epoch 027] training: accuracy=71.576629 loss=1.100182 [Epoch 027] speed: 125 samples/sec time cost: 2111.697592 [Epoch 027] validation: acc-top1=61.602723 acc-top5=83.916048 loss=2.175607 Epoch[028] Batch [0049]/[3760] Speed: 91.073407 samples/sec accuracy=72.687500 loss=1.041654 lr=0.008185 Epoch[028] Batch [0099]/[3760] Speed: 131.360035 samples/sec accuracy=73.031250 loss=1.041602 lr=0.008183 Epoch[028] Batch [0149]/[3760] Speed: 122.426315 samples/sec accuracy=73.239583 loss=1.030284 lr=0.008182 Epoch[028] Batch [0199]/[3760] Speed: 128.648619 samples/sec accuracy=73.414062 loss=1.025944 lr=0.008180 Epoch[028] Batch [0249]/[3760] Speed: 119.638873 samples/sec accuracy=73.137500 loss=1.025364 lr=0.008178 Epoch[028] Batch [0299]/[3760] Speed: 131.285295 samples/sec accuracy=73.067708 loss=1.029346 lr=0.008177 Epoch[028] Batch [0349]/[3760] Speed: 124.051123 samples/sec accuracy=73.035714 loss=1.036879 lr=0.008175 Epoch[028] Batch [0399]/[3760] Speed: 122.842936 samples/sec accuracy=72.917969 loss=1.040288 lr=0.008174 Epoch[028] Batch [0449]/[3760] Speed: 128.744086 samples/sec accuracy=72.909722 loss=1.041539 lr=0.008172 Epoch[028] Batch [0499]/[3760] Speed: 121.860817 samples/sec accuracy=72.793750 loss=1.045889 lr=0.008170 Epoch[028] Batch [0549]/[3760] Speed: 127.499793 samples/sec accuracy=72.625000 loss=1.051673 lr=0.008169 Epoch[028] Batch [0599]/[3760] Speed: 125.448553 samples/sec accuracy=72.640625 loss=1.052327 lr=0.008167 Epoch[028] Batch [0649]/[3760] Speed: 126.748949 samples/sec accuracy=72.637019 loss=1.049993 lr=0.008166 Epoch[028] Batch [0699]/[3760] Speed: 129.196072 samples/sec accuracy=72.709821 loss=1.047836 lr=0.008164 Epoch[028] Batch [0749]/[3760] Speed: 121.493956 samples/sec accuracy=72.581250 loss=1.050252 lr=0.008162 Epoch[028] Batch [0799]/[3760] Speed: 126.891500 samples/sec accuracy=72.650391 loss=1.050570 lr=0.008161 Epoch[028] Batch [0849]/[3760] Speed: 123.493835 samples/sec accuracy=72.597426 loss=1.050516 lr=0.008159 Epoch[028] Batch [0899]/[3760] Speed: 131.947414 samples/sec accuracy=72.581597 loss=1.051831 lr=0.008157 Epoch[028] Batch [0949]/[3760] Speed: 118.359536 samples/sec accuracy=72.585526 loss=1.053020 lr=0.008156 Epoch[028] Batch [0999]/[3760] Speed: 128.395655 samples/sec accuracy=72.568750 loss=1.053141 lr=0.008154 Epoch[028] Batch [1049]/[3760] Speed: 121.617747 samples/sec accuracy=72.552083 loss=1.054498 lr=0.008153 Epoch[028] Batch [1099]/[3760] Speed: 131.638224 samples/sec accuracy=72.467330 loss=1.057766 lr=0.008151 Epoch[028] Batch [1149]/[3760] Speed: 120.041153 samples/sec accuracy=72.350543 loss=1.061806 lr=0.008149 Epoch[028] Batch [1199]/[3760] Speed: 128.584467 samples/sec accuracy=72.367188 loss=1.063251 lr=0.008148 Epoch[028] Batch [1249]/[3760] Speed: 121.898675 samples/sec accuracy=72.400000 loss=1.063348 lr=0.008146 Epoch[028] Batch [1299]/[3760] Speed: 127.853562 samples/sec accuracy=72.381010 loss=1.064684 lr=0.008144 Epoch[028] Batch [1349]/[3760] Speed: 122.711572 samples/sec accuracy=72.346065 loss=1.065480 lr=0.008143 Epoch[028] Batch [1399]/[3760] Speed: 132.634538 samples/sec accuracy=72.323661 loss=1.065799 lr=0.008141 Epoch[028] Batch [1449]/[3760] Speed: 116.818718 samples/sec accuracy=72.303879 loss=1.066582 lr=0.008140 Epoch[028] Batch [1499]/[3760] Speed: 132.811518 samples/sec accuracy=72.338542 loss=1.065420 lr=0.008138 Epoch[028] Batch [1549]/[3760] Speed: 121.278401 samples/sec accuracy=72.353831 loss=1.065912 lr=0.008136 Epoch[028] Batch [1599]/[3760] Speed: 128.987290 samples/sec accuracy=72.348633 loss=1.066429 lr=0.008135 Epoch[028] Batch [1649]/[3760] Speed: 131.648860 samples/sec accuracy=72.295455 loss=1.068410 lr=0.008133 Epoch[028] Batch [1699]/[3760] Speed: 118.844139 samples/sec accuracy=72.309743 loss=1.068979 lr=0.008131 Epoch[028] Batch [1749]/[3760] Speed: 131.536558 samples/sec accuracy=72.282143 loss=1.069941 lr=0.008130 Epoch[028] Batch [1799]/[3760] Speed: 123.627471 samples/sec accuracy=72.248264 loss=1.070332 lr=0.008128 Epoch[028] Batch [1849]/[3760] Speed: 125.385054 samples/sec accuracy=72.246622 loss=1.070175 lr=0.008127 Epoch[028] Batch [1899]/[3760] Speed: 120.608960 samples/sec accuracy=72.256579 loss=1.069686 lr=0.008125 Epoch[028] Batch [1949]/[3760] Speed: 133.188678 samples/sec accuracy=72.252404 loss=1.070731 lr=0.008123 Epoch[028] Batch [1999]/[3760] Speed: 122.002693 samples/sec accuracy=72.225000 loss=1.071856 lr=0.008122 Epoch[028] Batch [2049]/[3760] Speed: 126.849158 samples/sec accuracy=72.233232 loss=1.072374 lr=0.008120 Epoch[028] Batch [2099]/[3760] Speed: 118.654093 samples/sec accuracy=72.191964 loss=1.074009 lr=0.008118 Epoch[028] Batch [2149]/[3760] Speed: 130.819614 samples/sec accuracy=72.192587 loss=1.074952 lr=0.008117 Epoch[028] Batch [2199]/[3760] Speed: 129.187797 samples/sec accuracy=72.156960 loss=1.075542 lr=0.008115 Epoch[028] Batch [2249]/[3760] Speed: 122.249369 samples/sec accuracy=72.134028 loss=1.076132 lr=0.008114 Epoch[028] Batch [2299]/[3760] Speed: 128.208938 samples/sec accuracy=72.135190 loss=1.076507 lr=0.008112 Epoch[028] Batch [2349]/[3760] Speed: 122.222697 samples/sec accuracy=72.114362 loss=1.077246 lr=0.008110 Epoch[028] Batch [2399]/[3760] Speed: 128.413045 samples/sec accuracy=72.111979 loss=1.077994 lr=0.008109 Epoch[028] Batch [2449]/[3760] Speed: 116.343932 samples/sec accuracy=72.107781 loss=1.078486 lr=0.008107 Epoch[028] Batch [2499]/[3760] Speed: 133.291627 samples/sec accuracy=72.110625 loss=1.078756 lr=0.008105 Epoch[028] Batch [2549]/[3760] Speed: 129.781797 samples/sec accuracy=72.115809 loss=1.078831 lr=0.008104 Epoch[028] Batch [2599]/[3760] Speed: 120.638126 samples/sec accuracy=72.102764 loss=1.079518 lr=0.008102 Epoch[028] Batch [2649]/[3760] Speed: 131.598841 samples/sec accuracy=72.056014 loss=1.080450 lr=0.008100 Epoch[028] Batch [2699]/[3760] Speed: 119.420971 samples/sec accuracy=71.992477 loss=1.082461 lr=0.008099 Epoch[028] Batch [2749]/[3760] Speed: 126.931870 samples/sec accuracy=71.993182 loss=1.082724 lr=0.008097 Epoch[028] Batch [2799]/[3760] Speed: 127.429974 samples/sec accuracy=71.979911 loss=1.083229 lr=0.008096 Epoch[028] Batch [2849]/[3760] Speed: 123.908947 samples/sec accuracy=71.943531 loss=1.084377 lr=0.008094 Epoch[028] Batch [2899]/[3760] Speed: 130.154545 samples/sec accuracy=71.945043 loss=1.084331 lr=0.008092 Epoch[028] Batch [2949]/[3760] Speed: 122.505580 samples/sec accuracy=71.957097 loss=1.084521 lr=0.008091 Epoch[028] Batch [2999]/[3760] Speed: 122.962412 samples/sec accuracy=71.942708 loss=1.084816 lr=0.008089 Epoch[028] Batch [3049]/[3760] Speed: 129.109284 samples/sec accuracy=71.912910 loss=1.085624 lr=0.008087 Epoch[028] Batch [3099]/[3760] Speed: 120.855799 samples/sec accuracy=71.892641 loss=1.086197 lr=0.008086 Epoch[028] Batch [3149]/[3760] Speed: 123.755338 samples/sec accuracy=71.890873 loss=1.086366 lr=0.008084 Epoch[028] Batch [3199]/[3760] Speed: 133.294301 samples/sec accuracy=71.881836 loss=1.086491 lr=0.008082 Epoch[028] Batch [3249]/[3760] Speed: 121.734285 samples/sec accuracy=71.880769 loss=1.086281 lr=0.008081 Epoch[028] Batch [3299]/[3760] Speed: 126.495094 samples/sec accuracy=71.866951 loss=1.087261 lr=0.008079 Epoch[028] Batch [3349]/[3760] Speed: 124.377818 samples/sec accuracy=71.830690 loss=1.088910 lr=0.008077 Epoch[028] Batch [3399]/[3760] Speed: 131.713439 samples/sec accuracy=71.836857 loss=1.089386 lr=0.008076 Epoch[028] Batch [3449]/[3760] Speed: 117.835181 samples/sec accuracy=71.817029 loss=1.090261 lr=0.008074 Epoch[028] Batch [3499]/[3760] Speed: 130.691765 samples/sec accuracy=71.819643 loss=1.090008 lr=0.008072 Epoch[028] Batch [3549]/[3760] Speed: 120.817439 samples/sec accuracy=71.801937 loss=1.090686 lr=0.008071 Epoch[028] Batch [3599]/[3760] Speed: 130.242609 samples/sec accuracy=71.802517 loss=1.090817 lr=0.008069 Epoch[028] Batch [3649]/[3760] Speed: 130.304553 samples/sec accuracy=71.788955 loss=1.091249 lr=0.008068 Epoch[028] Batch [3699]/[3760] Speed: 118.204258 samples/sec accuracy=71.794341 loss=1.091752 lr=0.008066 Epoch[028] Batch [3749]/[3760] Speed: 148.101698 samples/sec accuracy=71.771667 loss=1.092408 lr=0.008064 Batch [0049]/[0303]: acc-top1=63.093750 acc-top5=84.187500 Batch [0099]/[0303]: acc-top1=62.906250 acc-top5=84.265625 Batch [0149]/[0303]: acc-top1=62.468750 acc-top5=84.458333 Batch [0199]/[0303]: acc-top1=62.062500 acc-top5=84.210938 Batch [0249]/[0303]: acc-top1=62.250000 acc-top5=84.243750 Batch [0299]/[0303]: acc-top1=62.109375 acc-top5=84.270833 [Epoch 028] training: accuracy=71.769448 loss=1.092423 [Epoch 028] speed: 125 samples/sec time cost: 2110.478642 [Epoch 028] validation: acc-top1=62.066832 acc-top5=84.225454 loss=2.084856 Epoch[029] Batch [0049]/[3759] Speed: 89.026353 samples/sec accuracy=73.187500 loss=1.029958 lr=0.008062 Epoch[029] Batch [0099]/[3759] Speed: 127.568648 samples/sec accuracy=73.765625 loss=1.007308 lr=0.008061 Epoch[029] Batch [0149]/[3759] Speed: 129.343841 samples/sec accuracy=73.854167 loss=1.006592 lr=0.008059 Epoch[029] Batch [0199]/[3759] Speed: 122.357903 samples/sec accuracy=73.601562 loss=1.017637 lr=0.008057 Epoch[029] Batch [0249]/[3759] Speed: 129.188537 samples/sec accuracy=73.556250 loss=1.021683 lr=0.008056 Epoch[029] Batch [0299]/[3759] Speed: 127.014623 samples/sec accuracy=73.463542 loss=1.026250 lr=0.008054 Epoch[029] Batch [0349]/[3759] Speed: 118.984582 samples/sec accuracy=73.482143 loss=1.025100 lr=0.008052 Epoch[029] Batch [0399]/[3759] Speed: 132.827355 samples/sec accuracy=73.429688 loss=1.025510 lr=0.008051 Epoch[029] Batch [0449]/[3759] Speed: 118.643220 samples/sec accuracy=73.458333 loss=1.026023 lr=0.008049 Epoch[029] Batch [0499]/[3759] Speed: 128.968879 samples/sec accuracy=73.468750 loss=1.023772 lr=0.008047 Epoch[029] Batch [0549]/[3759] Speed: 131.870876 samples/sec accuracy=73.514205 loss=1.022626 lr=0.008046 Epoch[029] Batch [0599]/[3759] Speed: 119.183635 samples/sec accuracy=73.395833 loss=1.026546 lr=0.008044 Epoch[029] Batch [0649]/[3759] Speed: 131.742374 samples/sec accuracy=73.353365 loss=1.026985 lr=0.008042 Epoch[029] Batch [0699]/[3759] Speed: 121.462375 samples/sec accuracy=73.433036 loss=1.025656 lr=0.008041 Epoch[029] Batch [0749]/[3759] Speed: 133.433842 samples/sec accuracy=73.350000 loss=1.027327 lr=0.008039 Epoch[029] Batch [0799]/[3759] Speed: 119.322937 samples/sec accuracy=73.285156 loss=1.029100 lr=0.008037 Epoch[029] Batch [0849]/[3759] Speed: 126.045704 samples/sec accuracy=73.218750 loss=1.029833 lr=0.008036 Epoch[029] Batch [0899]/[3759] Speed: 124.394584 samples/sec accuracy=73.229167 loss=1.031851 lr=0.008034 Epoch[029] Batch [0949]/[3759] Speed: 129.927028 samples/sec accuracy=73.148026 loss=1.033608 lr=0.008032 Epoch[029] Batch [0999]/[3759] Speed: 124.746831 samples/sec accuracy=73.168750 loss=1.032294 lr=0.008031 Epoch[029] Batch [1049]/[3759] Speed: 127.232963 samples/sec accuracy=73.130952 loss=1.033216 lr=0.008029 Epoch[029] Batch [1099]/[3759] Speed: 120.106000 samples/sec accuracy=73.075284 loss=1.037324 lr=0.008027 Epoch[029] Batch [1149]/[3759] Speed: 131.466216 samples/sec accuracy=72.983696 loss=1.040233 lr=0.008026 Epoch[029] Batch [1199]/[3759] Speed: 130.047608 samples/sec accuracy=72.925781 loss=1.042639 lr=0.008024 Epoch[029] Batch [1249]/[3759] Speed: 119.863534 samples/sec accuracy=72.946250 loss=1.041659 lr=0.008022 Epoch[029] Batch [1299]/[3759] Speed: 129.397480 samples/sec accuracy=72.931490 loss=1.042359 lr=0.008021 Epoch[029] Batch [1349]/[3759] Speed: 119.036853 samples/sec accuracy=72.942130 loss=1.042709 lr=0.008019 Epoch[029] Batch [1399]/[3759] Speed: 129.967953 samples/sec accuracy=72.925223 loss=1.043333 lr=0.008017 Epoch[029] Batch [1449]/[3759] Speed: 129.676101 samples/sec accuracy=72.884698 loss=1.045985 lr=0.008016 Epoch[029] Batch [1499]/[3759] Speed: 117.273773 samples/sec accuracy=72.827083 loss=1.047226 lr=0.008014 Epoch[029] Batch [1549]/[3759] Speed: 134.564765 samples/sec accuracy=72.829637 loss=1.047234 lr=0.008012 Epoch[029] Batch [1599]/[3759] Speed: 121.314970 samples/sec accuracy=72.846680 loss=1.046808 lr=0.008011 Epoch[029] Batch [1649]/[3759] Speed: 129.876205 samples/sec accuracy=72.836174 loss=1.047622 lr=0.008009 Epoch[029] Batch [1699]/[3759] Speed: 122.392808 samples/sec accuracy=72.802390 loss=1.048770 lr=0.008007 Epoch[029] Batch [1749]/[3759] Speed: 127.347808 samples/sec accuracy=72.775893 loss=1.050515 lr=0.008006 Epoch[029] Batch [1799]/[3759] Speed: 120.745296 samples/sec accuracy=72.730903 loss=1.052062 lr=0.008004 Epoch[029] Batch [1849]/[3759] Speed: 132.630943 samples/sec accuracy=72.698480 loss=1.053539 lr=0.008002 Epoch[029] Batch [1899]/[3759] Speed: 119.615671 samples/sec accuracy=72.639803 loss=1.055264 lr=0.008001 Epoch[029] Batch [1949]/[3759] Speed: 127.712328 samples/sec accuracy=72.621795 loss=1.055969 lr=0.007999 Epoch[029] Batch [1999]/[3759] Speed: 132.925003 samples/sec accuracy=72.582813 loss=1.057168 lr=0.007997 Epoch[029] Batch [2049]/[3759] Speed: 122.205260 samples/sec accuracy=72.582317 loss=1.057447 lr=0.007996 Epoch[029] Batch [2099]/[3759] Speed: 130.462029 samples/sec accuracy=72.574405 loss=1.057848 lr=0.007994 Epoch[029] Batch [2149]/[3759] Speed: 118.802029 samples/sec accuracy=72.538517 loss=1.058201 lr=0.007992 Epoch[029] Batch [2199]/[3759] Speed: 126.894425 samples/sec accuracy=72.501420 loss=1.059745 lr=0.007991 Epoch[029] Batch [2249]/[3759] Speed: 131.502000 samples/sec accuracy=72.475000 loss=1.060464 lr=0.007989 Epoch[029] Batch [2299]/[3759] Speed: 118.847031 samples/sec accuracy=72.438859 loss=1.061608 lr=0.007987 Epoch[029] Batch [2349]/[3759] Speed: 129.714882 samples/sec accuracy=72.425532 loss=1.063018 lr=0.007986 Epoch[029] Batch [2399]/[3759] Speed: 126.815497 samples/sec accuracy=72.376302 loss=1.064410 lr=0.007984 Epoch[029] Batch [2449]/[3759] Speed: 120.280634 samples/sec accuracy=72.364796 loss=1.065008 lr=0.007982 Epoch[029] Batch [2499]/[3759] Speed: 134.293680 samples/sec accuracy=72.344375 loss=1.065523 lr=0.007981 Epoch[029] Batch [2549]/[3759] Speed: 120.704786 samples/sec accuracy=72.301471 loss=1.066548 lr=0.007979 Epoch[029] Batch [2599]/[3759] Speed: 129.924039 samples/sec accuracy=72.278846 loss=1.068005 lr=0.007977 Epoch[029] Batch [2649]/[3759] Speed: 119.028754 samples/sec accuracy=72.274175 loss=1.068777 lr=0.007976 Epoch[029] Batch [2699]/[3759] Speed: 131.979537 samples/sec accuracy=72.270255 loss=1.069342 lr=0.007974 Epoch[029] Batch [2749]/[3759] Speed: 120.882704 samples/sec accuracy=72.251136 loss=1.070230 lr=0.007972 Epoch[029] Batch [2799]/[3759] Speed: 130.264786 samples/sec accuracy=72.215960 loss=1.071618 lr=0.007971 Epoch[029] Batch [2849]/[3759] Speed: 127.086162 samples/sec accuracy=72.191338 loss=1.072690 lr=0.007969 Epoch[029] Batch [2899]/[3759] Speed: 122.942602 samples/sec accuracy=72.183728 loss=1.073003 lr=0.007967 Epoch[029] Batch [2949]/[3759] Speed: 128.858916 samples/sec accuracy=72.192267 loss=1.073509 lr=0.007966 Epoch[029] Batch [2999]/[3759] Speed: 124.431611 samples/sec accuracy=72.178125 loss=1.073789 lr=0.007964 Epoch[029] Batch [3049]/[3759] Speed: 128.620479 samples/sec accuracy=72.154201 loss=1.074739 lr=0.007962 Epoch[029] Batch [3099]/[3759] Speed: 123.105556 samples/sec accuracy=72.138609 loss=1.074914 lr=0.007961 Epoch[029] Batch [3149]/[3759] Speed: 129.044267 samples/sec accuracy=72.146329 loss=1.074956 lr=0.007959 Epoch[029] Batch [3199]/[3759] Speed: 120.176402 samples/sec accuracy=72.133301 loss=1.075477 lr=0.007957 Epoch[029] Batch [3249]/[3759] Speed: 129.993318 samples/sec accuracy=72.114904 loss=1.075826 lr=0.007955 Epoch[029] Batch [3299]/[3759] Speed: 116.487315 samples/sec accuracy=72.127367 loss=1.075813 lr=0.007954 Epoch[029] Batch [3349]/[3759] Speed: 133.545282 samples/sec accuracy=72.118937 loss=1.076243 lr=0.007952 Epoch[029] Batch [3399]/[3759] Speed: 121.749666 samples/sec accuracy=72.142463 loss=1.075614 lr=0.007950 Epoch[029] Batch [3449]/[3759] Speed: 128.083294 samples/sec accuracy=72.136775 loss=1.075951 lr=0.007949 Epoch[029] Batch [3499]/[3759] Speed: 123.689324 samples/sec accuracy=72.126786 loss=1.076076 lr=0.007947 Epoch[029] Batch [3549]/[3759] Speed: 131.165334 samples/sec accuracy=72.102993 loss=1.077068 lr=0.007945 Epoch[029] Batch [3599]/[3759] Speed: 127.440301 samples/sec accuracy=72.099826 loss=1.077701 lr=0.007944 Epoch[029] Batch [3649]/[3759] Speed: 121.690554 samples/sec accuracy=72.078767 loss=1.078579 lr=0.007942 Epoch[029] Batch [3699]/[3759] Speed: 128.521231 samples/sec accuracy=72.065456 loss=1.078884 lr=0.007940 Epoch[029] Batch [3749]/[3759] Speed: 144.533964 samples/sec accuracy=72.052500 loss=1.079135 lr=0.007939 Batch [0049]/[0303]: acc-top1=62.250000 acc-top5=84.750000 Batch [0099]/[0303]: acc-top1=62.515625 acc-top5=84.640625 Batch [0149]/[0303]: acc-top1=62.166667 acc-top5=84.260417 Batch [0199]/[0303]: acc-top1=61.695312 acc-top5=84.046875 Batch [0249]/[0303]: acc-top1=61.887500 acc-top5=84.025000 Batch [0299]/[0303]: acc-top1=61.906250 acc-top5=84.026042 [Epoch 029] training: accuracy=72.047918 loss=1.079235 [Epoch 029] speed: 125 samples/sec time cost: 2107.578589 [Epoch 029] validation: acc-top1=61.845091 acc-top5=83.983086 loss=2.121504 Epoch[030] Batch [0049]/[3760] Speed: 88.925639 samples/sec accuracy=73.750000 loss=0.983693 lr=0.007937 Epoch[030] Batch [0099]/[3760] Speed: 133.244260 samples/sec accuracy=73.359375 loss=1.017533 lr=0.007935 Epoch[030] Batch [0149]/[3760] Speed: 125.173441 samples/sec accuracy=73.281250 loss=1.022773 lr=0.007933 Epoch[030] Batch [0199]/[3760] Speed: 120.276835 samples/sec accuracy=73.109375 loss=1.022124 lr=0.007932 Epoch[030] Batch [0249]/[3760] Speed: 132.989469 samples/sec accuracy=72.775000 loss=1.030176 lr=0.007930 Epoch[030] Batch [0299]/[3760] Speed: 118.091555 samples/sec accuracy=72.666667 loss=1.035702 lr=0.007928 Epoch[030] Batch [0349]/[3760] Speed: 133.169595 samples/sec accuracy=73.040179 loss=1.026012 lr=0.007926 Epoch[030] Batch [0399]/[3760] Speed: 112.227234 samples/sec accuracy=73.085938 loss=1.025516 lr=0.007925 Epoch[030] Batch [0449]/[3760] Speed: 137.260191 samples/sec accuracy=73.048611 loss=1.026077 lr=0.007923 Epoch[030] Batch [0499]/[3760] Speed: 125.018493 samples/sec accuracy=73.065625 loss=1.026986 lr=0.007921 Epoch[030] Batch [0549]/[3760] Speed: 127.841150 samples/sec accuracy=73.161932 loss=1.024074 lr=0.007920 Epoch[030] Batch [0599]/[3760] Speed: 128.943935 samples/sec accuracy=73.145833 loss=1.028082 lr=0.007918 Epoch[030] Batch [0649]/[3760] Speed: 121.821361 samples/sec accuracy=73.153846 loss=1.029281 lr=0.007916 Epoch[030] Batch [0699]/[3760] Speed: 125.681920 samples/sec accuracy=73.093750 loss=1.031546 lr=0.007915 Epoch[030] Batch [0749]/[3760] Speed: 123.232389 samples/sec accuracy=73.102083 loss=1.031953 lr=0.007913 Epoch[030] Batch [0799]/[3760] Speed: 132.126729 samples/sec accuracy=73.044922 loss=1.033037 lr=0.007911 Epoch[030] Batch [0849]/[3760] Speed: 122.177109 samples/sec accuracy=73.066176 loss=1.033253 lr=0.007909 Epoch[030] Batch [0899]/[3760] Speed: 122.911490 samples/sec accuracy=73.027778 loss=1.034585 lr=0.007908 Epoch[030] Batch [0949]/[3760] Speed: 130.755072 samples/sec accuracy=73.024671 loss=1.033965 lr=0.007906 Epoch[030] Batch [0999]/[3760] Speed: 127.513354 samples/sec accuracy=73.100000 loss=1.033423 lr=0.007904 Epoch[030] Batch [1049]/[3760] Speed: 123.973478 samples/sec accuracy=73.105655 loss=1.031790 lr=0.007903 Epoch[030] Batch [1099]/[3760] Speed: 124.968477 samples/sec accuracy=73.055398 loss=1.034342 lr=0.007901 Epoch[030] Batch [1149]/[3760] Speed: 130.491335 samples/sec accuracy=73.033967 loss=1.035262 lr=0.007899 Epoch[030] Batch [1199]/[3760] Speed: 124.187269 samples/sec accuracy=73.006510 loss=1.036180 lr=0.007898 Epoch[030] Batch [1249]/[3760] Speed: 122.250324 samples/sec accuracy=72.995000 loss=1.037349 lr=0.007896 Epoch[030] Batch [1299]/[3760] Speed: 133.085676 samples/sec accuracy=72.891827 loss=1.040741 lr=0.007894 Epoch[030] Batch [1349]/[3760] Speed: 119.111908 samples/sec accuracy=72.870370 loss=1.042289 lr=0.007892 Epoch[030] Batch [1399]/[3760] Speed: 131.315351 samples/sec accuracy=72.886161 loss=1.041862 lr=0.007891 Epoch[030] Batch [1449]/[3760] Speed: 121.603946 samples/sec accuracy=72.842672 loss=1.043137 lr=0.007889 Epoch[030] Batch [1499]/[3760] Speed: 130.877675 samples/sec accuracy=72.787500 loss=1.043804 lr=0.007887 Epoch[030] Batch [1549]/[3760] Speed: 125.136592 samples/sec accuracy=72.755040 loss=1.045861 lr=0.007886 Epoch[030] Batch [1599]/[3760] Speed: 124.928718 samples/sec accuracy=72.744141 loss=1.046469 lr=0.007884 Epoch[030] Batch [1649]/[3760] Speed: 128.149121 samples/sec accuracy=72.726326 loss=1.047489 lr=0.007882 Epoch[030] Batch [1699]/[3760] Speed: 118.683222 samples/sec accuracy=72.737132 loss=1.046712 lr=0.007881 Epoch[030] Batch [1749]/[3760] Speed: 131.668103 samples/sec accuracy=72.764286 loss=1.045763 lr=0.007879 Epoch[030] Batch [1799]/[3760] Speed: 123.288776 samples/sec accuracy=72.746528 loss=1.046911 lr=0.007877 Epoch[030] Batch [1849]/[3760] Speed: 126.133473 samples/sec accuracy=72.716216 loss=1.048105 lr=0.007875 Epoch[030] Batch [1899]/[3760] Speed: 130.066500 samples/sec accuracy=72.720395 loss=1.048217 lr=0.007874 Epoch[030] Batch [1949]/[3760] Speed: 121.228888 samples/sec accuracy=72.721955 loss=1.048454 lr=0.007872 Epoch[030] Batch [1999]/[3760] Speed: 123.397459 samples/sec accuracy=72.722656 loss=1.048762 lr=0.007870 Epoch[030] Batch [2049]/[3760] Speed: 133.915740 samples/sec accuracy=72.679116 loss=1.050153 lr=0.007869 Epoch[030] Batch [2099]/[3760] Speed: 119.898193 samples/sec accuracy=72.654762 loss=1.051080 lr=0.007867 Epoch[030] Batch [2149]/[3760] Speed: 127.868413 samples/sec accuracy=72.659157 loss=1.051202 lr=0.007865 Epoch[030] Batch [2199]/[3760] Speed: 121.694301 samples/sec accuracy=72.612926 loss=1.053069 lr=0.007863 Epoch[030] Batch [2249]/[3760] Speed: 128.418283 samples/sec accuracy=72.575000 loss=1.053946 lr=0.007862 Epoch[030] Batch [2299]/[3760] Speed: 119.160432 samples/sec accuracy=72.567935 loss=1.054614 lr=0.007860 Epoch[030] Batch [2349]/[3760] Speed: 131.572803 samples/sec accuracy=72.572473 loss=1.054850 lr=0.007858 Epoch[030] Batch [2399]/[3760] Speed: 127.205045 samples/sec accuracy=72.548177 loss=1.056332 lr=0.007857 Epoch[030] Batch [2449]/[3760] Speed: 125.021333 samples/sec accuracy=72.507653 loss=1.058162 lr=0.007855 Epoch[030] Batch [2499]/[3760] Speed: 122.682747 samples/sec accuracy=72.489375 loss=1.058861 lr=0.007853 Epoch[030] Batch [2549]/[3760] Speed: 129.495529 samples/sec accuracy=72.452819 loss=1.060184 lr=0.007851 Epoch[030] Batch [2599]/[3760] Speed: 119.173910 samples/sec accuracy=72.463942 loss=1.059800 lr=0.007850 Epoch[030] Batch [2649]/[3760] Speed: 128.430501 samples/sec accuracy=72.457547 loss=1.060417 lr=0.007848 Epoch[030] Batch [2699]/[3760] Speed: 122.369651 samples/sec accuracy=72.446759 loss=1.060826 lr=0.007846 Epoch[030] Batch [2749]/[3760] Speed: 127.688698 samples/sec accuracy=72.420455 loss=1.061340 lr=0.007845 Epoch[030] Batch [2799]/[3760] Speed: 123.218594 samples/sec accuracy=72.405692 loss=1.062145 lr=0.007843 Epoch[030] Batch [2849]/[3760] Speed: 127.206128 samples/sec accuracy=72.382675 loss=1.063137 lr=0.007841 Epoch[030] Batch [2899]/[3760] Speed: 125.836856 samples/sec accuracy=72.369612 loss=1.063514 lr=0.007839 Epoch[030] Batch [2949]/[3760] Speed: 127.822776 samples/sec accuracy=72.359110 loss=1.063496 lr=0.007838 Epoch[030] Batch [2999]/[3760] Speed: 125.705951 samples/sec accuracy=72.331771 loss=1.064589 lr=0.007836 Epoch[030] Batch [3049]/[3760] Speed: 122.852766 samples/sec accuracy=72.329918 loss=1.064932 lr=0.007834 Epoch[030] Batch [3099]/[3760] Speed: 126.089885 samples/sec accuracy=72.311492 loss=1.065344 lr=0.007832 Epoch[030] Batch [3149]/[3760] Speed: 126.901627 samples/sec accuracy=72.310516 loss=1.065773 lr=0.007831 Epoch[030] Batch [3199]/[3760] Speed: 123.741568 samples/sec accuracy=72.307129 loss=1.066596 lr=0.007829 Epoch[030] Batch [3249]/[3760] Speed: 122.380191 samples/sec accuracy=72.300481 loss=1.066895 lr=0.007827 Epoch[030] Batch [3299]/[3760] Speed: 132.399303 samples/sec accuracy=72.315814 loss=1.066370 lr=0.007826 Epoch[030] Batch [3349]/[3760] Speed: 121.298893 samples/sec accuracy=72.326959 loss=1.066266 lr=0.007824 Epoch[030] Batch [3399]/[3760] Speed: 127.841696 samples/sec accuracy=72.325827 loss=1.067028 lr=0.007822 Epoch[030] Batch [3449]/[3760] Speed: 126.248905 samples/sec accuracy=72.302083 loss=1.068125 lr=0.007820 Epoch[030] Batch [3499]/[3760] Speed: 125.126391 samples/sec accuracy=72.274554 loss=1.069016 lr=0.007819 Epoch[030] Batch [3549]/[3760] Speed: 123.937182 samples/sec accuracy=72.260123 loss=1.069241 lr=0.007817 Epoch[030] Batch [3599]/[3760] Speed: 129.384237 samples/sec accuracy=72.257812 loss=1.069661 lr=0.007815 Epoch[030] Batch [3649]/[3760] Speed: 129.367462 samples/sec accuracy=72.241010 loss=1.069944 lr=0.007814 Epoch[030] Batch [3699]/[3760] Speed: 120.080834 samples/sec accuracy=72.226774 loss=1.070254 lr=0.007812 Epoch[030] Batch [3749]/[3760] Speed: 144.473500 samples/sec accuracy=72.220833 loss=1.070577 lr=0.007810 Batch [0049]/[0303]: acc-top1=63.250000 acc-top5=84.687500 Batch [0099]/[0303]: acc-top1=62.671875 acc-top5=84.421875 Batch [0149]/[0303]: acc-top1=62.375000 acc-top5=84.177083 Batch [0199]/[0303]: acc-top1=61.937500 acc-top5=84.000000 Batch [0249]/[0303]: acc-top1=61.950000 acc-top5=83.806250 Batch [0299]/[0303]: acc-top1=61.942708 acc-top5=83.828125 [Epoch 030] training: accuracy=72.215758 loss=1.070802 [Epoch 030] speed: 125 samples/sec time cost: 2109.508136 [Epoch 030] validation: acc-top1=61.937913 acc-top5=83.776815 loss=2.177671 Epoch[031] Batch [0049]/[3760] Speed: 90.775130 samples/sec accuracy=74.625000 loss=0.986426 lr=0.007808 Epoch[031] Batch [0099]/[3760] Speed: 123.871049 samples/sec accuracy=73.937500 loss=1.005050 lr=0.007806 Epoch[031] Batch [0149]/[3760] Speed: 126.349172 samples/sec accuracy=74.468750 loss=0.988899 lr=0.007805 Epoch[031] Batch [0199]/[3760] Speed: 120.696489 samples/sec accuracy=74.367188 loss=0.988927 lr=0.007803 Epoch[031] Batch [0249]/[3760] Speed: 125.667610 samples/sec accuracy=74.275000 loss=0.991918 lr=0.007801 Epoch[031] Batch [0299]/[3760] Speed: 125.196038 samples/sec accuracy=74.427083 loss=0.989814 lr=0.007799 Epoch[031] Batch [0349]/[3760] Speed: 133.536589 samples/sec accuracy=74.276786 loss=0.994694 lr=0.007798 Epoch[031] Batch [0399]/[3760] Speed: 122.882589 samples/sec accuracy=74.085938 loss=1.000310 lr=0.007796 Epoch[031] Batch [0449]/[3760] Speed: 121.318212 samples/sec accuracy=74.086806 loss=0.998888 lr=0.007794 Epoch[031] Batch [0499]/[3760] Speed: 129.621419 samples/sec accuracy=73.940625 loss=1.004175 lr=0.007792 Epoch[031] Batch [0549]/[3760] Speed: 119.138840 samples/sec accuracy=73.914773 loss=1.005333 lr=0.007791 Epoch[031] Batch [0599]/[3760] Speed: 131.588069 samples/sec accuracy=73.768229 loss=1.010371 lr=0.007789 Epoch[031] Batch [0649]/[3760] Speed: 130.049841 samples/sec accuracy=73.680288 loss=1.013146 lr=0.007787 Epoch[031] Batch [0699]/[3760] Speed: 119.182299 samples/sec accuracy=73.651786 loss=1.013041 lr=0.007785 Epoch[031] Batch [0749]/[3760] Speed: 128.752739 samples/sec accuracy=73.570833 loss=1.015482 lr=0.007784 Epoch[031] Batch [0799]/[3760] Speed: 121.834994 samples/sec accuracy=73.531250 loss=1.017514 lr=0.007782 Epoch[031] Batch [0849]/[3760] Speed: 131.225569 samples/sec accuracy=73.558824 loss=1.017397 lr=0.007780 Epoch[031] Batch [0899]/[3760] Speed: 118.603415 samples/sec accuracy=73.569444 loss=1.016903 lr=0.007779 Epoch[031] Batch [0949]/[3760] Speed: 128.297228 samples/sec accuracy=73.516447 loss=1.017905 lr=0.007777 Epoch[031] Batch [0999]/[3760] Speed: 123.734890 samples/sec accuracy=73.493750 loss=1.019778 lr=0.007775 Epoch[031] Batch [1049]/[3760] Speed: 128.732828 samples/sec accuracy=73.401786 loss=1.022442 lr=0.007773 Epoch[031] Batch [1099]/[3760] Speed: 124.971168 samples/sec accuracy=73.436080 loss=1.021732 lr=0.007772 Epoch[031] Batch [1149]/[3760] Speed: 126.221862 samples/sec accuracy=73.437500 loss=1.021942 lr=0.007770 Epoch[031] Batch [1199]/[3760] Speed: 130.963300 samples/sec accuracy=73.363281 loss=1.023178 lr=0.007768 Epoch[031] Batch [1249]/[3760] Speed: 117.852902 samples/sec accuracy=73.378750 loss=1.022921 lr=0.007766 Epoch[031] Batch [1299]/[3760] Speed: 135.628409 samples/sec accuracy=73.352163 loss=1.023588 lr=0.007765 Epoch[031] Batch [1349]/[3760] Speed: 120.283964 samples/sec accuracy=73.305556 loss=1.024032 lr=0.007763 Epoch[031] Batch [1399]/[3760] Speed: 130.489044 samples/sec accuracy=73.299107 loss=1.024574 lr=0.007761 Epoch[031] Batch [1449]/[3760] Speed: 126.911865 samples/sec accuracy=73.330819 loss=1.023256 lr=0.007759 Epoch[031] Batch [1499]/[3760] Speed: 120.273348 samples/sec accuracy=73.288542 loss=1.024956 lr=0.007758 Epoch[031] Batch [1549]/[3760] Speed: 129.108457 samples/sec accuracy=73.276210 loss=1.025442 lr=0.007756 Epoch[031] Batch [1599]/[3760] Speed: 122.539725 samples/sec accuracy=73.255859 loss=1.026101 lr=0.007754 Epoch[031] Batch [1649]/[3760] Speed: 128.338809 samples/sec accuracy=73.246212 loss=1.026493 lr=0.007752 Epoch[031] Batch [1699]/[3760] Speed: 129.851016 samples/sec accuracy=73.189338 loss=1.028561 lr=0.007751 Epoch[031] Batch [1749]/[3760] Speed: 118.644957 samples/sec accuracy=73.180357 loss=1.028626 lr=0.007749 Epoch[031] Batch [1799]/[3760] Speed: 127.798249 samples/sec accuracy=73.164062 loss=1.029789 lr=0.007747 Epoch[031] Batch [1849]/[3760] Speed: 126.610292 samples/sec accuracy=73.161318 loss=1.029993 lr=0.007745 Epoch[031] Batch [1899]/[3760] Speed: 119.853934 samples/sec accuracy=73.142270 loss=1.031510 lr=0.007744 Epoch[031] Batch [1949]/[3760] Speed: 135.231926 samples/sec accuracy=73.124199 loss=1.032677 lr=0.007742 Epoch[031] Batch [1999]/[3760] Speed: 118.367391 samples/sec accuracy=73.108594 loss=1.033266 lr=0.007740 Epoch[031] Batch [2049]/[3760] Speed: 132.029417 samples/sec accuracy=73.072409 loss=1.034478 lr=0.007738 Epoch[031] Batch [2099]/[3760] Speed: 117.700385 samples/sec accuracy=73.038690 loss=1.035232 lr=0.007737 Epoch[031] Batch [2149]/[3760] Speed: 131.275957 samples/sec accuracy=72.993459 loss=1.037049 lr=0.007735 Epoch[031] Batch [2199]/[3760] Speed: 126.777000 samples/sec accuracy=72.956676 loss=1.038279 lr=0.007733 Epoch[031] Batch [2249]/[3760] Speed: 126.183334 samples/sec accuracy=72.952083 loss=1.038349 lr=0.007731 Epoch[031] Batch [2299]/[3760] Speed: 129.156235 samples/sec accuracy=72.934783 loss=1.038647 lr=0.007730 Epoch[031] Batch [2349]/[3760] Speed: 124.212111 samples/sec accuracy=72.931516 loss=1.039043 lr=0.007728 Epoch[031] Batch [2399]/[3760] Speed: 126.183345 samples/sec accuracy=72.923828 loss=1.039741 lr=0.007726 Epoch[031] Batch [2449]/[3760] Speed: 128.529902 samples/sec accuracy=72.915816 loss=1.040560 lr=0.007724 Epoch[031] Batch [2499]/[3760] Speed: 121.583522 samples/sec accuracy=72.913750 loss=1.040696 lr=0.007723 Epoch[031] Batch [2549]/[3760] Speed: 130.763391 samples/sec accuracy=72.903186 loss=1.041272 lr=0.007721 Epoch[031] Batch [2599]/[3760] Speed: 120.819149 samples/sec accuracy=72.885216 loss=1.042039 lr=0.007719 Epoch[031] Batch [2649]/[3760] Speed: 128.632434 samples/sec accuracy=72.861439 loss=1.042943 lr=0.007717 Epoch[031] Batch [2699]/[3760] Speed: 118.301270 samples/sec accuracy=72.875000 loss=1.042263 lr=0.007716 Epoch[031] Batch [2749]/[3760] Speed: 130.466982 samples/sec accuracy=72.842045 loss=1.043267 lr=0.007714 Epoch[031] Batch [2799]/[3760] Speed: 122.778879 samples/sec accuracy=72.824219 loss=1.043900 lr=0.007712 Epoch[031] Batch [2849]/[3760] Speed: 128.064972 samples/sec accuracy=72.786184 loss=1.045315 lr=0.007710 Epoch[031] Batch [2899]/[3760] Speed: 126.236450 samples/sec accuracy=72.784483 loss=1.045227 lr=0.007709 Epoch[031] Batch [2949]/[3760] Speed: 125.041881 samples/sec accuracy=72.752119 loss=1.046380 lr=0.007707 Epoch[031] Batch [2999]/[3760] Speed: 122.782679 samples/sec accuracy=72.738542 loss=1.046913 lr=0.007705 Epoch[031] Batch [3049]/[3760] Speed: 129.949585 samples/sec accuracy=72.725410 loss=1.047740 lr=0.007703 Epoch[031] Batch [3099]/[3760] Speed: 122.984323 samples/sec accuracy=72.707661 loss=1.048798 lr=0.007702 Epoch[031] Batch [3149]/[3760] Speed: 127.582990 samples/sec accuracy=72.698909 loss=1.049094 lr=0.007700 Epoch[031] Batch [3199]/[3760] Speed: 122.687332 samples/sec accuracy=72.668457 loss=1.049908 lr=0.007698 Epoch[031] Batch [3249]/[3760] Speed: 133.429067 samples/sec accuracy=72.653846 loss=1.050217 lr=0.007696 Epoch[031] Batch [3299]/[3760] Speed: 118.228754 samples/sec accuracy=72.646307 loss=1.050818 lr=0.007695 Epoch[031] Batch [3349]/[3760] Speed: 128.947813 samples/sec accuracy=72.606343 loss=1.052073 lr=0.007693 Epoch[031] Batch [3399]/[3760] Speed: 127.054134 samples/sec accuracy=72.616268 loss=1.052057 lr=0.007691 Epoch[031] Batch [3449]/[3760] Speed: 124.974791 samples/sec accuracy=72.593297 loss=1.052579 lr=0.007689 Epoch[031] Batch [3499]/[3760] Speed: 124.975756 samples/sec accuracy=72.597321 loss=1.052439 lr=0.007688 Epoch[031] Batch [3549]/[3760] Speed: 125.915746 samples/sec accuracy=72.606954 loss=1.052117 lr=0.007686 Epoch[031] Batch [3599]/[3760] Speed: 123.490869 samples/sec accuracy=72.587674 loss=1.052910 lr=0.007684 Epoch[031] Batch [3649]/[3760] Speed: 129.952511 samples/sec accuracy=72.578339 loss=1.053166 lr=0.007682 Epoch[031] Batch [3699]/[3760] Speed: 130.814880 samples/sec accuracy=72.556166 loss=1.054057 lr=0.007680 Epoch[031] Batch [3749]/[3760] Speed: 131.017841 samples/sec accuracy=72.550833 loss=1.054178 lr=0.007679 Batch [0049]/[0303]: acc-top1=62.500000 acc-top5=85.093750 Batch [0099]/[0303]: acc-top1=62.343750 acc-top5=84.515625 Batch [0149]/[0303]: acc-top1=62.281250 acc-top5=84.375000 Batch [0199]/[0303]: acc-top1=61.843750 acc-top5=84.195312 Batch [0249]/[0303]: acc-top1=61.906250 acc-top5=84.187500 Batch [0299]/[0303]: acc-top1=61.880208 acc-top5=84.140625 [Epoch 031] training: accuracy=72.547789 loss=1.054386 [Epoch 031] speed: 125 samples/sec time cost: 2110.591716 [Epoch 031] validation: acc-top1=61.850248 acc-top5=84.117162 loss=2.178591 Epoch[032] Batch [0049]/[3759] Speed: 90.033159 samples/sec accuracy=74.843750 loss=0.964122 lr=0.007677 Epoch[032] Batch [0099]/[3759] Speed: 128.973497 samples/sec accuracy=74.296875 loss=1.003990 lr=0.007675 Epoch[032] Batch [0149]/[3759] Speed: 122.610484 samples/sec accuracy=74.447917 loss=0.995150 lr=0.007673 Epoch[032] Batch [0199]/[3759] Speed: 130.733928 samples/sec accuracy=74.492188 loss=0.988980 lr=0.007671 Epoch[032] Batch [0249]/[3759] Speed: 121.726074 samples/sec accuracy=74.368750 loss=0.993849 lr=0.007670 Epoch[032] Batch [0299]/[3759] Speed: 127.001696 samples/sec accuracy=74.156250 loss=0.997156 lr=0.007668 Epoch[032] Batch [0349]/[3759] Speed: 127.729373 samples/sec accuracy=74.169643 loss=0.995999 lr=0.007666 Epoch[032] Batch [0399]/[3759] Speed: 117.903384 samples/sec accuracy=73.972656 loss=1.002306 lr=0.007664 Epoch[032] Batch [0449]/[3759] Speed: 135.389243 samples/sec accuracy=73.951389 loss=1.003481 lr=0.007662 Epoch[032] Batch [0499]/[3759] Speed: 121.418305 samples/sec accuracy=73.865625 loss=1.005117 lr=0.007661 Epoch[032] Batch [0549]/[3759] Speed: 129.978044 samples/sec accuracy=73.849432 loss=1.005624 lr=0.007659 Epoch[032] Batch [0599]/[3759] Speed: 124.035188 samples/sec accuracy=73.833333 loss=1.005491 lr=0.007657 Epoch[032] Batch [0649]/[3759] Speed: 126.465132 samples/sec accuracy=73.817308 loss=1.005912 lr=0.007655 Epoch[032] Batch [0699]/[3759] Speed: 124.270631 samples/sec accuracy=73.866071 loss=1.003952 lr=0.007654 Epoch[032] Batch [0749]/[3759] Speed: 127.837051 samples/sec accuracy=73.927083 loss=1.001531 lr=0.007652 Epoch[032] Batch [0799]/[3759] Speed: 120.659563 samples/sec accuracy=73.908203 loss=1.001996 lr=0.007650 Epoch[032] Batch [0849]/[3759] Speed: 131.965035 samples/sec accuracy=73.863971 loss=1.003373 lr=0.007648 Epoch[032] Batch [0899]/[3759] Speed: 129.896256 samples/sec accuracy=73.848958 loss=1.005767 lr=0.007647 Epoch[032] Batch [0949]/[3759] Speed: 118.451191 samples/sec accuracy=73.782895 loss=1.007370 lr=0.007645 Epoch[032] Batch [0999]/[3759] Speed: 128.178111 samples/sec accuracy=73.754688 loss=1.008005 lr=0.007643 Epoch[032] Batch [1049]/[3759] Speed: 131.218809 samples/sec accuracy=73.784226 loss=1.007542 lr=0.007641 Epoch[032] Batch [1099]/[3759] Speed: 118.637825 samples/sec accuracy=73.775568 loss=1.008876 lr=0.007639 Epoch[032] Batch [1149]/[3759] Speed: 130.993892 samples/sec accuracy=73.798913 loss=1.008855 lr=0.007638 Epoch[032] Batch [1199]/[3759] Speed: 122.354355 samples/sec accuracy=73.812500 loss=1.009667 lr=0.007636 Epoch[032] Batch [1249]/[3759] Speed: 125.977829 samples/sec accuracy=73.780000 loss=1.010126 lr=0.007634 Epoch[032] Batch [1299]/[3759] Speed: 122.396038 samples/sec accuracy=73.760817 loss=1.011507 lr=0.007632 Epoch[032] Batch [1349]/[3759] Speed: 125.661895 samples/sec accuracy=73.684028 loss=1.013633 lr=0.007631 Epoch[032] Batch [1399]/[3759] Speed: 131.940287 samples/sec accuracy=73.648438 loss=1.014073 lr=0.007629 Epoch[032] Batch [1449]/[3759] Speed: 117.977074 samples/sec accuracy=73.636853 loss=1.015548 lr=0.007627 Epoch[032] Batch [1499]/[3759] Speed: 134.336849 samples/sec accuracy=73.604167 loss=1.016105 lr=0.007625 Epoch[032] Batch [1549]/[3759] Speed: 119.664029 samples/sec accuracy=73.590726 loss=1.017682 lr=0.007623 Epoch[032] Batch [1599]/[3759] Speed: 130.655927 samples/sec accuracy=73.529297 loss=1.019077 lr=0.007622 Epoch[032] Batch [1649]/[3759] Speed: 121.132701 samples/sec accuracy=73.514205 loss=1.019770 lr=0.007620 Epoch[032] Batch [1699]/[3759] Speed: 125.868509 samples/sec accuracy=73.463235 loss=1.021881 lr=0.007618 Epoch[032] Batch [1749]/[3759] Speed: 129.030528 samples/sec accuracy=73.458036 loss=1.021687 lr=0.007616 Epoch[032] Batch [1799]/[3759] Speed: 123.809480 samples/sec accuracy=73.414931 loss=1.022755 lr=0.007615 Epoch[032] Batch [1849]/[3759] Speed: 124.629906 samples/sec accuracy=73.376689 loss=1.023854 lr=0.007613 Epoch[032] Batch [1899]/[3759] Speed: 123.638971 samples/sec accuracy=73.370888 loss=1.023590 lr=0.007611 Epoch[032] Batch [1949]/[3759] Speed: 130.219039 samples/sec accuracy=73.373397 loss=1.024198 lr=0.007609 Epoch[032] Batch [1999]/[3759] Speed: 120.415201 samples/sec accuracy=73.360156 loss=1.024941 lr=0.007607 Epoch[032] Batch [2049]/[3759] Speed: 127.140583 samples/sec accuracy=73.336128 loss=1.026194 lr=0.007606 Epoch[032] Batch [2099]/[3759] Speed: 123.818819 samples/sec accuracy=73.328125 loss=1.026802 lr=0.007604 Epoch[032] Batch [2149]/[3759] Speed: 126.258817 samples/sec accuracy=73.342297 loss=1.026762 lr=0.007602 Epoch[032] Batch [2199]/[3759] Speed: 133.180756 samples/sec accuracy=73.333807 loss=1.027374 lr=0.007600 Epoch[032] Batch [2249]/[3759] Speed: 118.005309 samples/sec accuracy=73.324306 loss=1.027589 lr=0.007599 Epoch[032] Batch [2299]/[3759] Speed: 131.718363 samples/sec accuracy=73.296196 loss=1.028872 lr=0.007597 Epoch[032] Batch [2349]/[3759] Speed: 121.188907 samples/sec accuracy=73.261968 loss=1.030442 lr=0.007595 Epoch[032] Batch [2399]/[3759] Speed: 125.440365 samples/sec accuracy=73.236979 loss=1.030991 lr=0.007593 Epoch[032] Batch [2449]/[3759] Speed: 121.372087 samples/sec accuracy=73.235332 loss=1.031525 lr=0.007591 Epoch[032] Batch [2499]/[3759] Speed: 134.258298 samples/sec accuracy=73.180000 loss=1.033544 lr=0.007590 Epoch[032] Batch [2549]/[3759] Speed: 120.352622 samples/sec accuracy=73.175858 loss=1.034299 lr=0.007588 Epoch[032] Batch [2599]/[3759] Speed: 126.488716 samples/sec accuracy=73.168870 loss=1.034593 lr=0.007586 Epoch[032] Batch [2649]/[3759] Speed: 133.226991 samples/sec accuracy=73.166863 loss=1.035273 lr=0.007584 Epoch[032] Batch [2699]/[3759] Speed: 117.819420 samples/sec accuracy=73.169560 loss=1.035286 lr=0.007582 Epoch[032] Batch [2749]/[3759] Speed: 133.452387 samples/sec accuracy=73.151705 loss=1.035798 lr=0.007581 Epoch[032] Batch [2799]/[3759] Speed: 123.838104 samples/sec accuracy=73.122768 loss=1.036685 lr=0.007579 Epoch[032] Batch [2849]/[3759] Speed: 120.327963 samples/sec accuracy=73.111294 loss=1.037388 lr=0.007577 Epoch[032] Batch [2899]/[3759] Speed: 129.592191 samples/sec accuracy=73.122306 loss=1.037299 lr=0.007575 Epoch[032] Batch [2949]/[3759] Speed: 125.302664 samples/sec accuracy=73.111229 loss=1.037141 lr=0.007573 Epoch[032] Batch [2999]/[3759] Speed: 125.179379 samples/sec accuracy=73.087500 loss=1.038181 lr=0.007572 Epoch[032] Batch [3049]/[3759] Speed: 126.443148 samples/sec accuracy=73.086578 loss=1.038246 lr=0.007570 Epoch[032] Batch [3099]/[3759] Speed: 121.167278 samples/sec accuracy=73.055444 loss=1.039791 lr=0.007568 Epoch[032] Batch [3149]/[3759] Speed: 134.123345 samples/sec accuracy=73.026786 loss=1.040591 lr=0.007566 Epoch[032] Batch [3199]/[3759] Speed: 117.776180 samples/sec accuracy=73.005371 loss=1.041187 lr=0.007565 Epoch[032] Batch [3249]/[3759] Speed: 130.499439 samples/sec accuracy=73.001442 loss=1.041612 lr=0.007563 Epoch[032] Batch [3299]/[3759] Speed: 121.243997 samples/sec accuracy=72.997633 loss=1.041780 lr=0.007561 Epoch[032] Batch [3349]/[3759] Speed: 127.489845 samples/sec accuracy=72.994403 loss=1.041968 lr=0.007559 Epoch[032] Batch [3399]/[3759] Speed: 125.696562 samples/sec accuracy=72.992188 loss=1.042150 lr=0.007557 Epoch[032] Batch [3449]/[3759] Speed: 127.794489 samples/sec accuracy=72.961504 loss=1.043507 lr=0.007556 Epoch[032] Batch [3499]/[3759] Speed: 117.511541 samples/sec accuracy=72.952679 loss=1.044396 lr=0.007554 Epoch[032] Batch [3549]/[3759] Speed: 129.714867 samples/sec accuracy=72.928697 loss=1.045206 lr=0.007552 Epoch[032] Batch [3599]/[3759] Speed: 125.734796 samples/sec accuracy=72.918837 loss=1.045388 lr=0.007550 Epoch[032] Batch [3649]/[3759] Speed: 127.919620 samples/sec accuracy=72.914812 loss=1.045761 lr=0.007548 Epoch[032] Batch [3699]/[3759] Speed: 121.857477 samples/sec accuracy=72.894003 loss=1.046602 lr=0.007547 Epoch[032] Batch [3749]/[3759] Speed: 148.713249 samples/sec accuracy=72.877083 loss=1.047334 lr=0.007545 Batch [0049]/[0303]: acc-top1=62.718750 acc-top5=85.281250 Batch [0099]/[0303]: acc-top1=62.515625 acc-top5=84.609375 Batch [0149]/[0303]: acc-top1=62.281250 acc-top5=84.281250 Batch [0199]/[0303]: acc-top1=61.718750 acc-top5=84.203125 Batch [0249]/[0303]: acc-top1=61.968750 acc-top5=84.237500 Batch [0299]/[0303]: acc-top1=62.072917 acc-top5=84.276042 [Epoch 032] training: accuracy=72.880088 loss=1.047248 [Epoch 032] speed: 125 samples/sec time cost: 2109.208144 [Epoch 032] validation: acc-top1=62.046205 acc-top5=84.235767 loss=2.096934 Epoch[033] Batch [0049]/[3760] Speed: 89.796991 samples/sec accuracy=74.531250 loss=0.970900 lr=0.007543 Epoch[033] Batch [0099]/[3760] Speed: 128.153554 samples/sec accuracy=74.656250 loss=0.955959 lr=0.007541 Epoch[033] Batch [0149]/[3760] Speed: 127.534434 samples/sec accuracy=74.500000 loss=0.977000 lr=0.007539 Epoch[033] Batch [0199]/[3760] Speed: 123.507041 samples/sec accuracy=74.265625 loss=0.987132 lr=0.007537 Epoch[033] Batch [0249]/[3760] Speed: 126.121226 samples/sec accuracy=74.400000 loss=0.979792 lr=0.007535 Epoch[033] Batch [0299]/[3760] Speed: 127.168627 samples/sec accuracy=74.401042 loss=0.979123 lr=0.007534 Epoch[033] Batch [0349]/[3760] Speed: 126.122391 samples/sec accuracy=74.263393 loss=0.989825 lr=0.007532 Epoch[033] Batch [0399]/[3760] Speed: 120.601864 samples/sec accuracy=74.296875 loss=0.992432 lr=0.007530 Epoch[033] Batch [0449]/[3760] Speed: 128.101367 samples/sec accuracy=74.368056 loss=0.990783 lr=0.007528 Epoch[033] Batch [0499]/[3760] Speed: 127.790121 samples/sec accuracy=74.346875 loss=0.992645 lr=0.007526 Epoch[033] Batch [0549]/[3760] Speed: 124.809724 samples/sec accuracy=74.426136 loss=0.991456 lr=0.007525 Epoch[033] Batch [0599]/[3760] Speed: 125.039265 samples/sec accuracy=74.359375 loss=0.993703 lr=0.007523 Epoch[033] Batch [0649]/[3760] Speed: 123.901247 samples/sec accuracy=74.389423 loss=0.993435 lr=0.007521 Epoch[033] Batch [0699]/[3760] Speed: 132.332614 samples/sec accuracy=74.359375 loss=0.993931 lr=0.007519 Epoch[033] Batch [0749]/[3760] Speed: 118.322178 samples/sec accuracy=74.275000 loss=0.994190 lr=0.007517 Epoch[033] Batch [0799]/[3760] Speed: 132.249355 samples/sec accuracy=74.335938 loss=0.991548 lr=0.007516 Epoch[033] Batch [0849]/[3760] Speed: 122.255981 samples/sec accuracy=74.369485 loss=0.990087 lr=0.007514 Epoch[033] Batch [0899]/[3760] Speed: 128.714312 samples/sec accuracy=74.364583 loss=0.989951 lr=0.007512 Epoch[033] Batch [0949]/[3760] Speed: 119.000717 samples/sec accuracy=74.368421 loss=0.989378 lr=0.007510 Epoch[033] Batch [0999]/[3760] Speed: 130.639121 samples/sec accuracy=74.328125 loss=0.989656 lr=0.007508 Epoch[033] Batch [1049]/[3760] Speed: 128.629015 samples/sec accuracy=74.309524 loss=0.990469 lr=0.007507 Epoch[033] Batch [1099]/[3760] Speed: 121.463117 samples/sec accuracy=74.286932 loss=0.990230 lr=0.007505 Epoch[033] Batch [1149]/[3760] Speed: 130.925297 samples/sec accuracy=74.298913 loss=0.990455 lr=0.007503 Epoch[033] Batch [1199]/[3760] Speed: 121.843190 samples/sec accuracy=74.263021 loss=0.992539 lr=0.007501 Epoch[033] Batch [1249]/[3760] Speed: 124.875853 samples/sec accuracy=74.226250 loss=0.993778 lr=0.007499 Epoch[033] Batch [1299]/[3760] Speed: 129.245341 samples/sec accuracy=74.180288 loss=0.996351 lr=0.007498 Epoch[033] Batch [1349]/[3760] Speed: 115.247039 samples/sec accuracy=74.121528 loss=0.998441 lr=0.007496 Epoch[033] Batch [1399]/[3760] Speed: 134.595945 samples/sec accuracy=74.117188 loss=0.999167 lr=0.007494 Epoch[033] Batch [1449]/[3760] Speed: 125.717983 samples/sec accuracy=74.094828 loss=1.000272 lr=0.007492 Epoch[033] Batch [1499]/[3760] Speed: 121.466429 samples/sec accuracy=74.035417 loss=1.002145 lr=0.007490 Epoch[033] Batch [1549]/[3760] Speed: 122.787835 samples/sec accuracy=74.003024 loss=1.003821 lr=0.007488 Epoch[033] Batch [1599]/[3760] Speed: 127.468291 samples/sec accuracy=73.975586 loss=1.005050 lr=0.007487 Epoch[033] Batch [1649]/[3760] Speed: 129.447631 samples/sec accuracy=73.953598 loss=1.006264 lr=0.007485 Epoch[033] Batch [1699]/[3760] Speed: 126.736536 samples/sec accuracy=73.905331 loss=1.008055 lr=0.007483 Epoch[033] Batch [1749]/[3760] Speed: 117.491935 samples/sec accuracy=73.861607 loss=1.009235 lr=0.007481 Epoch[033] Batch [1799]/[3760] Speed: 135.629317 samples/sec accuracy=73.819444 loss=1.010271 lr=0.007479 Epoch[033] Batch [1849]/[3760] Speed: 114.996390 samples/sec accuracy=73.800676 loss=1.011280 lr=0.007478 Epoch[033] Batch [1899]/[3760] Speed: 136.260459 samples/sec accuracy=73.795230 loss=1.011464 lr=0.007476 Epoch[033] Batch [1949]/[3760] Speed: 119.136900 samples/sec accuracy=73.745994 loss=1.013392 lr=0.007474 Epoch[033] Batch [1999]/[3760] Speed: 129.632446 samples/sec accuracy=73.727344 loss=1.014775 lr=0.007472 Epoch[033] Batch [2049]/[3760] Speed: 119.462167 samples/sec accuracy=73.692835 loss=1.015804 lr=0.007470 Epoch[033] Batch [2099]/[3760] Speed: 133.269826 samples/sec accuracy=73.663690 loss=1.016900 lr=0.007469 Epoch[033] Batch [2149]/[3760] Speed: 114.930597 samples/sec accuracy=73.675872 loss=1.016301 lr=0.007467 Epoch[033] Batch [2199]/[3760] Speed: 132.998662 samples/sec accuracy=73.632102 loss=1.018215 lr=0.007465 Epoch[033] Batch [2249]/[3760] Speed: 134.008062 samples/sec accuracy=73.602778 loss=1.018834 lr=0.007463 Epoch[033] Batch [2299]/[3760] Speed: 114.505352 samples/sec accuracy=73.568614 loss=1.020004 lr=0.007461 Epoch[033] Batch [2349]/[3760] Speed: 132.471834 samples/sec accuracy=73.544548 loss=1.021558 lr=0.007459 Epoch[033] Batch [2399]/[3760] Speed: 124.374390 samples/sec accuracy=73.533203 loss=1.021841 lr=0.007458 Epoch[033] Batch [2449]/[3760] Speed: 126.690071 samples/sec accuracy=73.535714 loss=1.022322 lr=0.007456 Epoch[033] Batch [2499]/[3760] Speed: 120.130111 samples/sec accuracy=73.553125 loss=1.022299 lr=0.007454 Epoch[033] Batch [2549]/[3760] Speed: 131.300838 samples/sec accuracy=73.514706 loss=1.023318 lr=0.007452 Epoch[033] Batch [2599]/[3760] Speed: 119.661486 samples/sec accuracy=73.489784 loss=1.024340 lr=0.007450 Epoch[033] Batch [2649]/[3760] Speed: 133.434275 samples/sec accuracy=73.466392 loss=1.025187 lr=0.007448 Epoch[033] Batch [2699]/[3760] Speed: 122.880112 samples/sec accuracy=73.427662 loss=1.025508 lr=0.007447 Epoch[033] Batch [2749]/[3760] Speed: 119.600465 samples/sec accuracy=73.411364 loss=1.026042 lr=0.007445 Epoch[033] Batch [2799]/[3760] Speed: 135.363286 samples/sec accuracy=73.397879 loss=1.026550 lr=0.007443 Epoch[033] Batch [2849]/[3760] Speed: 120.659329 samples/sec accuracy=73.379386 loss=1.027128 lr=0.007441 Epoch[033] Batch [2899]/[3760] Speed: 130.977319 samples/sec accuracy=73.351293 loss=1.028271 lr=0.007439 Epoch[033] Batch [2949]/[3760] Speed: 122.379947 samples/sec accuracy=73.323093 loss=1.029401 lr=0.007438 Epoch[033] Batch [2999]/[3760] Speed: 126.013141 samples/sec accuracy=73.319271 loss=1.029765 lr=0.007436 Epoch[033] Batch [3049]/[3760] Speed: 128.392820 samples/sec accuracy=73.280738 loss=1.030801 lr=0.007434 Epoch[033] Batch [3099]/[3760] Speed: 126.527508 samples/sec accuracy=73.255040 loss=1.031788 lr=0.007432 Epoch[033] Batch [3149]/[3760] Speed: 123.375802 samples/sec accuracy=73.242063 loss=1.032001 lr=0.007430 Epoch[033] Batch [3199]/[3760] Speed: 128.605757 samples/sec accuracy=73.232422 loss=1.032083 lr=0.007428 Epoch[033] Batch [3249]/[3760] Speed: 121.108049 samples/sec accuracy=73.204808 loss=1.033023 lr=0.007427 Epoch[033] Batch [3299]/[3760] Speed: 129.330060 samples/sec accuracy=73.195076 loss=1.033155 lr=0.007425 Epoch[033] Batch [3349]/[3760] Speed: 120.791925 samples/sec accuracy=73.185168 loss=1.033656 lr=0.007423 Epoch[033] Batch [3399]/[3760] Speed: 131.608426 samples/sec accuracy=73.159926 loss=1.034144 lr=0.007421 Epoch[033] Batch [3449]/[3760] Speed: 124.865303 samples/sec accuracy=73.141757 loss=1.034171 lr=0.007419 Epoch[033] Batch [3499]/[3760] Speed: 123.807720 samples/sec accuracy=73.121875 loss=1.034774 lr=0.007417 Epoch[033] Batch [3549]/[3760] Speed: 131.817106 samples/sec accuracy=73.125000 loss=1.034741 lr=0.007416 Epoch[033] Batch [3599]/[3760] Speed: 119.223593 samples/sec accuracy=73.085069 loss=1.035745 lr=0.007414 Epoch[033] Batch [3649]/[3760] Speed: 133.551637 samples/sec accuracy=73.078767 loss=1.036186 lr=0.007412 Epoch[033] Batch [3699]/[3760] Speed: 122.103277 samples/sec accuracy=73.049831 loss=1.037506 lr=0.007410 Epoch[033] Batch [3749]/[3760] Speed: 144.685768 samples/sec accuracy=73.026667 loss=1.038674 lr=0.007408 Batch [0049]/[0303]: acc-top1=63.093750 acc-top5=84.625000 Batch [0099]/[0303]: acc-top1=62.890625 acc-top5=84.421875 Batch [0149]/[0303]: acc-top1=62.593750 acc-top5=84.270833 Batch [0199]/[0303]: acc-top1=61.929688 acc-top5=84.062500 Batch [0249]/[0303]: acc-top1=62.037500 acc-top5=84.075000 Batch [0299]/[0303]: acc-top1=62.015625 acc-top5=84.104167 [Epoch 033] training: accuracy=73.023604 loss=1.038751 [Epoch 033] speed: 125 samples/sec time cost: 2109.680099 [Epoch 033] validation: acc-top1=61.943069 acc-top5=84.086221 loss=2.083402 Epoch[034] Batch [0049]/[3759] Speed: 86.888389 samples/sec accuracy=75.312500 loss=0.977626 lr=0.007406 Epoch[034] Batch [0099]/[3759] Speed: 133.227040 samples/sec accuracy=75.343750 loss=0.956805 lr=0.007404 Epoch[034] Batch [0149]/[3759] Speed: 131.267201 samples/sec accuracy=74.750000 loss=0.967332 lr=0.007402 Epoch[034] Batch [0199]/[3759] Speed: 116.318836 samples/sec accuracy=74.867188 loss=0.962583 lr=0.007401 Epoch[034] Batch [0249]/[3759] Speed: 132.438386 samples/sec accuracy=74.506250 loss=0.968631 lr=0.007399 Epoch[034] Batch [0299]/[3759] Speed: 118.580569 samples/sec accuracy=74.442708 loss=0.972818 lr=0.007397 Epoch[034] Batch [0349]/[3759] Speed: 132.221537 samples/sec accuracy=74.424107 loss=0.974664 lr=0.007395 Epoch[034] Batch [0399]/[3759] Speed: 119.279864 samples/sec accuracy=74.300781 loss=0.978895 lr=0.007393 Epoch[034] Batch [0449]/[3759] Speed: 126.087218 samples/sec accuracy=74.451389 loss=0.976578 lr=0.007391 Epoch[034] Batch [0499]/[3759] Speed: 127.920714 samples/sec accuracy=74.434375 loss=0.976942 lr=0.007390 Epoch[034] Batch [0549]/[3759] Speed: 121.285765 samples/sec accuracy=74.465909 loss=0.977940 lr=0.007388 Epoch[034] Batch [0599]/[3759] Speed: 127.420497 samples/sec accuracy=74.328125 loss=0.983438 lr=0.007386 Epoch[034] Batch [0649]/[3759] Speed: 134.490569 samples/sec accuracy=74.274038 loss=0.987415 lr=0.007384 Epoch[034] Batch [0699]/[3759] Speed: 118.385691 samples/sec accuracy=74.212054 loss=0.991416 lr=0.007382 Epoch[034] Batch [0749]/[3759] Speed: 130.233270 samples/sec accuracy=74.258333 loss=0.991929 lr=0.007380 Epoch[034] Batch [0799]/[3759] Speed: 117.604953 samples/sec accuracy=74.281250 loss=0.989357 lr=0.007379 Epoch[034] Batch [0849]/[3759] Speed: 127.606203 samples/sec accuracy=74.187500 loss=0.992127 lr=0.007377 Epoch[034] Batch [0899]/[3759] Speed: 133.187578 samples/sec accuracy=74.142361 loss=0.994282 lr=0.007375 Epoch[034] Batch [0949]/[3759] Speed: 118.989413 samples/sec accuracy=74.082237 loss=0.995384 lr=0.007373 Epoch[034] Batch [0999]/[3759] Speed: 128.966285 samples/sec accuracy=74.075000 loss=0.994606 lr=0.007371 Epoch[034] Batch [1049]/[3759] Speed: 121.478538 samples/sec accuracy=74.028274 loss=0.994309 lr=0.007369 Epoch[034] Batch [1099]/[3759] Speed: 130.230670 samples/sec accuracy=74.048295 loss=0.994720 lr=0.007368 Epoch[034] Batch [1149]/[3759] Speed: 115.856518 samples/sec accuracy=74.014946 loss=0.994873 lr=0.007366 Epoch[034] Batch [1199]/[3759] Speed: 134.468562 samples/sec accuracy=73.940104 loss=0.996772 lr=0.007364 Epoch[034] Batch [1249]/[3759] Speed: 126.355230 samples/sec accuracy=73.926250 loss=0.997864 lr=0.007362 Epoch[034] Batch [1299]/[3759] Speed: 121.690458 samples/sec accuracy=73.950721 loss=0.997695 lr=0.007360 Epoch[034] Batch [1349]/[3759] Speed: 132.072923 samples/sec accuracy=73.896991 loss=1.000101 lr=0.007358 Epoch[034] Batch [1399]/[3759] Speed: 121.556735 samples/sec accuracy=73.895089 loss=1.000533 lr=0.007357 Epoch[034] Batch [1449]/[3759] Speed: 126.510191 samples/sec accuracy=73.915948 loss=0.999324 lr=0.007355 Epoch[034] Batch [1499]/[3759] Speed: 125.522757 samples/sec accuracy=73.939583 loss=0.998924 lr=0.007353 Epoch[034] Batch [1549]/[3759] Speed: 128.450952 samples/sec accuracy=73.925403 loss=0.999405 lr=0.007351 Epoch[034] Batch [1599]/[3759] Speed: 122.677907 samples/sec accuracy=73.883789 loss=1.000506 lr=0.007349 Epoch[034] Batch [1649]/[3759] Speed: 128.358248 samples/sec accuracy=73.931818 loss=1.000162 lr=0.007347 Epoch[034] Batch [1699]/[3759] Speed: 124.034400 samples/sec accuracy=73.897978 loss=1.001376 lr=0.007345 Epoch[034] Batch [1749]/[3759] Speed: 129.039692 samples/sec accuracy=73.836607 loss=1.004184 lr=0.007344 Epoch[034] Batch [1799]/[3759] Speed: 121.550087 samples/sec accuracy=73.822917 loss=1.004125 lr=0.007342 Epoch[034] Batch [1849]/[3759] Speed: 127.196462 samples/sec accuracy=73.777027 loss=1.005543 lr=0.007340 Epoch[034] Batch [1899]/[3759] Speed: 125.228668 samples/sec accuracy=73.737664 loss=1.007425 lr=0.007338 Epoch[034] Batch [1949]/[3759] Speed: 122.307463 samples/sec accuracy=73.740385 loss=1.007633 lr=0.007336 Epoch[034] Batch [1999]/[3759] Speed: 133.218442 samples/sec accuracy=73.721875 loss=1.008479 lr=0.007334 Epoch[034] Batch [2049]/[3759] Speed: 117.610275 samples/sec accuracy=73.723323 loss=1.008740 lr=0.007333 Epoch[034] Batch [2099]/[3759] Speed: 131.540469 samples/sec accuracy=73.731399 loss=1.009061 lr=0.007331 Epoch[034] Batch [2149]/[3759] Speed: 124.105078 samples/sec accuracy=73.687500 loss=1.010076 lr=0.007329 Epoch[034] Batch [2199]/[3759] Speed: 122.634310 samples/sec accuracy=73.666193 loss=1.010625 lr=0.007327 Epoch[034] Batch [2249]/[3759] Speed: 132.886282 samples/sec accuracy=73.646528 loss=1.011900 lr=0.007325 Epoch[034] Batch [2299]/[3759] Speed: 117.998200 samples/sec accuracy=73.628397 loss=1.012722 lr=0.007323 Epoch[034] Batch [2349]/[3759] Speed: 131.446220 samples/sec accuracy=73.605718 loss=1.013763 lr=0.007321 Epoch[034] Batch [2399]/[3759] Speed: 120.394301 samples/sec accuracy=73.578125 loss=1.014384 lr=0.007320 Epoch[034] Batch [2449]/[3759] Speed: 132.956217 samples/sec accuracy=73.563138 loss=1.014652 lr=0.007318 Epoch[034] Batch [2499]/[3759] Speed: 119.547160 samples/sec accuracy=73.578750 loss=1.014317 lr=0.007316 Epoch[034] Batch [2549]/[3759] Speed: 128.929420 samples/sec accuracy=73.567402 loss=1.014747 lr=0.007314 Epoch[034] Batch [2599]/[3759] Speed: 129.194066 samples/sec accuracy=73.572716 loss=1.015106 lr=0.007312 Epoch[034] Batch [2649]/[3759] Speed: 117.369211 samples/sec accuracy=73.547170 loss=1.016299 lr=0.007310 Epoch[034] Batch [2699]/[3759] Speed: 134.503952 samples/sec accuracy=73.556134 loss=1.016180 lr=0.007308 Epoch[034] Batch [2749]/[3759] Speed: 117.479776 samples/sec accuracy=73.559659 loss=1.016748 lr=0.007307 Epoch[034] Batch [2799]/[3759] Speed: 127.139450 samples/sec accuracy=73.529576 loss=1.017590 lr=0.007305 Epoch[034] Batch [2849]/[3759] Speed: 132.077787 samples/sec accuracy=73.498904 loss=1.018444 lr=0.007303 Epoch[034] Batch [2899]/[3759] Speed: 119.568983 samples/sec accuracy=73.479526 loss=1.019652 lr=0.007301 Epoch[034] Batch [2949]/[3759] Speed: 128.188579 samples/sec accuracy=73.474576 loss=1.020301 lr=0.007299 Epoch[034] Batch [2999]/[3759] Speed: 124.727250 samples/sec accuracy=73.468750 loss=1.020646 lr=0.007297 Epoch[034] Batch [3049]/[3759] Speed: 126.747353 samples/sec accuracy=73.463627 loss=1.020628 lr=0.007295 Epoch[034] Batch [3099]/[3759] Speed: 128.590702 samples/sec accuracy=73.439012 loss=1.021707 lr=0.007294 Epoch[034] Batch [3149]/[3759] Speed: 120.238075 samples/sec accuracy=73.449901 loss=1.021505 lr=0.007292 Epoch[034] Batch [3199]/[3759] Speed: 125.824963 samples/sec accuracy=73.443359 loss=1.021920 lr=0.007290 Epoch[034] Batch [3249]/[3759] Speed: 132.124358 samples/sec accuracy=73.447596 loss=1.021880 lr=0.007288 Epoch[034] Batch [3299]/[3759] Speed: 118.481975 samples/sec accuracy=73.436080 loss=1.022182 lr=0.007286 Epoch[034] Batch [3349]/[3759] Speed: 122.702264 samples/sec accuracy=73.423974 loss=1.022827 lr=0.007284 Epoch[034] Batch [3399]/[3759] Speed: 128.105535 samples/sec accuracy=73.391085 loss=1.023800 lr=0.007282 Epoch[034] Batch [3449]/[3759] Speed: 129.108284 samples/sec accuracy=73.378170 loss=1.024460 lr=0.007281 Epoch[034] Batch [3499]/[3759] Speed: 129.440308 samples/sec accuracy=73.374107 loss=1.024533 lr=0.007279 Epoch[034] Batch [3549]/[3759] Speed: 121.591734 samples/sec accuracy=73.378081 loss=1.024685 lr=0.007277 Epoch[034] Batch [3599]/[3759] Speed: 126.402099 samples/sec accuracy=73.354167 loss=1.025184 lr=0.007275 Epoch[034] Batch [3649]/[3759] Speed: 122.179832 samples/sec accuracy=73.345890 loss=1.025337 lr=0.007273 Epoch[034] Batch [3699]/[3759] Speed: 126.323961 samples/sec accuracy=73.349662 loss=1.025495 lr=0.007271 Epoch[034] Batch [3749]/[3759] Speed: 149.467724 samples/sec accuracy=73.336667 loss=1.026132 lr=0.007269 Batch [0049]/[0303]: acc-top1=61.156250 acc-top5=84.562500 Batch [0099]/[0303]: acc-top1=61.687500 acc-top5=84.437500 Batch [0149]/[0303]: acc-top1=61.697917 acc-top5=84.322917 Batch [0199]/[0303]: acc-top1=61.617188 acc-top5=84.234375 Batch [0249]/[0303]: acc-top1=61.831250 acc-top5=84.075000 Batch [0299]/[0303]: acc-top1=61.875000 acc-top5=84.088542 [Epoch 034] training: accuracy=73.342312 loss=1.025970 [Epoch 034] speed: 125 samples/sec time cost: 2109.816996 [Epoch 034] validation: acc-top1=61.839934 acc-top5=84.044967 loss=2.193675 Epoch[035] Batch [0049]/[3760] Speed: 88.835558 samples/sec accuracy=75.031250 loss=0.937512 lr=0.007267 Epoch[035] Batch [0099]/[3760] Speed: 129.818871 samples/sec accuracy=75.203125 loss=0.952229 lr=0.007265 Epoch[035] Batch [0149]/[3760] Speed: 122.370666 samples/sec accuracy=75.010417 loss=0.954867 lr=0.007264 Epoch[035] Batch [0199]/[3760] Speed: 123.431075 samples/sec accuracy=74.781250 loss=0.961171 lr=0.007262 Epoch[035] Batch [0249]/[3760] Speed: 131.890148 samples/sec accuracy=74.837500 loss=0.961412 lr=0.007260 Epoch[035] Batch [0299]/[3760] Speed: 118.183595 samples/sec accuracy=74.932292 loss=0.957088 lr=0.007258 Epoch[035] Batch [0349]/[3760] Speed: 132.719500 samples/sec accuracy=74.839286 loss=0.960205 lr=0.007256 Epoch[035] Batch [0399]/[3760] Speed: 121.480555 samples/sec accuracy=74.695312 loss=0.967100 lr=0.007254 Epoch[035] Batch [0449]/[3760] Speed: 123.826053 samples/sec accuracy=74.638889 loss=0.971316 lr=0.007252 Epoch[035] Batch [0499]/[3760] Speed: 128.843696 samples/sec accuracy=74.559375 loss=0.972843 lr=0.007250 Epoch[035] Batch [0549]/[3760] Speed: 120.949005 samples/sec accuracy=74.485795 loss=0.974929 lr=0.007249 Epoch[035] Batch [0599]/[3760] Speed: 132.500682 samples/sec accuracy=74.401042 loss=0.978376 lr=0.007247 Epoch[035] Batch [0649]/[3760] Speed: 119.973926 samples/sec accuracy=74.415865 loss=0.977685 lr=0.007245 Epoch[035] Batch [0699]/[3760] Speed: 126.993832 samples/sec accuracy=74.345982 loss=0.979712 lr=0.007243 Epoch[035] Batch [0749]/[3760] Speed: 123.637549 samples/sec accuracy=74.331250 loss=0.980136 lr=0.007241 Epoch[035] Batch [0799]/[3760] Speed: 128.537531 samples/sec accuracy=74.326172 loss=0.980640 lr=0.007239 Epoch[035] Batch [0849]/[3760] Speed: 131.407699 samples/sec accuracy=74.312500 loss=0.979571 lr=0.007237 Epoch[035] Batch [0899]/[3760] Speed: 115.705074 samples/sec accuracy=74.336806 loss=0.977880 lr=0.007236 Epoch[035] Batch [0949]/[3760] Speed: 130.740100 samples/sec accuracy=74.422697 loss=0.977093 lr=0.007234 Epoch[035] Batch [0999]/[3760] Speed: 118.870529 samples/sec accuracy=74.417187 loss=0.977898 lr=0.007232 Epoch[035] Batch [1049]/[3760] Speed: 130.136239 samples/sec accuracy=74.427083 loss=0.977612 lr=0.007230 Epoch[035] Batch [1099]/[3760] Speed: 127.428001 samples/sec accuracy=74.359375 loss=0.979455 lr=0.007228 Epoch[035] Batch [1149]/[3760] Speed: 119.429636 samples/sec accuracy=74.289402 loss=0.981388 lr=0.007226 Epoch[035] Batch [1199]/[3760] Speed: 135.238425 samples/sec accuracy=74.263021 loss=0.983427 lr=0.007224 Epoch[035] Batch [1249]/[3760] Speed: 119.634592 samples/sec accuracy=74.273750 loss=0.983517 lr=0.007222 Epoch[035] Batch [1299]/[3760] Speed: 124.303667 samples/sec accuracy=74.247596 loss=0.984506 lr=0.007221 Epoch[035] Batch [1349]/[3760] Speed: 133.203002 samples/sec accuracy=74.193287 loss=0.986234 lr=0.007219 Epoch[035] Batch [1399]/[3760] Speed: 124.180625 samples/sec accuracy=74.175223 loss=0.987181 lr=0.007217 Epoch[035] Batch [1449]/[3760] Speed: 127.123576 samples/sec accuracy=74.193966 loss=0.986929 lr=0.007215 Epoch[035] Batch [1499]/[3760] Speed: 125.856177 samples/sec accuracy=74.192708 loss=0.987679 lr=0.007213 Epoch[035] Batch [1549]/[3760] Speed: 122.862348 samples/sec accuracy=74.171371 loss=0.988012 lr=0.007211 Epoch[035] Batch [1599]/[3760] Speed: 130.834611 samples/sec accuracy=74.136719 loss=0.989326 lr=0.007209 Epoch[035] Batch [1649]/[3760] Speed: 122.412254 samples/sec accuracy=74.127841 loss=0.988965 lr=0.007207 Epoch[035] Batch [1699]/[3760] Speed: 124.297221 samples/sec accuracy=74.057904 loss=0.991279 lr=0.007206 Epoch[035] Batch [1749]/[3760] Speed: 126.332125 samples/sec accuracy=74.033036 loss=0.991322 lr=0.007204 Epoch[035] Batch [1799]/[3760] Speed: 127.304659 samples/sec accuracy=74.018229 loss=0.992302 lr=0.007202 Epoch[035] Batch [1849]/[3760] Speed: 129.581014 samples/sec accuracy=73.974662 loss=0.994072 lr=0.007200 Epoch[035] Batch [1899]/[3760] Speed: 118.229002 samples/sec accuracy=73.958882 loss=0.994635 lr=0.007198 Epoch[035] Batch [1949]/[3760] Speed: 129.628625 samples/sec accuracy=73.942308 loss=0.995515 lr=0.007196 Epoch[035] Batch [1999]/[3760] Speed: 126.165526 samples/sec accuracy=73.896875 loss=0.996246 lr=0.007194 Epoch[035] Batch [2049]/[3760] Speed: 123.838360 samples/sec accuracy=73.855945 loss=0.997653 lr=0.007192 Epoch[035] Batch [2099]/[3760] Speed: 120.592510 samples/sec accuracy=73.869792 loss=0.997854 lr=0.007191 Epoch[035] Batch [2149]/[3760] Speed: 133.663857 samples/sec accuracy=73.876453 loss=0.997576 lr=0.007189 Epoch[035] Batch [2199]/[3760] Speed: 119.199709 samples/sec accuracy=73.876420 loss=0.998295 lr=0.007187 Epoch[035] Batch [2249]/[3760] Speed: 129.868799 samples/sec accuracy=73.885417 loss=0.998687 lr=0.007185 Epoch[035] Batch [2299]/[3760] Speed: 120.363386 samples/sec accuracy=73.873641 loss=0.998988 lr=0.007183 Epoch[035] Batch [2349]/[3760] Speed: 130.530858 samples/sec accuracy=73.883644 loss=0.999255 lr=0.007181 Epoch[035] Batch [2399]/[3760] Speed: 130.266199 samples/sec accuracy=73.893880 loss=0.998861 lr=0.007179 Epoch[035] Batch [2449]/[3760] Speed: 119.909770 samples/sec accuracy=73.868622 loss=0.999783 lr=0.007177 Epoch[035] Batch [2499]/[3760] Speed: 128.786328 samples/sec accuracy=73.843750 loss=1.001372 lr=0.007176 Epoch[035] Batch [2549]/[3760] Speed: 127.028220 samples/sec accuracy=73.821078 loss=1.002196 lr=0.007174 Epoch[035] Batch [2599]/[3760] Speed: 122.869246 samples/sec accuracy=73.815505 loss=1.002721 lr=0.007172 Epoch[035] Batch [2649]/[3760] Speed: 125.418640 samples/sec accuracy=73.808373 loss=1.002999 lr=0.007170 Epoch[035] Batch [2699]/[3760] Speed: 128.800121 samples/sec accuracy=73.800926 loss=1.003627 lr=0.007168 Epoch[035] Batch [2749]/[3760] Speed: 119.653424 samples/sec accuracy=73.765341 loss=1.004588 lr=0.007166 Epoch[035] Batch [2799]/[3760] Speed: 132.983561 samples/sec accuracy=73.757812 loss=1.004871 lr=0.007164 Epoch[035] Batch [2849]/[3760] Speed: 122.655854 samples/sec accuracy=73.750548 loss=1.004919 lr=0.007162 Epoch[035] Batch [2899]/[3760] Speed: 124.643360 samples/sec accuracy=73.742996 loss=1.005215 lr=0.007160 Epoch[035] Batch [2949]/[3760] Speed: 119.591725 samples/sec accuracy=73.747881 loss=1.005732 lr=0.007159 Epoch[035] Batch [2999]/[3760] Speed: 133.799239 samples/sec accuracy=73.733854 loss=1.006728 lr=0.007157 Epoch[035] Batch [3049]/[3760] Speed: 130.183941 samples/sec accuracy=73.733607 loss=1.007058 lr=0.007155 Epoch[035] Batch [3099]/[3760] Speed: 122.143233 samples/sec accuracy=73.736895 loss=1.007284 lr=0.007153 Epoch[035] Batch [3149]/[3760] Speed: 126.331952 samples/sec accuracy=73.722222 loss=1.007925 lr=0.007151 Epoch[035] Batch [3199]/[3760] Speed: 122.955336 samples/sec accuracy=73.708008 loss=1.008542 lr=0.007149 Epoch[035] Batch [3249]/[3760] Speed: 131.610691 samples/sec accuracy=73.683173 loss=1.009005 lr=0.007147 Epoch[035] Batch [3299]/[3760] Speed: 124.058572 samples/sec accuracy=73.664299 loss=1.009647 lr=0.007145 Epoch[035] Batch [3349]/[3760] Speed: 121.813686 samples/sec accuracy=73.642257 loss=1.010603 lr=0.007144 Epoch[035] Batch [3399]/[3760] Speed: 123.770661 samples/sec accuracy=73.626838 loss=1.011126 lr=0.007142 Epoch[035] Batch [3449]/[3760] Speed: 128.190424 samples/sec accuracy=73.596467 loss=1.012339 lr=0.007140 Epoch[035] Batch [3499]/[3760] Speed: 129.369677 samples/sec accuracy=73.608036 loss=1.012303 lr=0.007138 Epoch[035] Batch [3549]/[3760] Speed: 120.318314 samples/sec accuracy=73.620599 loss=1.012001 lr=0.007136 Epoch[035] Batch [3599]/[3760] Speed: 126.731834 samples/sec accuracy=73.610677 loss=1.012499 lr=0.007134 Epoch[035] Batch [3649]/[3760] Speed: 121.418475 samples/sec accuracy=73.620719 loss=1.011909 lr=0.007132 Epoch[035] Batch [3699]/[3760] Speed: 127.779891 samples/sec accuracy=73.601774 loss=1.012263 lr=0.007130 Epoch[035] Batch [3749]/[3760] Speed: 145.243765 samples/sec accuracy=73.593750 loss=1.012449 lr=0.007128 Batch [0049]/[0303]: acc-top1=62.531250 acc-top5=84.281250 Batch [0099]/[0303]: acc-top1=62.468750 acc-top5=84.187500 Batch [0149]/[0303]: acc-top1=62.416667 acc-top5=84.062500 Batch [0199]/[0303]: acc-top1=62.078125 acc-top5=83.960938 Batch [0249]/[0303]: acc-top1=62.043750 acc-top5=83.950000 Batch [0299]/[0303]: acc-top1=61.833333 acc-top5=83.927083 [Epoch 035] training: accuracy=73.587517 loss=1.012606 [Epoch 035] speed: 125 samples/sec time cost: 2111.155594 [Epoch 035] validation: acc-top1=61.762583 acc-top5=83.900578 loss=2.139802 Epoch[036] Batch [0049]/[3760] Speed: 88.518979 samples/sec accuracy=72.687500 loss=0.990249 lr=0.007126 Epoch[036] Batch [0099]/[3760] Speed: 133.567634 samples/sec accuracy=73.687500 loss=0.993220 lr=0.007124 Epoch[036] Batch [0149]/[3760] Speed: 118.775240 samples/sec accuracy=74.979167 loss=0.954136 lr=0.007122 Epoch[036] Batch [0199]/[3760] Speed: 126.018986 samples/sec accuracy=75.023438 loss=0.948702 lr=0.007120 Epoch[036] Batch [0249]/[3760] Speed: 125.599408 samples/sec accuracy=75.112500 loss=0.946687 lr=0.007119 Epoch[036] Batch [0299]/[3760] Speed: 126.667544 samples/sec accuracy=74.890625 loss=0.954639 lr=0.007117 Epoch[036] Batch [0349]/[3760] Speed: 119.285921 samples/sec accuracy=74.875000 loss=0.959663 lr=0.007115 Epoch[036] Batch [0399]/[3760] Speed: 131.143524 samples/sec accuracy=74.929688 loss=0.956080 lr=0.007113 Epoch[036] Batch [0449]/[3760] Speed: 115.743424 samples/sec accuracy=74.885417 loss=0.956965 lr=0.007111 Epoch[036] Batch [0499]/[3760] Speed: 135.201033 samples/sec accuracy=74.609375 loss=0.966007 lr=0.007109 Epoch[036] Batch [0549]/[3760] Speed: 123.676749 samples/sec accuracy=74.556818 loss=0.969594 lr=0.007107 Epoch[036] Batch [0599]/[3760] Speed: 125.946712 samples/sec accuracy=74.549479 loss=0.969159 lr=0.007105 Epoch[036] Batch [0649]/[3760] Speed: 130.673218 samples/sec accuracy=74.574519 loss=0.969064 lr=0.007103 Epoch[036] Batch [0699]/[3760] Speed: 118.760274 samples/sec accuracy=74.584821 loss=0.969279 lr=0.007102 Epoch[036] Batch [0749]/[3760] Speed: 130.176874 samples/sec accuracy=74.543750 loss=0.970154 lr=0.007100 Epoch[036] Batch [0799]/[3760] Speed: 119.552280 samples/sec accuracy=74.492188 loss=0.971526 lr=0.007098 Epoch[036] Batch [0849]/[3760] Speed: 130.006058 samples/sec accuracy=74.448529 loss=0.973240 lr=0.007096 Epoch[036] Batch [0899]/[3760] Speed: 122.063118 samples/sec accuracy=74.546875 loss=0.972155 lr=0.007094 Epoch[036] Batch [0949]/[3760] Speed: 126.216914 samples/sec accuracy=74.565789 loss=0.973326 lr=0.007092 Epoch[036] Batch [0999]/[3760] Speed: 133.912672 samples/sec accuracy=74.623437 loss=0.971061 lr=0.007090 Epoch[036] Batch [1049]/[3760] Speed: 121.853872 samples/sec accuracy=74.619048 loss=0.970431 lr=0.007088 Epoch[036] Batch [1099]/[3760] Speed: 131.049414 samples/sec accuracy=74.572443 loss=0.972284 lr=0.007086 Epoch[036] Batch [1149]/[3760] Speed: 116.086842 samples/sec accuracy=74.599185 loss=0.972101 lr=0.007084 Epoch[036] Batch [1199]/[3760] Speed: 127.912806 samples/sec accuracy=74.619792 loss=0.970771 lr=0.007083 Epoch[036] Batch [1249]/[3760] Speed: 132.410629 samples/sec accuracy=74.605000 loss=0.971807 lr=0.007081 Epoch[036] Batch [1299]/[3760] Speed: 128.814067 samples/sec accuracy=74.549279 loss=0.973413 lr=0.007079 Epoch[036] Batch [1349]/[3760] Speed: 122.085555 samples/sec accuracy=74.535880 loss=0.973991 lr=0.007077 Epoch[036] Batch [1399]/[3760] Speed: 125.802521 samples/sec accuracy=74.532366 loss=0.974564 lr=0.007075 Epoch[036] Batch [1449]/[3760] Speed: 120.937606 samples/sec accuracy=74.512931 loss=0.974944 lr=0.007073 Epoch[036] Batch [1499]/[3760] Speed: 129.165880 samples/sec accuracy=74.507292 loss=0.975709 lr=0.007071 Epoch[036] Batch [1549]/[3760] Speed: 124.135369 samples/sec accuracy=74.493952 loss=0.975932 lr=0.007069 Epoch[036] Batch [1599]/[3760] Speed: 121.486231 samples/sec accuracy=74.481445 loss=0.976669 lr=0.007067 Epoch[036] Batch [1649]/[3760] Speed: 131.024112 samples/sec accuracy=74.463068 loss=0.977321 lr=0.007065 Epoch[036] Batch [1699]/[3760] Speed: 121.170986 samples/sec accuracy=74.452206 loss=0.977661 lr=0.007064 Epoch[036] Batch [1749]/[3760] Speed: 129.111024 samples/sec accuracy=74.431250 loss=0.978199 lr=0.007062 Epoch[036] Batch [1799]/[3760] Speed: 129.867320 samples/sec accuracy=74.383681 loss=0.980132 lr=0.007060 Epoch[036] Batch [1849]/[3760] Speed: 119.735110 samples/sec accuracy=74.380068 loss=0.980565 lr=0.007058 Epoch[036] Batch [1899]/[3760] Speed: 128.171263 samples/sec accuracy=74.389803 loss=0.980898 lr=0.007056 Epoch[036] Batch [1949]/[3760] Speed: 124.373403 samples/sec accuracy=74.403846 loss=0.980194 lr=0.007054 Epoch[036] Batch [1999]/[3760] Speed: 124.123110 samples/sec accuracy=74.377344 loss=0.981465 lr=0.007052 Epoch[036] Batch [2049]/[3760] Speed: 124.799589 samples/sec accuracy=74.332317 loss=0.983004 lr=0.007050 Epoch[036] Batch [2099]/[3760] Speed: 131.432367 samples/sec accuracy=74.320685 loss=0.984334 lr=0.007048 Epoch[036] Batch [2149]/[3760] Speed: 122.084416 samples/sec accuracy=74.297965 loss=0.985458 lr=0.007046 Epoch[036] Batch [2199]/[3760] Speed: 127.379883 samples/sec accuracy=74.308239 loss=0.985397 lr=0.007044 Epoch[036] Batch [2249]/[3760] Speed: 128.446878 samples/sec accuracy=74.260417 loss=0.986545 lr=0.007043 Epoch[036] Batch [2299]/[3760] Speed: 123.066703 samples/sec accuracy=74.259511 loss=0.987064 lr=0.007041 Epoch[036] Batch [2349]/[3760] Speed: 121.156986 samples/sec accuracy=74.222074 loss=0.988523 lr=0.007039 Epoch[036] Batch [2399]/[3760] Speed: 131.059490 samples/sec accuracy=74.231120 loss=0.987805 lr=0.007037 Epoch[036] Batch [2449]/[3760] Speed: 124.462548 samples/sec accuracy=74.191964 loss=0.988460 lr=0.007035 Epoch[036] Batch [2499]/[3760] Speed: 124.935809 samples/sec accuracy=74.183125 loss=0.988725 lr=0.007033 Epoch[036] Batch [2549]/[3760] Speed: 133.068382 samples/sec accuracy=74.181373 loss=0.989032 lr=0.007031 Epoch[036] Batch [2599]/[3760] Speed: 115.077363 samples/sec accuracy=74.186298 loss=0.989052 lr=0.007029 Epoch[036] Batch [2649]/[3760] Speed: 127.164797 samples/sec accuracy=74.178066 loss=0.989708 lr=0.007027 Epoch[036] Batch [2699]/[3760] Speed: 129.133753 samples/sec accuracy=74.184606 loss=0.989867 lr=0.007025 Epoch[036] Batch [2749]/[3760] Speed: 121.835812 samples/sec accuracy=74.155114 loss=0.990388 lr=0.007023 Epoch[036] Batch [2799]/[3760] Speed: 129.183427 samples/sec accuracy=74.154018 loss=0.989954 lr=0.007022 Epoch[036] Batch [2849]/[3760] Speed: 122.940335 samples/sec accuracy=74.133772 loss=0.991094 lr=0.007020 Epoch[036] Batch [2899]/[3760] Speed: 125.042513 samples/sec accuracy=74.108836 loss=0.991756 lr=0.007018 Epoch[036] Batch [2949]/[3760] Speed: 127.934453 samples/sec accuracy=74.065148 loss=0.993249 lr=0.007016 Epoch[036] Batch [2999]/[3760] Speed: 124.533717 samples/sec accuracy=74.042187 loss=0.993958 lr=0.007014 Epoch[036] Batch [3049]/[3760] Speed: 127.936270 samples/sec accuracy=74.014344 loss=0.995099 lr=0.007012 Epoch[036] Batch [3099]/[3760] Speed: 128.005493 samples/sec accuracy=74.015121 loss=0.995273 lr=0.007010 Epoch[036] Batch [3149]/[3760] Speed: 115.311730 samples/sec accuracy=73.988095 loss=0.996356 lr=0.007008 Epoch[036] Batch [3199]/[3760] Speed: 132.620779 samples/sec accuracy=73.998535 loss=0.996413 lr=0.007006 Epoch[036] Batch [3249]/[3760] Speed: 132.189254 samples/sec accuracy=73.967308 loss=0.997327 lr=0.007004 Epoch[036] Batch [3299]/[3760] Speed: 116.556494 samples/sec accuracy=73.952178 loss=0.997854 lr=0.007002 Epoch[036] Batch [3349]/[3760] Speed: 135.224627 samples/sec accuracy=73.944030 loss=0.998346 lr=0.007001 Epoch[036] Batch [3399]/[3760] Speed: 116.661114 samples/sec accuracy=73.955423 loss=0.998312 lr=0.006999 Epoch[036] Batch [3449]/[3760] Speed: 133.192415 samples/sec accuracy=73.954257 loss=0.998773 lr=0.006997 Epoch[036] Batch [3499]/[3760] Speed: 119.486343 samples/sec accuracy=73.943304 loss=0.999288 lr=0.006995 Epoch[036] Batch [3549]/[3760] Speed: 133.551041 samples/sec accuracy=73.910211 loss=1.000211 lr=0.006993 Epoch[036] Batch [3599]/[3760] Speed: 118.943214 samples/sec accuracy=73.888021 loss=1.001035 lr=0.006991 Epoch[036] Batch [3649]/[3760] Speed: 130.082673 samples/sec accuracy=73.889983 loss=1.001333 lr=0.006989 Epoch[036] Batch [3699]/[3760] Speed: 129.528858 samples/sec accuracy=73.896537 loss=1.001381 lr=0.006987 Epoch[036] Batch [3749]/[3760] Speed: 142.272768 samples/sec accuracy=73.868333 loss=1.002209 lr=0.006985 Batch [0049]/[0303]: acc-top1=62.406250 acc-top5=84.343750 Batch [0099]/[0303]: acc-top1=62.640625 acc-top5=84.171875 Batch [0149]/[0303]: acc-top1=62.656250 acc-top5=84.104167 Batch [0199]/[0303]: acc-top1=62.156250 acc-top5=83.921875 Batch [0249]/[0303]: acc-top1=62.100000 acc-top5=83.931250 Batch [0299]/[0303]: acc-top1=62.156250 acc-top5=83.958333 [Epoch 036] training: accuracy=73.865941 loss=1.002176 [Epoch 036] speed: 125 samples/sec time cost: 2110.424914 [Epoch 036] validation: acc-top1=62.056518 acc-top5=83.900578 loss=2.240966 Epoch[037] Batch [0049]/[3759] Speed: 90.213883 samples/sec accuracy=76.875000 loss=0.907739 lr=0.006983 Epoch[037] Batch [0099]/[3759] Speed: 126.924510 samples/sec accuracy=76.125000 loss=0.916299 lr=0.006981 Epoch[037] Batch [0149]/[3759] Speed: 125.067641 samples/sec accuracy=75.437500 loss=0.934375 lr=0.006979 Epoch[037] Batch [0199]/[3759] Speed: 124.341468 samples/sec accuracy=75.390625 loss=0.935620 lr=0.006977 Epoch[037] Batch [0249]/[3759] Speed: 127.141651 samples/sec accuracy=75.400000 loss=0.935405 lr=0.006975 Epoch[037] Batch [0299]/[3759] Speed: 121.352556 samples/sec accuracy=75.432292 loss=0.936788 lr=0.006973 Epoch[037] Batch [0349]/[3759] Speed: 135.649742 samples/sec accuracy=75.441964 loss=0.938344 lr=0.006971 Epoch[037] Batch [0399]/[3759] Speed: 117.605625 samples/sec accuracy=75.375000 loss=0.940168 lr=0.006969 Epoch[037] Batch [0449]/[3759] Speed: 127.461880 samples/sec accuracy=75.232639 loss=0.943238 lr=0.006968 Epoch[037] Batch [0499]/[3759] Speed: 131.114031 samples/sec accuracy=75.125000 loss=0.947986 lr=0.006966 Epoch[037] Batch [0549]/[3759] Speed: 121.743367 samples/sec accuracy=75.065341 loss=0.948181 lr=0.006964 Epoch[037] Batch [0599]/[3759] Speed: 126.133569 samples/sec accuracy=74.968750 loss=0.949829 lr=0.006962 Epoch[037] Batch [0649]/[3759] Speed: 125.807131 samples/sec accuracy=74.882212 loss=0.950556 lr=0.006960 Epoch[037] Batch [0699]/[3759] Speed: 126.302988 samples/sec accuracy=74.868304 loss=0.951428 lr=0.006958 Epoch[037] Batch [0749]/[3759] Speed: 123.074670 samples/sec accuracy=74.829167 loss=0.950377 lr=0.006956 Epoch[037] Batch [0799]/[3759] Speed: 121.985825 samples/sec accuracy=74.937500 loss=0.949651 lr=0.006954 Epoch[037] Batch [0849]/[3759] Speed: 131.474726 samples/sec accuracy=74.919118 loss=0.950904 lr=0.006952 Epoch[037] Batch [0899]/[3759] Speed: 126.270742 samples/sec accuracy=74.911458 loss=0.951156 lr=0.006950 Epoch[037] Batch [0949]/[3759] Speed: 122.790602 samples/sec accuracy=74.930921 loss=0.950953 lr=0.006948 Epoch[037] Batch [0999]/[3759] Speed: 131.576764 samples/sec accuracy=74.918750 loss=0.951569 lr=0.006946 Epoch[037] Batch [1049]/[3759] Speed: 124.403029 samples/sec accuracy=74.909226 loss=0.952591 lr=0.006944 Epoch[037] Batch [1099]/[3759] Speed: 123.723309 samples/sec accuracy=74.936080 loss=0.952533 lr=0.006943 Epoch[037] Batch [1149]/[3759] Speed: 128.254160 samples/sec accuracy=74.904891 loss=0.952589 lr=0.006941 Epoch[037] Batch [1199]/[3759] Speed: 115.376213 samples/sec accuracy=74.927083 loss=0.951348 lr=0.006939 Epoch[037] Batch [1249]/[3759] Speed: 135.626656 samples/sec accuracy=74.868750 loss=0.953614 lr=0.006937 Epoch[037] Batch [1299]/[3759] Speed: 125.992633 samples/sec accuracy=74.868990 loss=0.953653 lr=0.006935 Epoch[037] Batch [1349]/[3759] Speed: 122.116294 samples/sec accuracy=74.842593 loss=0.953712 lr=0.006933 Epoch[037] Batch [1399]/[3759] Speed: 126.716706 samples/sec accuracy=74.849330 loss=0.954181 lr=0.006931 Epoch[037] Batch [1449]/[3759] Speed: 125.075946 samples/sec accuracy=74.771552 loss=0.955985 lr=0.006929 Epoch[037] Batch [1499]/[3759] Speed: 126.907435 samples/sec accuracy=74.716667 loss=0.957981 lr=0.006927 Epoch[037] Batch [1549]/[3759] Speed: 122.261515 samples/sec accuracy=74.715726 loss=0.958316 lr=0.006925 Epoch[037] Batch [1599]/[3759] Speed: 126.628549 samples/sec accuracy=74.696289 loss=0.959642 lr=0.006923 Epoch[037] Batch [1649]/[3759] Speed: 133.493350 samples/sec accuracy=74.689394 loss=0.960863 lr=0.006921 Epoch[037] Batch [1699]/[3759] Speed: 123.508389 samples/sec accuracy=74.660846 loss=0.961797 lr=0.006919 Epoch[037] Batch [1749]/[3759] Speed: 125.250045 samples/sec accuracy=74.658929 loss=0.962128 lr=0.006917 Epoch[037] Batch [1799]/[3759] Speed: 122.541923 samples/sec accuracy=74.646701 loss=0.963096 lr=0.006916 Epoch[037] Batch [1849]/[3759] Speed: 133.565698 samples/sec accuracy=74.634291 loss=0.963935 lr=0.006914 Epoch[037] Batch [1899]/[3759] Speed: 119.426871 samples/sec accuracy=74.612664 loss=0.965284 lr=0.006912 Epoch[037] Batch [1949]/[3759] Speed: 127.793538 samples/sec accuracy=74.581731 loss=0.966562 lr=0.006910 Epoch[037] Batch [1999]/[3759] Speed: 124.639720 samples/sec accuracy=74.552344 loss=0.967339 lr=0.006908 Epoch[037] Batch [2049]/[3759] Speed: 129.535719 samples/sec accuracy=74.548780 loss=0.968042 lr=0.006906 Epoch[037] Batch [2099]/[3759] Speed: 121.691556 samples/sec accuracy=74.543899 loss=0.967483 lr=0.006904 Epoch[037] Batch [2149]/[3759] Speed: 126.843229 samples/sec accuracy=74.533430 loss=0.967806 lr=0.006902 Epoch[037] Batch [2199]/[3759] Speed: 125.797592 samples/sec accuracy=74.553977 loss=0.967672 lr=0.006900 Epoch[037] Batch [2249]/[3759] Speed: 124.647474 samples/sec accuracy=74.535417 loss=0.968111 lr=0.006898 Epoch[037] Batch [2299]/[3759] Speed: 128.926226 samples/sec accuracy=74.516304 loss=0.969373 lr=0.006896 Epoch[037] Batch [2349]/[3759] Speed: 124.113310 samples/sec accuracy=74.499335 loss=0.970292 lr=0.006894 Epoch[037] Batch [2399]/[3759] Speed: 123.516289 samples/sec accuracy=74.472656 loss=0.971362 lr=0.006892 Epoch[037] Batch [2449]/[3759] Speed: 132.579480 samples/sec accuracy=74.447704 loss=0.972678 lr=0.006890 Epoch[037] Batch [2499]/[3759] Speed: 118.272013 samples/sec accuracy=74.423125 loss=0.973641 lr=0.006888 Epoch[037] Batch [2549]/[3759] Speed: 130.474606 samples/sec accuracy=74.412990 loss=0.974103 lr=0.006887 Epoch[037] Batch [2599]/[3759] Speed: 126.187865 samples/sec accuracy=74.395433 loss=0.974359 lr=0.006885 Epoch[037] Batch [2649]/[3759] Speed: 125.186030 samples/sec accuracy=74.382665 loss=0.975114 lr=0.006883 Epoch[037] Batch [2699]/[3759] Speed: 128.611608 samples/sec accuracy=74.353009 loss=0.976227 lr=0.006881 Epoch[037] Batch [2749]/[3759] Speed: 124.210456 samples/sec accuracy=74.327273 loss=0.977099 lr=0.006879 Epoch[037] Batch [2799]/[3759] Speed: 128.283330 samples/sec accuracy=74.280134 loss=0.978719 lr=0.006877 Epoch[037] Batch [2849]/[3759] Speed: 124.539391 samples/sec accuracy=74.276316 loss=0.979486 lr=0.006875 Epoch[037] Batch [2899]/[3759] Speed: 128.871842 samples/sec accuracy=74.267780 loss=0.979995 lr=0.006873 Epoch[037] Batch [2949]/[3759] Speed: 118.445461 samples/sec accuracy=74.254767 loss=0.980781 lr=0.006871 Epoch[037] Batch [2999]/[3759] Speed: 127.483040 samples/sec accuracy=74.230208 loss=0.981288 lr=0.006869 Epoch[037] Batch [3049]/[3759] Speed: 131.669835 samples/sec accuracy=74.225410 loss=0.981947 lr=0.006867 Epoch[037] Batch [3099]/[3759] Speed: 121.051444 samples/sec accuracy=74.212702 loss=0.982738 lr=0.006865 Epoch[037] Batch [3149]/[3759] Speed: 129.556031 samples/sec accuracy=74.186508 loss=0.983605 lr=0.006863 Epoch[037] Batch [3199]/[3759] Speed: 125.637927 samples/sec accuracy=74.178223 loss=0.983597 lr=0.006861 Epoch[037] Batch [3249]/[3759] Speed: 128.678395 samples/sec accuracy=74.173077 loss=0.984244 lr=0.006859 Epoch[037] Batch [3299]/[3759] Speed: 122.195980 samples/sec accuracy=74.164299 loss=0.984395 lr=0.006857 Epoch[037] Batch [3349]/[3759] Speed: 127.066648 samples/sec accuracy=74.164646 loss=0.985072 lr=0.006856 Epoch[037] Batch [3399]/[3759] Speed: 123.277206 samples/sec accuracy=74.160846 loss=0.985233 lr=0.006854 Epoch[037] Batch [3449]/[3759] Speed: 123.849868 samples/sec accuracy=74.158514 loss=0.985522 lr=0.006852 Epoch[037] Batch [3499]/[3759] Speed: 128.220689 samples/sec accuracy=74.146875 loss=0.986218 lr=0.006850 Epoch[037] Batch [3549]/[3759] Speed: 124.546444 samples/sec accuracy=74.121479 loss=0.987228 lr=0.006848 Epoch[037] Batch [3599]/[3759] Speed: 126.694753 samples/sec accuracy=74.109375 loss=0.988268 lr=0.006846 Epoch[037] Batch [3649]/[3759] Speed: 128.144978 samples/sec accuracy=74.097603 loss=0.988654 lr=0.006844 Epoch[037] Batch [3699]/[3759] Speed: 119.416194 samples/sec accuracy=74.065878 loss=0.989715 lr=0.006842 Epoch[037] Batch [3749]/[3759] Speed: 145.900220 samples/sec accuracy=74.068750 loss=0.990160 lr=0.006840 Batch [0049]/[0303]: acc-top1=63.125000 acc-top5=84.968750 Batch [0099]/[0303]: acc-top1=63.562500 acc-top5=84.734375 Batch [0149]/[0303]: acc-top1=63.177083 acc-top5=84.927083 Batch [0199]/[0303]: acc-top1=62.781250 acc-top5=84.765625 Batch [0249]/[0303]: acc-top1=62.825000 acc-top5=84.762500 Batch [0299]/[0303]: acc-top1=62.796875 acc-top5=84.781250 [Epoch 037] training: accuracy=74.066407 loss=0.990181 [Epoch 037] speed: 125 samples/sec time cost: 2108.079870 [Epoch 037] validation: acc-top1=62.742368 acc-top5=84.761757 loss=2.127365 Epoch[038] Batch [0049]/[3760] Speed: 89.448261 samples/sec accuracy=74.531250 loss=0.954024 lr=0.006838 Epoch[038] Batch [0099]/[3760] Speed: 128.018176 samples/sec accuracy=74.796875 loss=0.937129 lr=0.006836 Epoch[038] Batch [0149]/[3760] Speed: 126.410777 samples/sec accuracy=74.979167 loss=0.938766 lr=0.006834 Epoch[038] Batch [0199]/[3760] Speed: 120.171309 samples/sec accuracy=74.906250 loss=0.942593 lr=0.006832 Epoch[038] Batch [0249]/[3760] Speed: 128.851296 samples/sec accuracy=74.950000 loss=0.945467 lr=0.006830 Epoch[038] Batch [0299]/[3760] Speed: 129.388657 samples/sec accuracy=75.166667 loss=0.942180 lr=0.006828 Epoch[038] Batch [0349]/[3760] Speed: 124.584225 samples/sec accuracy=75.218750 loss=0.942203 lr=0.006826 Epoch[038] Batch [0399]/[3760] Speed: 127.556589 samples/sec accuracy=75.097656 loss=0.945919 lr=0.006824 Epoch[038] Batch [0449]/[3760] Speed: 123.709044 samples/sec accuracy=75.225694 loss=0.941220 lr=0.006822 Epoch[038] Batch [0499]/[3760] Speed: 127.607945 samples/sec accuracy=75.287500 loss=0.939966 lr=0.006820 Epoch[038] Batch [0549]/[3760] Speed: 121.799690 samples/sec accuracy=75.298295 loss=0.940000 lr=0.006818 Epoch[038] Batch [0599]/[3760] Speed: 124.451185 samples/sec accuracy=75.322917 loss=0.938253 lr=0.006816 Epoch[038] Batch [0649]/[3760] Speed: 131.771224 samples/sec accuracy=75.310096 loss=0.939061 lr=0.006814 Epoch[038] Batch [0699]/[3760] Speed: 125.720763 samples/sec accuracy=75.357143 loss=0.937838 lr=0.006812 Epoch[038] Batch [0749]/[3760] Speed: 122.816899 samples/sec accuracy=75.322917 loss=0.938759 lr=0.006810 Epoch[038] Batch [0799]/[3760] Speed: 123.468651 samples/sec accuracy=75.263672 loss=0.941644 lr=0.006809 Epoch[038] Batch [0849]/[3760] Speed: 128.721706 samples/sec accuracy=75.290441 loss=0.941151 lr=0.006807 Epoch[038] Batch [0899]/[3760] Speed: 126.627831 samples/sec accuracy=75.243056 loss=0.943317 lr=0.006805 Epoch[038] Batch [0949]/[3760] Speed: 125.271775 samples/sec accuracy=75.213816 loss=0.945096 lr=0.006803 Epoch[038] Batch [0999]/[3760] Speed: 120.951984 samples/sec accuracy=75.164062 loss=0.946915 lr=0.006801 Epoch[038] Batch [1049]/[3760] Speed: 127.356245 samples/sec accuracy=75.114583 loss=0.948252 lr=0.006799 Epoch[038] Batch [1099]/[3760] Speed: 124.420753 samples/sec accuracy=75.099432 loss=0.948741 lr=0.006797 Epoch[038] Batch [1149]/[3760] Speed: 132.791506 samples/sec accuracy=75.112772 loss=0.948170 lr=0.006795 Epoch[038] Batch [1199]/[3760] Speed: 114.584167 samples/sec accuracy=75.078125 loss=0.949742 lr=0.006793 Epoch[038] Batch [1249]/[3760] Speed: 132.974400 samples/sec accuracy=75.091250 loss=0.950074 lr=0.006791 Epoch[038] Batch [1299]/[3760] Speed: 125.433835 samples/sec accuracy=75.051683 loss=0.950265 lr=0.006789 Epoch[038] Batch [1349]/[3760] Speed: 123.324170 samples/sec accuracy=75.001157 loss=0.952158 lr=0.006787 Epoch[038] Batch [1399]/[3760] Speed: 129.293227 samples/sec accuracy=75.005580 loss=0.952733 lr=0.006785 Epoch[038] Batch [1449]/[3760] Speed: 130.443916 samples/sec accuracy=75.018319 loss=0.953665 lr=0.006783 Epoch[038] Batch [1499]/[3760] Speed: 121.749876 samples/sec accuracy=74.982292 loss=0.955335 lr=0.006781 Epoch[038] Batch [1549]/[3760] Speed: 129.249639 samples/sec accuracy=74.989919 loss=0.955451 lr=0.006779 Epoch[038] Batch [1599]/[3760] Speed: 122.023463 samples/sec accuracy=74.943359 loss=0.956590 lr=0.006777 Epoch[038] Batch [1649]/[3760] Speed: 121.272363 samples/sec accuracy=74.910985 loss=0.957773 lr=0.006775 Epoch[038] Batch [1699]/[3760] Speed: 131.489183 samples/sec accuracy=74.871324 loss=0.958336 lr=0.006773 Epoch[038] Batch [1749]/[3760] Speed: 118.928119 samples/sec accuracy=74.872321 loss=0.957672 lr=0.006771 Epoch[038] Batch [1799]/[3760] Speed: 126.765252 samples/sec accuracy=74.864583 loss=0.958716 lr=0.006770 Epoch[038] Batch [1849]/[3760] Speed: 130.315165 samples/sec accuracy=74.815034 loss=0.960720 lr=0.006768 Epoch[038] Batch [1899]/[3760] Speed: 122.721885 samples/sec accuracy=74.785362 loss=0.962070 lr=0.006766 Epoch[038] Batch [1949]/[3760] Speed: 128.690471 samples/sec accuracy=74.775641 loss=0.962707 lr=0.006764 Epoch[038] Batch [1999]/[3760] Speed: 123.683808 samples/sec accuracy=74.760937 loss=0.963198 lr=0.006762 Epoch[038] Batch [2049]/[3760] Speed: 126.939472 samples/sec accuracy=74.744665 loss=0.964254 lr=0.006760 Epoch[038] Batch [2099]/[3760] Speed: 124.049957 samples/sec accuracy=74.737351 loss=0.964882 lr=0.006758 Epoch[038] Batch [2149]/[3760] Speed: 127.404197 samples/sec accuracy=74.744186 loss=0.964406 lr=0.006756 Epoch[038] Batch [2199]/[3760] Speed: 125.023565 samples/sec accuracy=74.759943 loss=0.963525 lr=0.006754 Epoch[038] Batch [2249]/[3760] Speed: 123.330753 samples/sec accuracy=74.742361 loss=0.963979 lr=0.006752 Epoch[038] Batch [2299]/[3760] Speed: 130.280503 samples/sec accuracy=74.711957 loss=0.965292 lr=0.006750 Epoch[038] Batch [2349]/[3760] Speed: 120.567895 samples/sec accuracy=74.691489 loss=0.966730 lr=0.006748 Epoch[038] Batch [2399]/[3760] Speed: 126.438087 samples/sec accuracy=74.675130 loss=0.966965 lr=0.006746 Epoch[038] Batch [2449]/[3760] Speed: 125.983070 samples/sec accuracy=74.676658 loss=0.967197 lr=0.006744 Epoch[038] Batch [2499]/[3760] Speed: 118.390799 samples/sec accuracy=74.659375 loss=0.968159 lr=0.006742 Epoch[038] Batch [2549]/[3760] Speed: 135.640980 samples/sec accuracy=74.637868 loss=0.969105 lr=0.006740 Epoch[038] Batch [2599]/[3760] Speed: 124.666190 samples/sec accuracy=74.635216 loss=0.968984 lr=0.006738 Epoch[038] Batch [2649]/[3760] Speed: 121.406993 samples/sec accuracy=74.607901 loss=0.969858 lr=0.006736 Epoch[038] Batch [2699]/[3760] Speed: 129.802148 samples/sec accuracy=74.602431 loss=0.970260 lr=0.006734 Epoch[038] Batch [2749]/[3760] Speed: 125.155846 samples/sec accuracy=74.594886 loss=0.970728 lr=0.006732 Epoch[038] Batch [2799]/[3760] Speed: 125.151395 samples/sec accuracy=74.545201 loss=0.972517 lr=0.006730 Epoch[038] Batch [2849]/[3760] Speed: 124.826262 samples/sec accuracy=74.524671 loss=0.973239 lr=0.006728 Epoch[038] Batch [2899]/[3760] Speed: 123.126679 samples/sec accuracy=74.516703 loss=0.973598 lr=0.006726 Epoch[038] Batch [2949]/[3760] Speed: 127.699276 samples/sec accuracy=74.513771 loss=0.974212 lr=0.006725 Epoch[038] Batch [2999]/[3760] Speed: 127.192664 samples/sec accuracy=74.500000 loss=0.974776 lr=0.006723 Epoch[038] Batch [3049]/[3760] Speed: 127.078765 samples/sec accuracy=74.485656 loss=0.975356 lr=0.006721 Epoch[038] Batch [3099]/[3760] Speed: 126.055091 samples/sec accuracy=74.487903 loss=0.975502 lr=0.006719 Epoch[038] Batch [3149]/[3760] Speed: 119.916558 samples/sec accuracy=74.460317 loss=0.975917 lr=0.006717 Epoch[038] Batch [3199]/[3760] Speed: 132.230154 samples/sec accuracy=74.456055 loss=0.976324 lr=0.006715 Epoch[038] Batch [3249]/[3760] Speed: 124.590838 samples/sec accuracy=74.447115 loss=0.976627 lr=0.006713 Epoch[038] Batch [3299]/[3760] Speed: 123.707905 samples/sec accuracy=74.425189 loss=0.977239 lr=0.006711 Epoch[038] Batch [3349]/[3760] Speed: 125.202817 samples/sec accuracy=74.415112 loss=0.977324 lr=0.006709 Epoch[038] Batch [3399]/[3760] Speed: 128.047882 samples/sec accuracy=74.411305 loss=0.977816 lr=0.006707 Epoch[038] Batch [3449]/[3760] Speed: 121.198206 samples/sec accuracy=74.406703 loss=0.978106 lr=0.006705 Epoch[038] Batch [3499]/[3760] Speed: 131.771014 samples/sec accuracy=74.397768 loss=0.978972 lr=0.006703 Epoch[038] Batch [3549]/[3760] Speed: 118.747675 samples/sec accuracy=74.408011 loss=0.979094 lr=0.006701 Epoch[038] Batch [3599]/[3760] Speed: 135.849617 samples/sec accuracy=74.412760 loss=0.979175 lr=0.006699 Epoch[038] Batch [3649]/[3760] Speed: 117.210289 samples/sec accuracy=74.395548 loss=0.979800 lr=0.006697 Epoch[038] Batch [3699]/[3760] Speed: 131.133357 samples/sec accuracy=74.379223 loss=0.980681 lr=0.006695 Epoch[038] Batch [3749]/[3760] Speed: 142.233865 samples/sec accuracy=74.370417 loss=0.981100 lr=0.006693 Batch [0049]/[0303]: acc-top1=63.031250 acc-top5=84.718750 Batch [0099]/[0303]: acc-top1=63.828125 acc-top5=84.750000 Batch [0149]/[0303]: acc-top1=63.270833 acc-top5=84.697917 Batch [0199]/[0303]: acc-top1=62.828125 acc-top5=84.507812 Batch [0249]/[0303]: acc-top1=62.787500 acc-top5=84.475000 Batch [0299]/[0303]: acc-top1=62.682292 acc-top5=84.463542 [Epoch 038] training: accuracy=74.367520 loss=0.981136 [Epoch 038] speed: 125 samples/sec time cost: 2108.850108 [Epoch 038] validation: acc-top1=62.634076 acc-top5=84.431724 loss=2.142776 Epoch[039] Batch [0049]/[3760] Speed: 89.822958 samples/sec accuracy=76.093750 loss=0.934269 lr=0.006691 Epoch[039] Batch [0099]/[3760] Speed: 127.411868 samples/sec accuracy=75.500000 loss=0.933202 lr=0.006689 Epoch[039] Batch [0149]/[3760] Speed: 125.734815 samples/sec accuracy=75.739583 loss=0.924822 lr=0.006687 Epoch[039] Batch [0199]/[3760] Speed: 125.474164 samples/sec accuracy=75.570312 loss=0.929184 lr=0.006685 Epoch[039] Batch [0249]/[3760] Speed: 127.253026 samples/sec accuracy=75.643750 loss=0.929647 lr=0.006683 Epoch[039] Batch [0299]/[3760] Speed: 125.953518 samples/sec accuracy=75.744792 loss=0.929217 lr=0.006681 Epoch[039] Batch [0349]/[3760] Speed: 120.952460 samples/sec accuracy=75.750000 loss=0.929105 lr=0.006679 Epoch[039] Batch [0399]/[3760] Speed: 125.859399 samples/sec accuracy=75.613281 loss=0.931551 lr=0.006677 Epoch[039] Batch [0449]/[3760] Speed: 126.204075 samples/sec accuracy=75.534722 loss=0.936823 lr=0.006675 Epoch[039] Batch [0499]/[3760] Speed: 123.027855 samples/sec accuracy=75.553125 loss=0.936719 lr=0.006673 Epoch[039] Batch [0549]/[3760] Speed: 131.794001 samples/sec accuracy=75.451705 loss=0.937828 lr=0.006671 Epoch[039] Batch [0599]/[3760] Speed: 114.691545 samples/sec accuracy=75.518229 loss=0.936649 lr=0.006669 Epoch[039] Batch [0649]/[3760] Speed: 133.822116 samples/sec accuracy=75.576923 loss=0.935906 lr=0.006667 Epoch[039] Batch [0699]/[3760] Speed: 120.048246 samples/sec accuracy=75.535714 loss=0.937439 lr=0.006665 Epoch[039] Batch [0749]/[3760] Speed: 128.897011 samples/sec accuracy=75.439583 loss=0.940432 lr=0.006663 Epoch[039] Batch [0799]/[3760] Speed: 129.778613 samples/sec accuracy=75.439453 loss=0.939344 lr=0.006661 Epoch[039] Batch [0849]/[3760] Speed: 122.850543 samples/sec accuracy=75.404412 loss=0.939642 lr=0.006659 Epoch[039] Batch [0899]/[3760] Speed: 122.312420 samples/sec accuracy=75.473958 loss=0.937851 lr=0.006657 Epoch[039] Batch [0949]/[3760] Speed: 127.793495 samples/sec accuracy=75.416118 loss=0.938894 lr=0.006655 Epoch[039] Batch [0999]/[3760] Speed: 126.312564 samples/sec accuracy=75.432812 loss=0.939127 lr=0.006653 Epoch[039] Batch [1049]/[3760] Speed: 123.642406 samples/sec accuracy=75.377976 loss=0.940768 lr=0.006651 Epoch[039] Batch [1099]/[3760] Speed: 130.228497 samples/sec accuracy=75.348011 loss=0.941807 lr=0.006649 Epoch[039] Batch [1149]/[3760] Speed: 127.297827 samples/sec accuracy=75.375000 loss=0.940714 lr=0.006647 Epoch[039] Batch [1199]/[3760] Speed: 117.465187 samples/sec accuracy=75.325521 loss=0.941771 lr=0.006645 Epoch[039] Batch [1249]/[3760] Speed: 135.093805 samples/sec accuracy=75.337500 loss=0.941286 lr=0.006643 Epoch[039] Batch [1299]/[3760] Speed: 115.158498 samples/sec accuracy=75.313702 loss=0.942449 lr=0.006641 Epoch[039] Batch [1349]/[3760] Speed: 133.467688 samples/sec accuracy=75.295139 loss=0.943199 lr=0.006640 Epoch[039] Batch [1399]/[3760] Speed: 122.211119 samples/sec accuracy=75.264509 loss=0.944555 lr=0.006638 Epoch[039] Batch [1449]/[3760] Speed: 125.167076 samples/sec accuracy=75.257543 loss=0.945375 lr=0.006636 Epoch[039] Batch [1499]/[3760] Speed: 133.046973 samples/sec accuracy=75.265625 loss=0.945952 lr=0.006634 Epoch[039] Batch [1549]/[3760] Speed: 121.147619 samples/sec accuracy=75.228831 loss=0.947071 lr=0.006632 Epoch[039] Batch [1599]/[3760] Speed: 126.645526 samples/sec accuracy=75.207031 loss=0.948366 lr=0.006630 Epoch[039] Batch [1649]/[3760] Speed: 125.315743 samples/sec accuracy=75.197917 loss=0.949114 lr=0.006628 Epoch[039] Batch [1699]/[3760] Speed: 123.173459 samples/sec accuracy=75.148897 loss=0.950356 lr=0.006626 Epoch[039] Batch [1749]/[3760] Speed: 127.311824 samples/sec accuracy=75.123214 loss=0.951110 lr=0.006624 Epoch[039] Batch [1799]/[3760] Speed: 123.042195 samples/sec accuracy=75.071181 loss=0.953466 lr=0.006622 Epoch[039] Batch [1849]/[3760] Speed: 128.743211 samples/sec accuracy=75.048142 loss=0.953269 lr=0.006620 Epoch[039] Batch [1899]/[3760] Speed: 124.400623 samples/sec accuracy=75.026316 loss=0.953978 lr=0.006618 Epoch[039] Batch [1949]/[3760] Speed: 123.388362 samples/sec accuracy=75.006410 loss=0.954254 lr=0.006616 Epoch[039] Batch [1999]/[3760] Speed: 125.091310 samples/sec accuracy=75.011719 loss=0.954401 lr=0.006614 Epoch[039] Batch [2049]/[3760] Speed: 130.891155 samples/sec accuracy=74.997713 loss=0.955195 lr=0.006612 Epoch[039] Batch [2099]/[3760] Speed: 122.670195 samples/sec accuracy=74.965030 loss=0.956763 lr=0.006610 Epoch[039] Batch [2149]/[3760] Speed: 131.119189 samples/sec accuracy=74.949128 loss=0.957096 lr=0.006608 Epoch[039] Batch [2199]/[3760] Speed: 120.905621 samples/sec accuracy=74.921875 loss=0.958266 lr=0.006606 Epoch[039] Batch [2249]/[3760] Speed: 120.220022 samples/sec accuracy=74.930556 loss=0.957718 lr=0.006604 Epoch[039] Batch [2299]/[3760] Speed: 134.349702 samples/sec accuracy=74.898777 loss=0.958525 lr=0.006602 Epoch[039] Batch [2349]/[3760] Speed: 120.247620 samples/sec accuracy=74.874335 loss=0.958412 lr=0.006600 Epoch[039] Batch [2399]/[3760] Speed: 129.521560 samples/sec accuracy=74.848307 loss=0.959261 lr=0.006598 Epoch[039] Batch [2449]/[3760] Speed: 125.726066 samples/sec accuracy=74.813138 loss=0.960183 lr=0.006596 Epoch[039] Batch [2499]/[3760] Speed: 127.507299 samples/sec accuracy=74.789375 loss=0.961180 lr=0.006594 Epoch[039] Batch [2549]/[3760] Speed: 120.839824 samples/sec accuracy=74.783701 loss=0.961090 lr=0.006592 Epoch[039] Batch [2599]/[3760] Speed: 129.084667 samples/sec accuracy=74.775240 loss=0.961625 lr=0.006590 Epoch[039] Batch [2649]/[3760] Speed: 123.908203 samples/sec accuracy=74.750590 loss=0.962605 lr=0.006588 Epoch[039] Batch [2699]/[3760] Speed: 125.667656 samples/sec accuracy=74.718750 loss=0.962756 lr=0.006586 Epoch[039] Batch [2749]/[3760] Speed: 127.373738 samples/sec accuracy=74.691477 loss=0.963490 lr=0.006584 Epoch[039] Batch [2799]/[3760] Speed: 127.219979 samples/sec accuracy=74.675223 loss=0.963843 lr=0.006582 Epoch[039] Batch [2849]/[3760] Speed: 123.398045 samples/sec accuracy=74.677632 loss=0.964112 lr=0.006580 Epoch[039] Batch [2899]/[3760] Speed: 124.976228 samples/sec accuracy=74.675108 loss=0.963987 lr=0.006578 Epoch[039] Batch [2949]/[3760] Speed: 125.827371 samples/sec accuracy=74.659428 loss=0.964645 lr=0.006576 Epoch[039] Batch [2999]/[3760] Speed: 131.966476 samples/sec accuracy=74.644271 loss=0.964802 lr=0.006574 Epoch[039] Batch [3049]/[3760] Speed: 117.108125 samples/sec accuracy=74.652152 loss=0.964336 lr=0.006572 Epoch[039] Batch [3099]/[3760] Speed: 134.551197 samples/sec accuracy=74.653730 loss=0.964345 lr=0.006570 Epoch[039] Batch [3149]/[3760] Speed: 113.029508 samples/sec accuracy=74.655754 loss=0.964483 lr=0.006568 Epoch[039] Batch [3199]/[3760] Speed: 136.658125 samples/sec accuracy=74.655762 loss=0.964620 lr=0.006566 Epoch[039] Batch [3249]/[3760] Speed: 122.797560 samples/sec accuracy=74.646635 loss=0.965136 lr=0.006564 Epoch[039] Batch [3299]/[3760] Speed: 121.836461 samples/sec accuracy=74.645360 loss=0.965031 lr=0.006562 Epoch[039] Batch [3349]/[3760] Speed: 131.626373 samples/sec accuracy=74.643657 loss=0.965305 lr=0.006560 Epoch[039] Batch [3399]/[3760] Speed: 125.751581 samples/sec accuracy=74.642004 loss=0.965386 lr=0.006558 Epoch[039] Batch [3449]/[3760] Speed: 122.279397 samples/sec accuracy=74.646286 loss=0.965289 lr=0.006556 Epoch[039] Batch [3499]/[3760] Speed: 131.616655 samples/sec accuracy=74.626339 loss=0.965866 lr=0.006554 Epoch[039] Batch [3549]/[3760] Speed: 122.072276 samples/sec accuracy=74.616197 loss=0.966477 lr=0.006552 Epoch[039] Batch [3599]/[3760] Speed: 126.811882 samples/sec accuracy=74.613281 loss=0.966358 lr=0.006550 Epoch[039] Batch [3649]/[3760] Speed: 124.697375 samples/sec accuracy=74.590325 loss=0.967203 lr=0.006548 Epoch[039] Batch [3699]/[3760] Speed: 128.715360 samples/sec accuracy=74.564189 loss=0.967715 lr=0.006546 Epoch[039] Batch [3749]/[3760] Speed: 142.138847 samples/sec accuracy=74.546667 loss=0.968585 lr=0.006544 Batch [0049]/[0303]: acc-top1=62.781250 acc-top5=84.656250 Batch [0099]/[0303]: acc-top1=62.890625 acc-top5=84.328125 Batch [0149]/[0303]: acc-top1=62.437500 acc-top5=84.093750 Batch [0199]/[0303]: acc-top1=62.078125 acc-top5=83.921875 Batch [0249]/[0303]: acc-top1=62.187500 acc-top5=83.837500 Batch [0299]/[0303]: acc-top1=62.067708 acc-top5=83.802083 [Epoch 039] training: accuracy=74.546210 loss=0.968565 [Epoch 039] speed: 125 samples/sec time cost: 2109.480876 [Epoch 039] validation: acc-top1=62.010107 acc-top5=83.756188 loss=2.294367 Epoch[040] Batch [0049]/[3759] Speed: 89.228540 samples/sec accuracy=74.375000 loss=0.936588 lr=0.006542 Epoch[040] Batch [0099]/[3759] Speed: 128.062994 samples/sec accuracy=74.921875 loss=0.936692 lr=0.006540 Epoch[040] Batch [0149]/[3759] Speed: 126.769412 samples/sec accuracy=74.927083 loss=0.937655 lr=0.006538 Epoch[040] Batch [0199]/[3759] Speed: 125.141735 samples/sec accuracy=74.859375 loss=0.935328 lr=0.006536 Epoch[040] Batch [0249]/[3759] Speed: 121.007446 samples/sec accuracy=74.831250 loss=0.938022 lr=0.006534 Epoch[040] Batch [0299]/[3759] Speed: 129.795355 samples/sec accuracy=74.984375 loss=0.932625 lr=0.006532 Epoch[040] Batch [0349]/[3759] Speed: 128.228010 samples/sec accuracy=75.214286 loss=0.933063 lr=0.006530 Epoch[040] Batch [0399]/[3759] Speed: 121.391224 samples/sec accuracy=75.285156 loss=0.933560 lr=0.006528 Epoch[040] Batch [0449]/[3759] Speed: 133.581929 samples/sec accuracy=75.312500 loss=0.934522 lr=0.006526 Epoch[040] Batch [0499]/[3759] Speed: 120.455499 samples/sec accuracy=75.403125 loss=0.933240 lr=0.006524 Epoch[040] Batch [0549]/[3759] Speed: 129.328288 samples/sec accuracy=75.377841 loss=0.932257 lr=0.006522 Epoch[040] Batch [0599]/[3759] Speed: 118.496839 samples/sec accuracy=75.276042 loss=0.933493 lr=0.006520 Epoch[040] Batch [0649]/[3759] Speed: 135.537440 samples/sec accuracy=75.283654 loss=0.933943 lr=0.006518 Epoch[040] Batch [0699]/[3759] Speed: 125.178724 samples/sec accuracy=75.370536 loss=0.930658 lr=0.006516 Epoch[040] Batch [0749]/[3759] Speed: 123.586621 samples/sec accuracy=75.333333 loss=0.933981 lr=0.006514 Epoch[040] Batch [0799]/[3759] Speed: 126.697566 samples/sec accuracy=75.406250 loss=0.933170 lr=0.006512 Epoch[040] Batch [0849]/[3759] Speed: 124.540872 samples/sec accuracy=75.310662 loss=0.937114 lr=0.006510 Epoch[040] Batch [0899]/[3759] Speed: 124.105878 samples/sec accuracy=75.368056 loss=0.936784 lr=0.006508 Epoch[040] Batch [0949]/[3759] Speed: 124.353344 samples/sec accuracy=75.383224 loss=0.935838 lr=0.006506 Epoch[040] Batch [0999]/[3759] Speed: 129.621237 samples/sec accuracy=75.409375 loss=0.935781 lr=0.006504 Epoch[040] Batch [1049]/[3759] Speed: 125.540365 samples/sec accuracy=75.401786 loss=0.936741 lr=0.006502 Epoch[040] Batch [1099]/[3759] Speed: 124.060514 samples/sec accuracy=75.457386 loss=0.936180 lr=0.006500 Epoch[040] Batch [1149]/[3759] Speed: 130.960036 samples/sec accuracy=75.422554 loss=0.937807 lr=0.006498 Epoch[040] Batch [1199]/[3759] Speed: 120.735185 samples/sec accuracy=75.472656 loss=0.937346 lr=0.006496 Epoch[040] Batch [1249]/[3759] Speed: 123.947538 samples/sec accuracy=75.467500 loss=0.937801 lr=0.006494 Epoch[040] Batch [1299]/[3759] Speed: 131.674825 samples/sec accuracy=75.427885 loss=0.937716 lr=0.006492 Epoch[040] Batch [1349]/[3759] Speed: 119.408846 samples/sec accuracy=75.378472 loss=0.939192 lr=0.006490 Epoch[040] Batch [1399]/[3759] Speed: 133.589219 samples/sec accuracy=75.386161 loss=0.939083 lr=0.006488 Epoch[040] Batch [1449]/[3759] Speed: 115.672356 samples/sec accuracy=75.386853 loss=0.939172 lr=0.006486 Epoch[040] Batch [1499]/[3759] Speed: 132.248287 samples/sec accuracy=75.354167 loss=0.939618 lr=0.006484 Epoch[040] Batch [1549]/[3759] Speed: 120.477386 samples/sec accuracy=75.347782 loss=0.940840 lr=0.006482 Epoch[040] Batch [1599]/[3759] Speed: 129.323463 samples/sec accuracy=75.338867 loss=0.941190 lr=0.006480 Epoch[040] Batch [1649]/[3759] Speed: 124.701277 samples/sec accuracy=75.275568 loss=0.942839 lr=0.006478 Epoch[040] Batch [1699]/[3759] Speed: 128.187457 samples/sec accuracy=75.252757 loss=0.943987 lr=0.006476 Epoch[040] Batch [1749]/[3759] Speed: 125.834113 samples/sec accuracy=75.254464 loss=0.944482 lr=0.006474 Epoch[040] Batch [1799]/[3759] Speed: 124.205788 samples/sec accuracy=75.248264 loss=0.946128 lr=0.006472 Epoch[040] Batch [1849]/[3759] Speed: 125.508748 samples/sec accuracy=75.232264 loss=0.946150 lr=0.006470 Epoch[040] Batch [1899]/[3759] Speed: 123.870687 samples/sec accuracy=75.238487 loss=0.946224 lr=0.006468 Epoch[040] Batch [1949]/[3759] Speed: 130.277808 samples/sec accuracy=75.198718 loss=0.947372 lr=0.006466 Epoch[040] Batch [1999]/[3759] Speed: 122.677640 samples/sec accuracy=75.227344 loss=0.946097 lr=0.006464 Epoch[040] Batch [2049]/[3759] Speed: 133.870392 samples/sec accuracy=75.234756 loss=0.946211 lr=0.006462 Epoch[040] Batch [2099]/[3759] Speed: 116.106923 samples/sec accuracy=75.220982 loss=0.947089 lr=0.006460 Epoch[040] Batch [2149]/[3759] Speed: 135.964988 samples/sec accuracy=75.193314 loss=0.948069 lr=0.006458 Epoch[040] Batch [2199]/[3759] Speed: 121.623632 samples/sec accuracy=75.180398 loss=0.948553 lr=0.006456 Epoch[040] Batch [2249]/[3759] Speed: 124.528105 samples/sec accuracy=75.186806 loss=0.948386 lr=0.006454 Epoch[040] Batch [2299]/[3759] Speed: 129.826985 samples/sec accuracy=75.205842 loss=0.948214 lr=0.006452 Epoch[040] Batch [2349]/[3759] Speed: 123.088021 samples/sec accuracy=75.198138 loss=0.948826 lr=0.006450 Epoch[040] Batch [2399]/[3759] Speed: 125.644740 samples/sec accuracy=75.144531 loss=0.951341 lr=0.006448 Epoch[040] Batch [2449]/[3759] Speed: 122.934645 samples/sec accuracy=75.136480 loss=0.951539 lr=0.006446 Epoch[040] Batch [2499]/[3759] Speed: 131.975874 samples/sec accuracy=75.113125 loss=0.951818 lr=0.006444 Epoch[040] Batch [2549]/[3759] Speed: 120.635693 samples/sec accuracy=75.120098 loss=0.951801 lr=0.006442 Epoch[040] Batch [2599]/[3759] Speed: 131.983624 samples/sec accuracy=75.079327 loss=0.952549 lr=0.006440 Epoch[040] Batch [2649]/[3759] Speed: 116.265107 samples/sec accuracy=75.060731 loss=0.953435 lr=0.006438 Epoch[040] Batch [2699]/[3759] Speed: 132.688855 samples/sec accuracy=75.075231 loss=0.952954 lr=0.006436 Epoch[040] Batch [2749]/[3759] Speed: 127.647657 samples/sec accuracy=75.093182 loss=0.951904 lr=0.006434 Epoch[040] Batch [2799]/[3759] Speed: 122.936613 samples/sec accuracy=75.102679 loss=0.951713 lr=0.006432 Epoch[040] Batch [2849]/[3759] Speed: 121.186661 samples/sec accuracy=75.071820 loss=0.952762 lr=0.006430 Epoch[040] Batch [2899]/[3759] Speed: 132.208684 samples/sec accuracy=75.054957 loss=0.953569 lr=0.006428 Epoch[040] Batch [2949]/[3759] Speed: 124.849886 samples/sec accuracy=75.029131 loss=0.954116 lr=0.006426 Epoch[040] Batch [2999]/[3759] Speed: 125.907279 samples/sec accuracy=75.032813 loss=0.953488 lr=0.006424 Epoch[040] Batch [3049]/[3759] Speed: 128.627727 samples/sec accuracy=75.010758 loss=0.953864 lr=0.006422 Epoch[040] Batch [3099]/[3759] Speed: 121.290339 samples/sec accuracy=74.995464 loss=0.955104 lr=0.006420 Epoch[040] Batch [3149]/[3759] Speed: 125.123475 samples/sec accuracy=74.974702 loss=0.955672 lr=0.006418 Epoch[040] Batch [3199]/[3759] Speed: 129.010727 samples/sec accuracy=74.980469 loss=0.955452 lr=0.006416 Epoch[040] Batch [3249]/[3759] Speed: 126.299536 samples/sec accuracy=74.992788 loss=0.955530 lr=0.006414 Epoch[040] Batch [3299]/[3759] Speed: 128.735705 samples/sec accuracy=74.978693 loss=0.956148 lr=0.006412 Epoch[040] Batch [3349]/[3759] Speed: 116.958116 samples/sec accuracy=74.981810 loss=0.956064 lr=0.006410 Epoch[040] Batch [3399]/[3759] Speed: 132.776143 samples/sec accuracy=74.983915 loss=0.956089 lr=0.006408 Epoch[040] Batch [3449]/[3759] Speed: 121.765523 samples/sec accuracy=74.965127 loss=0.956594 lr=0.006406 Epoch[040] Batch [3499]/[3759] Speed: 126.838192 samples/sec accuracy=74.976339 loss=0.956079 lr=0.006404 Epoch[040] Batch [3549]/[3759] Speed: 130.906915 samples/sec accuracy=74.970511 loss=0.956175 lr=0.006402 Epoch[040] Batch [3599]/[3759] Speed: 121.153928 samples/sec accuracy=74.957899 loss=0.956496 lr=0.006400 Epoch[040] Batch [3649]/[3759] Speed: 128.519010 samples/sec accuracy=74.953339 loss=0.956668 lr=0.006398 Epoch[040] Batch [3699]/[3759] Speed: 125.013702 samples/sec accuracy=74.937922 loss=0.957238 lr=0.006396 Epoch[040] Batch [3749]/[3759] Speed: 143.168735 samples/sec accuracy=74.915000 loss=0.958115 lr=0.006394 Batch [0049]/[0303]: acc-top1=63.250000 acc-top5=84.156250 Batch [0099]/[0303]: acc-top1=63.000000 acc-top5=84.156250 Batch [0149]/[0303]: acc-top1=62.770833 acc-top5=84.260417 Batch [0199]/[0303]: acc-top1=62.359375 acc-top5=84.085938 Batch [0249]/[0303]: acc-top1=62.343750 acc-top5=84.050000 Batch [0299]/[0303]: acc-top1=62.197917 acc-top5=84.119792 [Epoch 040] training: accuracy=74.908553 loss=0.958226 [Epoch 040] speed: 125 samples/sec time cost: 2106.788914 [Epoch 040] validation: acc-top1=62.164810 acc-top5=84.096535 loss=2.227482 Epoch[041] Batch [0049]/[3760] Speed: 90.289174 samples/sec accuracy=76.750000 loss=0.911549 lr=0.006392 Epoch[041] Batch [0099]/[3760] Speed: 126.666588 samples/sec accuracy=76.812500 loss=0.893183 lr=0.006390 Epoch[041] Batch [0149]/[3760] Speed: 123.375433 samples/sec accuracy=76.854167 loss=0.888936 lr=0.006388 Epoch[041] Batch [0199]/[3760] Speed: 127.770790 samples/sec accuracy=76.562500 loss=0.897094 lr=0.006386 Epoch[041] Batch [0249]/[3760] Speed: 126.754024 samples/sec accuracy=76.343750 loss=0.905844 lr=0.006384 Epoch[041] Batch [0299]/[3760] Speed: 120.010054 samples/sec accuracy=76.182292 loss=0.906625 lr=0.006382 Epoch[041] Batch [0349]/[3760] Speed: 132.821061 samples/sec accuracy=76.214286 loss=0.906485 lr=0.006380 Epoch[041] Batch [0399]/[3760] Speed: 130.226727 samples/sec accuracy=76.199219 loss=0.905141 lr=0.006378 Epoch[041] Batch [0449]/[3760] Speed: 118.033339 samples/sec accuracy=76.041667 loss=0.910286 lr=0.006376 Epoch[041] Batch [0499]/[3760] Speed: 134.036543 samples/sec accuracy=76.121875 loss=0.907298 lr=0.006374 Epoch[041] Batch [0549]/[3760] Speed: 118.391706 samples/sec accuracy=76.181818 loss=0.905647 lr=0.006372 Epoch[041] Batch [0599]/[3760] Speed: 131.495884 samples/sec accuracy=76.135417 loss=0.906592 lr=0.006370 Epoch[041] Batch [0649]/[3760] Speed: 119.184047 samples/sec accuracy=76.072115 loss=0.906957 lr=0.006368 Epoch[041] Batch [0699]/[3760] Speed: 128.730779 samples/sec accuracy=76.040179 loss=0.909017 lr=0.006366 Epoch[041] Batch [0749]/[3760] Speed: 129.911125 samples/sec accuracy=76.020833 loss=0.909991 lr=0.006364 Epoch[041] Batch [0799]/[3760] Speed: 123.312509 samples/sec accuracy=75.914062 loss=0.913641 lr=0.006362 Epoch[041] Batch [0849]/[3760] Speed: 129.473328 samples/sec accuracy=75.988971 loss=0.911873 lr=0.006360 Epoch[041] Batch [0899]/[3760] Speed: 117.667180 samples/sec accuracy=76.027778 loss=0.911871 lr=0.006358 Epoch[041] Batch [0949]/[3760] Speed: 128.281347 samples/sec accuracy=76.039474 loss=0.911386 lr=0.006356 Epoch[041] Batch [0999]/[3760] Speed: 122.742573 samples/sec accuracy=75.998438 loss=0.912173 lr=0.006354 Epoch[041] Batch [1049]/[3760] Speed: 125.259228 samples/sec accuracy=75.980655 loss=0.912340 lr=0.006352 Epoch[041] Batch [1099]/[3760] Speed: 129.081804 samples/sec accuracy=75.955966 loss=0.913652 lr=0.006350 Epoch[041] Batch [1149]/[3760] Speed: 121.530256 samples/sec accuracy=75.983696 loss=0.911949 lr=0.006348 Epoch[041] Batch [1199]/[3760] Speed: 128.479856 samples/sec accuracy=75.977865 loss=0.912254 lr=0.006346 Epoch[041] Batch [1249]/[3760] Speed: 124.913310 samples/sec accuracy=75.951250 loss=0.913425 lr=0.006344 Epoch[041] Batch [1299]/[3760] Speed: 129.947999 samples/sec accuracy=75.917067 loss=0.916058 lr=0.006342 Epoch[041] Batch [1349]/[3760] Speed: 127.129610 samples/sec accuracy=75.915509 loss=0.915858 lr=0.006340 Epoch[041] Batch [1399]/[3760] Speed: 127.182837 samples/sec accuracy=75.847098 loss=0.917936 lr=0.006338 Epoch[041] Batch [1449]/[3760] Speed: 116.928736 samples/sec accuracy=75.837284 loss=0.918928 lr=0.006336 Epoch[041] Batch [1499]/[3760] Speed: 133.238758 samples/sec accuracy=75.855208 loss=0.918548 lr=0.006334 Epoch[041] Batch [1549]/[3760] Speed: 124.896836 samples/sec accuracy=75.839718 loss=0.919578 lr=0.006332 Epoch[041] Batch [1599]/[3760] Speed: 123.817513 samples/sec accuracy=75.818359 loss=0.920630 lr=0.006330 Epoch[041] Batch [1649]/[3760] Speed: 132.902610 samples/sec accuracy=75.822917 loss=0.921051 lr=0.006328 Epoch[041] Batch [1699]/[3760] Speed: 120.935168 samples/sec accuracy=75.837316 loss=0.921328 lr=0.006326 Epoch[041] Batch [1749]/[3760] Speed: 123.472416 samples/sec accuracy=75.778571 loss=0.923010 lr=0.006324 Epoch[041] Batch [1799]/[3760] Speed: 125.207442 samples/sec accuracy=75.769965 loss=0.923616 lr=0.006322 Epoch[041] Batch [1849]/[3760] Speed: 129.253530 samples/sec accuracy=75.730574 loss=0.925079 lr=0.006319 Epoch[041] Batch [1899]/[3760] Speed: 121.664284 samples/sec accuracy=75.680921 loss=0.926170 lr=0.006317 Epoch[041] Batch [1949]/[3760] Speed: 128.005785 samples/sec accuracy=75.667468 loss=0.926671 lr=0.006315 Epoch[041] Batch [1999]/[3760] Speed: 121.446702 samples/sec accuracy=75.667969 loss=0.926550 lr=0.006313 Epoch[041] Batch [2049]/[3760] Speed: 129.038937 samples/sec accuracy=75.646341 loss=0.927329 lr=0.006311 Epoch[041] Batch [2099]/[3760] Speed: 125.306700 samples/sec accuracy=75.623512 loss=0.928531 lr=0.006309 Epoch[041] Batch [2149]/[3760] Speed: 123.121266 samples/sec accuracy=75.609738 loss=0.929192 lr=0.006307 Epoch[041] Batch [2199]/[3760] Speed: 127.079618 samples/sec accuracy=75.621449 loss=0.928900 lr=0.006305 Epoch[041] Batch [2249]/[3760] Speed: 125.599085 samples/sec accuracy=75.606250 loss=0.929553 lr=0.006303 Epoch[041] Batch [2299]/[3760] Speed: 125.969328 samples/sec accuracy=75.584239 loss=0.930437 lr=0.006301 Epoch[041] Batch [2349]/[3760] Speed: 127.778224 samples/sec accuracy=75.554521 loss=0.931952 lr=0.006299 Epoch[041] Batch [2399]/[3760] Speed: 123.648387 samples/sec accuracy=75.570312 loss=0.931441 lr=0.006297 Epoch[041] Batch [2449]/[3760] Speed: 125.344412 samples/sec accuracy=75.581633 loss=0.931275 lr=0.006295 Epoch[041] Batch [2499]/[3760] Speed: 130.430528 samples/sec accuracy=75.573750 loss=0.931734 lr=0.006293 Epoch[041] Batch [2549]/[3760] Speed: 124.205239 samples/sec accuracy=75.530025 loss=0.933836 lr=0.006291 Epoch[041] Batch [2599]/[3760] Speed: 119.653107 samples/sec accuracy=75.538462 loss=0.933900 lr=0.006289 Epoch[041] Batch [2649]/[3760] Speed: 133.963743 samples/sec accuracy=75.541863 loss=0.933359 lr=0.006287 Epoch[041] Batch [2699]/[3760] Speed: 124.767373 samples/sec accuracy=75.520255 loss=0.934255 lr=0.006285 Epoch[041] Batch [2749]/[3760] Speed: 127.615429 samples/sec accuracy=75.509091 loss=0.934986 lr=0.006283 Epoch[041] Batch [2799]/[3760] Speed: 121.028849 samples/sec accuracy=75.491071 loss=0.935171 lr=0.006281 Epoch[041] Batch [2849]/[3760] Speed: 124.782174 samples/sec accuracy=75.473684 loss=0.935828 lr=0.006279 Epoch[041] Batch [2899]/[3760] Speed: 129.405924 samples/sec accuracy=75.456358 loss=0.936556 lr=0.006277 Epoch[041] Batch [2949]/[3760] Speed: 123.324578 samples/sec accuracy=75.452860 loss=0.936743 lr=0.006275 Epoch[041] Batch [2999]/[3760] Speed: 126.021905 samples/sec accuracy=75.435938 loss=0.937657 lr=0.006273 Epoch[041] Batch [3049]/[3760] Speed: 129.348736 samples/sec accuracy=75.424693 loss=0.938155 lr=0.006271 Epoch[041] Batch [3099]/[3760] Speed: 118.220316 samples/sec accuracy=75.412298 loss=0.938582 lr=0.006269 Epoch[041] Batch [3149]/[3760] Speed: 132.098505 samples/sec accuracy=75.414683 loss=0.938257 lr=0.006267 Epoch[041] Batch [3199]/[3760] Speed: 116.673703 samples/sec accuracy=75.384766 loss=0.939086 lr=0.006265 Epoch[041] Batch [3249]/[3760] Speed: 134.205982 samples/sec accuracy=75.371154 loss=0.939493 lr=0.006263 Epoch[041] Batch [3299]/[3760] Speed: 127.686201 samples/sec accuracy=75.375000 loss=0.939398 lr=0.006261 Epoch[041] Batch [3349]/[3760] Speed: 117.184945 samples/sec accuracy=75.373134 loss=0.939260 lr=0.006259 Epoch[041] Batch [3399]/[3760] Speed: 134.795525 samples/sec accuracy=75.348805 loss=0.940051 lr=0.006257 Epoch[041] Batch [3449]/[3760] Speed: 114.538633 samples/sec accuracy=75.351449 loss=0.940019 lr=0.006255 Epoch[041] Batch [3499]/[3760] Speed: 132.281869 samples/sec accuracy=75.339732 loss=0.940527 lr=0.006253 Epoch[041] Batch [3549]/[3760] Speed: 120.059614 samples/sec accuracy=75.333627 loss=0.940815 lr=0.006251 Epoch[041] Batch [3599]/[3760] Speed: 131.733321 samples/sec accuracy=75.334635 loss=0.940827 lr=0.006249 Epoch[041] Batch [3649]/[3760] Speed: 119.996344 samples/sec accuracy=75.329623 loss=0.941548 lr=0.006247 Epoch[041] Batch [3699]/[3760] Speed: 127.409616 samples/sec accuracy=75.313345 loss=0.942332 lr=0.006245 Epoch[041] Batch [3749]/[3760] Speed: 145.864285 samples/sec accuracy=75.292083 loss=0.943258 lr=0.006243 Batch [0049]/[0303]: acc-top1=63.656250 acc-top5=84.781250 Batch [0099]/[0303]: acc-top1=63.515625 acc-top5=84.562500 Batch [0149]/[0303]: acc-top1=63.458333 acc-top5=84.885417 Batch [0199]/[0303]: acc-top1=63.023438 acc-top5=84.687500 Batch [0249]/[0303]: acc-top1=63.031250 acc-top5=84.675000 Batch [0299]/[0303]: acc-top1=63.114583 acc-top5=84.645833 [Epoch 041] training: accuracy=75.285073 loss=0.943452 [Epoch 041] speed: 125 samples/sec time cost: 2110.432822 [Epoch 041] validation: acc-top1=63.087871 acc-top5=84.622525 loss=2.168384 Epoch[042] Batch [0049]/[3760] Speed: 88.267084 samples/sec accuracy=75.937500 loss=0.927482 lr=0.006240 Epoch[042] Batch [0099]/[3760] Speed: 132.861517 samples/sec accuracy=76.500000 loss=0.911684 lr=0.006238 Epoch[042] Batch [0149]/[3760] Speed: 120.592138 samples/sec accuracy=76.364583 loss=0.913030 lr=0.006236 Epoch[042] Batch [0199]/[3760] Speed: 125.045772 samples/sec accuracy=76.539062 loss=0.902185 lr=0.006234 Epoch[042] Batch [0249]/[3760] Speed: 131.969158 samples/sec accuracy=76.262500 loss=0.906052 lr=0.006232 Epoch[042] Batch [0299]/[3760] Speed: 122.031468 samples/sec accuracy=76.291667 loss=0.904580 lr=0.006230 Epoch[042] Batch [0349]/[3760] Speed: 122.668663 samples/sec accuracy=76.406250 loss=0.898163 lr=0.006228 Epoch[042] Batch [0399]/[3760] Speed: 127.177218 samples/sec accuracy=76.296875 loss=0.899975 lr=0.006226 Epoch[042] Batch [0449]/[3760] Speed: 123.286189 samples/sec accuracy=76.104167 loss=0.903596 lr=0.006224 Epoch[042] Batch [0499]/[3760] Speed: 125.848652 samples/sec accuracy=76.012500 loss=0.904658 lr=0.006222 Epoch[042] Batch [0549]/[3760] Speed: 124.952459 samples/sec accuracy=76.002841 loss=0.905617 lr=0.006220 Epoch[042] Batch [0599]/[3760] Speed: 120.168499 samples/sec accuracy=76.218750 loss=0.901745 lr=0.006218 Epoch[042] Batch [0649]/[3760] Speed: 134.473199 samples/sec accuracy=76.233173 loss=0.900880 lr=0.006216 Epoch[042] Batch [0699]/[3760] Speed: 118.898781 samples/sec accuracy=76.232143 loss=0.900623 lr=0.006214 Epoch[042] Batch [0749]/[3760] Speed: 128.802643 samples/sec accuracy=76.283333 loss=0.898750 lr=0.006212 Epoch[042] Batch [0799]/[3760] Speed: 119.910173 samples/sec accuracy=76.236328 loss=0.900134 lr=0.006210 Epoch[042] Batch [0849]/[3760] Speed: 128.759311 samples/sec accuracy=76.222426 loss=0.900476 lr=0.006208 Epoch[042] Batch [0899]/[3760] Speed: 122.358493 samples/sec accuracy=76.282986 loss=0.897351 lr=0.006206 Epoch[042] Batch [0949]/[3760] Speed: 129.119072 samples/sec accuracy=76.312500 loss=0.897222 lr=0.006204 Epoch[042] Batch [0999]/[3760] Speed: 128.152984 samples/sec accuracy=76.356250 loss=0.895948 lr=0.006202 Epoch[042] Batch [1049]/[3760] Speed: 121.907202 samples/sec accuracy=76.333333 loss=0.897045 lr=0.006200 Epoch[042] Batch [1099]/[3760] Speed: 131.552715 samples/sec accuracy=76.318182 loss=0.897687 lr=0.006198 Epoch[042] Batch [1149]/[3760] Speed: 124.808825 samples/sec accuracy=76.243207 loss=0.899301 lr=0.006196 Epoch[042] Batch [1199]/[3760] Speed: 119.105662 samples/sec accuracy=76.282552 loss=0.898232 lr=0.006194 Epoch[042] Batch [1249]/[3760] Speed: 135.397899 samples/sec accuracy=76.212500 loss=0.900459 lr=0.006192 Epoch[042] Batch [1299]/[3760] Speed: 119.110567 samples/sec accuracy=76.181490 loss=0.900626 lr=0.006190 Epoch[042] Batch [1349]/[3760] Speed: 125.470114 samples/sec accuracy=76.148148 loss=0.903559 lr=0.006188 Epoch[042] Batch [1399]/[3760] Speed: 129.229932 samples/sec accuracy=76.137277 loss=0.904526 lr=0.006186 Epoch[042] Batch [1449]/[3760] Speed: 123.133553 samples/sec accuracy=76.134698 loss=0.904828 lr=0.006184 Epoch[042] Batch [1499]/[3760] Speed: 128.939409 samples/sec accuracy=76.148958 loss=0.904438 lr=0.006182 Epoch[042] Batch [1549]/[3760] Speed: 127.827484 samples/sec accuracy=76.100806 loss=0.905955 lr=0.006179 Epoch[042] Batch [1599]/[3760] Speed: 123.965161 samples/sec accuracy=76.072266 loss=0.907367 lr=0.006177 Epoch[042] Batch [1649]/[3760] Speed: 128.123437 samples/sec accuracy=76.053030 loss=0.908166 lr=0.006175 Epoch[042] Batch [1699]/[3760] Speed: 119.341043 samples/sec accuracy=76.022978 loss=0.909466 lr=0.006173 Epoch[042] Batch [1749]/[3760] Speed: 126.924116 samples/sec accuracy=75.984821 loss=0.910749 lr=0.006171 Epoch[042] Batch [1799]/[3760] Speed: 127.002069 samples/sec accuracy=75.992188 loss=0.911066 lr=0.006169 Epoch[042] Batch [1849]/[3760] Speed: 126.381410 samples/sec accuracy=75.960304 loss=0.912128 lr=0.006167 Epoch[042] Batch [1899]/[3760] Speed: 125.626948 samples/sec accuracy=75.967928 loss=0.912704 lr=0.006165 Epoch[042] Batch [1949]/[3760] Speed: 128.486887 samples/sec accuracy=75.931891 loss=0.914053 lr=0.006163 Epoch[042] Batch [1999]/[3760] Speed: 124.172885 samples/sec accuracy=75.921094 loss=0.914651 lr=0.006161 Epoch[042] Batch [2049]/[3760] Speed: 121.790701 samples/sec accuracy=75.887957 loss=0.915729 lr=0.006159 Epoch[042] Batch [2099]/[3760] Speed: 125.245097 samples/sec accuracy=75.880952 loss=0.916688 lr=0.006157 Epoch[042] Batch [2149]/[3760] Speed: 129.574186 samples/sec accuracy=75.873547 loss=0.916624 lr=0.006155 Epoch[042] Batch [2199]/[3760] Speed: 122.371726 samples/sec accuracy=75.875000 loss=0.916624 lr=0.006153 Epoch[042] Batch [2249]/[3760] Speed: 128.034820 samples/sec accuracy=75.869444 loss=0.916531 lr=0.006151 Epoch[042] Batch [2299]/[3760] Speed: 126.410941 samples/sec accuracy=75.844429 loss=0.916918 lr=0.006149 Epoch[042] Batch [2349]/[3760] Speed: 123.187795 samples/sec accuracy=75.859707 loss=0.916840 lr=0.006147 Epoch[042] Batch [2399]/[3760] Speed: 125.008581 samples/sec accuracy=75.857422 loss=0.916643 lr=0.006145 Epoch[042] Batch [2449]/[3760] Speed: 123.053845 samples/sec accuracy=75.811224 loss=0.918137 lr=0.006143 Epoch[042] Batch [2499]/[3760] Speed: 133.676199 samples/sec accuracy=75.820000 loss=0.917842 lr=0.006141 Epoch[042] Batch [2549]/[3760] Speed: 118.147976 samples/sec accuracy=75.809436 loss=0.918041 lr=0.006139 Epoch[042] Batch [2599]/[3760] Speed: 133.342487 samples/sec accuracy=75.797476 loss=0.918864 lr=0.006137 Epoch[042] Batch [2649]/[3760] Speed: 118.411588 samples/sec accuracy=75.788915 loss=0.919667 lr=0.006135 Epoch[042] Batch [2699]/[3760] Speed: 132.397108 samples/sec accuracy=75.768519 loss=0.920171 lr=0.006133 Epoch[042] Batch [2749]/[3760] Speed: 130.988427 samples/sec accuracy=75.752273 loss=0.920848 lr=0.006131 Epoch[042] Batch [2799]/[3760] Speed: 118.287515 samples/sec accuracy=75.742746 loss=0.921158 lr=0.006129 Epoch[042] Batch [2849]/[3760] Speed: 131.034622 samples/sec accuracy=75.748904 loss=0.921024 lr=0.006127 Epoch[042] Batch [2899]/[3760] Speed: 126.858667 samples/sec accuracy=75.744073 loss=0.921087 lr=0.006125 Epoch[042] Batch [2949]/[3760] Speed: 122.795152 samples/sec accuracy=75.731992 loss=0.921748 lr=0.006123 Epoch[042] Batch [2999]/[3760] Speed: 133.935090 samples/sec accuracy=75.732813 loss=0.922004 lr=0.006121 Epoch[042] Batch [3049]/[3760] Speed: 121.557386 samples/sec accuracy=75.724898 loss=0.922466 lr=0.006118 Epoch[042] Batch [3099]/[3760] Speed: 127.302654 samples/sec accuracy=75.718246 loss=0.922953 lr=0.006116 Epoch[042] Batch [3149]/[3760] Speed: 117.500331 samples/sec accuracy=75.717262 loss=0.923306 lr=0.006114 Epoch[042] Batch [3199]/[3760] Speed: 133.216624 samples/sec accuracy=75.706055 loss=0.924020 lr=0.006112 Epoch[042] Batch [3249]/[3760] Speed: 128.790312 samples/sec accuracy=75.697115 loss=0.924480 lr=0.006110 Epoch[042] Batch [3299]/[3760] Speed: 117.994249 samples/sec accuracy=75.696023 loss=0.924689 lr=0.006108 Epoch[042] Batch [3349]/[3760] Speed: 132.394826 samples/sec accuracy=75.689366 loss=0.925282 lr=0.006106 Epoch[042] Batch [3399]/[3760] Speed: 121.827035 samples/sec accuracy=75.650735 loss=0.926883 lr=0.006104 Epoch[042] Batch [3449]/[3760] Speed: 125.805294 samples/sec accuracy=75.651268 loss=0.926858 lr=0.006102 Epoch[042] Batch [3499]/[3760] Speed: 133.623256 samples/sec accuracy=75.651339 loss=0.926955 lr=0.006100 Epoch[042] Batch [3549]/[3760] Speed: 115.027466 samples/sec accuracy=75.631602 loss=0.927701 lr=0.006098 Epoch[042] Batch [3599]/[3760] Speed: 131.694567 samples/sec accuracy=75.611111 loss=0.928599 lr=0.006096 Epoch[042] Batch [3649]/[3760] Speed: 126.532576 samples/sec accuracy=75.603168 loss=0.928825 lr=0.006094 Epoch[042] Batch [3699]/[3760] Speed: 124.566770 samples/sec accuracy=75.574747 loss=0.929680 lr=0.006092 Epoch[042] Batch [3749]/[3760] Speed: 144.477601 samples/sec accuracy=75.555000 loss=0.930520 lr=0.006090 Batch [0049]/[0303]: acc-top1=62.875000 acc-top5=85.500000 Batch [0099]/[0303]: acc-top1=63.171875 acc-top5=85.062500 Batch [0149]/[0303]: acc-top1=63.000000 acc-top5=84.770833 Batch [0199]/[0303]: acc-top1=62.500000 acc-top5=84.609375 Batch [0249]/[0303]: acc-top1=62.593750 acc-top5=84.556250 Batch [0299]/[0303]: acc-top1=62.625000 acc-top5=84.421875 [Epoch 042] training: accuracy=75.551862 loss=0.930649 [Epoch 042] speed: 125 samples/sec time cost: 2109.632717 [Epoch 042] validation: acc-top1=62.603135 acc-top5=84.375000 loss=2.216536 Epoch[043] Batch [0049]/[3759] Speed: 89.492819 samples/sec accuracy=75.593750 loss=0.901239 lr=0.006088 Epoch[043] Batch [0099]/[3759] Speed: 130.187045 samples/sec accuracy=75.968750 loss=0.892868 lr=0.006085 Epoch[043] Batch [0149]/[3759] Speed: 117.689126 samples/sec accuracy=76.468750 loss=0.885394 lr=0.006083 Epoch[043] Batch [0199]/[3759] Speed: 133.342550 samples/sec accuracy=76.773438 loss=0.870926 lr=0.006081 Epoch[043] Batch [0249]/[3759] Speed: 127.369139 samples/sec accuracy=76.643750 loss=0.874498 lr=0.006079 Epoch[043] Batch [0299]/[3759] Speed: 120.354419 samples/sec accuracy=76.770833 loss=0.876099 lr=0.006077 Epoch[043] Batch [0349]/[3759] Speed: 131.619955 samples/sec accuracy=76.803571 loss=0.877235 lr=0.006075 Epoch[043] Batch [0399]/[3759] Speed: 121.972628 samples/sec accuracy=76.734375 loss=0.881376 lr=0.006073 Epoch[043] Batch [0449]/[3759] Speed: 124.051599 samples/sec accuracy=76.812500 loss=0.882371 lr=0.006071 Epoch[043] Batch [0499]/[3759] Speed: 127.375552 samples/sec accuracy=76.840625 loss=0.881945 lr=0.006069 Epoch[043] Batch [0549]/[3759] Speed: 126.438767 samples/sec accuracy=76.803977 loss=0.882901 lr=0.006067 Epoch[043] Batch [0599]/[3759] Speed: 121.277998 samples/sec accuracy=76.778646 loss=0.883630 lr=0.006065 Epoch[043] Batch [0649]/[3759] Speed: 133.457134 samples/sec accuracy=76.644231 loss=0.883975 lr=0.006063 Epoch[043] Batch [0699]/[3759] Speed: 123.421745 samples/sec accuracy=76.662946 loss=0.884701 lr=0.006061 Epoch[043] Batch [0749]/[3759] Speed: 123.571116 samples/sec accuracy=76.704167 loss=0.884969 lr=0.006059 Epoch[043] Batch [0799]/[3759] Speed: 131.277630 samples/sec accuracy=76.732422 loss=0.883978 lr=0.006057 Epoch[043] Batch [0849]/[3759] Speed: 119.285092 samples/sec accuracy=76.827206 loss=0.880811 lr=0.006055 Epoch[043] Batch [0899]/[3759] Speed: 130.630107 samples/sec accuracy=76.836806 loss=0.880989 lr=0.006053 Epoch[043] Batch [0949]/[3759] Speed: 131.181174 samples/sec accuracy=76.870066 loss=0.878624 lr=0.006051 Epoch[043] Batch [0999]/[3759] Speed: 118.221126 samples/sec accuracy=76.795312 loss=0.880425 lr=0.006049 Epoch[043] Batch [1049]/[3759] Speed: 132.504673 samples/sec accuracy=76.748512 loss=0.880512 lr=0.006047 Epoch[043] Batch [1099]/[3759] Speed: 120.820988 samples/sec accuracy=76.747159 loss=0.881535 lr=0.006045 Epoch[043] Batch [1149]/[3759] Speed: 124.530933 samples/sec accuracy=76.672554 loss=0.884481 lr=0.006043 Epoch[043] Batch [1199]/[3759] Speed: 130.245166 samples/sec accuracy=76.627604 loss=0.886255 lr=0.006041 Epoch[043] Batch [1249]/[3759] Speed: 124.933543 samples/sec accuracy=76.607500 loss=0.887989 lr=0.006039 Epoch[043] Batch [1299]/[3759] Speed: 122.716706 samples/sec accuracy=76.590144 loss=0.889157 lr=0.006036 Epoch[043] Batch [1349]/[3759] Speed: 133.639079 samples/sec accuracy=76.579861 loss=0.888993 lr=0.006034 Epoch[043] Batch [1399]/[3759] Speed: 120.431090 samples/sec accuracy=76.554688 loss=0.890703 lr=0.006032 Epoch[043] Batch [1449]/[3759] Speed: 127.123640 samples/sec accuracy=76.538793 loss=0.891151 lr=0.006030 Epoch[043] Batch [1499]/[3759] Speed: 122.756421 samples/sec accuracy=76.537500 loss=0.891044 lr=0.006028 Epoch[043] Batch [1549]/[3759] Speed: 125.100651 samples/sec accuracy=76.539315 loss=0.890990 lr=0.006026 Epoch[043] Batch [1599]/[3759] Speed: 132.156919 samples/sec accuracy=76.524414 loss=0.891937 lr=0.006024 Epoch[043] Batch [1649]/[3759] Speed: 119.152003 samples/sec accuracy=76.501894 loss=0.892896 lr=0.006022 Epoch[043] Batch [1699]/[3759] Speed: 130.561816 samples/sec accuracy=76.495404 loss=0.893700 lr=0.006020 Epoch[043] Batch [1749]/[3759] Speed: 127.698768 samples/sec accuracy=76.462500 loss=0.894921 lr=0.006018 Epoch[043] Batch [1799]/[3759] Speed: 122.105452 samples/sec accuracy=76.424479 loss=0.896279 lr=0.006016 Epoch[043] Batch [1849]/[3759] Speed: 122.905129 samples/sec accuracy=76.423986 loss=0.896375 lr=0.006014 Epoch[043] Batch [1899]/[3759] Speed: 127.387362 samples/sec accuracy=76.402138 loss=0.897120 lr=0.006012 Epoch[043] Batch [1949]/[3759] Speed: 128.521060 samples/sec accuracy=76.390224 loss=0.897550 lr=0.006010 Epoch[043] Batch [1999]/[3759] Speed: 122.966385 samples/sec accuracy=76.373437 loss=0.898237 lr=0.006008 Epoch[043] Batch [2049]/[3759] Speed: 126.407043 samples/sec accuracy=76.342226 loss=0.899716 lr=0.006006 Epoch[043] Batch [2099]/[3759] Speed: 122.985305 samples/sec accuracy=76.322917 loss=0.900954 lr=0.006004 Epoch[043] Batch [2149]/[3759] Speed: 125.187743 samples/sec accuracy=76.319041 loss=0.900754 lr=0.006002 Epoch[043] Batch [2199]/[3759] Speed: 133.422661 samples/sec accuracy=76.293324 loss=0.901475 lr=0.006000 Epoch[043] Batch [2249]/[3759] Speed: 120.313210 samples/sec accuracy=76.303472 loss=0.901307 lr=0.005998 Epoch[043] Batch [2299]/[3759] Speed: 126.702987 samples/sec accuracy=76.274457 loss=0.902622 lr=0.005996 Epoch[043] Batch [2349]/[3759] Speed: 129.066509 samples/sec accuracy=76.229388 loss=0.904345 lr=0.005994 Epoch[043] Batch [2399]/[3759] Speed: 121.898942 samples/sec accuracy=76.186198 loss=0.905742 lr=0.005991 Epoch[043] Batch [2449]/[3759] Speed: 130.494541 samples/sec accuracy=76.163265 loss=0.906040 lr=0.005989 Epoch[043] Batch [2499]/[3759] Speed: 121.436646 samples/sec accuracy=76.168750 loss=0.906511 lr=0.005987 Epoch[043] Batch [2549]/[3759] Speed: 130.068460 samples/sec accuracy=76.150735 loss=0.907033 lr=0.005985 Epoch[043] Batch [2599]/[3759] Speed: 121.865324 samples/sec accuracy=76.177284 loss=0.906336 lr=0.005983 Epoch[043] Batch [2649]/[3759] Speed: 127.890543 samples/sec accuracy=76.147995 loss=0.907499 lr=0.005981 Epoch[043] Batch [2699]/[3759] Speed: 132.389030 samples/sec accuracy=76.144676 loss=0.907977 lr=0.005979 Epoch[043] Batch [2749]/[3759] Speed: 114.266762 samples/sec accuracy=76.102273 loss=0.909510 lr=0.005977 Epoch[043] Batch [2799]/[3759] Speed: 130.185503 samples/sec accuracy=76.100446 loss=0.909800 lr=0.005975 Epoch[043] Batch [2849]/[3759] Speed: 129.622652 samples/sec accuracy=76.077303 loss=0.910747 lr=0.005973 Epoch[043] Batch [2899]/[3759] Speed: 125.962937 samples/sec accuracy=76.072198 loss=0.910847 lr=0.005971 Epoch[043] Batch [2949]/[3759] Speed: 125.258314 samples/sec accuracy=76.037606 loss=0.912164 lr=0.005969 Epoch[043] Batch [2999]/[3759] Speed: 126.797318 samples/sec accuracy=76.040625 loss=0.912271 lr=0.005967 Epoch[043] Batch [3049]/[3759] Speed: 125.239378 samples/sec accuracy=76.030225 loss=0.912617 lr=0.005965 Epoch[043] Batch [3099]/[3759] Speed: 129.735846 samples/sec accuracy=76.039819 loss=0.912206 lr=0.005963 Epoch[043] Batch [3149]/[3759] Speed: 123.034817 samples/sec accuracy=76.018849 loss=0.912906 lr=0.005961 Epoch[043] Batch [3199]/[3759] Speed: 129.885314 samples/sec accuracy=75.991211 loss=0.913793 lr=0.005959 Epoch[043] Batch [3249]/[3759] Speed: 120.140380 samples/sec accuracy=75.964904 loss=0.914485 lr=0.005957 Epoch[043] Batch [3299]/[3759] Speed: 128.407900 samples/sec accuracy=75.947443 loss=0.915590 lr=0.005955 Epoch[043] Batch [3349]/[3759] Speed: 124.280510 samples/sec accuracy=75.935168 loss=0.915922 lr=0.005953 Epoch[043] Batch [3399]/[3759] Speed: 132.772878 samples/sec accuracy=75.929688 loss=0.916015 lr=0.005950 Epoch[043] Batch [3449]/[3759] Speed: 118.461413 samples/sec accuracy=75.914402 loss=0.916687 lr=0.005948 Epoch[043] Batch [3499]/[3759] Speed: 129.757212 samples/sec accuracy=75.902679 loss=0.916927 lr=0.005946 Epoch[043] Batch [3549]/[3759] Speed: 122.993413 samples/sec accuracy=75.897007 loss=0.917178 lr=0.005944 Epoch[043] Batch [3599]/[3759] Speed: 129.241891 samples/sec accuracy=75.887153 loss=0.917589 lr=0.005942 Epoch[043] Batch [3649]/[3759] Speed: 122.344938 samples/sec accuracy=75.863870 loss=0.918314 lr=0.005940 Epoch[043] Batch [3699]/[3759] Speed: 126.187840 samples/sec accuracy=75.849240 loss=0.918577 lr=0.005938 Epoch[043] Batch [3749]/[3759] Speed: 147.827735 samples/sec accuracy=75.855417 loss=0.918513 lr=0.005936 Batch [0049]/[0303]: acc-top1=63.625000 acc-top5=85.562500 Batch [0099]/[0303]: acc-top1=63.781250 acc-top5=85.125000 Batch [0149]/[0303]: acc-top1=63.677083 acc-top5=84.947917 Batch [0199]/[0303]: acc-top1=63.000000 acc-top5=84.687500 Batch [0249]/[0303]: acc-top1=63.237500 acc-top5=84.656250 Batch [0299]/[0303]: acc-top1=63.234375 acc-top5=84.630208 [Epoch 043] training: accuracy=75.849628 loss=0.918758 [Epoch 043] speed: 125 samples/sec time cost: 2105.263044 [Epoch 043] validation: acc-top1=63.154909 acc-top5=84.581271 loss=2.142381 Epoch[044] Batch [0049]/[3760] Speed: 88.079136 samples/sec accuracy=76.343750 loss=0.900775 lr=0.005934 Epoch[044] Batch [0099]/[3760] Speed: 132.368271 samples/sec accuracy=76.687500 loss=0.888582 lr=0.005932 Epoch[044] Batch [0149]/[3760] Speed: 126.274083 samples/sec accuracy=77.093750 loss=0.875053 lr=0.005930 Epoch[044] Batch [0199]/[3760] Speed: 123.742056 samples/sec accuracy=77.125000 loss=0.873561 lr=0.005928 Epoch[044] Batch [0249]/[3760] Speed: 125.935648 samples/sec accuracy=77.193750 loss=0.878140 lr=0.005925 Epoch[044] Batch [0299]/[3760] Speed: 126.944861 samples/sec accuracy=77.421875 loss=0.870423 lr=0.005923 Epoch[044] Batch [0349]/[3760] Speed: 121.829115 samples/sec accuracy=77.303571 loss=0.870569 lr=0.005921 Epoch[044] Batch [0399]/[3760] Speed: 127.906664 samples/sec accuracy=77.234375 loss=0.870867 lr=0.005919 Epoch[044] Batch [0449]/[3760] Speed: 128.295084 samples/sec accuracy=77.239583 loss=0.871619 lr=0.005917 Epoch[044] Batch [0499]/[3760] Speed: 125.188342 samples/sec accuracy=77.321875 loss=0.868977 lr=0.005915 Epoch[044] Batch [0549]/[3760] Speed: 126.034548 samples/sec accuracy=77.178977 loss=0.871580 lr=0.005913 Epoch[044] Batch [0599]/[3760] Speed: 119.666648 samples/sec accuracy=77.221354 loss=0.869982 lr=0.005911 Epoch[044] Batch [0649]/[3760] Speed: 130.058248 samples/sec accuracy=77.257212 loss=0.869564 lr=0.005909 Epoch[044] Batch [0699]/[3760] Speed: 126.446545 samples/sec accuracy=77.171875 loss=0.871288 lr=0.005907 Epoch[044] Batch [0749]/[3760] Speed: 128.475735 samples/sec accuracy=77.204167 loss=0.869438 lr=0.005905 Epoch[044] Batch [0799]/[3760] Speed: 123.087156 samples/sec accuracy=77.152344 loss=0.871936 lr=0.005903 Epoch[044] Batch [0849]/[3760] Speed: 126.293466 samples/sec accuracy=77.150735 loss=0.871270 lr=0.005901 Epoch[044] Batch [0899]/[3760] Speed: 125.520329 samples/sec accuracy=77.102431 loss=0.871727 lr=0.005899 Epoch[044] Batch [0949]/[3760] Speed: 123.578413 samples/sec accuracy=77.067434 loss=0.873264 lr=0.005897 Epoch[044] Batch [0999]/[3760] Speed: 125.616580 samples/sec accuracy=77.054688 loss=0.873268 lr=0.005895 Epoch[044] Batch [1049]/[3760] Speed: 126.721676 samples/sec accuracy=77.023810 loss=0.873967 lr=0.005893 Epoch[044] Batch [1099]/[3760] Speed: 126.982500 samples/sec accuracy=77.085227 loss=0.872001 lr=0.005891 Epoch[044] Batch [1149]/[3760] Speed: 126.879129 samples/sec accuracy=77.072011 loss=0.872996 lr=0.005888 Epoch[044] Batch [1199]/[3760] Speed: 125.980575 samples/sec accuracy=77.041667 loss=0.874066 lr=0.005886 Epoch[044] Batch [1249]/[3760] Speed: 129.300758 samples/sec accuracy=76.932500 loss=0.878117 lr=0.005884 Epoch[044] Batch [1299]/[3760] Speed: 122.118602 samples/sec accuracy=76.895433 loss=0.879321 lr=0.005882 Epoch[044] Batch [1349]/[3760] Speed: 128.359988 samples/sec accuracy=76.841435 loss=0.881261 lr=0.005880 Epoch[044] Batch [1399]/[3760] Speed: 121.630171 samples/sec accuracy=76.782366 loss=0.882699 lr=0.005878 Epoch[044] Batch [1449]/[3760] Speed: 132.501821 samples/sec accuracy=76.726293 loss=0.882930 lr=0.005876 Epoch[044] Batch [1499]/[3760] Speed: 116.251451 samples/sec accuracy=76.689583 loss=0.883999 lr=0.005874 Epoch[044] Batch [1549]/[3760] Speed: 134.076654 samples/sec accuracy=76.630040 loss=0.885684 lr=0.005872 Epoch[044] Batch [1599]/[3760] Speed: 129.723800 samples/sec accuracy=76.603516 loss=0.886818 lr=0.005870 Epoch[044] Batch [1649]/[3760] Speed: 117.959853 samples/sec accuracy=76.623106 loss=0.885731 lr=0.005868 Epoch[044] Batch [1699]/[3760] Speed: 130.244380 samples/sec accuracy=76.646140 loss=0.885256 lr=0.005866 Epoch[044] Batch [1749]/[3760] Speed: 125.983142 samples/sec accuracy=76.614286 loss=0.886325 lr=0.005864 Epoch[044] Batch [1799]/[3760] Speed: 122.268407 samples/sec accuracy=76.585938 loss=0.887401 lr=0.005862 Epoch[044] Batch [1849]/[3760] Speed: 124.527755 samples/sec accuracy=76.559966 loss=0.888189 lr=0.005860 Epoch[044] Batch [1899]/[3760] Speed: 121.848335 samples/sec accuracy=76.573191 loss=0.887707 lr=0.005858 Epoch[044] Batch [1949]/[3760] Speed: 128.340298 samples/sec accuracy=76.559295 loss=0.888600 lr=0.005856 Epoch[044] Batch [1999]/[3760] Speed: 131.087599 samples/sec accuracy=76.535156 loss=0.889498 lr=0.005854 Epoch[044] Batch [2049]/[3760] Speed: 120.495756 samples/sec accuracy=76.528201 loss=0.889944 lr=0.005851 Epoch[044] Batch [2099]/[3760] Speed: 132.284841 samples/sec accuracy=76.529762 loss=0.889202 lr=0.005849 Epoch[044] Batch [2149]/[3760] Speed: 120.067338 samples/sec accuracy=76.499273 loss=0.889911 lr=0.005847 Epoch[044] Batch [2199]/[3760] Speed: 131.286593 samples/sec accuracy=76.510653 loss=0.889950 lr=0.005845 Epoch[044] Batch [2249]/[3760] Speed: 119.483712 samples/sec accuracy=76.516667 loss=0.890000 lr=0.005843 Epoch[044] Batch [2299]/[3760] Speed: 124.149245 samples/sec accuracy=76.512228 loss=0.890119 lr=0.005841 Epoch[044] Batch [2349]/[3760] Speed: 130.262322 samples/sec accuracy=76.500665 loss=0.891091 lr=0.005839 Epoch[044] Batch [2399]/[3760] Speed: 125.803100 samples/sec accuracy=76.474609 loss=0.891858 lr=0.005837 Epoch[044] Batch [2449]/[3760] Speed: 125.088262 samples/sec accuracy=76.463648 loss=0.892494 lr=0.005835 Epoch[044] Batch [2499]/[3760] Speed: 122.988917 samples/sec accuracy=76.444375 loss=0.893462 lr=0.005833 Epoch[044] Batch [2549]/[3760] Speed: 121.510565 samples/sec accuracy=76.424020 loss=0.893848 lr=0.005831 Epoch[044] Batch [2599]/[3760] Speed: 132.661350 samples/sec accuracy=76.400841 loss=0.894559 lr=0.005829 Epoch[044] Batch [2649]/[3760] Speed: 117.371942 samples/sec accuracy=76.387382 loss=0.895408 lr=0.005827 Epoch[044] Batch [2699]/[3760] Speed: 129.698143 samples/sec accuracy=76.379630 loss=0.895006 lr=0.005825 Epoch[044] Batch [2749]/[3760] Speed: 128.642820 samples/sec accuracy=76.359091 loss=0.895990 lr=0.005823 Epoch[044] Batch [2799]/[3760] Speed: 122.680514 samples/sec accuracy=76.345424 loss=0.896314 lr=0.005821 Epoch[044] Batch [2849]/[3760] Speed: 127.875277 samples/sec accuracy=76.322917 loss=0.897281 lr=0.005818 Epoch[044] Batch [2899]/[3760] Speed: 124.658035 samples/sec accuracy=76.321659 loss=0.897082 lr=0.005816 Epoch[044] Batch [2949]/[3760] Speed: 128.062638 samples/sec accuracy=76.314619 loss=0.897419 lr=0.005814 Epoch[044] Batch [2999]/[3760] Speed: 120.936529 samples/sec accuracy=76.295312 loss=0.898354 lr=0.005812 Epoch[044] Batch [3049]/[3760] Speed: 127.236318 samples/sec accuracy=76.277152 loss=0.898975 lr=0.005810 Epoch[044] Batch [3099]/[3760] Speed: 125.787307 samples/sec accuracy=76.276714 loss=0.899171 lr=0.005808 Epoch[044] Batch [3149]/[3760] Speed: 123.906394 samples/sec accuracy=76.267857 loss=0.899594 lr=0.005806 Epoch[044] Batch [3199]/[3760] Speed: 127.453746 samples/sec accuracy=76.254395 loss=0.900311 lr=0.005804 Epoch[044] Batch [3249]/[3760] Speed: 129.526251 samples/sec accuracy=76.232212 loss=0.900910 lr=0.005802 Epoch[044] Batch [3299]/[3760] Speed: 120.271975 samples/sec accuracy=76.211648 loss=0.901621 lr=0.005800 Epoch[044] Batch [3349]/[3760] Speed: 127.966222 samples/sec accuracy=76.208022 loss=0.901602 lr=0.005798 Epoch[044] Batch [3399]/[3760] Speed: 126.426609 samples/sec accuracy=76.181526 loss=0.902771 lr=0.005796 Epoch[044] Batch [3449]/[3760] Speed: 121.710479 samples/sec accuracy=76.151721 loss=0.903973 lr=0.005794 Epoch[044] Batch [3499]/[3760] Speed: 129.377402 samples/sec accuracy=76.120982 loss=0.904949 lr=0.005792 Epoch[044] Batch [3549]/[3760] Speed: 121.609882 samples/sec accuracy=76.106954 loss=0.905818 lr=0.005790 Epoch[044] Batch [3599]/[3760] Speed: 128.581698 samples/sec accuracy=76.086806 loss=0.906583 lr=0.005788 Epoch[044] Batch [3649]/[3760] Speed: 123.219240 samples/sec accuracy=76.075342 loss=0.906712 lr=0.005785 Epoch[044] Batch [3699]/[3760] Speed: 127.690219 samples/sec accuracy=76.072213 loss=0.906992 lr=0.005783 Epoch[044] Batch [3749]/[3760] Speed: 144.812449 samples/sec accuracy=76.063333 loss=0.907759 lr=0.005781 Batch [0049]/[0303]: acc-top1=62.875000 acc-top5=85.156250 Batch [0099]/[0303]: acc-top1=63.062500 acc-top5=84.656250 Batch [0149]/[0303]: acc-top1=62.947917 acc-top5=84.541667 Batch [0199]/[0303]: acc-top1=62.539062 acc-top5=84.453125 Batch [0249]/[0303]: acc-top1=62.693750 acc-top5=84.556250 Batch [0299]/[0303]: acc-top1=62.640625 acc-top5=84.479167 [Epoch 044] training: accuracy=76.062583 loss=0.907791 [Epoch 044] speed: 125 samples/sec time cost: 2110.215855 [Epoch 044] validation: acc-top1=62.603135 acc-top5=84.436881 loss=2.187831 Epoch[045] Batch [0049]/[3760] Speed: 91.082128 samples/sec accuracy=77.500000 loss=0.833708 lr=0.005779 Epoch[045] Batch [0099]/[3760] Speed: 125.126652 samples/sec accuracy=77.546875 loss=0.840470 lr=0.005777 Epoch[045] Batch [0149]/[3760] Speed: 127.463727 samples/sec accuracy=77.760417 loss=0.845322 lr=0.005775 Epoch[045] Batch [0199]/[3760] Speed: 124.322215 samples/sec accuracy=77.398438 loss=0.854294 lr=0.005773 Epoch[045] Batch [0249]/[3760] Speed: 124.823904 samples/sec accuracy=77.437500 loss=0.853849 lr=0.005771 Epoch[045] Batch [0299]/[3760] Speed: 127.277524 samples/sec accuracy=77.234375 loss=0.860770 lr=0.005769 Epoch[045] Batch [0349]/[3760] Speed: 122.812699 samples/sec accuracy=77.138393 loss=0.861068 lr=0.005767 Epoch[045] Batch [0399]/[3760] Speed: 124.984304 samples/sec accuracy=77.140625 loss=0.862570 lr=0.005764 Epoch[045] Batch [0449]/[3760] Speed: 132.691205 samples/sec accuracy=77.131944 loss=0.859901 lr=0.005762 Epoch[045] Batch [0499]/[3760] Speed: 118.529078 samples/sec accuracy=77.193750 loss=0.861537 lr=0.005760 Epoch[045] Batch [0549]/[3760] Speed: 133.069138 samples/sec accuracy=77.156250 loss=0.863638 lr=0.005758 Epoch[045] Batch [0599]/[3760] Speed: 120.575104 samples/sec accuracy=77.239583 loss=0.861993 lr=0.005756 Epoch[045] Batch [0649]/[3760] Speed: 128.996141 samples/sec accuracy=77.276442 loss=0.862360 lr=0.005754 Epoch[045] Batch [0699]/[3760] Speed: 122.140086 samples/sec accuracy=77.261161 loss=0.860821 lr=0.005752 Epoch[045] Batch [0749]/[3760] Speed: 130.067775 samples/sec accuracy=77.268750 loss=0.860771 lr=0.005750 Epoch[045] Batch [0799]/[3760] Speed: 124.989076 samples/sec accuracy=77.226562 loss=0.863037 lr=0.005748 Epoch[045] Batch [0849]/[3760] Speed: 123.115471 samples/sec accuracy=77.194853 loss=0.863844 lr=0.005746 Epoch[045] Batch [0899]/[3760] Speed: 129.716734 samples/sec accuracy=77.173611 loss=0.864154 lr=0.005744 Epoch[045] Batch [0949]/[3760] Speed: 124.849161 samples/sec accuracy=77.070724 loss=0.866508 lr=0.005742 Epoch[045] Batch [0999]/[3760] Speed: 121.769483 samples/sec accuracy=77.162500 loss=0.864818 lr=0.005740 Epoch[045] Batch [1049]/[3760] Speed: 128.932912 samples/sec accuracy=77.114583 loss=0.865628 lr=0.005738 Epoch[045] Batch [1099]/[3760] Speed: 123.313089 samples/sec accuracy=77.085227 loss=0.864930 lr=0.005736 Epoch[045] Batch [1149]/[3760] Speed: 126.164343 samples/sec accuracy=77.065217 loss=0.865028 lr=0.005733 Epoch[045] Batch [1199]/[3760] Speed: 131.420763 samples/sec accuracy=77.036458 loss=0.865535 lr=0.005731 Epoch[045] Batch [1249]/[3760] Speed: 119.573287 samples/sec accuracy=76.993750 loss=0.866728 lr=0.005729 Epoch[045] Batch [1299]/[3760] Speed: 129.703687 samples/sec accuracy=76.983173 loss=0.867209 lr=0.005727 Epoch[045] Batch [1349]/[3760] Speed: 121.663213 samples/sec accuracy=76.983796 loss=0.866984 lr=0.005725 Epoch[045] Batch [1399]/[3760] Speed: 130.285853 samples/sec accuracy=76.995536 loss=0.867524 lr=0.005723 Epoch[045] Batch [1449]/[3760] Speed: 119.818233 samples/sec accuracy=76.981681 loss=0.867975 lr=0.005721 Epoch[045] Batch [1499]/[3760] Speed: 126.178348 samples/sec accuracy=76.966667 loss=0.868683 lr=0.005719 Epoch[045] Batch [1549]/[3760] Speed: 127.778848 samples/sec accuracy=76.954637 loss=0.868734 lr=0.005717 Epoch[045] Batch [1599]/[3760] Speed: 120.050690 samples/sec accuracy=76.935547 loss=0.869447 lr=0.005715 Epoch[045] Batch [1649]/[3760] Speed: 126.984289 samples/sec accuracy=76.907197 loss=0.870724 lr=0.005713 Epoch[045] Batch [1699]/[3760] Speed: 122.455443 samples/sec accuracy=76.892463 loss=0.871240 lr=0.005711 Epoch[045] Batch [1749]/[3760] Speed: 128.392080 samples/sec accuracy=76.874107 loss=0.872223 lr=0.005709 Epoch[045] Batch [1799]/[3760] Speed: 128.064987 samples/sec accuracy=76.860243 loss=0.873022 lr=0.005707 Epoch[045] Batch [1849]/[3760] Speed: 123.482816 samples/sec accuracy=76.844595 loss=0.873464 lr=0.005705 Epoch[045] Batch [1899]/[3760] Speed: 124.289566 samples/sec accuracy=76.848684 loss=0.873614 lr=0.005702 Epoch[045] Batch [1949]/[3760] Speed: 126.095697 samples/sec accuracy=76.816506 loss=0.875746 lr=0.005700 Epoch[045] Batch [1999]/[3760] Speed: 127.142258 samples/sec accuracy=76.785156 loss=0.877436 lr=0.005698 Epoch[045] Batch [2049]/[3760] Speed: 122.850117 samples/sec accuracy=76.751524 loss=0.878424 lr=0.005696 Epoch[045] Batch [2099]/[3760] Speed: 130.898203 samples/sec accuracy=76.737351 loss=0.878648 lr=0.005694 Epoch[045] Batch [2149]/[3760] Speed: 124.802822 samples/sec accuracy=76.752907 loss=0.878142 lr=0.005692 Epoch[045] Batch [2199]/[3760] Speed: 122.778234 samples/sec accuracy=76.737216 loss=0.878383 lr=0.005690 Epoch[045] Batch [2249]/[3760] Speed: 129.745189 samples/sec accuracy=76.732639 loss=0.878379 lr=0.005688 Epoch[045] Batch [2299]/[3760] Speed: 120.049093 samples/sec accuracy=76.709918 loss=0.879218 lr=0.005686 Epoch[045] Batch [2349]/[3760] Speed: 126.761703 samples/sec accuracy=76.682181 loss=0.879870 lr=0.005684 Epoch[045] Batch [2399]/[3760] Speed: 124.984158 samples/sec accuracy=76.678385 loss=0.879961 lr=0.005682 Epoch[045] Batch [2449]/[3760] Speed: 133.805948 samples/sec accuracy=76.686224 loss=0.880080 lr=0.005680 Epoch[045] Batch [2499]/[3760] Speed: 116.741123 samples/sec accuracy=76.660625 loss=0.880836 lr=0.005678 Epoch[045] Batch [2549]/[3760] Speed: 134.171747 samples/sec accuracy=76.646446 loss=0.880918 lr=0.005676 Epoch[045] Batch [2599]/[3760] Speed: 122.376618 samples/sec accuracy=76.609976 loss=0.881676 lr=0.005673 Epoch[045] Batch [2649]/[3760] Speed: 123.092227 samples/sec accuracy=76.591392 loss=0.882537 lr=0.005671 Epoch[045] Batch [2699]/[3760] Speed: 131.271650 samples/sec accuracy=76.585648 loss=0.883045 lr=0.005669 Epoch[045] Batch [2749]/[3760] Speed: 118.559441 samples/sec accuracy=76.559091 loss=0.883997 lr=0.005667 Epoch[045] Batch [2799]/[3760] Speed: 131.863877 samples/sec accuracy=76.550223 loss=0.883913 lr=0.005665 Epoch[045] Batch [2849]/[3760] Speed: 124.870052 samples/sec accuracy=76.542215 loss=0.884293 lr=0.005663 Epoch[045] Batch [2899]/[3760] Speed: 122.913801 samples/sec accuracy=76.528017 loss=0.884625 lr=0.005661 Epoch[045] Batch [2949]/[3760] Speed: 130.571784 samples/sec accuracy=76.500000 loss=0.885496 lr=0.005659 Epoch[045] Batch [2999]/[3760] Speed: 120.425914 samples/sec accuracy=76.467187 loss=0.886167 lr=0.005657 Epoch[045] Batch [3049]/[3760] Speed: 126.572513 samples/sec accuracy=76.459529 loss=0.886285 lr=0.005655 Epoch[045] Batch [3099]/[3760] Speed: 124.230628 samples/sec accuracy=76.436492 loss=0.886527 lr=0.005653 Epoch[045] Batch [3149]/[3760] Speed: 125.574993 samples/sec accuracy=76.413194 loss=0.887043 lr=0.005651 Epoch[045] Batch [3199]/[3760] Speed: 127.329833 samples/sec accuracy=76.381348 loss=0.888222 lr=0.005649 Epoch[045] Batch [3249]/[3760] Speed: 122.701965 samples/sec accuracy=76.346635 loss=0.889368 lr=0.005647 Epoch[045] Batch [3299]/[3760] Speed: 127.483736 samples/sec accuracy=76.339015 loss=0.890116 lr=0.005644 Epoch[045] Batch [3349]/[3760] Speed: 122.357214 samples/sec accuracy=76.333022 loss=0.890756 lr=0.005642 Epoch[045] Batch [3399]/[3760] Speed: 127.917677 samples/sec accuracy=76.320772 loss=0.891605 lr=0.005640 Epoch[045] Batch [3449]/[3760] Speed: 129.381073 samples/sec accuracy=76.312953 loss=0.892287 lr=0.005638 Epoch[045] Batch [3499]/[3760] Speed: 122.723547 samples/sec accuracy=76.322768 loss=0.892855 lr=0.005636 Epoch[045] Batch [3549]/[3760] Speed: 125.891742 samples/sec accuracy=76.316901 loss=0.892773 lr=0.005634 Epoch[045] Batch [3599]/[3760] Speed: 122.091140 samples/sec accuracy=76.302517 loss=0.893388 lr=0.005632 Epoch[045] Batch [3649]/[3760] Speed: 126.840602 samples/sec accuracy=76.272688 loss=0.894305 lr=0.005630 Epoch[045] Batch [3699]/[3760] Speed: 128.276908 samples/sec accuracy=76.265203 loss=0.895353 lr=0.005628 Epoch[045] Batch [3749]/[3760] Speed: 141.681423 samples/sec accuracy=76.252083 loss=0.896078 lr=0.005626 Batch [0049]/[0303]: acc-top1=63.625000 acc-top5=85.500000 Batch [0099]/[0303]: acc-top1=64.171875 acc-top5=85.281250 Batch [0149]/[0303]: acc-top1=63.833333 acc-top5=84.750000 Batch [0199]/[0303]: acc-top1=63.304688 acc-top5=84.640625 Batch [0249]/[0303]: acc-top1=63.256250 acc-top5=84.743750 Batch [0299]/[0303]: acc-top1=63.052083 acc-top5=84.661458 [Epoch 045] training: accuracy=76.252493 loss=0.896096 [Epoch 045] speed: 125 samples/sec time cost: 2110.143506 [Epoch 045] validation: acc-top1=62.989893 acc-top5=84.617368 loss=2.127792 Epoch[046] Batch [0049]/[3759] Speed: 88.006871 samples/sec accuracy=77.500000 loss=0.834422 lr=0.005623 Epoch[046] Batch [0099]/[3759] Speed: 131.687460 samples/sec accuracy=77.406250 loss=0.834494 lr=0.005621 Epoch[046] Batch [0149]/[3759] Speed: 120.222917 samples/sec accuracy=77.958333 loss=0.832449 lr=0.005619 Epoch[046] Batch [0199]/[3759] Speed: 126.448779 samples/sec accuracy=78.218750 loss=0.825260 lr=0.005617 Epoch[046] Batch [0249]/[3759] Speed: 125.743332 samples/sec accuracy=78.106250 loss=0.827808 lr=0.005615 Epoch[046] Batch [0299]/[3759] Speed: 120.405345 samples/sec accuracy=78.223958 loss=0.822275 lr=0.005613 Epoch[046] Batch [0349]/[3759] Speed: 135.695236 samples/sec accuracy=78.276786 loss=0.819418 lr=0.005611 Epoch[046] Batch [0399]/[3759] Speed: 120.661656 samples/sec accuracy=78.242188 loss=0.820829 lr=0.005609 Epoch[046] Batch [0449]/[3759] Speed: 124.856883 samples/sec accuracy=78.180556 loss=0.820203 lr=0.005607 Epoch[046] Batch [0499]/[3759] Speed: 126.644130 samples/sec accuracy=78.162500 loss=0.822692 lr=0.005605 Epoch[046] Batch [0549]/[3759] Speed: 122.874413 samples/sec accuracy=78.028409 loss=0.825501 lr=0.005603 Epoch[046] Batch [0599]/[3759] Speed: 131.032535 samples/sec accuracy=77.984375 loss=0.830265 lr=0.005601 Epoch[046] Batch [0649]/[3759] Speed: 125.707910 samples/sec accuracy=77.896635 loss=0.831812 lr=0.005598 Epoch[046] Batch [0699]/[3759] Speed: 122.852781 samples/sec accuracy=77.821429 loss=0.834317 lr=0.005596 Epoch[046] Batch [0749]/[3759] Speed: 127.507205 samples/sec accuracy=77.693750 loss=0.837782 lr=0.005594 Epoch[046] Batch [0799]/[3759] Speed: 125.333484 samples/sec accuracy=77.580078 loss=0.840312 lr=0.005592 Epoch[046] Batch [0849]/[3759] Speed: 124.204821 samples/sec accuracy=77.538603 loss=0.841393 lr=0.005590 Epoch[046] Batch [0899]/[3759] Speed: 131.209577 samples/sec accuracy=77.482639 loss=0.845198 lr=0.005588 Epoch[046] Batch [0949]/[3759] Speed: 115.812145 samples/sec accuracy=77.417763 loss=0.847299 lr=0.005586 Epoch[046] Batch [0999]/[3759] Speed: 136.117872 samples/sec accuracy=77.384375 loss=0.848957 lr=0.005584 Epoch[046] Batch [1049]/[3759] Speed: 119.573504 samples/sec accuracy=77.377976 loss=0.848279 lr=0.005582 Epoch[046] Batch [1099]/[3759] Speed: 127.707703 samples/sec accuracy=77.380682 loss=0.848957 lr=0.005580 Epoch[046] Batch [1149]/[3759] Speed: 132.816921 samples/sec accuracy=77.326087 loss=0.851422 lr=0.005578 Epoch[046] Batch [1199]/[3759] Speed: 116.604923 samples/sec accuracy=77.369792 loss=0.850215 lr=0.005576 Epoch[046] Batch [1249]/[3759] Speed: 130.258073 samples/sec accuracy=77.325000 loss=0.853007 lr=0.005574 Epoch[046] Batch [1299]/[3759] Speed: 131.645304 samples/sec accuracy=77.344952 loss=0.851681 lr=0.005571 Epoch[046] Batch [1349]/[3759] Speed: 116.682614 samples/sec accuracy=77.342593 loss=0.852255 lr=0.005569 Epoch[046] Batch [1399]/[3759] Speed: 130.524115 samples/sec accuracy=77.274554 loss=0.855031 lr=0.005567 Epoch[046] Batch [1449]/[3759] Speed: 128.779926 samples/sec accuracy=77.246767 loss=0.855927 lr=0.005565 Epoch[046] Batch [1499]/[3759] Speed: 120.883777 samples/sec accuracy=77.211458 loss=0.857530 lr=0.005563 Epoch[046] Batch [1549]/[3759] Speed: 127.711420 samples/sec accuracy=77.228831 loss=0.858352 lr=0.005561 Epoch[046] Batch [1599]/[3759] Speed: 120.168108 samples/sec accuracy=77.269531 loss=0.857363 lr=0.005559 Epoch[046] Batch [1649]/[3759] Speed: 132.183782 samples/sec accuracy=77.283144 loss=0.857371 lr=0.005557 Epoch[046] Batch [1699]/[3759] Speed: 124.985854 samples/sec accuracy=77.238971 loss=0.858930 lr=0.005555 Epoch[046] Batch [1749]/[3759] Speed: 122.320103 samples/sec accuracy=77.210714 loss=0.860796 lr=0.005553 Epoch[046] Batch [1799]/[3759] Speed: 126.938197 samples/sec accuracy=77.230035 loss=0.860408 lr=0.005551 Epoch[046] Batch [1849]/[3759] Speed: 122.833081 samples/sec accuracy=77.184122 loss=0.860735 lr=0.005549 Epoch[046] Batch [1899]/[3759] Speed: 127.309119 samples/sec accuracy=77.162829 loss=0.861240 lr=0.005547 Epoch[046] Batch [1949]/[3759] Speed: 125.205526 samples/sec accuracy=77.137821 loss=0.862582 lr=0.005544 Epoch[046] Batch [1999]/[3759] Speed: 124.260512 samples/sec accuracy=77.136719 loss=0.862895 lr=0.005542 Epoch[046] Batch [2049]/[3759] Speed: 128.056303 samples/sec accuracy=77.139482 loss=0.863238 lr=0.005540 Epoch[046] Batch [2099]/[3759] Speed: 122.311134 samples/sec accuracy=77.152530 loss=0.862837 lr=0.005538 Epoch[046] Batch [2149]/[3759] Speed: 128.099616 samples/sec accuracy=77.132994 loss=0.863696 lr=0.005536 Epoch[046] Batch [2199]/[3759] Speed: 125.546177 samples/sec accuracy=77.112926 loss=0.864179 lr=0.005534 Epoch[046] Batch [2249]/[3759] Speed: 124.984610 samples/sec accuracy=77.106944 loss=0.864784 lr=0.005532 Epoch[046] Batch [2299]/[3759] Speed: 124.372717 samples/sec accuracy=77.109375 loss=0.865073 lr=0.005530 Epoch[046] Batch [2349]/[3759] Speed: 126.852504 samples/sec accuracy=77.094415 loss=0.865849 lr=0.005528 Epoch[046] Batch [2399]/[3759] Speed: 121.055531 samples/sec accuracy=77.090495 loss=0.866376 lr=0.005526 Epoch[046] Batch [2449]/[3759] Speed: 130.960980 samples/sec accuracy=77.099490 loss=0.866112 lr=0.005524 Epoch[046] Batch [2499]/[3759] Speed: 117.712475 samples/sec accuracy=77.100625 loss=0.866702 lr=0.005522 Epoch[046] Batch [2549]/[3759] Speed: 127.004753 samples/sec accuracy=77.080270 loss=0.867370 lr=0.005520 Epoch[046] Batch [2599]/[3759] Speed: 133.177838 samples/sec accuracy=77.059495 loss=0.868008 lr=0.005517 Epoch[046] Batch [2649]/[3759] Speed: 118.489940 samples/sec accuracy=77.033019 loss=0.869002 lr=0.005515 Epoch[046] Batch [2699]/[3759] Speed: 131.726856 samples/sec accuracy=77.014468 loss=0.869173 lr=0.005513 Epoch[046] Batch [2749]/[3759] Speed: 122.286051 samples/sec accuracy=76.978409 loss=0.870541 lr=0.005511 Epoch[046] Batch [2799]/[3759] Speed: 126.842231 samples/sec accuracy=76.944196 loss=0.871680 lr=0.005509 Epoch[046] Batch [2849]/[3759] Speed: 123.406416 samples/sec accuracy=76.939693 loss=0.871622 lr=0.005507 Epoch[046] Batch [2899]/[3759] Speed: 126.216524 samples/sec accuracy=76.933190 loss=0.872199 lr=0.005505 Epoch[046] Batch [2949]/[3759] Speed: 125.532022 samples/sec accuracy=76.927966 loss=0.872081 lr=0.005503 Epoch[046] Batch [2999]/[3759] Speed: 124.215938 samples/sec accuracy=76.927083 loss=0.872555 lr=0.005501 Epoch[046] Batch [3049]/[3759] Speed: 129.947993 samples/sec accuracy=76.903176 loss=0.874166 lr=0.005499 Epoch[046] Batch [3099]/[3759] Speed: 118.193653 samples/sec accuracy=76.891633 loss=0.874867 lr=0.005497 Epoch[046] Batch [3149]/[3759] Speed: 132.605595 samples/sec accuracy=76.883929 loss=0.875345 lr=0.005495 Epoch[046] Batch [3199]/[3759] Speed: 122.644544 samples/sec accuracy=76.874023 loss=0.875931 lr=0.005493 Epoch[046] Batch [3249]/[3759] Speed: 127.392180 samples/sec accuracy=76.867788 loss=0.876714 lr=0.005490 Epoch[046] Batch [3299]/[3759] Speed: 124.112863 samples/sec accuracy=76.854167 loss=0.877168 lr=0.005488 Epoch[046] Batch [3349]/[3759] Speed: 123.312180 samples/sec accuracy=76.849347 loss=0.877373 lr=0.005486 Epoch[046] Batch [3399]/[3759] Speed: 134.204965 samples/sec accuracy=76.826746 loss=0.877888 lr=0.005484 Epoch[046] Batch [3449]/[3759] Speed: 120.571244 samples/sec accuracy=76.805707 loss=0.878608 lr=0.005482 Epoch[046] Batch [3499]/[3759] Speed: 128.877676 samples/sec accuracy=76.779464 loss=0.879334 lr=0.005480 Epoch[046] Batch [3549]/[3759] Speed: 125.114105 samples/sec accuracy=76.770246 loss=0.879873 lr=0.005478 Epoch[046] Batch [3599]/[3759] Speed: 119.913319 samples/sec accuracy=76.760417 loss=0.880456 lr=0.005476 Epoch[046] Batch [3649]/[3759] Speed: 134.339622 samples/sec accuracy=76.768408 loss=0.880514 lr=0.005474 Epoch[046] Batch [3699]/[3759] Speed: 116.385928 samples/sec accuracy=76.760557 loss=0.880773 lr=0.005472 Epoch[046] Batch [3749]/[3759] Speed: 149.868774 samples/sec accuracy=76.747500 loss=0.881606 lr=0.005470 Batch [0049]/[0303]: acc-top1=64.125000 acc-top5=84.968750 Batch [0099]/[0303]: acc-top1=63.703125 acc-top5=84.500000 Batch [0149]/[0303]: acc-top1=63.885417 acc-top5=84.541667 Batch [0199]/[0303]: acc-top1=63.359375 acc-top5=84.578125 Batch [0249]/[0303]: acc-top1=63.262500 acc-top5=84.375000 Batch [0299]/[0303]: acc-top1=63.171875 acc-top5=84.369792 [Epoch 046] training: accuracy=76.747057 loss=0.881604 [Epoch 046] speed: 125 samples/sec time cost: 2110.730936 [Epoch 046] validation: acc-top1=63.108498 acc-top5=84.349216 loss=2.182952 Epoch[047] Batch [0049]/[3760] Speed: 87.513610 samples/sec accuracy=78.875000 loss=0.805001 lr=0.005467 Epoch[047] Batch [0099]/[3760] Speed: 134.930021 samples/sec accuracy=78.578125 loss=0.808181 lr=0.005465 Epoch[047] Batch [0149]/[3760] Speed: 119.261717 samples/sec accuracy=78.208333 loss=0.817417 lr=0.005463 Epoch[047] Batch [0199]/[3760] Speed: 130.490950 samples/sec accuracy=77.984375 loss=0.824609 lr=0.005461 Epoch[047] Batch [0249]/[3760] Speed: 122.594736 samples/sec accuracy=77.668750 loss=0.835209 lr=0.005459 Epoch[047] Batch [0299]/[3760] Speed: 124.501994 samples/sec accuracy=77.703125 loss=0.833216 lr=0.005457 Epoch[047] Batch [0349]/[3760] Speed: 129.407667 samples/sec accuracy=77.821429 loss=0.831834 lr=0.005455 Epoch[047] Batch [0399]/[3760] Speed: 118.093689 samples/sec accuracy=77.812500 loss=0.833496 lr=0.005453 Epoch[047] Batch [0449]/[3760] Speed: 131.401747 samples/sec accuracy=77.822917 loss=0.833884 lr=0.005451 Epoch[047] Batch [0499]/[3760] Speed: 122.205776 samples/sec accuracy=77.800000 loss=0.835082 lr=0.005448 Epoch[047] Batch [0549]/[3760] Speed: 126.596711 samples/sec accuracy=77.764205 loss=0.836691 lr=0.005446 Epoch[047] Batch [0599]/[3760] Speed: 129.918936 samples/sec accuracy=77.755208 loss=0.836667 lr=0.005444 Epoch[047] Batch [0649]/[3760] Speed: 122.848430 samples/sec accuracy=77.831731 loss=0.833920 lr=0.005442 Epoch[047] Batch [0699]/[3760] Speed: 125.280396 samples/sec accuracy=77.854911 loss=0.832870 lr=0.005440 Epoch[047] Batch [0749]/[3760] Speed: 124.809112 samples/sec accuracy=77.954167 loss=0.829632 lr=0.005438 Epoch[047] Batch [0799]/[3760] Speed: 125.508256 samples/sec accuracy=78.068359 loss=0.825603 lr=0.005436 Epoch[047] Batch [0849]/[3760] Speed: 124.259900 samples/sec accuracy=78.064338 loss=0.825264 lr=0.005434 Epoch[047] Batch [0899]/[3760] Speed: 119.858673 samples/sec accuracy=77.986111 loss=0.829188 lr=0.005432 Epoch[047] Batch [0949]/[3760] Speed: 132.787791 samples/sec accuracy=77.985197 loss=0.830044 lr=0.005430 Epoch[047] Batch [0999]/[3760] Speed: 124.075107 samples/sec accuracy=77.946875 loss=0.830912 lr=0.005428 Epoch[047] Batch [1049]/[3760] Speed: 123.528762 samples/sec accuracy=77.958333 loss=0.830016 lr=0.005426 Epoch[047] Batch [1099]/[3760] Speed: 128.458564 samples/sec accuracy=77.937500 loss=0.830530 lr=0.005423 Epoch[047] Batch [1149]/[3760] Speed: 116.184074 samples/sec accuracy=77.907609 loss=0.832905 lr=0.005421 Epoch[047] Batch [1199]/[3760] Speed: 132.970765 samples/sec accuracy=77.882812 loss=0.833933 lr=0.005419 Epoch[047] Batch [1249]/[3760] Speed: 130.831812 samples/sec accuracy=77.853750 loss=0.834969 lr=0.005417 Epoch[047] Batch [1299]/[3760] Speed: 122.792650 samples/sec accuracy=77.844952 loss=0.836147 lr=0.005415 Epoch[047] Batch [1349]/[3760] Speed: 123.846156 samples/sec accuracy=77.793981 loss=0.837921 lr=0.005413 Epoch[047] Batch [1399]/[3760] Speed: 126.955398 samples/sec accuracy=77.768973 loss=0.839262 lr=0.005411 Epoch[047] Batch [1449]/[3760] Speed: 123.353096 samples/sec accuracy=77.750000 loss=0.839824 lr=0.005409 Epoch[047] Batch [1499]/[3760] Speed: 122.927897 samples/sec accuracy=77.716667 loss=0.840471 lr=0.005407 Epoch[047] Batch [1549]/[3760] Speed: 127.273656 samples/sec accuracy=77.710685 loss=0.840717 lr=0.005405 Epoch[047] Batch [1599]/[3760] Speed: 130.562855 samples/sec accuracy=77.672852 loss=0.842161 lr=0.005403 Epoch[047] Batch [1649]/[3760] Speed: 125.505040 samples/sec accuracy=77.640152 loss=0.842890 lr=0.005401 Epoch[047] Batch [1699]/[3760] Speed: 118.180304 samples/sec accuracy=77.604779 loss=0.844476 lr=0.005399 Epoch[047] Batch [1749]/[3760] Speed: 130.152145 samples/sec accuracy=77.594643 loss=0.844995 lr=0.005396 Epoch[047] Batch [1799]/[3760] Speed: 128.051082 samples/sec accuracy=77.570312 loss=0.846188 lr=0.005394 Epoch[047] Batch [1849]/[3760] Speed: 118.655914 samples/sec accuracy=77.509291 loss=0.848191 lr=0.005392 Epoch[047] Batch [1899]/[3760] Speed: 134.398193 samples/sec accuracy=77.504112 loss=0.848615 lr=0.005390 Epoch[047] Batch [1949]/[3760] Speed: 117.020141 samples/sec accuracy=77.488782 loss=0.849308 lr=0.005388 Epoch[047] Batch [1999]/[3760] Speed: 134.735051 samples/sec accuracy=77.465625 loss=0.850057 lr=0.005386 Epoch[047] Batch [2049]/[3760] Speed: 116.131442 samples/sec accuracy=77.455030 loss=0.850750 lr=0.005384 Epoch[047] Batch [2099]/[3760] Speed: 132.335768 samples/sec accuracy=77.473214 loss=0.850537 lr=0.005382 Epoch[047] Batch [2149]/[3760] Speed: 116.240244 samples/sec accuracy=77.455669 loss=0.851503 lr=0.005380 Epoch[047] Batch [2199]/[3760] Speed: 134.866868 samples/sec accuracy=77.444602 loss=0.851825 lr=0.005378 Epoch[047] Batch [2249]/[3760] Speed: 128.247511 samples/sec accuracy=77.465278 loss=0.851276 lr=0.005376 Epoch[047] Batch [2299]/[3760] Speed: 120.287913 samples/sec accuracy=77.453804 loss=0.851526 lr=0.005374 Epoch[047] Batch [2349]/[3760] Speed: 129.216242 samples/sec accuracy=77.450133 loss=0.851761 lr=0.005371 Epoch[047] Batch [2399]/[3760] Speed: 119.802215 samples/sec accuracy=77.447917 loss=0.852701 lr=0.005369 Epoch[047] Batch [2449]/[3760] Speed: 133.821753 samples/sec accuracy=77.459821 loss=0.852725 lr=0.005367 Epoch[047] Batch [2499]/[3760] Speed: 117.869031 samples/sec accuracy=77.463750 loss=0.852430 lr=0.005365 Epoch[047] Batch [2549]/[3760] Speed: 131.576674 samples/sec accuracy=77.446078 loss=0.852859 lr=0.005363 Epoch[047] Batch [2599]/[3760] Speed: 126.147836 samples/sec accuracy=77.436298 loss=0.853518 lr=0.005361 Epoch[047] Batch [2649]/[3760] Speed: 123.855398 samples/sec accuracy=77.426887 loss=0.854225 lr=0.005359 Epoch[047] Batch [2699]/[3760] Speed: 126.499208 samples/sec accuracy=77.420139 loss=0.854471 lr=0.005357 Epoch[047] Batch [2749]/[3760] Speed: 126.771398 samples/sec accuracy=77.423295 loss=0.854352 lr=0.005355 Epoch[047] Batch [2799]/[3760] Speed: 124.796201 samples/sec accuracy=77.415737 loss=0.855160 lr=0.005353 Epoch[047] Batch [2849]/[3760] Speed: 124.604444 samples/sec accuracy=77.423246 loss=0.855116 lr=0.005351 Epoch[047] Batch [2899]/[3760] Speed: 123.720377 samples/sec accuracy=77.403556 loss=0.855827 lr=0.005348 Epoch[047] Batch [2949]/[3760] Speed: 129.448827 samples/sec accuracy=77.373411 loss=0.856249 lr=0.005346 Epoch[047] Batch [2999]/[3760] Speed: 126.649629 samples/sec accuracy=77.372396 loss=0.856264 lr=0.005344 Epoch[047] Batch [3049]/[3760] Speed: 118.542787 samples/sec accuracy=77.357582 loss=0.856964 lr=0.005342 Epoch[047] Batch [3099]/[3760] Speed: 129.794151 samples/sec accuracy=77.326109 loss=0.857902 lr=0.005340 Epoch[047] Batch [3149]/[3760] Speed: 121.300314 samples/sec accuracy=77.316964 loss=0.858794 lr=0.005338 Epoch[047] Batch [3199]/[3760] Speed: 130.871622 samples/sec accuracy=77.293945 loss=0.859500 lr=0.005336 Epoch[047] Batch [3249]/[3760] Speed: 122.368723 samples/sec accuracy=77.273077 loss=0.859809 lr=0.005334 Epoch[047] Batch [3299]/[3760] Speed: 134.565094 samples/sec accuracy=77.266572 loss=0.860024 lr=0.005332 Epoch[047] Batch [3349]/[3760] Speed: 118.980440 samples/sec accuracy=77.244869 loss=0.860604 lr=0.005330 Epoch[047] Batch [3399]/[3760] Speed: 132.387978 samples/sec accuracy=77.238971 loss=0.861027 lr=0.005328 Epoch[047] Batch [3449]/[3760] Speed: 121.235726 samples/sec accuracy=77.234601 loss=0.861367 lr=0.005326 Epoch[047] Batch [3499]/[3760] Speed: 129.524547 samples/sec accuracy=77.240625 loss=0.861165 lr=0.005323 Epoch[047] Batch [3549]/[3760] Speed: 125.781026 samples/sec accuracy=77.215229 loss=0.862263 lr=0.005321 Epoch[047] Batch [3599]/[3760] Speed: 125.731323 samples/sec accuracy=77.189236 loss=0.862965 lr=0.005319 Epoch[047] Batch [3649]/[3760] Speed: 127.857867 samples/sec accuracy=77.177654 loss=0.863301 lr=0.005317 Epoch[047] Batch [3699]/[3760] Speed: 119.543910 samples/sec accuracy=77.175676 loss=0.863553 lr=0.005315 Epoch[047] Batch [3749]/[3760] Speed: 147.300408 samples/sec accuracy=77.182917 loss=0.863530 lr=0.005313 Batch [0049]/[0303]: acc-top1=63.625000 acc-top5=85.906250 Batch [0099]/[0303]: acc-top1=63.250000 acc-top5=85.390625 Batch [0149]/[0303]: acc-top1=63.322917 acc-top5=85.156250 Batch [0199]/[0303]: acc-top1=63.140625 acc-top5=84.882812 Batch [0249]/[0303]: acc-top1=63.287500 acc-top5=84.668750 Batch [0299]/[0303]: acc-top1=63.130208 acc-top5=84.578125 [Epoch 047] training: accuracy=77.186669 loss=0.863384 [Epoch 047] speed: 125 samples/sec time cost: 2110.952437 [Epoch 047] validation: acc-top1=63.123969 acc-top5=84.550330 loss=2.187180 Epoch[048] Batch [0049]/[3760] Speed: 88.605699 samples/sec accuracy=77.875000 loss=0.795393 lr=0.005311 Epoch[048] Batch [0099]/[3760] Speed: 132.141130 samples/sec accuracy=78.078125 loss=0.795300 lr=0.005308 Epoch[048] Batch [0149]/[3760] Speed: 117.070862 samples/sec accuracy=78.197917 loss=0.806705 lr=0.005306 Epoch[048] Batch [0199]/[3760] Speed: 132.655762 samples/sec accuracy=78.304688 loss=0.802503 lr=0.005304 Epoch[048] Batch [0249]/[3760] Speed: 127.816838 samples/sec accuracy=78.250000 loss=0.801341 lr=0.005302 Epoch[048] Batch [0299]/[3760] Speed: 121.230801 samples/sec accuracy=78.156250 loss=0.806725 lr=0.005300 Epoch[048] Batch [0349]/[3760] Speed: 126.787826 samples/sec accuracy=78.183036 loss=0.806597 lr=0.005298 Epoch[048] Batch [0399]/[3760] Speed: 127.814697 samples/sec accuracy=78.265625 loss=0.805149 lr=0.005296 Epoch[048] Batch [0449]/[3760] Speed: 125.200902 samples/sec accuracy=78.333333 loss=0.803640 lr=0.005294 Epoch[048] Batch [0499]/[3760] Speed: 128.132105 samples/sec accuracy=78.318750 loss=0.804291 lr=0.005292 Epoch[048] Batch [0549]/[3760] Speed: 119.395683 samples/sec accuracy=78.309659 loss=0.806575 lr=0.005290 Epoch[048] Batch [0599]/[3760] Speed: 131.393628 samples/sec accuracy=78.354167 loss=0.806539 lr=0.005288 Epoch[048] Batch [0649]/[3760] Speed: 122.966578 samples/sec accuracy=78.326923 loss=0.806395 lr=0.005286 Epoch[048] Batch [0699]/[3760] Speed: 121.853307 samples/sec accuracy=78.339286 loss=0.807890 lr=0.005283 Epoch[048] Batch [0749]/[3760] Speed: 127.772205 samples/sec accuracy=78.268750 loss=0.811711 lr=0.005281 Epoch[048] Batch [0799]/[3760] Speed: 122.205567 samples/sec accuracy=78.179688 loss=0.814942 lr=0.005279 Epoch[048] Batch [0849]/[3760] Speed: 129.105010 samples/sec accuracy=78.159926 loss=0.815723 lr=0.005277 Epoch[048] Batch [0899]/[3760] Speed: 126.700277 samples/sec accuracy=78.164931 loss=0.816216 lr=0.005275 Epoch[048] Batch [0949]/[3760] Speed: 119.561142 samples/sec accuracy=78.220395 loss=0.815070 lr=0.005273 Epoch[048] Batch [0999]/[3760] Speed: 133.311070 samples/sec accuracy=78.253125 loss=0.813987 lr=0.005271 Epoch[048] Batch [1049]/[3760] Speed: 117.369437 samples/sec accuracy=78.188988 loss=0.815928 lr=0.005269 Epoch[048] Batch [1099]/[3760] Speed: 132.880617 samples/sec accuracy=78.200284 loss=0.816273 lr=0.005267 Epoch[048] Batch [1149]/[3760] Speed: 121.350367 samples/sec accuracy=78.202446 loss=0.816171 lr=0.005265 Epoch[048] Batch [1199]/[3760] Speed: 125.060068 samples/sec accuracy=78.183594 loss=0.815854 lr=0.005263 Epoch[048] Batch [1249]/[3760] Speed: 126.656185 samples/sec accuracy=78.183750 loss=0.816440 lr=0.005260 Epoch[048] Batch [1299]/[3760] Speed: 126.712981 samples/sec accuracy=78.132212 loss=0.818732 lr=0.005258 Epoch[048] Batch [1349]/[3760] Speed: 123.215074 samples/sec accuracy=78.140046 loss=0.819746 lr=0.005256 Epoch[048] Batch [1399]/[3760] Speed: 124.232765 samples/sec accuracy=78.152902 loss=0.819907 lr=0.005254 Epoch[048] Batch [1449]/[3760] Speed: 129.479963 samples/sec accuracy=78.137931 loss=0.820296 lr=0.005252 Epoch[048] Batch [1499]/[3760] Speed: 120.447744 samples/sec accuracy=78.122917 loss=0.822025 lr=0.005250 Epoch[048] Batch [1549]/[3760] Speed: 132.119227 samples/sec accuracy=78.103831 loss=0.823084 lr=0.005248 Epoch[048] Batch [1599]/[3760] Speed: 119.710131 samples/sec accuracy=78.106445 loss=0.822950 lr=0.005246 Epoch[048] Batch [1649]/[3760] Speed: 126.693062 samples/sec accuracy=78.075758 loss=0.824224 lr=0.005244 Epoch[048] Batch [1699]/[3760] Speed: 123.921283 samples/sec accuracy=78.032169 loss=0.826105 lr=0.005242 Epoch[048] Batch [1749]/[3760] Speed: 123.227973 samples/sec accuracy=78.022321 loss=0.826491 lr=0.005240 Epoch[048] Batch [1799]/[3760] Speed: 135.796517 samples/sec accuracy=77.983507 loss=0.828093 lr=0.005238 Epoch[048] Batch [1849]/[3760] Speed: 120.063858 samples/sec accuracy=77.974662 loss=0.828882 lr=0.005235 Epoch[048] Batch [1899]/[3760] Speed: 128.079407 samples/sec accuracy=77.934211 loss=0.830202 lr=0.005233 Epoch[048] Batch [1949]/[3760] Speed: 121.165909 samples/sec accuracy=77.888622 loss=0.831491 lr=0.005231 Epoch[048] Batch [1999]/[3760] Speed: 124.111035 samples/sec accuracy=77.875781 loss=0.832249 lr=0.005229 Epoch[048] Batch [2049]/[3760] Speed: 128.446642 samples/sec accuracy=77.892530 loss=0.832392 lr=0.005227 Epoch[048] Batch [2099]/[3760] Speed: 129.886455 samples/sec accuracy=77.887649 loss=0.832165 lr=0.005225 Epoch[048] Batch [2149]/[3760] Speed: 117.613903 samples/sec accuracy=77.890988 loss=0.832451 lr=0.005223 Epoch[048] Batch [2199]/[3760] Speed: 133.610482 samples/sec accuracy=77.868608 loss=0.833636 lr=0.005221 Epoch[048] Batch [2249]/[3760] Speed: 116.322351 samples/sec accuracy=77.859722 loss=0.833676 lr=0.005219 Epoch[048] Batch [2299]/[3760] Speed: 129.683040 samples/sec accuracy=77.841712 loss=0.834240 lr=0.005217 Epoch[048] Batch [2349]/[3760] Speed: 124.566488 samples/sec accuracy=77.823803 loss=0.834863 lr=0.005215 Epoch[048] Batch [2399]/[3760] Speed: 125.409039 samples/sec accuracy=77.838542 loss=0.834877 lr=0.005212 Epoch[048] Batch [2449]/[3760] Speed: 128.942028 samples/sec accuracy=77.820791 loss=0.835498 lr=0.005210 Epoch[048] Batch [2499]/[3760] Speed: 127.794380 samples/sec accuracy=77.807500 loss=0.835992 lr=0.005208 Epoch[048] Batch [2549]/[3760] Speed: 119.008492 samples/sec accuracy=77.803922 loss=0.835969 lr=0.005206 Epoch[048] Batch [2599]/[3760] Speed: 131.451718 samples/sec accuracy=77.786058 loss=0.836867 lr=0.005204 Epoch[048] Batch [2649]/[3760] Speed: 123.907227 samples/sec accuracy=77.776533 loss=0.837564 lr=0.005202 Epoch[048] Batch [2699]/[3760] Speed: 120.874034 samples/sec accuracy=77.751157 loss=0.838300 lr=0.005200 Epoch[048] Batch [2749]/[3760] Speed: 132.433430 samples/sec accuracy=77.735795 loss=0.838830 lr=0.005198 Epoch[048] Batch [2799]/[3760] Speed: 114.802264 samples/sec accuracy=77.715402 loss=0.839435 lr=0.005196 Epoch[048] Batch [2849]/[3760] Speed: 135.417387 samples/sec accuracy=77.705044 loss=0.840341 lr=0.005194 Epoch[048] Batch [2899]/[3760] Speed: 130.200937 samples/sec accuracy=77.668642 loss=0.841397 lr=0.005192 Epoch[048] Batch [2949]/[3760] Speed: 120.009604 samples/sec accuracy=77.664725 loss=0.841864 lr=0.005190 Epoch[048] Batch [2999]/[3760] Speed: 130.388534 samples/sec accuracy=77.660938 loss=0.842035 lr=0.005187 Epoch[048] Batch [3049]/[3760] Speed: 123.295382 samples/sec accuracy=77.665984 loss=0.841883 lr=0.005185 Epoch[048] Batch [3099]/[3760] Speed: 124.920425 samples/sec accuracy=77.644153 loss=0.842723 lr=0.005183 Epoch[048] Batch [3149]/[3760] Speed: 131.993408 samples/sec accuracy=77.647817 loss=0.842514 lr=0.005181 Epoch[048] Batch [3199]/[3760] Speed: 113.915115 samples/sec accuracy=77.631348 loss=0.843156 lr=0.005179 Epoch[048] Batch [3249]/[3760] Speed: 137.891432 samples/sec accuracy=77.587019 loss=0.844477 lr=0.005177 Epoch[048] Batch [3299]/[3760] Speed: 122.461514 samples/sec accuracy=77.574337 loss=0.845018 lr=0.005175 Epoch[048] Batch [3349]/[3760] Speed: 125.247199 samples/sec accuracy=77.577425 loss=0.845327 lr=0.005173 Epoch[048] Batch [3399]/[3760] Speed: 129.217125 samples/sec accuracy=77.567096 loss=0.846109 lr=0.005171 Epoch[048] Batch [3449]/[3760] Speed: 122.197392 samples/sec accuracy=77.549819 loss=0.847042 lr=0.005169 Epoch[048] Batch [3499]/[3760] Speed: 126.098742 samples/sec accuracy=77.543304 loss=0.847479 lr=0.005167 Epoch[048] Batch [3549]/[3760] Speed: 129.043060 samples/sec accuracy=77.536532 loss=0.847814 lr=0.005164 Epoch[048] Batch [3599]/[3760] Speed: 123.492651 samples/sec accuracy=77.505642 loss=0.848850 lr=0.005162 Epoch[048] Batch [3649]/[3760] Speed: 123.961780 samples/sec accuracy=77.485445 loss=0.849999 lr=0.005160 Epoch[048] Batch [3699]/[3760] Speed: 126.625155 samples/sec accuracy=77.469172 loss=0.850506 lr=0.005158 Epoch[048] Batch [3749]/[3760] Speed: 141.008460 samples/sec accuracy=77.457917 loss=0.851085 lr=0.005156 Batch [0049]/[0303]: acc-top1=63.562500 acc-top5=85.750000 Batch [0099]/[0303]: acc-top1=63.734375 acc-top5=85.312500 Batch [0149]/[0303]: acc-top1=63.822917 acc-top5=84.843750 Batch [0199]/[0303]: acc-top1=63.671875 acc-top5=84.726562 Batch [0249]/[0303]: acc-top1=63.718750 acc-top5=84.693750 Batch [0299]/[0303]: acc-top1=63.640625 acc-top5=84.729167 [Epoch 048] training: accuracy=77.455535 loss=0.851130 [Epoch 048] speed: 125 samples/sec time cost: 2110.746908 [Epoch 048] validation: acc-top1=63.572607 acc-top5=84.684406 loss=2.115327 Epoch[049] Batch [0049]/[3759] Speed: 88.536508 samples/sec accuracy=78.281250 loss=0.809262 lr=0.005154 Epoch[049] Batch [0099]/[3759] Speed: 132.040971 samples/sec accuracy=78.765625 loss=0.797816 lr=0.005152 Epoch[049] Batch [0149]/[3759] Speed: 120.405021 samples/sec accuracy=78.937500 loss=0.798568 lr=0.005149 Epoch[049] Batch [0199]/[3759] Speed: 123.288585 samples/sec accuracy=78.742188 loss=0.791425 lr=0.005147 Epoch[049] Batch [0249]/[3759] Speed: 132.147613 samples/sec accuracy=78.768750 loss=0.792167 lr=0.005145 Epoch[049] Batch [0299]/[3759] Speed: 122.036603 samples/sec accuracy=78.901042 loss=0.788304 lr=0.005143 Epoch[049] Batch [0349]/[3759] Speed: 129.855043 samples/sec accuracy=78.794643 loss=0.790320 lr=0.005141 Epoch[049] Batch [0399]/[3759] Speed: 128.323056 samples/sec accuracy=78.777344 loss=0.791094 lr=0.005139 Epoch[049] Batch [0449]/[3759] Speed: 119.750473 samples/sec accuracy=78.736111 loss=0.792113 lr=0.005137 Epoch[049] Batch [0499]/[3759] Speed: 129.534279 samples/sec accuracy=78.728125 loss=0.794045 lr=0.005135 Epoch[049] Batch [0549]/[3759] Speed: 118.913232 samples/sec accuracy=78.724432 loss=0.793583 lr=0.005133 Epoch[049] Batch [0599]/[3759] Speed: 130.177375 samples/sec accuracy=78.679688 loss=0.796340 lr=0.005131 Epoch[049] Batch [0649]/[3759] Speed: 124.328647 samples/sec accuracy=78.572115 loss=0.799542 lr=0.005129 Epoch[049] Batch [0699]/[3759] Speed: 122.290940 samples/sec accuracy=78.421875 loss=0.802862 lr=0.005126 Epoch[049] Batch [0749]/[3759] Speed: 125.239981 samples/sec accuracy=78.475000 loss=0.802159 lr=0.005124 Epoch[049] Batch [0799]/[3759] Speed: 124.772232 samples/sec accuracy=78.429688 loss=0.803798 lr=0.005122 Epoch[049] Batch [0849]/[3759] Speed: 131.134946 samples/sec accuracy=78.365809 loss=0.805833 lr=0.005120 Epoch[049] Batch [0899]/[3759] Speed: 124.537267 samples/sec accuracy=78.336806 loss=0.807478 lr=0.005118 Epoch[049] Batch [0949]/[3759] Speed: 125.088631 samples/sec accuracy=78.297697 loss=0.808940 lr=0.005116 Epoch[049] Batch [0999]/[3759] Speed: 128.467839 samples/sec accuracy=78.271875 loss=0.809401 lr=0.005114 Epoch[049] Batch [1049]/[3759] Speed: 123.288459 samples/sec accuracy=78.236607 loss=0.810650 lr=0.005112 Epoch[049] Batch [1099]/[3759] Speed: 127.151745 samples/sec accuracy=78.205966 loss=0.811871 lr=0.005110 Epoch[049] Batch [1149]/[3759] Speed: 119.491452 samples/sec accuracy=78.192935 loss=0.812518 lr=0.005108 Epoch[049] Batch [1199]/[3759] Speed: 133.876090 samples/sec accuracy=78.186198 loss=0.813001 lr=0.005106 Epoch[049] Batch [1249]/[3759] Speed: 122.249227 samples/sec accuracy=78.198750 loss=0.812503 lr=0.005103 Epoch[049] Batch [1299]/[3759] Speed: 126.821513 samples/sec accuracy=78.189904 loss=0.813543 lr=0.005101 Epoch[049] Batch [1349]/[3759] Speed: 124.908986 samples/sec accuracy=78.151620 loss=0.815097 lr=0.005099 Epoch[049] Batch [1399]/[3759] Speed: 123.815907 samples/sec accuracy=78.131696 loss=0.815907 lr=0.005097 Epoch[049] Batch [1449]/[3759] Speed: 130.519991 samples/sec accuracy=78.116379 loss=0.815979 lr=0.005095 Epoch[049] Batch [1499]/[3759] Speed: 124.859743 samples/sec accuracy=78.093750 loss=0.817613 lr=0.005093 Epoch[049] Batch [1549]/[3759] Speed: 123.554316 samples/sec accuracy=78.069556 loss=0.818747 lr=0.005091 Epoch[049] Batch [1599]/[3759] Speed: 125.546725 samples/sec accuracy=78.042969 loss=0.819673 lr=0.005089 Epoch[049] Batch [1649]/[3759] Speed: 128.994538 samples/sec accuracy=78.076705 loss=0.819290 lr=0.005087 Epoch[049] Batch [1699]/[3759] Speed: 123.508760 samples/sec accuracy=78.075368 loss=0.819007 lr=0.005085 Epoch[049] Batch [1749]/[3759] Speed: 127.519333 samples/sec accuracy=78.041964 loss=0.818915 lr=0.005083 Epoch[049] Batch [1799]/[3759] Speed: 120.852389 samples/sec accuracy=78.052951 loss=0.819045 lr=0.005081 Epoch[049] Batch [1849]/[3759] Speed: 124.405367 samples/sec accuracy=78.067568 loss=0.818631 lr=0.005078 Epoch[049] Batch [1899]/[3759] Speed: 131.879937 samples/sec accuracy=78.042763 loss=0.819875 lr=0.005076 Epoch[049] Batch [1949]/[3759] Speed: 122.538238 samples/sec accuracy=78.037660 loss=0.819966 lr=0.005074 Epoch[049] Batch [1999]/[3759] Speed: 123.931134 samples/sec accuracy=78.026562 loss=0.821344 lr=0.005072 Epoch[049] Batch [2049]/[3759] Speed: 130.896015 samples/sec accuracy=78.044970 loss=0.821398 lr=0.005070 Epoch[049] Batch [2099]/[3759] Speed: 124.411767 samples/sec accuracy=78.024554 loss=0.821896 lr=0.005068 Epoch[049] Batch [2149]/[3759] Speed: 127.221125 samples/sec accuracy=78.002180 loss=0.823213 lr=0.005066 Epoch[049] Batch [2199]/[3759] Speed: 120.466090 samples/sec accuracy=77.992898 loss=0.824069 lr=0.005064 Epoch[049] Batch [2249]/[3759] Speed: 129.321100 samples/sec accuracy=77.975000 loss=0.824141 lr=0.005062 Epoch[049] Batch [2299]/[3759] Speed: 122.640829 samples/sec accuracy=77.957880 loss=0.824998 lr=0.005060 Epoch[049] Batch [2349]/[3759] Speed: 128.454577 samples/sec accuracy=77.951463 loss=0.825711 lr=0.005058 Epoch[049] Batch [2399]/[3759] Speed: 125.959691 samples/sec accuracy=77.961589 loss=0.825379 lr=0.005055 Epoch[049] Batch [2449]/[3759] Speed: 125.019176 samples/sec accuracy=77.944515 loss=0.826135 lr=0.005053 Epoch[049] Batch [2499]/[3759] Speed: 118.155511 samples/sec accuracy=77.927500 loss=0.827072 lr=0.005051 Epoch[049] Batch [2549]/[3759] Speed: 133.811482 samples/sec accuracy=77.900735 loss=0.827754 lr=0.005049 Epoch[049] Batch [2599]/[3759] Speed: 126.030392 samples/sec accuracy=77.878005 loss=0.828810 lr=0.005047 Epoch[049] Batch [2649]/[3759] Speed: 123.511465 samples/sec accuracy=77.879717 loss=0.828407 lr=0.005045 Epoch[049] Batch [2699]/[3759] Speed: 127.835869 samples/sec accuracy=77.872106 loss=0.828835 lr=0.005043 Epoch[049] Batch [2749]/[3759] Speed: 123.893664 samples/sec accuracy=77.872159 loss=0.828819 lr=0.005041 Epoch[049] Batch [2799]/[3759] Speed: 125.516116 samples/sec accuracy=77.858817 loss=0.829207 lr=0.005039 Epoch[049] Batch [2849]/[3759] Speed: 125.710356 samples/sec accuracy=77.849781 loss=0.829844 lr=0.005037 Epoch[049] Batch [2899]/[3759] Speed: 127.307206 samples/sec accuracy=77.827047 loss=0.830497 lr=0.005035 Epoch[049] Batch [2949]/[3759] Speed: 120.410350 samples/sec accuracy=77.813030 loss=0.831304 lr=0.005032 Epoch[049] Batch [2999]/[3759] Speed: 129.265501 samples/sec accuracy=77.805208 loss=0.831647 lr=0.005030 Epoch[049] Batch [3049]/[3759] Speed: 122.562259 samples/sec accuracy=77.805840 loss=0.831514 lr=0.005028 Epoch[049] Batch [3099]/[3759] Speed: 128.602281 samples/sec accuracy=77.801915 loss=0.831765 lr=0.005026 Epoch[049] Batch [3149]/[3759] Speed: 128.597737 samples/sec accuracy=77.784722 loss=0.832419 lr=0.005024 Epoch[049] Batch [3199]/[3759] Speed: 119.229829 samples/sec accuracy=77.770996 loss=0.832904 lr=0.005022 Epoch[049] Batch [3249]/[3759] Speed: 128.852794 samples/sec accuracy=77.775481 loss=0.833342 lr=0.005020 Epoch[049] Batch [3299]/[3759] Speed: 122.303873 samples/sec accuracy=77.766098 loss=0.834094 lr=0.005018 Epoch[049] Batch [3349]/[3759] Speed: 127.432607 samples/sec accuracy=77.758396 loss=0.834566 lr=0.005016 Epoch[049] Batch [3399]/[3759] Speed: 130.704326 samples/sec accuracy=77.751379 loss=0.834894 lr=0.005014 Epoch[049] Batch [3449]/[3759] Speed: 123.165363 samples/sec accuracy=77.736413 loss=0.835328 lr=0.005012 Epoch[049] Batch [3499]/[3759] Speed: 125.245171 samples/sec accuracy=77.713839 loss=0.836135 lr=0.005009 Epoch[049] Batch [3549]/[3759] Speed: 123.578408 samples/sec accuracy=77.705106 loss=0.836519 lr=0.005007 Epoch[049] Batch [3599]/[3759] Speed: 125.426683 samples/sec accuracy=77.702257 loss=0.836436 lr=0.005005 Epoch[049] Batch [3649]/[3759] Speed: 128.761552 samples/sec accuracy=77.684075 loss=0.836787 lr=0.005003 Epoch[049] Batch [3699]/[3759] Speed: 117.928674 samples/sec accuracy=77.661318 loss=0.837794 lr=0.005001 Epoch[049] Batch [3749]/[3759] Speed: 152.510600 samples/sec accuracy=77.665417 loss=0.837672 lr=0.004999 Batch [0049]/[0303]: acc-top1=64.093750 acc-top5=86.062500 Batch [0099]/[0303]: acc-top1=64.562500 acc-top5=85.234375 Batch [0149]/[0303]: acc-top1=64.083333 acc-top5=85.104167 Batch [0199]/[0303]: acc-top1=63.648438 acc-top5=85.000000 Batch [0249]/[0303]: acc-top1=63.743750 acc-top5=85.012500 Batch [0299]/[0303]: acc-top1=63.677083 acc-top5=84.942708 [Epoch 049] training: accuracy=77.654047 loss=0.838039 [Epoch 049] speed: 125 samples/sec time cost: 2108.257497 [Epoch 049] validation: acc-top1=63.624175 acc-top5=84.900990 loss=2.155406 Epoch[050] Batch [0049]/[3760] Speed: 88.902463 samples/sec accuracy=77.968750 loss=0.799327 lr=0.004997 Epoch[050] Batch [0099]/[3760] Speed: 131.146327 samples/sec accuracy=78.187500 loss=0.812851 lr=0.004994 Epoch[050] Batch [0149]/[3760] Speed: 127.198283 samples/sec accuracy=78.281250 loss=0.805642 lr=0.004992 Epoch[050] Batch [0199]/[3760] Speed: 121.114731 samples/sec accuracy=78.617188 loss=0.799146 lr=0.004990 Epoch[050] Batch [0249]/[3760] Speed: 122.120068 samples/sec accuracy=78.600000 loss=0.797278 lr=0.004988 Epoch[050] Batch [0299]/[3760] Speed: 135.443418 samples/sec accuracy=78.541667 loss=0.798234 lr=0.004986 Epoch[050] Batch [0349]/[3760] Speed: 119.399422 samples/sec accuracy=78.562500 loss=0.796441 lr=0.004984 Epoch[050] Batch [0399]/[3760] Speed: 131.711842 samples/sec accuracy=78.644531 loss=0.794305 lr=0.004982 Epoch[050] Batch [0449]/[3760] Speed: 121.302694 samples/sec accuracy=78.611111 loss=0.798492 lr=0.004980 Epoch[050] Batch [0499]/[3760] Speed: 127.874023 samples/sec accuracy=78.640625 loss=0.796132 lr=0.004978 Epoch[050] Batch [0549]/[3760] Speed: 124.882657 samples/sec accuracy=78.769886 loss=0.794066 lr=0.004976 Epoch[050] Batch [0599]/[3760] Speed: 123.810933 samples/sec accuracy=78.848958 loss=0.793922 lr=0.004974 Epoch[050] Batch [0649]/[3760] Speed: 128.574338 samples/sec accuracy=78.812500 loss=0.795385 lr=0.004971 Epoch[050] Batch [0699]/[3760] Speed: 124.569794 samples/sec accuracy=78.845982 loss=0.794335 lr=0.004969 Epoch[050] Batch [0749]/[3760] Speed: 124.127035 samples/sec accuracy=78.727083 loss=0.797076 lr=0.004967 Epoch[050] Batch [0799]/[3760] Speed: 124.410879 samples/sec accuracy=78.691406 loss=0.797620 lr=0.004965 Epoch[050] Batch [0849]/[3760] Speed: 127.003892 samples/sec accuracy=78.707721 loss=0.797686 lr=0.004963 Epoch[050] Batch [0899]/[3760] Speed: 131.746476 samples/sec accuracy=78.753472 loss=0.796136 lr=0.004961 Epoch[050] Batch [0949]/[3760] Speed: 118.339899 samples/sec accuracy=78.713816 loss=0.796990 lr=0.004959 Epoch[050] Batch [0999]/[3760] Speed: 128.311047 samples/sec accuracy=78.706250 loss=0.797737 lr=0.004957 Epoch[050] Batch [1049]/[3760] Speed: 123.792316 samples/sec accuracy=78.659226 loss=0.800615 lr=0.004955 Epoch[050] Batch [1099]/[3760] Speed: 126.885376 samples/sec accuracy=78.693182 loss=0.800007 lr=0.004953 Epoch[050] Batch [1149]/[3760] Speed: 123.364893 samples/sec accuracy=78.661685 loss=0.801325 lr=0.004951 Epoch[050] Batch [1199]/[3760] Speed: 131.318723 samples/sec accuracy=78.638021 loss=0.802546 lr=0.004948 Epoch[050] Batch [1249]/[3760] Speed: 125.968769 samples/sec accuracy=78.641250 loss=0.802161 lr=0.004946 Epoch[050] Batch [1299]/[3760] Speed: 125.250500 samples/sec accuracy=78.634615 loss=0.802522 lr=0.004944 Epoch[050] Batch [1349]/[3760] Speed: 122.260828 samples/sec accuracy=78.667824 loss=0.801337 lr=0.004942 Epoch[050] Batch [1399]/[3760] Speed: 124.010883 samples/sec accuracy=78.625000 loss=0.803233 lr=0.004940 Epoch[050] Batch [1449]/[3760] Speed: 130.436575 samples/sec accuracy=78.564655 loss=0.804969 lr=0.004938 Epoch[050] Batch [1499]/[3760] Speed: 118.228174 samples/sec accuracy=78.544792 loss=0.805618 lr=0.004936 Epoch[050] Batch [1549]/[3760] Speed: 128.829502 samples/sec accuracy=78.541331 loss=0.806310 lr=0.004934 Epoch[050] Batch [1599]/[3760] Speed: 129.582686 samples/sec accuracy=78.549805 loss=0.806252 lr=0.004932 Epoch[050] Batch [1649]/[3760] Speed: 122.121141 samples/sec accuracy=78.553030 loss=0.806078 lr=0.004930 Epoch[050] Batch [1699]/[3760] Speed: 125.903726 samples/sec accuracy=78.542279 loss=0.806326 lr=0.004928 Epoch[050] Batch [1749]/[3760] Speed: 130.606236 samples/sec accuracy=78.512500 loss=0.806938 lr=0.004926 Epoch[050] Batch [1799]/[3760] Speed: 124.823621 samples/sec accuracy=78.496528 loss=0.807073 lr=0.004923 Epoch[050] Batch [1849]/[3760] Speed: 130.153191 samples/sec accuracy=78.496622 loss=0.807451 lr=0.004921 Epoch[050] Batch [1899]/[3760] Speed: 122.151426 samples/sec accuracy=78.477796 loss=0.808567 lr=0.004919 Epoch[050] Batch [1949]/[3760] Speed: 124.708666 samples/sec accuracy=78.470353 loss=0.809078 lr=0.004917 Epoch[050] Batch [1999]/[3760] Speed: 128.117179 samples/sec accuracy=78.481250 loss=0.808972 lr=0.004915 Epoch[050] Batch [2049]/[3760] Speed: 122.535747 samples/sec accuracy=78.458079 loss=0.809785 lr=0.004913 Epoch[050] Batch [2099]/[3760] Speed: 123.896312 samples/sec accuracy=78.421131 loss=0.811214 lr=0.004911 Epoch[050] Batch [2149]/[3760] Speed: 132.153783 samples/sec accuracy=78.402616 loss=0.811228 lr=0.004909 Epoch[050] Batch [2199]/[3760] Speed: 122.466262 samples/sec accuracy=78.394176 loss=0.811503 lr=0.004907 Epoch[050] Batch [2249]/[3760] Speed: 129.380694 samples/sec accuracy=78.358333 loss=0.812529 lr=0.004905 Epoch[050] Batch [2299]/[3760] Speed: 120.185699 samples/sec accuracy=78.334918 loss=0.813112 lr=0.004903 Epoch[050] Batch [2349]/[3760] Speed: 128.906773 samples/sec accuracy=78.311835 loss=0.814663 lr=0.004900 Epoch[050] Batch [2399]/[3760] Speed: 122.242593 samples/sec accuracy=78.305339 loss=0.814823 lr=0.004898 Epoch[050] Batch [2449]/[3760] Speed: 128.358075 samples/sec accuracy=78.295918 loss=0.815728 lr=0.004896 Epoch[050] Batch [2499]/[3760] Speed: 124.315716 samples/sec accuracy=78.276875 loss=0.816039 lr=0.004894 Epoch[050] Batch [2549]/[3760] Speed: 121.193801 samples/sec accuracy=78.233456 loss=0.818035 lr=0.004892 Epoch[050] Batch [2599]/[3760] Speed: 131.602084 samples/sec accuracy=78.222356 loss=0.817837 lr=0.004890 Epoch[050] Batch [2649]/[3760] Speed: 123.528711 samples/sec accuracy=78.221698 loss=0.817877 lr=0.004888 Epoch[050] Batch [2699]/[3760] Speed: 122.434173 samples/sec accuracy=78.201968 loss=0.818358 lr=0.004886 Epoch[050] Batch [2749]/[3760] Speed: 134.559140 samples/sec accuracy=78.215341 loss=0.818300 lr=0.004884 Epoch[050] Batch [2799]/[3760] Speed: 117.218412 samples/sec accuracy=78.226004 loss=0.818625 lr=0.004882 Epoch[050] Batch [2849]/[3760] Speed: 130.842309 samples/sec accuracy=78.211623 loss=0.819155 lr=0.004880 Epoch[050] Batch [2899]/[3760] Speed: 117.493755 samples/sec accuracy=78.192349 loss=0.820037 lr=0.004877 Epoch[050] Batch [2949]/[3760] Speed: 128.928558 samples/sec accuracy=78.197034 loss=0.820362 lr=0.004875 Epoch[050] Batch [2999]/[3760] Speed: 127.669607 samples/sec accuracy=78.201042 loss=0.820370 lr=0.004873 Epoch[050] Batch [3049]/[3760] Speed: 124.038656 samples/sec accuracy=78.183402 loss=0.820893 lr=0.004871 Epoch[050] Batch [3099]/[3760] Speed: 126.169651 samples/sec accuracy=78.183468 loss=0.821642 lr=0.004869 Epoch[050] Batch [3149]/[3760] Speed: 118.980414 samples/sec accuracy=78.175099 loss=0.821460 lr=0.004867 Epoch[050] Batch [3199]/[3760] Speed: 132.281350 samples/sec accuracy=78.157227 loss=0.821943 lr=0.004865 Epoch[050] Batch [3249]/[3760] Speed: 126.158475 samples/sec accuracy=78.160577 loss=0.822414 lr=0.004863 Epoch[050] Batch [3299]/[3760] Speed: 128.304003 samples/sec accuracy=78.157670 loss=0.822855 lr=0.004861 Epoch[050] Batch [3349]/[3760] Speed: 125.216336 samples/sec accuracy=78.144123 loss=0.823622 lr=0.004859 Epoch[050] Batch [3399]/[3760] Speed: 124.819975 samples/sec accuracy=78.133732 loss=0.823751 lr=0.004857 Epoch[050] Batch [3449]/[3760] Speed: 123.664807 samples/sec accuracy=78.136322 loss=0.823646 lr=0.004854 Epoch[050] Batch [3499]/[3760] Speed: 127.821900 samples/sec accuracy=78.112500 loss=0.824137 lr=0.004852 Epoch[050] Batch [3549]/[3760] Speed: 120.002416 samples/sec accuracy=78.087588 loss=0.824879 lr=0.004850 Epoch[050] Batch [3599]/[3760] Speed: 128.541083 samples/sec accuracy=78.067708 loss=0.825372 lr=0.004848 Epoch[050] Batch [3649]/[3760] Speed: 126.275055 samples/sec accuracy=78.044092 loss=0.825803 lr=0.004846 Epoch[050] Batch [3699]/[3760] Speed: 127.020364 samples/sec accuracy=78.045608 loss=0.825938 lr=0.004844 Epoch[050] Batch [3749]/[3760] Speed: 143.487705 samples/sec accuracy=78.038750 loss=0.826138 lr=0.004842 Batch [0049]/[0303]: acc-top1=63.906250 acc-top5=85.625000 Batch [0099]/[0303]: acc-top1=64.031250 acc-top5=85.421875 Batch [0149]/[0303]: acc-top1=63.875000 acc-top5=85.114583 Batch [0199]/[0303]: acc-top1=63.453125 acc-top5=84.898438 Batch [0249]/[0303]: acc-top1=63.281250 acc-top5=84.825000 Batch [0299]/[0303]: acc-top1=63.348958 acc-top5=84.729167 [Epoch 050] training: accuracy=78.036902 loss=0.826282 [Epoch 050] speed: 125 samples/sec time cost: 2109.631294 [Epoch 050] validation: acc-top1=63.314769 acc-top5=84.710190 loss=2.163851 Epoch[051] Batch [0049]/[3760] Speed: 89.686403 samples/sec accuracy=80.000000 loss=0.759774 lr=0.004839 Epoch[051] Batch [0099]/[3760] Speed: 132.357038 samples/sec accuracy=80.031250 loss=0.753045 lr=0.004837 Epoch[051] Batch [0149]/[3760] Speed: 121.995787 samples/sec accuracy=79.572917 loss=0.770324 lr=0.004835 Epoch[051] Batch [0199]/[3760] Speed: 124.563321 samples/sec accuracy=79.203125 loss=0.785445 lr=0.004833 Epoch[051] Batch [0249]/[3760] Speed: 124.007542 samples/sec accuracy=79.375000 loss=0.780136 lr=0.004831 Epoch[051] Batch [0299]/[3760] Speed: 126.995552 samples/sec accuracy=79.385417 loss=0.784425 lr=0.004829 Epoch[051] Batch [0349]/[3760] Speed: 121.167839 samples/sec accuracy=79.191964 loss=0.789725 lr=0.004827 Epoch[051] Batch [0399]/[3760] Speed: 128.061669 samples/sec accuracy=79.125000 loss=0.793397 lr=0.004825 Epoch[051] Batch [0449]/[3760] Speed: 128.471742 samples/sec accuracy=79.180556 loss=0.791313 lr=0.004823 Epoch[051] Batch [0499]/[3760] Speed: 125.477685 samples/sec accuracy=79.078125 loss=0.794236 lr=0.004821 Epoch[051] Batch [0549]/[3760] Speed: 125.109580 samples/sec accuracy=79.045455 loss=0.793541 lr=0.004819 Epoch[051] Batch [0599]/[3760] Speed: 121.875535 samples/sec accuracy=79.067708 loss=0.791457 lr=0.004816 Epoch[051] Batch [0649]/[3760] Speed: 134.257018 samples/sec accuracy=79.125000 loss=0.787548 lr=0.004814 Epoch[051] Batch [0699]/[3760] Speed: 118.668510 samples/sec accuracy=79.138393 loss=0.787235 lr=0.004812 Epoch[051] Batch [0749]/[3760] Speed: 134.384947 samples/sec accuracy=79.112500 loss=0.786638 lr=0.004810 Epoch[051] Batch [0799]/[3760] Speed: 117.573239 samples/sec accuracy=79.144531 loss=0.785360 lr=0.004808 Epoch[051] Batch [0849]/[3760] Speed: 131.706711 samples/sec accuracy=79.205882 loss=0.783022 lr=0.004806 Epoch[051] Batch [0899]/[3760] Speed: 130.671444 samples/sec accuracy=79.177083 loss=0.783612 lr=0.004804 Epoch[051] Batch [0949]/[3760] Speed: 119.016237 samples/sec accuracy=79.172697 loss=0.784107 lr=0.004802 Epoch[051] Batch [0999]/[3760] Speed: 131.673823 samples/sec accuracy=79.129688 loss=0.784416 lr=0.004800 Epoch[051] Batch [1049]/[3760] Speed: 120.670940 samples/sec accuracy=79.107143 loss=0.785214 lr=0.004798 Epoch[051] Batch [1099]/[3760] Speed: 126.942653 samples/sec accuracy=79.102273 loss=0.785351 lr=0.004796 Epoch[051] Batch [1149]/[3760] Speed: 131.264088 samples/sec accuracy=79.089674 loss=0.784777 lr=0.004794 Epoch[051] Batch [1199]/[3760] Speed: 118.253716 samples/sec accuracy=79.106771 loss=0.784404 lr=0.004791 Epoch[051] Batch [1249]/[3760] Speed: 127.228054 samples/sec accuracy=79.080000 loss=0.785001 lr=0.004789 Epoch[051] Batch [1299]/[3760] Speed: 130.117975 samples/sec accuracy=79.091346 loss=0.785489 lr=0.004787 Epoch[051] Batch [1349]/[3760] Speed: 124.555307 samples/sec accuracy=79.109954 loss=0.785177 lr=0.004785 Epoch[051] Batch [1399]/[3760] Speed: 124.513560 samples/sec accuracy=79.148438 loss=0.783881 lr=0.004783 Epoch[051] Batch [1449]/[3760] Speed: 128.575887 samples/sec accuracy=79.113147 loss=0.785626 lr=0.004781 Epoch[051] Batch [1499]/[3760] Speed: 120.971065 samples/sec accuracy=79.119792 loss=0.785037 lr=0.004779 Epoch[051] Batch [1549]/[3760] Speed: 128.722714 samples/sec accuracy=79.099798 loss=0.786132 lr=0.004777 Epoch[051] Batch [1599]/[3760] Speed: 129.705217 samples/sec accuracy=79.107422 loss=0.786020 lr=0.004775 Epoch[051] Batch [1649]/[3760] Speed: 123.937448 samples/sec accuracy=79.081439 loss=0.786591 lr=0.004773 Epoch[051] Batch [1699]/[3760] Speed: 121.348894 samples/sec accuracy=79.052390 loss=0.788006 lr=0.004771 Epoch[051] Batch [1749]/[3760] Speed: 130.438095 samples/sec accuracy=79.045536 loss=0.788659 lr=0.004768 Epoch[051] Batch [1799]/[3760] Speed: 123.162755 samples/sec accuracy=79.023438 loss=0.789271 lr=0.004766 Epoch[051] Batch [1849]/[3760] Speed: 127.446024 samples/sec accuracy=79.005912 loss=0.790240 lr=0.004764 Epoch[051] Batch [1899]/[3760] Speed: 120.363694 samples/sec accuracy=78.981086 loss=0.791326 lr=0.004762 Epoch[051] Batch [1949]/[3760] Speed: 127.544083 samples/sec accuracy=78.931090 loss=0.793059 lr=0.004760 Epoch[051] Batch [1999]/[3760] Speed: 127.819225 samples/sec accuracy=78.891406 loss=0.794313 lr=0.004758 Epoch[051] Batch [2049]/[3760] Speed: 128.525974 samples/sec accuracy=78.880335 loss=0.793828 lr=0.004756 Epoch[051] Batch [2099]/[3760] Speed: 117.899304 samples/sec accuracy=78.880952 loss=0.793718 lr=0.004754 Epoch[051] Batch [2149]/[3760] Speed: 129.657034 samples/sec accuracy=78.826308 loss=0.795581 lr=0.004752 Epoch[051] Batch [2199]/[3760] Speed: 130.718658 samples/sec accuracy=78.804688 loss=0.796726 lr=0.004750 Epoch[051] Batch [2249]/[3760] Speed: 117.490882 samples/sec accuracy=78.797222 loss=0.796787 lr=0.004748 Epoch[051] Batch [2299]/[3760] Speed: 133.334662 samples/sec accuracy=78.783967 loss=0.796929 lr=0.004746 Epoch[051] Batch [2349]/[3760] Speed: 128.350335 samples/sec accuracy=78.763963 loss=0.797287 lr=0.004743 Epoch[051] Batch [2399]/[3760] Speed: 118.749326 samples/sec accuracy=78.750000 loss=0.797502 lr=0.004741 Epoch[051] Batch [2449]/[3760] Speed: 132.530172 samples/sec accuracy=78.758291 loss=0.798044 lr=0.004739 Epoch[051] Batch [2499]/[3760] Speed: 122.178353 samples/sec accuracy=78.731250 loss=0.798628 lr=0.004737 Epoch[051] Batch [2549]/[3760] Speed: 127.600743 samples/sec accuracy=78.700980 loss=0.799657 lr=0.004735 Epoch[051] Batch [2599]/[3760] Speed: 118.012625 samples/sec accuracy=78.702524 loss=0.799828 lr=0.004733 Epoch[051] Batch [2649]/[3760] Speed: 134.813313 samples/sec accuracy=78.687500 loss=0.800488 lr=0.004731 Epoch[051] Batch [2699]/[3760] Speed: 123.516139 samples/sec accuracy=78.695023 loss=0.800656 lr=0.004729 Epoch[051] Batch [2749]/[3760] Speed: 129.211109 samples/sec accuracy=78.689773 loss=0.800727 lr=0.004727 Epoch[051] Batch [2799]/[3760] Speed: 118.861614 samples/sec accuracy=78.682478 loss=0.800980 lr=0.004725 Epoch[051] Batch [2849]/[3760] Speed: 127.181775 samples/sec accuracy=78.672697 loss=0.801654 lr=0.004723 Epoch[051] Batch [2899]/[3760] Speed: 131.014565 samples/sec accuracy=78.685345 loss=0.801032 lr=0.004720 Epoch[051] Batch [2949]/[3760] Speed: 120.803053 samples/sec accuracy=78.675847 loss=0.801287 lr=0.004718 Epoch[051] Batch [2999]/[3760] Speed: 128.068778 samples/sec accuracy=78.663542 loss=0.801585 lr=0.004716 Epoch[051] Batch [3049]/[3760] Speed: 127.729583 samples/sec accuracy=78.648053 loss=0.801730 lr=0.004714 Epoch[051] Batch [3099]/[3760] Speed: 122.706585 samples/sec accuracy=78.657258 loss=0.801790 lr=0.004712 Epoch[051] Batch [3149]/[3760] Speed: 131.400696 samples/sec accuracy=78.646825 loss=0.801825 lr=0.004710 Epoch[051] Batch [3199]/[3760] Speed: 122.540918 samples/sec accuracy=78.637695 loss=0.802073 lr=0.004708 Epoch[051] Batch [3249]/[3760] Speed: 128.298159 samples/sec accuracy=78.623077 loss=0.802632 lr=0.004706 Epoch[051] Batch [3299]/[3760] Speed: 119.214263 samples/sec accuracy=78.610322 loss=0.803374 lr=0.004704 Epoch[051] Batch [3349]/[3760] Speed: 130.803931 samples/sec accuracy=78.604944 loss=0.803838 lr=0.004702 Epoch[051] Batch [3399]/[3760] Speed: 121.499651 samples/sec accuracy=78.583180 loss=0.804774 lr=0.004700 Epoch[051] Batch [3449]/[3760] Speed: 128.942234 samples/sec accuracy=78.562047 loss=0.805723 lr=0.004698 Epoch[051] Batch [3499]/[3760] Speed: 120.024216 samples/sec accuracy=78.559821 loss=0.806050 lr=0.004695 Epoch[051] Batch [3549]/[3760] Speed: 134.802817 samples/sec accuracy=78.551937 loss=0.806120 lr=0.004693 Epoch[051] Batch [3599]/[3760] Speed: 124.245163 samples/sec accuracy=78.540365 loss=0.806793 lr=0.004691 Epoch[051] Batch [3649]/[3760] Speed: 119.698303 samples/sec accuracy=78.495719 loss=0.808088 lr=0.004689 Epoch[051] Batch [3699]/[3760] Speed: 128.258068 samples/sec accuracy=78.460726 loss=0.809046 lr=0.004687 Epoch[051] Batch [3749]/[3760] Speed: 141.698086 samples/sec accuracy=78.470833 loss=0.808899 lr=0.004685 Batch [0049]/[0303]: acc-top1=64.156250 acc-top5=85.937500 Batch [0099]/[0303]: acc-top1=64.921875 acc-top5=85.578125 Batch [0149]/[0303]: acc-top1=64.510417 acc-top5=85.468750 Batch [0199]/[0303]: acc-top1=63.914062 acc-top5=85.218750 Batch [0249]/[0303]: acc-top1=63.800000 acc-top5=85.268750 Batch [0299]/[0303]: acc-top1=63.843750 acc-top5=85.291667 [Epoch 051] training: accuracy=78.471991 loss=0.808856 [Epoch 051] speed: 125 samples/sec time cost: 2106.719046 [Epoch 051] validation: acc-top1=63.778878 acc-top5=85.261964 loss=2.149905 Epoch[052] Batch [0049]/[3759] Speed: 90.790520 samples/sec accuracy=80.468750 loss=0.734827 lr=0.004683 Epoch[052] Batch [0099]/[3759] Speed: 130.358421 samples/sec accuracy=80.671875 loss=0.739828 lr=0.004680 Epoch[052] Batch [0149]/[3759] Speed: 121.393488 samples/sec accuracy=80.354167 loss=0.750763 lr=0.004678 Epoch[052] Batch [0199]/[3759] Speed: 122.326802 samples/sec accuracy=80.187500 loss=0.758702 lr=0.004676 Epoch[052] Batch [0249]/[3759] Speed: 134.011407 samples/sec accuracy=80.112500 loss=0.756449 lr=0.004674 Epoch[052] Batch [0299]/[3759] Speed: 125.892350 samples/sec accuracy=80.182292 loss=0.753701 lr=0.004672 Epoch[052] Batch [0349]/[3759] Speed: 121.125203 samples/sec accuracy=80.160714 loss=0.749637 lr=0.004670 Epoch[052] Batch [0399]/[3759] Speed: 130.682058 samples/sec accuracy=80.171875 loss=0.746983 lr=0.004668 Epoch[052] Batch [0449]/[3759] Speed: 121.029865 samples/sec accuracy=80.138889 loss=0.746031 lr=0.004666 Epoch[052] Batch [0499]/[3759] Speed: 131.140288 samples/sec accuracy=80.112500 loss=0.747557 lr=0.004664 Epoch[052] Batch [0549]/[3759] Speed: 118.800078 samples/sec accuracy=80.045455 loss=0.750817 lr=0.004662 Epoch[052] Batch [0599]/[3759] Speed: 131.370605 samples/sec accuracy=80.096354 loss=0.749778 lr=0.004660 Epoch[052] Batch [0649]/[3759] Speed: 118.667654 samples/sec accuracy=80.050481 loss=0.750964 lr=0.004658 Epoch[052] Batch [0699]/[3759] Speed: 131.957926 samples/sec accuracy=80.049107 loss=0.750586 lr=0.004655 Epoch[052] Batch [0749]/[3759] Speed: 130.114551 samples/sec accuracy=79.981250 loss=0.751536 lr=0.004653 Epoch[052] Batch [0799]/[3759] Speed: 117.494764 samples/sec accuracy=79.894531 loss=0.753256 lr=0.004651 Epoch[052] Batch [0849]/[3759] Speed: 135.768164 samples/sec accuracy=79.843750 loss=0.755233 lr=0.004649 Epoch[052] Batch [0899]/[3759] Speed: 120.370699 samples/sec accuracy=79.732639 loss=0.758162 lr=0.004647 Epoch[052] Batch [0949]/[3759] Speed: 132.182559 samples/sec accuracy=79.695724 loss=0.758884 lr=0.004645 Epoch[052] Batch [0999]/[3759] Speed: 116.962900 samples/sec accuracy=79.632812 loss=0.760592 lr=0.004643 Epoch[052] Batch [1049]/[3759] Speed: 132.994029 samples/sec accuracy=79.613095 loss=0.761891 lr=0.004641 Epoch[052] Batch [1099]/[3759] Speed: 123.770287 samples/sec accuracy=79.556818 loss=0.763779 lr=0.004639 Epoch[052] Batch [1149]/[3759] Speed: 123.746684 samples/sec accuracy=79.563859 loss=0.763531 lr=0.004637 Epoch[052] Batch [1199]/[3759] Speed: 129.448970 samples/sec accuracy=79.566406 loss=0.764931 lr=0.004635 Epoch[052] Batch [1249]/[3759] Speed: 122.112699 samples/sec accuracy=79.522500 loss=0.767029 lr=0.004632 Epoch[052] Batch [1299]/[3759] Speed: 130.492665 samples/sec accuracy=79.520433 loss=0.767111 lr=0.004630 Epoch[052] Batch [1349]/[3759] Speed: 121.595523 samples/sec accuracy=79.513889 loss=0.767747 lr=0.004628 Epoch[052] Batch [1399]/[3759] Speed: 129.833044 samples/sec accuracy=79.512277 loss=0.767726 lr=0.004626 Epoch[052] Batch [1449]/[3759] Speed: 120.108909 samples/sec accuracy=79.522629 loss=0.767595 lr=0.004624 Epoch[052] Batch [1499]/[3759] Speed: 129.268102 samples/sec accuracy=79.498958 loss=0.769089 lr=0.004622 Epoch[052] Batch [1549]/[3759] Speed: 129.608736 samples/sec accuracy=79.481855 loss=0.770449 lr=0.004620 Epoch[052] Batch [1599]/[3759] Speed: 118.479502 samples/sec accuracy=79.480469 loss=0.770974 lr=0.004618 Epoch[052] Batch [1649]/[3759] Speed: 125.333547 samples/sec accuracy=79.500947 loss=0.770898 lr=0.004616 Epoch[052] Batch [1699]/[3759] Speed: 127.363987 samples/sec accuracy=79.470588 loss=0.771063 lr=0.004614 Epoch[052] Batch [1749]/[3759] Speed: 124.799621 samples/sec accuracy=79.453571 loss=0.771129 lr=0.004612 Epoch[052] Batch [1799]/[3759] Speed: 129.259490 samples/sec accuracy=79.443576 loss=0.771349 lr=0.004610 Epoch[052] Batch [1849]/[3759] Speed: 120.561807 samples/sec accuracy=79.474662 loss=0.770605 lr=0.004607 Epoch[052] Batch [1899]/[3759] Speed: 127.271412 samples/sec accuracy=79.487664 loss=0.770099 lr=0.004605 Epoch[052] Batch [1949]/[3759] Speed: 128.357566 samples/sec accuracy=79.457532 loss=0.770423 lr=0.004603 Epoch[052] Batch [1999]/[3759] Speed: 119.572761 samples/sec accuracy=79.452344 loss=0.770531 lr=0.004601 Epoch[052] Batch [2049]/[3759] Speed: 131.825123 samples/sec accuracy=79.387957 loss=0.772189 lr=0.004599 Epoch[052] Batch [2099]/[3759] Speed: 124.432943 samples/sec accuracy=79.390625 loss=0.772020 lr=0.004597 Epoch[052] Batch [2149]/[3759] Speed: 125.361036 samples/sec accuracy=79.372820 loss=0.772742 lr=0.004595 Epoch[052] Batch [2199]/[3759] Speed: 127.228486 samples/sec accuracy=79.327415 loss=0.773976 lr=0.004593 Epoch[052] Batch [2249]/[3759] Speed: 124.686012 samples/sec accuracy=79.320139 loss=0.774168 lr=0.004591 Epoch[052] Batch [2299]/[3759] Speed: 128.747439 samples/sec accuracy=79.292799 loss=0.774514 lr=0.004589 Epoch[052] Batch [2349]/[3759] Speed: 123.553523 samples/sec accuracy=79.272606 loss=0.775523 lr=0.004587 Epoch[052] Batch [2399]/[3759] Speed: 127.410191 samples/sec accuracy=79.228516 loss=0.776805 lr=0.004585 Epoch[052] Batch [2449]/[3759] Speed: 124.465435 samples/sec accuracy=79.223214 loss=0.777137 lr=0.004583 Epoch[052] Batch [2499]/[3759] Speed: 125.137628 samples/sec accuracy=79.231250 loss=0.777177 lr=0.004580 Epoch[052] Batch [2549]/[3759] Speed: 122.328913 samples/sec accuracy=79.238358 loss=0.776808 lr=0.004578 Epoch[052] Batch [2599]/[3759] Speed: 126.092746 samples/sec accuracy=79.229567 loss=0.777140 lr=0.004576 Epoch[052] Batch [2649]/[3759] Speed: 125.564487 samples/sec accuracy=79.220519 loss=0.777331 lr=0.004574 Epoch[052] Batch [2699]/[3759] Speed: 124.953350 samples/sec accuracy=79.191551 loss=0.778574 lr=0.004572 Epoch[052] Batch [2749]/[3759] Speed: 132.126947 samples/sec accuracy=79.172727 loss=0.779589 lr=0.004570 Epoch[052] Batch [2799]/[3759] Speed: 116.008835 samples/sec accuracy=79.181362 loss=0.779429 lr=0.004568 Epoch[052] Batch [2849]/[3759] Speed: 127.680882 samples/sec accuracy=79.167763 loss=0.780447 lr=0.004566 Epoch[052] Batch [2899]/[3759] Speed: 129.972771 samples/sec accuracy=79.142780 loss=0.781501 lr=0.004564 Epoch[052] Batch [2949]/[3759] Speed: 119.737877 samples/sec accuracy=79.141949 loss=0.781648 lr=0.004562 Epoch[052] Batch [2999]/[3759] Speed: 130.773653 samples/sec accuracy=79.157292 loss=0.781495 lr=0.004560 Epoch[052] Batch [3049]/[3759] Speed: 125.783420 samples/sec accuracy=79.155738 loss=0.781597 lr=0.004558 Epoch[052] Batch [3099]/[3759] Speed: 122.057900 samples/sec accuracy=79.154234 loss=0.782152 lr=0.004555 Epoch[052] Batch [3149]/[3759] Speed: 127.488582 samples/sec accuracy=79.137897 loss=0.782570 lr=0.004553 Epoch[052] Batch [3199]/[3759] Speed: 124.015428 samples/sec accuracy=79.110352 loss=0.783273 lr=0.004551 Epoch[052] Batch [3249]/[3759] Speed: 133.562851 samples/sec accuracy=79.077885 loss=0.784045 lr=0.004549 Epoch[052] Batch [3299]/[3759] Speed: 120.285859 samples/sec accuracy=79.056345 loss=0.784654 lr=0.004547 Epoch[052] Batch [3349]/[3759] Speed: 122.111310 samples/sec accuracy=79.035448 loss=0.785493 lr=0.004545 Epoch[052] Batch [3399]/[3759] Speed: 130.752544 samples/sec accuracy=79.036305 loss=0.785971 lr=0.004543 Epoch[052] Batch [3449]/[3759] Speed: 126.042767 samples/sec accuracy=79.007246 loss=0.786795 lr=0.004541 Epoch[052] Batch [3499]/[3759] Speed: 122.074928 samples/sec accuracy=78.977232 loss=0.787694 lr=0.004539 Epoch[052] Batch [3549]/[3759] Speed: 131.743101 samples/sec accuracy=78.971391 loss=0.787883 lr=0.004537 Epoch[052] Batch [3599]/[3759] Speed: 122.137750 samples/sec accuracy=78.942708 loss=0.788693 lr=0.004535 Epoch[052] Batch [3649]/[3759] Speed: 126.355087 samples/sec accuracy=78.943921 loss=0.788990 lr=0.004533 Epoch[052] Batch [3699]/[3759] Speed: 121.183365 samples/sec accuracy=78.932010 loss=0.789563 lr=0.004530 Epoch[052] Batch [3749]/[3759] Speed: 146.329154 samples/sec accuracy=78.918333 loss=0.790339 lr=0.004528 Batch [0049]/[0303]: acc-top1=65.031250 acc-top5=85.562500 Batch [0099]/[0303]: acc-top1=64.718750 acc-top5=85.343750 Batch [0149]/[0303]: acc-top1=64.489583 acc-top5=85.125000 Batch [0199]/[0303]: acc-top1=64.156250 acc-top5=85.078125 Batch [0249]/[0303]: acc-top1=64.056250 acc-top5=85.037500 Batch [0299]/[0303]: acc-top1=63.963542 acc-top5=84.994792 [Epoch 052] training: accuracy=78.917681 loss=0.790432 [Epoch 052] speed: 125 samples/sec time cost: 2106.316025 [Epoch 052] validation: acc-top1=63.912954 acc-top5=84.998969 loss=2.191262 Epoch[053] Batch [0049]/[3760] Speed: 89.219803 samples/sec accuracy=79.281250 loss=0.762207 lr=0.004526 Epoch[053] Batch [0099]/[3760] Speed: 130.605923 samples/sec accuracy=79.609375 loss=0.756333 lr=0.004524 Epoch[053] Batch [0149]/[3760] Speed: 121.967968 samples/sec accuracy=79.968750 loss=0.751750 lr=0.004522 Epoch[053] Batch [0199]/[3760] Speed: 123.527333 samples/sec accuracy=79.789062 loss=0.757551 lr=0.004520 Epoch[053] Batch [0249]/[3760] Speed: 133.994347 samples/sec accuracy=79.868750 loss=0.751885 lr=0.004518 Epoch[053] Batch [0299]/[3760] Speed: 118.208666 samples/sec accuracy=79.901042 loss=0.749194 lr=0.004516 Epoch[053] Batch [0349]/[3760] Speed: 128.419889 samples/sec accuracy=80.004464 loss=0.746464 lr=0.004513 Epoch[053] Batch [0399]/[3760] Speed: 126.938252 samples/sec accuracy=80.085938 loss=0.747582 lr=0.004511 Epoch[053] Batch [0449]/[3760] Speed: 123.813788 samples/sec accuracy=80.027778 loss=0.751890 lr=0.004509 Epoch[053] Batch [0499]/[3760] Speed: 131.704260 samples/sec accuracy=80.000000 loss=0.752957 lr=0.004507 Epoch[053] Batch [0549]/[3760] Speed: 117.941693 samples/sec accuracy=80.127841 loss=0.751081 lr=0.004505 Epoch[053] Batch [0599]/[3760] Speed: 130.892006 samples/sec accuracy=80.119792 loss=0.751270 lr=0.004503 Epoch[053] Batch [0649]/[3760] Speed: 127.097006 samples/sec accuracy=80.165865 loss=0.750912 lr=0.004501 Epoch[053] Batch [0699]/[3760] Speed: 115.996370 samples/sec accuracy=80.156250 loss=0.750641 lr=0.004499 Epoch[053] Batch [0749]/[3760] Speed: 134.762683 samples/sec accuracy=80.045833 loss=0.753028 lr=0.004497 Epoch[053] Batch [0799]/[3760] Speed: 123.874287 samples/sec accuracy=80.111328 loss=0.750698 lr=0.004495 Epoch[053] Batch [0849]/[3760] Speed: 123.113310 samples/sec accuracy=80.068015 loss=0.751605 lr=0.004493 Epoch[053] Batch [0899]/[3760] Speed: 134.246572 samples/sec accuracy=80.001736 loss=0.752477 lr=0.004491 Epoch[053] Batch [0949]/[3760] Speed: 116.651340 samples/sec accuracy=80.014803 loss=0.751562 lr=0.004489 Epoch[053] Batch [0999]/[3760] Speed: 130.631487 samples/sec accuracy=80.051562 loss=0.750721 lr=0.004486 Epoch[053] Batch [1049]/[3760] Speed: 132.127490 samples/sec accuracy=80.046131 loss=0.751645 lr=0.004484 Epoch[053] Batch [1099]/[3760] Speed: 118.722410 samples/sec accuracy=80.062500 loss=0.751912 lr=0.004482 Epoch[053] Batch [1149]/[3760] Speed: 128.379825 samples/sec accuracy=80.039402 loss=0.752712 lr=0.004480 Epoch[053] Batch [1199]/[3760] Speed: 121.385698 samples/sec accuracy=79.976562 loss=0.754377 lr=0.004478 Epoch[053] Batch [1249]/[3760] Speed: 127.302788 samples/sec accuracy=79.953750 loss=0.754585 lr=0.004476 Epoch[053] Batch [1299]/[3760] Speed: 127.928496 samples/sec accuracy=79.942308 loss=0.755999 lr=0.004474 Epoch[053] Batch [1349]/[3760] Speed: 125.742589 samples/sec accuracy=79.942130 loss=0.755254 lr=0.004472 Epoch[053] Batch [1399]/[3760] Speed: 120.201588 samples/sec accuracy=79.885045 loss=0.756942 lr=0.004470 Epoch[053] Batch [1449]/[3760] Speed: 132.574866 samples/sec accuracy=79.806034 loss=0.758454 lr=0.004468 Epoch[053] Batch [1499]/[3760] Speed: 123.073990 samples/sec accuracy=79.834375 loss=0.756896 lr=0.004466 Epoch[053] Batch [1549]/[3760] Speed: 127.907215 samples/sec accuracy=79.830645 loss=0.756680 lr=0.004464 Epoch[053] Batch [1599]/[3760] Speed: 121.860354 samples/sec accuracy=79.804688 loss=0.757810 lr=0.004462 Epoch[053] Batch [1649]/[3760] Speed: 130.668701 samples/sec accuracy=79.802083 loss=0.757748 lr=0.004459 Epoch[053] Batch [1699]/[3760] Speed: 123.198446 samples/sec accuracy=79.806985 loss=0.757676 lr=0.004457 Epoch[053] Batch [1749]/[3760] Speed: 122.998853 samples/sec accuracy=79.765179 loss=0.760029 lr=0.004455 Epoch[053] Batch [1799]/[3760] Speed: 129.443332 samples/sec accuracy=79.745660 loss=0.760944 lr=0.004453 Epoch[053] Batch [1849]/[3760] Speed: 124.389079 samples/sec accuracy=79.734797 loss=0.760785 lr=0.004451 Epoch[053] Batch [1899]/[3760] Speed: 123.793598 samples/sec accuracy=79.725329 loss=0.761119 lr=0.004449 Epoch[053] Batch [1949]/[3760] Speed: 133.172307 samples/sec accuracy=79.737179 loss=0.760741 lr=0.004447 Epoch[053] Batch [1999]/[3760] Speed: 119.074170 samples/sec accuracy=79.736719 loss=0.761262 lr=0.004445 Epoch[053] Batch [2049]/[3760] Speed: 126.014375 samples/sec accuracy=79.708079 loss=0.761966 lr=0.004443 Epoch[053] Batch [2099]/[3760] Speed: 125.470867 samples/sec accuracy=79.691964 loss=0.762434 lr=0.004441 Epoch[053] Batch [2149]/[3760] Speed: 127.451093 samples/sec accuracy=79.699855 loss=0.762272 lr=0.004439 Epoch[053] Batch [2199]/[3760] Speed: 121.712397 samples/sec accuracy=79.708807 loss=0.762915 lr=0.004437 Epoch[053] Batch [2249]/[3760] Speed: 135.368345 samples/sec accuracy=79.684028 loss=0.764418 lr=0.004435 Epoch[053] Batch [2299]/[3760] Speed: 120.020919 samples/sec accuracy=79.662364 loss=0.765548 lr=0.004432 Epoch[053] Batch [2349]/[3760] Speed: 131.623894 samples/sec accuracy=79.669548 loss=0.765407 lr=0.004430 Epoch[053] Batch [2399]/[3760] Speed: 119.688814 samples/sec accuracy=79.655599 loss=0.765771 lr=0.004428 Epoch[053] Batch [2449]/[3760] Speed: 128.512572 samples/sec accuracy=79.654337 loss=0.765889 lr=0.004426 Epoch[053] Batch [2499]/[3760] Speed: 130.800715 samples/sec accuracy=79.644375 loss=0.766006 lr=0.004424 Epoch[053] Batch [2549]/[3760] Speed: 123.500267 samples/sec accuracy=79.633578 loss=0.766765 lr=0.004422 Epoch[053] Batch [2599]/[3760] Speed: 123.813476 samples/sec accuracy=79.621394 loss=0.767186 lr=0.004420 Epoch[053] Batch [2649]/[3760] Speed: 121.284358 samples/sec accuracy=79.606722 loss=0.767756 lr=0.004418 Epoch[053] Batch [2699]/[3760] Speed: 133.943265 samples/sec accuracy=79.589120 loss=0.768321 lr=0.004416 Epoch[053] Batch [2749]/[3760] Speed: 116.114239 samples/sec accuracy=79.564773 loss=0.768955 lr=0.004414 Epoch[053] Batch [2799]/[3760] Speed: 131.345492 samples/sec accuracy=79.529018 loss=0.769864 lr=0.004412 Epoch[053] Batch [2849]/[3760] Speed: 128.146054 samples/sec accuracy=79.526316 loss=0.769862 lr=0.004410 Epoch[053] Batch [2899]/[3760] Speed: 123.902397 samples/sec accuracy=79.508082 loss=0.770291 lr=0.004408 Epoch[053] Batch [2949]/[3760] Speed: 125.664029 samples/sec accuracy=79.503178 loss=0.770240 lr=0.004405 Epoch[053] Batch [2999]/[3760] Speed: 121.134404 samples/sec accuracy=79.475000 loss=0.771100 lr=0.004403 Epoch[053] Batch [3049]/[3760] Speed: 131.062842 samples/sec accuracy=79.450820 loss=0.771703 lr=0.004401 Epoch[053] Batch [3099]/[3760] Speed: 124.981170 samples/sec accuracy=79.421371 loss=0.771955 lr=0.004399 Epoch[053] Batch [3149]/[3760] Speed: 123.617933 samples/sec accuracy=79.389881 loss=0.773206 lr=0.004397 Epoch[053] Batch [3199]/[3760] Speed: 124.299940 samples/sec accuracy=79.382812 loss=0.773360 lr=0.004395 Epoch[053] Batch [3249]/[3760] Speed: 124.358362 samples/sec accuracy=79.364904 loss=0.774098 lr=0.004393 Epoch[053] Batch [3299]/[3760] Speed: 122.584319 samples/sec accuracy=79.342803 loss=0.774671 lr=0.004391 Epoch[053] Batch [3349]/[3760] Speed: 129.086650 samples/sec accuracy=79.322295 loss=0.775419 lr=0.004389 Epoch[053] Batch [3399]/[3760] Speed: 129.466462 samples/sec accuracy=79.307445 loss=0.776183 lr=0.004387 Epoch[053] Batch [3449]/[3760] Speed: 118.395766 samples/sec accuracy=79.291214 loss=0.776679 lr=0.004385 Epoch[053] Batch [3499]/[3760] Speed: 135.034038 samples/sec accuracy=79.276339 loss=0.777314 lr=0.004383 Epoch[053] Batch [3549]/[3760] Speed: 115.689642 samples/sec accuracy=79.250000 loss=0.778061 lr=0.004381 Epoch[053] Batch [3599]/[3760] Speed: 136.965630 samples/sec accuracy=79.225694 loss=0.778662 lr=0.004378 Epoch[053] Batch [3649]/[3760] Speed: 115.137025 samples/sec accuracy=79.212757 loss=0.779388 lr=0.004376 Epoch[053] Batch [3699]/[3760] Speed: 134.173149 samples/sec accuracy=79.201858 loss=0.779809 lr=0.004374 Epoch[053] Batch [3749]/[3760] Speed: 137.086535 samples/sec accuracy=79.194167 loss=0.780160 lr=0.004372 Batch [0049]/[0303]: acc-top1=64.843750 acc-top5=86.062500 Batch [0099]/[0303]: acc-top1=64.687500 acc-top5=85.515625 Batch [0149]/[0303]: acc-top1=64.375000 acc-top5=85.500000 Batch [0199]/[0303]: acc-top1=64.070312 acc-top5=85.210938 Batch [0249]/[0303]: acc-top1=64.081250 acc-top5=85.268750 Batch [0299]/[0303]: acc-top1=64.119792 acc-top5=85.223958 [Epoch 053] training: accuracy=79.194232 loss=0.780020 [Epoch 053] speed: 125 samples/sec time cost: 2109.165257 [Epoch 053] validation: acc-top1=64.072814 acc-top5=85.194926 loss=2.145922 Epoch[054] Batch [0049]/[3760] Speed: 91.350702 samples/sec accuracy=80.562500 loss=0.707006 lr=0.004370 Epoch[054] Batch [0099]/[3760] Speed: 122.108727 samples/sec accuracy=80.484375 loss=0.721677 lr=0.004368 Epoch[054] Batch [0149]/[3760] Speed: 126.097186 samples/sec accuracy=80.562500 loss=0.717285 lr=0.004366 Epoch[054] Batch [0199]/[3760] Speed: 125.522976 samples/sec accuracy=80.476562 loss=0.721009 lr=0.004364 Epoch[054] Batch [0249]/[3760] Speed: 128.159389 samples/sec accuracy=80.506250 loss=0.721119 lr=0.004361 Epoch[054] Batch [0299]/[3760] Speed: 123.527397 samples/sec accuracy=80.625000 loss=0.719281 lr=0.004359 Epoch[054] Batch [0349]/[3760] Speed: 125.870433 samples/sec accuracy=80.584821 loss=0.721264 lr=0.004357 Epoch[054] Batch [0399]/[3760] Speed: 125.512467 samples/sec accuracy=80.625000 loss=0.720558 lr=0.004355 Epoch[054] Batch [0449]/[3760] Speed: 126.408475 samples/sec accuracy=80.663194 loss=0.721822 lr=0.004353 Epoch[054] Batch [0499]/[3760] Speed: 130.353105 samples/sec accuracy=80.653125 loss=0.722294 lr=0.004351 Epoch[054] Batch [0549]/[3760] Speed: 120.376601 samples/sec accuracy=80.605114 loss=0.726938 lr=0.004349 Epoch[054] Batch [0599]/[3760] Speed: 129.677079 samples/sec accuracy=80.575521 loss=0.728887 lr=0.004347 Epoch[054] Batch [0649]/[3760] Speed: 119.894390 samples/sec accuracy=80.526442 loss=0.731401 lr=0.004345 Epoch[054] Batch [0699]/[3760] Speed: 131.634022 samples/sec accuracy=80.408482 loss=0.733567 lr=0.004343 Epoch[054] Batch [0749]/[3760] Speed: 121.376826 samples/sec accuracy=80.418750 loss=0.734572 lr=0.004341 Epoch[054] Batch [0799]/[3760] Speed: 127.828751 samples/sec accuracy=80.392578 loss=0.734549 lr=0.004339 Epoch[054] Batch [0849]/[3760] Speed: 121.989267 samples/sec accuracy=80.360294 loss=0.735209 lr=0.004337 Epoch[054] Batch [0899]/[3760] Speed: 131.415458 samples/sec accuracy=80.347222 loss=0.736199 lr=0.004335 Epoch[054] Batch [0949]/[3760] Speed: 122.256126 samples/sec accuracy=80.375000 loss=0.735395 lr=0.004332 Epoch[054] Batch [0999]/[3760] Speed: 126.921710 samples/sec accuracy=80.328125 loss=0.737451 lr=0.004330 Epoch[054] Batch [1049]/[3760] Speed: 120.448138 samples/sec accuracy=80.334821 loss=0.736877 lr=0.004328 Epoch[054] Batch [1099]/[3760] Speed: 131.780499 samples/sec accuracy=80.379261 loss=0.735479 lr=0.004326 Epoch[054] Batch [1149]/[3760] Speed: 119.468669 samples/sec accuracy=80.432065 loss=0.734270 lr=0.004324 Epoch[054] Batch [1199]/[3760] Speed: 129.704415 samples/sec accuracy=80.420573 loss=0.734509 lr=0.004322 Epoch[054] Batch [1249]/[3760] Speed: 121.463395 samples/sec accuracy=80.371250 loss=0.736178 lr=0.004320 Epoch[054] Batch [1299]/[3760] Speed: 128.720862 samples/sec accuracy=80.338942 loss=0.737685 lr=0.004318 Epoch[054] Batch [1349]/[3760] Speed: 130.094723 samples/sec accuracy=80.376157 loss=0.735798 lr=0.004316 Epoch[054] Batch [1399]/[3760] Speed: 117.868846 samples/sec accuracy=80.371652 loss=0.736073 lr=0.004314 Epoch[054] Batch [1449]/[3760] Speed: 128.270187 samples/sec accuracy=80.308190 loss=0.737672 lr=0.004312 Epoch[054] Batch [1499]/[3760] Speed: 124.661974 samples/sec accuracy=80.266667 loss=0.738550 lr=0.004310 Epoch[054] Batch [1549]/[3760] Speed: 125.514550 samples/sec accuracy=80.226815 loss=0.738913 lr=0.004308 Epoch[054] Batch [1599]/[3760] Speed: 127.969446 samples/sec accuracy=80.224609 loss=0.738682 lr=0.004306 Epoch[054] Batch [1649]/[3760] Speed: 123.214787 samples/sec accuracy=80.221591 loss=0.738793 lr=0.004304 Epoch[054] Batch [1699]/[3760] Speed: 127.705889 samples/sec accuracy=80.171875 loss=0.739603 lr=0.004301 Epoch[054] Batch [1749]/[3760] Speed: 126.731406 samples/sec accuracy=80.180357 loss=0.740351 lr=0.004299 Epoch[054] Batch [1799]/[3760] Speed: 123.932837 samples/sec accuracy=80.175347 loss=0.740609 lr=0.004297 Epoch[054] Batch [1849]/[3760] Speed: 128.474383 samples/sec accuracy=80.143581 loss=0.741961 lr=0.004295 Epoch[054] Batch [1899]/[3760] Speed: 117.975384 samples/sec accuracy=80.127467 loss=0.742158 lr=0.004293 Epoch[054] Batch [1949]/[3760] Speed: 133.733776 samples/sec accuracy=80.085737 loss=0.744581 lr=0.004291 Epoch[054] Batch [1999]/[3760] Speed: 118.296237 samples/sec accuracy=80.082031 loss=0.744943 lr=0.004289 Epoch[054] Batch [2049]/[3760] Speed: 127.678053 samples/sec accuracy=80.057165 loss=0.746070 lr=0.004287 Epoch[054] Batch [2099]/[3760] Speed: 130.396538 samples/sec accuracy=80.057292 loss=0.746778 lr=0.004285 Epoch[054] Batch [2149]/[3760] Speed: 122.689817 samples/sec accuracy=80.055959 loss=0.747465 lr=0.004283 Epoch[054] Batch [2199]/[3760] Speed: 132.711717 samples/sec accuracy=80.035511 loss=0.748261 lr=0.004281 Epoch[054] Batch [2249]/[3760] Speed: 119.122388 samples/sec accuracy=80.011806 loss=0.749208 lr=0.004279 Epoch[054] Batch [2299]/[3760] Speed: 128.885497 samples/sec accuracy=80.016304 loss=0.749373 lr=0.004277 Epoch[054] Batch [2349]/[3760] Speed: 128.886742 samples/sec accuracy=80.013963 loss=0.749415 lr=0.004275 Epoch[054] Batch [2399]/[3760] Speed: 120.565392 samples/sec accuracy=79.986979 loss=0.750333 lr=0.004272 Epoch[054] Batch [2449]/[3760] Speed: 131.472046 samples/sec accuracy=79.959821 loss=0.750909 lr=0.004270 Epoch[054] Batch [2499]/[3760] Speed: 115.686551 samples/sec accuracy=79.942500 loss=0.751547 lr=0.004268 Epoch[054] Batch [2549]/[3760] Speed: 133.774550 samples/sec accuracy=79.921569 loss=0.752138 lr=0.004266 Epoch[054] Batch [2599]/[3760] Speed: 116.899482 samples/sec accuracy=79.935096 loss=0.752243 lr=0.004264 Epoch[054] Batch [2649]/[3760] Speed: 131.385431 samples/sec accuracy=79.926887 loss=0.752663 lr=0.004262 Epoch[054] Batch [2699]/[3760] Speed: 130.193557 samples/sec accuracy=79.895833 loss=0.753099 lr=0.004260 Epoch[054] Batch [2749]/[3760] Speed: 116.884400 samples/sec accuracy=79.877841 loss=0.753400 lr=0.004258 Epoch[054] Batch [2799]/[3760] Speed: 138.148809 samples/sec accuracy=79.864955 loss=0.753615 lr=0.004256 Epoch[054] Batch [2849]/[3760] Speed: 116.557976 samples/sec accuracy=79.853618 loss=0.753936 lr=0.004254 Epoch[054] Batch [2899]/[3760] Speed: 128.383449 samples/sec accuracy=79.836207 loss=0.754982 lr=0.004252 Epoch[054] Batch [2949]/[3760] Speed: 126.770201 samples/sec accuracy=79.824153 loss=0.755388 lr=0.004250 Epoch[054] Batch [2999]/[3760] Speed: 124.708768 samples/sec accuracy=79.820833 loss=0.755905 lr=0.004248 Epoch[054] Batch [3049]/[3760] Speed: 119.149362 samples/sec accuracy=79.810963 loss=0.756201 lr=0.004246 Epoch[054] Batch [3099]/[3760] Speed: 132.665141 samples/sec accuracy=79.803427 loss=0.756322 lr=0.004244 Epoch[054] Batch [3149]/[3760] Speed: 126.801068 samples/sec accuracy=79.802083 loss=0.756242 lr=0.004242 Epoch[054] Batch [3199]/[3760] Speed: 122.654394 samples/sec accuracy=79.778320 loss=0.757044 lr=0.004239 Epoch[054] Batch [3249]/[3760] Speed: 122.803278 samples/sec accuracy=79.774038 loss=0.757301 lr=0.004237 Epoch[054] Batch [3299]/[3760] Speed: 126.958561 samples/sec accuracy=79.745265 loss=0.758036 lr=0.004235 Epoch[054] Batch [3349]/[3760] Speed: 131.024362 samples/sec accuracy=79.745802 loss=0.758288 lr=0.004233 Epoch[054] Batch [3399]/[3760] Speed: 119.247202 samples/sec accuracy=79.739890 loss=0.758588 lr=0.004231 Epoch[054] Batch [3449]/[3760] Speed: 126.383544 samples/sec accuracy=79.737772 loss=0.758840 lr=0.004229 Epoch[054] Batch [3499]/[3760] Speed: 130.903083 samples/sec accuracy=79.706250 loss=0.759671 lr=0.004227 Epoch[054] Batch [3549]/[3760] Speed: 127.523483 samples/sec accuracy=79.700264 loss=0.759900 lr=0.004225 Epoch[054] Batch [3599]/[3760] Speed: 122.950066 samples/sec accuracy=79.683594 loss=0.760106 lr=0.004223 Epoch[054] Batch [3649]/[3760] Speed: 126.936982 samples/sec accuracy=79.675086 loss=0.760469 lr=0.004221 Epoch[054] Batch [3699]/[3760] Speed: 122.579813 samples/sec accuracy=79.671875 loss=0.760400 lr=0.004219 Epoch[054] Batch [3749]/[3760] Speed: 145.786337 samples/sec accuracy=79.671250 loss=0.760678 lr=0.004217 Batch [0049]/[0303]: acc-top1=64.250000 acc-top5=85.562500 Batch [0099]/[0303]: acc-top1=64.437500 acc-top5=85.359375 Batch [0149]/[0303]: acc-top1=64.052083 acc-top5=85.135417 Batch [0199]/[0303]: acc-top1=63.742188 acc-top5=85.164062 Batch [0249]/[0303]: acc-top1=63.893750 acc-top5=85.137500 Batch [0299]/[0303]: acc-top1=63.770833 acc-top5=85.078125 [Epoch 054] training: accuracy=79.672124 loss=0.760634 [Epoch 054] speed: 125 samples/sec time cost: 2109.966837 [Epoch 054] validation: acc-top1=63.768564 acc-top5=85.060850 loss=2.122006 Epoch[055] Batch [0049]/[3759] Speed: 89.304539 samples/sec accuracy=80.937500 loss=0.711485 lr=0.004214 Epoch[055] Batch [0099]/[3759] Speed: 126.034068 samples/sec accuracy=81.500000 loss=0.703770 lr=0.004212 Epoch[055] Batch [0149]/[3759] Speed: 126.766160 samples/sec accuracy=81.427083 loss=0.704281 lr=0.004210 Epoch[055] Batch [0199]/[3759] Speed: 122.402716 samples/sec accuracy=81.289062 loss=0.709696 lr=0.004208 Epoch[055] Batch [0249]/[3759] Speed: 127.810248 samples/sec accuracy=81.162500 loss=0.709147 lr=0.004206 Epoch[055] Batch [0299]/[3759] Speed: 129.271990 samples/sec accuracy=81.145833 loss=0.707742 lr=0.004204 Epoch[055] Batch [0349]/[3759] Speed: 117.822850 samples/sec accuracy=81.214286 loss=0.706623 lr=0.004202 Epoch[055] Batch [0399]/[3759] Speed: 131.730957 samples/sec accuracy=81.152344 loss=0.706676 lr=0.004200 Epoch[055] Batch [0449]/[3759] Speed: 118.616927 samples/sec accuracy=80.968750 loss=0.710488 lr=0.004198 Epoch[055] Batch [0499]/[3759] Speed: 132.673642 samples/sec accuracy=80.975000 loss=0.711650 lr=0.004196 Epoch[055] Batch [0549]/[3759] Speed: 117.990620 samples/sec accuracy=80.943182 loss=0.712118 lr=0.004194 Epoch[055] Batch [0599]/[3759] Speed: 129.290655 samples/sec accuracy=80.890625 loss=0.713427 lr=0.004192 Epoch[055] Batch [0649]/[3759] Speed: 128.213746 samples/sec accuracy=80.850962 loss=0.713694 lr=0.004190 Epoch[055] Batch [0699]/[3759] Speed: 119.617172 samples/sec accuracy=80.816964 loss=0.714978 lr=0.004187 Epoch[055] Batch [0749]/[3759] Speed: 133.277872 samples/sec accuracy=80.768750 loss=0.716828 lr=0.004185 Epoch[055] Batch [0799]/[3759] Speed: 121.694139 samples/sec accuracy=80.755859 loss=0.717214 lr=0.004183 Epoch[055] Batch [0849]/[3759] Speed: 130.852291 samples/sec accuracy=80.704044 loss=0.719067 lr=0.004181 Epoch[055] Batch [0899]/[3759] Speed: 121.019943 samples/sec accuracy=80.699653 loss=0.720134 lr=0.004179 Epoch[055] Batch [0949]/[3759] Speed: 130.191400 samples/sec accuracy=80.735197 loss=0.718439 lr=0.004177 Epoch[055] Batch [0999]/[3759] Speed: 118.228890 samples/sec accuracy=80.703125 loss=0.718998 lr=0.004175 Epoch[055] Batch [1049]/[3759] Speed: 133.062629 samples/sec accuracy=80.708333 loss=0.719848 lr=0.004173 Epoch[055] Batch [1099]/[3759] Speed: 120.976273 samples/sec accuracy=80.688920 loss=0.719487 lr=0.004171 Epoch[055] Batch [1149]/[3759] Speed: 128.035705 samples/sec accuracy=80.684783 loss=0.719504 lr=0.004169 Epoch[055] Batch [1199]/[3759] Speed: 129.844947 samples/sec accuracy=80.684896 loss=0.719453 lr=0.004167 Epoch[055] Batch [1249]/[3759] Speed: 123.829291 samples/sec accuracy=80.692500 loss=0.718920 lr=0.004165 Epoch[055] Batch [1299]/[3759] Speed: 125.873646 samples/sec accuracy=80.671875 loss=0.720475 lr=0.004163 Epoch[055] Batch [1349]/[3759] Speed: 120.378962 samples/sec accuracy=80.652778 loss=0.721211 lr=0.004161 Epoch[055] Batch [1399]/[3759] Speed: 130.357419 samples/sec accuracy=80.630580 loss=0.723116 lr=0.004159 Epoch[055] Batch [1449]/[3759] Speed: 124.141388 samples/sec accuracy=80.678879 loss=0.722047 lr=0.004157 Epoch[055] Batch [1499]/[3759] Speed: 125.314081 samples/sec accuracy=80.660417 loss=0.723265 lr=0.004154 Epoch[055] Batch [1549]/[3759] Speed: 125.569220 samples/sec accuracy=80.646169 loss=0.723943 lr=0.004152 Epoch[055] Batch [1599]/[3759] Speed: 125.726389 samples/sec accuracy=80.626953 loss=0.725045 lr=0.004150 Epoch[055] Batch [1649]/[3759] Speed: 128.022001 samples/sec accuracy=80.604167 loss=0.725997 lr=0.004148 Epoch[055] Batch [1699]/[3759] Speed: 120.606219 samples/sec accuracy=80.630515 loss=0.725860 lr=0.004146 Epoch[055] Batch [1749]/[3759] Speed: 131.502397 samples/sec accuracy=80.584821 loss=0.726379 lr=0.004144 Epoch[055] Batch [1799]/[3759] Speed: 119.440315 samples/sec accuracy=80.567708 loss=0.727532 lr=0.004142 Epoch[055] Batch [1849]/[3759] Speed: 132.483965 samples/sec accuracy=80.496622 loss=0.729566 lr=0.004140 Epoch[055] Batch [1899]/[3759] Speed: 119.514467 samples/sec accuracy=80.448191 loss=0.730708 lr=0.004138 Epoch[055] Batch [1949]/[3759] Speed: 131.847522 samples/sec accuracy=80.438301 loss=0.730800 lr=0.004136 Epoch[055] Batch [1999]/[3759] Speed: 123.472429 samples/sec accuracy=80.449219 loss=0.730674 lr=0.004134 Epoch[055] Batch [2049]/[3759] Speed: 124.312111 samples/sec accuracy=80.452744 loss=0.730735 lr=0.004132 Epoch[055] Batch [2099]/[3759] Speed: 132.356319 samples/sec accuracy=80.445685 loss=0.731130 lr=0.004130 Epoch[055] Batch [2149]/[3759] Speed: 122.138338 samples/sec accuracy=80.438953 loss=0.731383 lr=0.004128 Epoch[055] Batch [2199]/[3759] Speed: 125.576645 samples/sec accuracy=80.421165 loss=0.731172 lr=0.004126 Epoch[055] Batch [2249]/[3759] Speed: 126.304628 samples/sec accuracy=80.375694 loss=0.732337 lr=0.004124 Epoch[055] Batch [2299]/[3759] Speed: 126.752051 samples/sec accuracy=80.360054 loss=0.733461 lr=0.004122 Epoch[055] Batch [2349]/[3759] Speed: 122.739120 samples/sec accuracy=80.341090 loss=0.734438 lr=0.004119 Epoch[055] Batch [2399]/[3759] Speed: 128.598859 samples/sec accuracy=80.338542 loss=0.734790 lr=0.004117 Epoch[055] Batch [2449]/[3759] Speed: 122.957719 samples/sec accuracy=80.313138 loss=0.735238 lr=0.004115 Epoch[055] Batch [2499]/[3759] Speed: 125.856256 samples/sec accuracy=80.316875 loss=0.735640 lr=0.004113 Epoch[055] Batch [2549]/[3759] Speed: 125.708065 samples/sec accuracy=80.323529 loss=0.735500 lr=0.004111 Epoch[055] Batch [2599]/[3759] Speed: 128.173464 samples/sec accuracy=80.338942 loss=0.735118 lr=0.004109 Epoch[055] Batch [2649]/[3759] Speed: 123.874630 samples/sec accuracy=80.326061 loss=0.736078 lr=0.004107 Epoch[055] Batch [2699]/[3759] Speed: 125.211485 samples/sec accuracy=80.343750 loss=0.736146 lr=0.004105 Epoch[055] Batch [2749]/[3759] Speed: 128.417658 samples/sec accuracy=80.337500 loss=0.736217 lr=0.004103 Epoch[055] Batch [2799]/[3759] Speed: 120.338689 samples/sec accuracy=80.334263 loss=0.736371 lr=0.004101 Epoch[055] Batch [2849]/[3759] Speed: 127.438495 samples/sec accuracy=80.329496 loss=0.736566 lr=0.004099 Epoch[055] Batch [2899]/[3759] Speed: 126.360450 samples/sec accuracy=80.301724 loss=0.736907 lr=0.004097 Epoch[055] Batch [2949]/[3759] Speed: 123.822605 samples/sec accuracy=80.279131 loss=0.737485 lr=0.004095 Epoch[055] Batch [2999]/[3759] Speed: 129.823230 samples/sec accuracy=80.243750 loss=0.738571 lr=0.004093 Epoch[055] Batch [3049]/[3759] Speed: 119.608752 samples/sec accuracy=80.218750 loss=0.739595 lr=0.004091 Epoch[055] Batch [3099]/[3759] Speed: 126.957323 samples/sec accuracy=80.218750 loss=0.739978 lr=0.004089 Epoch[055] Batch [3149]/[3759] Speed: 125.578275 samples/sec accuracy=80.195933 loss=0.740864 lr=0.004087 Epoch[055] Batch [3199]/[3759] Speed: 131.910399 samples/sec accuracy=80.185059 loss=0.741305 lr=0.004085 Epoch[055] Batch [3249]/[3759] Speed: 119.208784 samples/sec accuracy=80.169712 loss=0.741416 lr=0.004082 Epoch[055] Batch [3299]/[3759] Speed: 130.350181 samples/sec accuracy=80.169034 loss=0.741327 lr=0.004080 Epoch[055] Batch [3349]/[3759] Speed: 117.424438 samples/sec accuracy=80.139459 loss=0.742291 lr=0.004078 Epoch[055] Batch [3399]/[3759] Speed: 127.987471 samples/sec accuracy=80.130055 loss=0.742560 lr=0.004076 Epoch[055] Batch [3449]/[3759] Speed: 133.932173 samples/sec accuracy=80.126359 loss=0.742879 lr=0.004074 Epoch[055] Batch [3499]/[3759] Speed: 118.683724 samples/sec accuracy=80.113393 loss=0.743464 lr=0.004072 Epoch[055] Batch [3549]/[3759] Speed: 130.362362 samples/sec accuracy=80.110475 loss=0.744034 lr=0.004070 Epoch[055] Batch [3599]/[3759] Speed: 121.660124 samples/sec accuracy=80.096788 loss=0.744652 lr=0.004068 Epoch[055] Batch [3649]/[3759] Speed: 123.631268 samples/sec accuracy=80.098459 loss=0.744830 lr=0.004066 Epoch[055] Batch [3699]/[3759] Speed: 135.562797 samples/sec accuracy=80.097128 loss=0.744639 lr=0.004064 Epoch[055] Batch [3749]/[3759] Speed: 139.850311 samples/sec accuracy=80.089583 loss=0.744767 lr=0.004062 Batch [0049]/[0303]: acc-top1=64.468750 acc-top5=85.937500 Batch [0099]/[0303]: acc-top1=65.125000 acc-top5=85.546875 Batch [0149]/[0303]: acc-top1=64.895833 acc-top5=85.395833 Batch [0199]/[0303]: acc-top1=64.343750 acc-top5=85.210938 Batch [0249]/[0303]: acc-top1=64.568750 acc-top5=85.375000 Batch [0299]/[0303]: acc-top1=64.395833 acc-top5=85.270833 [Epoch 055] training: accuracy=80.084464 loss=0.744753 [Epoch 055] speed: 125 samples/sec time cost: 2108.144570 [Epoch 055] validation: acc-top1=64.377063 acc-top5=85.251650 loss=2.154905 Epoch[056] Batch [0049]/[3760] Speed: 92.547033 samples/sec accuracy=80.406250 loss=0.713769 lr=0.004060 Epoch[056] Batch [0099]/[3760] Speed: 123.486198 samples/sec accuracy=81.484375 loss=0.698377 lr=0.004057 Epoch[056] Batch [0149]/[3760] Speed: 126.286924 samples/sec accuracy=81.958333 loss=0.680021 lr=0.004055 Epoch[056] Batch [0199]/[3760] Speed: 123.193179 samples/sec accuracy=81.875000 loss=0.682490 lr=0.004053 Epoch[056] Batch [0249]/[3760] Speed: 130.347757 samples/sec accuracy=81.600000 loss=0.692913 lr=0.004051 Epoch[056] Batch [0299]/[3760] Speed: 125.259213 samples/sec accuracy=81.578125 loss=0.691409 lr=0.004049 Epoch[056] Batch [0349]/[3760] Speed: 121.088851 samples/sec accuracy=81.486607 loss=0.695380 lr=0.004047 Epoch[056] Batch [0399]/[3760] Speed: 129.112419 samples/sec accuracy=81.589844 loss=0.693742 lr=0.004045 Epoch[056] Batch [0449]/[3760] Speed: 130.112527 samples/sec accuracy=81.548611 loss=0.694995 lr=0.004043 Epoch[056] Batch [0499]/[3760] Speed: 117.454599 samples/sec accuracy=81.421875 loss=0.697796 lr=0.004041 Epoch[056] Batch [0549]/[3760] Speed: 130.190800 samples/sec accuracy=81.409091 loss=0.698663 lr=0.004039 Epoch[056] Batch [0599]/[3760] Speed: 125.590390 samples/sec accuracy=81.348958 loss=0.700796 lr=0.004037 Epoch[056] Batch [0649]/[3760] Speed: 124.488739 samples/sec accuracy=81.271635 loss=0.702561 lr=0.004035 Epoch[056] Batch [0699]/[3760] Speed: 122.670136 samples/sec accuracy=81.366071 loss=0.700379 lr=0.004033 Epoch[056] Batch [0749]/[3760] Speed: 129.087741 samples/sec accuracy=81.343750 loss=0.699931 lr=0.004031 Epoch[056] Batch [0799]/[3760] Speed: 121.082399 samples/sec accuracy=81.357422 loss=0.699296 lr=0.004029 Epoch[056] Batch [0849]/[3760] Speed: 134.494409 samples/sec accuracy=81.397059 loss=0.697832 lr=0.004027 Epoch[056] Batch [0899]/[3760] Speed: 120.747508 samples/sec accuracy=81.449653 loss=0.696606 lr=0.004025 Epoch[056] Batch [0949]/[3760] Speed: 126.481074 samples/sec accuracy=81.404605 loss=0.697630 lr=0.004023 Epoch[056] Batch [0999]/[3760] Speed: 127.020231 samples/sec accuracy=81.357813 loss=0.698045 lr=0.004021 Epoch[056] Batch [1049]/[3760] Speed: 122.879434 samples/sec accuracy=81.303571 loss=0.699382 lr=0.004019 Epoch[056] Batch [1099]/[3760] Speed: 124.633493 samples/sec accuracy=81.264205 loss=0.700773 lr=0.004016 Epoch[056] Batch [1149]/[3760] Speed: 128.605899 samples/sec accuracy=81.244565 loss=0.701463 lr=0.004014 Epoch[056] Batch [1199]/[3760] Speed: 122.179654 samples/sec accuracy=81.161458 loss=0.703936 lr=0.004012 Epoch[056] Batch [1249]/[3760] Speed: 131.310947 samples/sec accuracy=81.172500 loss=0.702726 lr=0.004010 Epoch[056] Batch [1299]/[3760] Speed: 121.452998 samples/sec accuracy=81.131010 loss=0.704335 lr=0.004008 Epoch[056] Batch [1349]/[3760] Speed: 129.005897 samples/sec accuracy=81.098380 loss=0.704978 lr=0.004006 Epoch[056] Batch [1399]/[3760] Speed: 117.920340 samples/sec accuracy=81.059152 loss=0.705736 lr=0.004004 Epoch[056] Batch [1449]/[3760] Speed: 128.074481 samples/sec accuracy=81.047414 loss=0.706635 lr=0.004002 Epoch[056] Batch [1499]/[3760] Speed: 122.062878 samples/sec accuracy=81.058333 loss=0.706659 lr=0.004000 Epoch[056] Batch [1549]/[3760] Speed: 129.319525 samples/sec accuracy=81.073589 loss=0.707187 lr=0.003998 Epoch[056] Batch [1599]/[3760] Speed: 127.266589 samples/sec accuracy=81.025391 loss=0.708516 lr=0.003996 Epoch[056] Batch [1649]/[3760] Speed: 127.773452 samples/sec accuracy=80.988636 loss=0.710118 lr=0.003994 Epoch[056] Batch [1699]/[3760] Speed: 127.238511 samples/sec accuracy=80.980699 loss=0.710825 lr=0.003992 Epoch[056] Batch [1749]/[3760] Speed: 119.644118 samples/sec accuracy=80.966071 loss=0.711672 lr=0.003990 Epoch[056] Batch [1799]/[3760] Speed: 130.125978 samples/sec accuracy=80.957465 loss=0.712404 lr=0.003988 Epoch[056] Batch [1849]/[3760] Speed: 121.163908 samples/sec accuracy=80.963682 loss=0.713074 lr=0.003986 Epoch[056] Batch [1899]/[3760] Speed: 128.031705 samples/sec accuracy=80.944901 loss=0.713355 lr=0.003984 Epoch[056] Batch [1949]/[3760] Speed: 121.203954 samples/sec accuracy=80.924679 loss=0.713850 lr=0.003982 Epoch[056] Batch [1999]/[3760] Speed: 126.155699 samples/sec accuracy=80.890625 loss=0.714646 lr=0.003980 Epoch[056] Batch [2049]/[3760] Speed: 132.010830 samples/sec accuracy=80.855183 loss=0.716158 lr=0.003978 Epoch[056] Batch [2099]/[3760] Speed: 120.371403 samples/sec accuracy=80.805060 loss=0.717527 lr=0.003976 Epoch[056] Batch [2149]/[3760] Speed: 126.642036 samples/sec accuracy=80.797238 loss=0.718092 lr=0.003974 Epoch[056] Batch [2199]/[3760] Speed: 121.798614 samples/sec accuracy=80.769886 loss=0.718976 lr=0.003971 Epoch[056] Batch [2249]/[3760] Speed: 127.999246 samples/sec accuracy=80.778472 loss=0.719090 lr=0.003969 Epoch[056] Batch [2299]/[3760] Speed: 129.301721 samples/sec accuracy=80.734375 loss=0.720542 lr=0.003967 Epoch[056] Batch [2349]/[3760] Speed: 121.204899 samples/sec accuracy=80.712766 loss=0.721752 lr=0.003965 Epoch[056] Batch [2399]/[3760] Speed: 131.915717 samples/sec accuracy=80.715495 loss=0.721998 lr=0.003963 Epoch[056] Batch [2449]/[3760] Speed: 123.520329 samples/sec accuracy=80.717474 loss=0.722230 lr=0.003961 Epoch[056] Batch [2499]/[3760] Speed: 122.365858 samples/sec accuracy=80.705000 loss=0.723034 lr=0.003959 Epoch[056] Batch [2549]/[3760] Speed: 131.718084 samples/sec accuracy=80.680760 loss=0.723925 lr=0.003957 Epoch[056] Batch [2599]/[3760] Speed: 125.152561 samples/sec accuracy=80.669471 loss=0.724425 lr=0.003955 Epoch[056] Batch [2649]/[3760] Speed: 123.001633 samples/sec accuracy=80.649764 loss=0.724680 lr=0.003953 Epoch[056] Batch [2699]/[3760] Speed: 124.900627 samples/sec accuracy=80.650463 loss=0.724586 lr=0.003951 Epoch[056] Batch [2749]/[3760] Speed: 129.235544 samples/sec accuracy=80.614205 loss=0.725523 lr=0.003949 Epoch[056] Batch [2799]/[3760] Speed: 119.424865 samples/sec accuracy=80.599888 loss=0.725715 lr=0.003947 Epoch[056] Batch [2849]/[3760] Speed: 132.481556 samples/sec accuracy=80.593202 loss=0.725764 lr=0.003945 Epoch[056] Batch [2899]/[3760] Speed: 121.614132 samples/sec accuracy=80.599138 loss=0.725601 lr=0.003943 Epoch[056] Batch [2949]/[3760] Speed: 128.647322 samples/sec accuracy=80.597987 loss=0.725779 lr=0.003941 Epoch[056] Batch [2999]/[3760] Speed: 125.263218 samples/sec accuracy=80.588021 loss=0.726193 lr=0.003939 Epoch[056] Batch [3049]/[3760] Speed: 122.290220 samples/sec accuracy=80.549180 loss=0.727462 lr=0.003937 Epoch[056] Batch [3099]/[3760] Speed: 125.376198 samples/sec accuracy=80.566532 loss=0.727040 lr=0.003935 Epoch[056] Batch [3149]/[3760] Speed: 123.668568 samples/sec accuracy=80.554563 loss=0.727540 lr=0.003933 Epoch[056] Batch [3199]/[3760] Speed: 132.088236 samples/sec accuracy=80.539551 loss=0.728062 lr=0.003931 Epoch[056] Batch [3249]/[3760] Speed: 126.332906 samples/sec accuracy=80.512981 loss=0.728920 lr=0.003929 Epoch[056] Batch [3299]/[3760] Speed: 124.647586 samples/sec accuracy=80.512784 loss=0.729005 lr=0.003927 Epoch[056] Batch [3349]/[3760] Speed: 124.719654 samples/sec accuracy=80.511660 loss=0.728884 lr=0.003924 Epoch[056] Batch [3399]/[3760] Speed: 124.750073 samples/sec accuracy=80.528952 loss=0.728442 lr=0.003922 Epoch[056] Batch [3449]/[3760] Speed: 125.631663 samples/sec accuracy=80.524909 loss=0.728806 lr=0.003920 Epoch[056] Batch [3499]/[3760] Speed: 124.303372 samples/sec accuracy=80.543304 loss=0.728541 lr=0.003918 Epoch[056] Batch [3549]/[3760] Speed: 130.380852 samples/sec accuracy=80.530370 loss=0.728891 lr=0.003916 Epoch[056] Batch [3599]/[3760] Speed: 122.358195 samples/sec accuracy=80.513889 loss=0.729393 lr=0.003914 Epoch[056] Batch [3649]/[3760] Speed: 125.578000 samples/sec accuracy=80.505993 loss=0.729739 lr=0.003912 Epoch[056] Batch [3699]/[3760] Speed: 132.407797 samples/sec accuracy=80.504645 loss=0.729733 lr=0.003910 Epoch[056] Batch [3749]/[3760] Speed: 139.530858 samples/sec accuracy=80.483750 loss=0.730441 lr=0.003908 Batch [0049]/[0303]: acc-top1=64.343750 acc-top5=86.093750 Batch [0099]/[0303]: acc-top1=64.671875 acc-top5=85.671875 Batch [0149]/[0303]: acc-top1=64.291667 acc-top5=85.364583 Batch [0199]/[0303]: acc-top1=63.796875 acc-top5=85.148438 Batch [0249]/[0303]: acc-top1=63.700000 acc-top5=85.143750 Batch [0299]/[0303]: acc-top1=63.630208 acc-top5=85.057292 [Epoch 056] training: accuracy=80.480801 loss=0.730623 [Epoch 056] speed: 125 samples/sec time cost: 2108.773434 [Epoch 056] validation: acc-top1=63.572607 acc-top5=85.014439 loss=2.238573 Epoch[057] Batch [0049]/[3760] Speed: 90.509601 samples/sec accuracy=80.812500 loss=0.694881 lr=0.003906 Epoch[057] Batch [0099]/[3760] Speed: 127.254307 samples/sec accuracy=81.625000 loss=0.672935 lr=0.003904 Epoch[057] Batch [0149]/[3760] Speed: 127.756032 samples/sec accuracy=81.968750 loss=0.670707 lr=0.003902 Epoch[057] Batch [0199]/[3760] Speed: 119.837788 samples/sec accuracy=82.062500 loss=0.673076 lr=0.003900 Epoch[057] Batch [0249]/[3760] Speed: 132.302908 samples/sec accuracy=82.187500 loss=0.667615 lr=0.003898 Epoch[057] Batch [0299]/[3760] Speed: 116.736096 samples/sec accuracy=82.000000 loss=0.672051 lr=0.003896 Epoch[057] Batch [0349]/[3760] Speed: 132.224491 samples/sec accuracy=81.937500 loss=0.674465 lr=0.003893 Epoch[057] Batch [0399]/[3760] Speed: 132.595194 samples/sec accuracy=82.027344 loss=0.671535 lr=0.003891 Epoch[057] Batch [0449]/[3760] Speed: 122.836100 samples/sec accuracy=82.065972 loss=0.669031 lr=0.003889 Epoch[057] Batch [0499]/[3760] Speed: 122.083807 samples/sec accuracy=82.021875 loss=0.670058 lr=0.003887 Epoch[057] Batch [0549]/[3760] Speed: 126.362539 samples/sec accuracy=82.019886 loss=0.668662 lr=0.003885 Epoch[057] Batch [0599]/[3760] Speed: 131.003319 samples/sec accuracy=81.989583 loss=0.669716 lr=0.003883 Epoch[057] Batch [0649]/[3760] Speed: 115.877907 samples/sec accuracy=81.980769 loss=0.670793 lr=0.003881 Epoch[057] Batch [0699]/[3760] Speed: 131.443537 samples/sec accuracy=81.928571 loss=0.672584 lr=0.003879 Epoch[057] Batch [0749]/[3760] Speed: 122.354569 samples/sec accuracy=81.937500 loss=0.673335 lr=0.003877 Epoch[057] Batch [0799]/[3760] Speed: 132.814504 samples/sec accuracy=81.875000 loss=0.674995 lr=0.003875 Epoch[057] Batch [0849]/[3760] Speed: 122.708605 samples/sec accuracy=81.911765 loss=0.675019 lr=0.003873 Epoch[057] Batch [0899]/[3760] Speed: 125.653780 samples/sec accuracy=81.887153 loss=0.675461 lr=0.003871 Epoch[057] Batch [0949]/[3760] Speed: 126.380937 samples/sec accuracy=81.873355 loss=0.675945 lr=0.003869 Epoch[057] Batch [0999]/[3760] Speed: 128.989967 samples/sec accuracy=81.839062 loss=0.676637 lr=0.003867 Epoch[057] Batch [1049]/[3760] Speed: 119.402044 samples/sec accuracy=81.822917 loss=0.677083 lr=0.003865 Epoch[057] Batch [1099]/[3760] Speed: 134.341763 samples/sec accuracy=81.826705 loss=0.677602 lr=0.003863 Epoch[057] Batch [1149]/[3760] Speed: 117.451920 samples/sec accuracy=81.835598 loss=0.678106 lr=0.003861 Epoch[057] Batch [1199]/[3760] Speed: 134.922616 samples/sec accuracy=81.800781 loss=0.680008 lr=0.003859 Epoch[057] Batch [1249]/[3760] Speed: 126.593589 samples/sec accuracy=81.736250 loss=0.682672 lr=0.003857 Epoch[057] Batch [1299]/[3760] Speed: 124.930932 samples/sec accuracy=81.747596 loss=0.682127 lr=0.003855 Epoch[057] Batch [1349]/[3760] Speed: 126.658595 samples/sec accuracy=81.682870 loss=0.684302 lr=0.003853 Epoch[057] Batch [1399]/[3760] Speed: 123.603106 samples/sec accuracy=81.632812 loss=0.685692 lr=0.003851 Epoch[057] Batch [1449]/[3760] Speed: 126.599034 samples/sec accuracy=81.571121 loss=0.687556 lr=0.003849 Epoch[057] Batch [1499]/[3760] Speed: 127.177132 samples/sec accuracy=81.573958 loss=0.687671 lr=0.003847 Epoch[057] Batch [1549]/[3760] Speed: 124.467942 samples/sec accuracy=81.555444 loss=0.688321 lr=0.003845 Epoch[057] Batch [1599]/[3760] Speed: 126.638415 samples/sec accuracy=81.519531 loss=0.689403 lr=0.003843 Epoch[057] Batch [1649]/[3760] Speed: 124.234981 samples/sec accuracy=81.494318 loss=0.689884 lr=0.003841 Epoch[057] Batch [1699]/[3760] Speed: 123.373117 samples/sec accuracy=81.509191 loss=0.689366 lr=0.003839 Epoch[057] Batch [1749]/[3760] Speed: 129.517768 samples/sec accuracy=81.480357 loss=0.689747 lr=0.003837 Epoch[057] Batch [1799]/[3760] Speed: 118.667639 samples/sec accuracy=81.494792 loss=0.689730 lr=0.003834 Epoch[057] Batch [1849]/[3760] Speed: 133.401405 samples/sec accuracy=81.463682 loss=0.691169 lr=0.003832 Epoch[057] Batch [1899]/[3760] Speed: 125.902564 samples/sec accuracy=81.444901 loss=0.691936 lr=0.003830 Epoch[057] Batch [1949]/[3760] Speed: 126.128342 samples/sec accuracy=81.443109 loss=0.691815 lr=0.003828 Epoch[057] Batch [1999]/[3760] Speed: 125.773379 samples/sec accuracy=81.425781 loss=0.692537 lr=0.003826 Epoch[057] Batch [2049]/[3760] Speed: 125.853593 samples/sec accuracy=81.399390 loss=0.693034 lr=0.003824 Epoch[057] Batch [2099]/[3760] Speed: 130.030013 samples/sec accuracy=81.414435 loss=0.692969 lr=0.003822 Epoch[057] Batch [2149]/[3760] Speed: 117.484174 samples/sec accuracy=81.384448 loss=0.694173 lr=0.003820 Epoch[057] Batch [2199]/[3760] Speed: 131.046923 samples/sec accuracy=81.359375 loss=0.695093 lr=0.003818 Epoch[057] Batch [2249]/[3760] Speed: 121.469124 samples/sec accuracy=81.356250 loss=0.695193 lr=0.003816 Epoch[057] Batch [2299]/[3760] Speed: 127.621286 samples/sec accuracy=81.334918 loss=0.696591 lr=0.003814 Epoch[057] Batch [2349]/[3760] Speed: 123.719907 samples/sec accuracy=81.307181 loss=0.697340 lr=0.003812 Epoch[057] Batch [2399]/[3760] Speed: 127.456048 samples/sec accuracy=81.273438 loss=0.698513 lr=0.003810 Epoch[057] Batch [2449]/[3760] Speed: 129.496192 samples/sec accuracy=81.247449 loss=0.699390 lr=0.003808 Epoch[057] Batch [2499]/[3760] Speed: 118.426802 samples/sec accuracy=81.240625 loss=0.699783 lr=0.003806 Epoch[057] Batch [2549]/[3760] Speed: 132.011905 samples/sec accuracy=81.234681 loss=0.699983 lr=0.003804 Epoch[057] Batch [2599]/[3760] Speed: 129.309694 samples/sec accuracy=81.232572 loss=0.700549 lr=0.003802 Epoch[057] Batch [2649]/[3760] Speed: 116.882147 samples/sec accuracy=81.244104 loss=0.700701 lr=0.003800 Epoch[057] Batch [2699]/[3760] Speed: 135.363850 samples/sec accuracy=81.204861 loss=0.701836 lr=0.003798 Epoch[057] Batch [2749]/[3760] Speed: 121.873290 samples/sec accuracy=81.202273 loss=0.701933 lr=0.003796 Epoch[057] Batch [2799]/[3760] Speed: 130.696922 samples/sec accuracy=81.184152 loss=0.702131 lr=0.003794 Epoch[057] Batch [2849]/[3760] Speed: 113.821550 samples/sec accuracy=81.176535 loss=0.702523 lr=0.003792 Epoch[057] Batch [2899]/[3760] Speed: 134.292944 samples/sec accuracy=81.163254 loss=0.703361 lr=0.003790 Epoch[057] Batch [2949]/[3760] Speed: 125.885715 samples/sec accuracy=81.165254 loss=0.703358 lr=0.003788 Epoch[057] Batch [2999]/[3760] Speed: 127.986433 samples/sec accuracy=81.152604 loss=0.703564 lr=0.003786 Epoch[057] Batch [3049]/[3760] Speed: 125.242375 samples/sec accuracy=81.153689 loss=0.703969 lr=0.003784 Epoch[057] Batch [3099]/[3760] Speed: 118.656835 samples/sec accuracy=81.139617 loss=0.704554 lr=0.003782 Epoch[057] Batch [3149]/[3760] Speed: 132.887263 samples/sec accuracy=81.112103 loss=0.705292 lr=0.003780 Epoch[057] Batch [3199]/[3760] Speed: 125.119040 samples/sec accuracy=81.088867 loss=0.705684 lr=0.003778 Epoch[057] Batch [3249]/[3760] Speed: 124.140137 samples/sec accuracy=81.090865 loss=0.705777 lr=0.003776 Epoch[057] Batch [3299]/[3760] Speed: 127.821025 samples/sec accuracy=81.083807 loss=0.706187 lr=0.003774 Epoch[057] Batch [3349]/[3760] Speed: 123.655090 samples/sec accuracy=81.078825 loss=0.706223 lr=0.003772 Epoch[057] Batch [3399]/[3760] Speed: 127.209974 samples/sec accuracy=81.065257 loss=0.706475 lr=0.003770 Epoch[057] Batch [3449]/[3760] Speed: 119.705846 samples/sec accuracy=81.052989 loss=0.706838 lr=0.003768 Epoch[057] Batch [3499]/[3760] Speed: 126.854916 samples/sec accuracy=81.047321 loss=0.706898 lr=0.003766 Epoch[057] Batch [3549]/[3760] Speed: 129.877186 samples/sec accuracy=81.035211 loss=0.707495 lr=0.003763 Epoch[057] Batch [3599]/[3760] Speed: 118.952471 samples/sec accuracy=81.017361 loss=0.708084 lr=0.003761 Epoch[057] Batch [3649]/[3760] Speed: 131.651511 samples/sec accuracy=80.998716 loss=0.708475 lr=0.003759 Epoch[057] Batch [3699]/[3760] Speed: 127.334499 samples/sec accuracy=80.981841 loss=0.709066 lr=0.003757 Epoch[057] Batch [3749]/[3760] Speed: 140.978398 samples/sec accuracy=80.978750 loss=0.709388 lr=0.003755 Batch [0049]/[0303]: acc-top1=65.000000 acc-top5=86.531250 Batch [0099]/[0303]: acc-top1=65.109375 acc-top5=86.000000 Batch [0149]/[0303]: acc-top1=64.781250 acc-top5=85.895833 Batch [0199]/[0303]: acc-top1=64.398438 acc-top5=85.687500 Batch [0249]/[0303]: acc-top1=64.587500 acc-top5=85.637500 Batch [0299]/[0303]: acc-top1=64.635417 acc-top5=85.520833 [Epoch 057] training: accuracy=80.972822 loss=0.709547 [Epoch 057] speed: 125 samples/sec time cost: 2105.801889 [Epoch 057] validation: acc-top1=64.614274 acc-top5=85.463078 loss=2.148936 Epoch[058] Batch [0049]/[3759] Speed: 89.990434 samples/sec accuracy=82.750000 loss=0.644282 lr=0.003753 Epoch[058] Batch [0099]/[3759] Speed: 133.300461 samples/sec accuracy=82.671875 loss=0.645464 lr=0.003751 Epoch[058] Batch [0149]/[3759] Speed: 117.544581 samples/sec accuracy=82.614583 loss=0.656789 lr=0.003749 Epoch[058] Batch [0199]/[3759] Speed: 127.214778 samples/sec accuracy=82.406250 loss=0.660019 lr=0.003747 Epoch[058] Batch [0249]/[3759] Speed: 131.901540 samples/sec accuracy=82.487500 loss=0.656439 lr=0.003745 Epoch[058] Batch [0299]/[3759] Speed: 116.153227 samples/sec accuracy=82.473958 loss=0.658134 lr=0.003743 Epoch[058] Batch [0349]/[3759] Speed: 134.001078 samples/sec accuracy=82.464286 loss=0.658921 lr=0.003741 Epoch[058] Batch [0399]/[3759] Speed: 121.586716 samples/sec accuracy=82.480469 loss=0.657950 lr=0.003739 Epoch[058] Batch [0449]/[3759] Speed: 130.604718 samples/sec accuracy=82.510417 loss=0.654191 lr=0.003737 Epoch[058] Batch [0499]/[3759] Speed: 122.201183 samples/sec accuracy=82.503125 loss=0.655733 lr=0.003735 Epoch[058] Batch [0549]/[3759] Speed: 123.357930 samples/sec accuracy=82.485795 loss=0.657060 lr=0.003733 Epoch[058] Batch [0599]/[3759] Speed: 131.430295 samples/sec accuracy=82.429688 loss=0.659112 lr=0.003731 Epoch[058] Batch [0649]/[3759] Speed: 122.515177 samples/sec accuracy=82.399038 loss=0.659950 lr=0.003729 Epoch[058] Batch [0699]/[3759] Speed: 125.594916 samples/sec accuracy=82.359375 loss=0.662311 lr=0.003727 Epoch[058] Batch [0749]/[3759] Speed: 125.456581 samples/sec accuracy=82.400000 loss=0.661159 lr=0.003725 Epoch[058] Batch [0799]/[3759] Speed: 120.852596 samples/sec accuracy=82.435547 loss=0.660277 lr=0.003723 Epoch[058] Batch [0849]/[3759] Speed: 133.940971 samples/sec accuracy=82.443015 loss=0.660198 lr=0.003721 Epoch[058] Batch [0899]/[3759] Speed: 123.638033 samples/sec accuracy=82.375000 loss=0.662846 lr=0.003719 Epoch[058] Batch [0949]/[3759] Speed: 123.896363 samples/sec accuracy=82.429276 loss=0.660301 lr=0.003717 Epoch[058] Batch [0999]/[3759] Speed: 128.880612 samples/sec accuracy=82.426563 loss=0.660319 lr=0.003715 Epoch[058] Batch [1049]/[3759] Speed: 124.584785 samples/sec accuracy=82.403274 loss=0.660142 lr=0.003713 Epoch[058] Batch [1099]/[3759] Speed: 121.028133 samples/sec accuracy=82.367898 loss=0.661400 lr=0.003711 Epoch[058] Batch [1149]/[3759] Speed: 132.744184 samples/sec accuracy=82.376359 loss=0.661545 lr=0.003709 Epoch[058] Batch [1199]/[3759] Speed: 128.812358 samples/sec accuracy=82.316406 loss=0.663614 lr=0.003706 Epoch[058] Batch [1249]/[3759] Speed: 115.078870 samples/sec accuracy=82.275000 loss=0.664473 lr=0.003704 Epoch[058] Batch [1299]/[3759] Speed: 135.426189 samples/sec accuracy=82.277644 loss=0.665301 lr=0.003702 Epoch[058] Batch [1349]/[3759] Speed: 128.223415 samples/sec accuracy=82.232639 loss=0.667076 lr=0.003700 Epoch[058] Batch [1399]/[3759] Speed: 120.947106 samples/sec accuracy=82.208705 loss=0.667859 lr=0.003698 Epoch[058] Batch [1449]/[3759] Speed: 126.415963 samples/sec accuracy=82.199353 loss=0.668381 lr=0.003696 Epoch[058] Batch [1499]/[3759] Speed: 123.467922 samples/sec accuracy=82.153125 loss=0.670129 lr=0.003694 Epoch[058] Batch [1549]/[3759] Speed: 127.281850 samples/sec accuracy=82.123992 loss=0.671660 lr=0.003692 Epoch[058] Batch [1599]/[3759] Speed: 126.748955 samples/sec accuracy=82.117188 loss=0.672812 lr=0.003690 Epoch[058] Batch [1649]/[3759] Speed: 124.183417 samples/sec accuracy=82.089962 loss=0.673666 lr=0.003688 Epoch[058] Batch [1699]/[3759] Speed: 129.286518 samples/sec accuracy=82.062500 loss=0.674599 lr=0.003686 Epoch[058] Batch [1749]/[3759] Speed: 123.762258 samples/sec accuracy=82.059821 loss=0.674866 lr=0.003684 Epoch[058] Batch [1799]/[3759] Speed: 124.440172 samples/sec accuracy=82.010417 loss=0.676328 lr=0.003682 Epoch[058] Batch [1849]/[3759] Speed: 132.420314 samples/sec accuracy=81.989020 loss=0.677077 lr=0.003680 Epoch[058] Batch [1899]/[3759] Speed: 120.060896 samples/sec accuracy=81.988487 loss=0.676731 lr=0.003678 Epoch[058] Batch [1949]/[3759] Speed: 133.509284 samples/sec accuracy=81.977564 loss=0.676928 lr=0.003676 Epoch[058] Batch [1999]/[3759] Speed: 117.559629 samples/sec accuracy=81.961719 loss=0.677975 lr=0.003674 Epoch[058] Batch [2049]/[3759] Speed: 133.125285 samples/sec accuracy=81.963415 loss=0.678189 lr=0.003672 Epoch[058] Batch [2099]/[3759] Speed: 125.707730 samples/sec accuracy=81.963542 loss=0.678014 lr=0.003670 Epoch[058] Batch [2149]/[3759] Speed: 119.210045 samples/sec accuracy=81.935320 loss=0.678532 lr=0.003668 Epoch[058] Batch [2199]/[3759] Speed: 132.325150 samples/sec accuracy=81.913352 loss=0.679336 lr=0.003666 Epoch[058] Batch [2249]/[3759] Speed: 120.530762 samples/sec accuracy=81.911111 loss=0.679722 lr=0.003664 Epoch[058] Batch [2299]/[3759] Speed: 129.889174 samples/sec accuracy=81.904212 loss=0.679893 lr=0.003662 Epoch[058] Batch [2349]/[3759] Speed: 125.983742 samples/sec accuracy=81.876330 loss=0.680614 lr=0.003660 Epoch[058] Batch [2399]/[3759] Speed: 122.379415 samples/sec accuracy=81.844401 loss=0.680942 lr=0.003658 Epoch[058] Batch [2449]/[3759] Speed: 132.010829 samples/sec accuracy=81.818240 loss=0.681923 lr=0.003656 Epoch[058] Batch [2499]/[3759] Speed: 119.832353 samples/sec accuracy=81.835000 loss=0.681509 lr=0.003654 Epoch[058] Batch [2549]/[3759] Speed: 130.275233 samples/sec accuracy=81.816176 loss=0.682372 lr=0.003652 Epoch[058] Batch [2599]/[3759] Speed: 119.218878 samples/sec accuracy=81.795072 loss=0.683561 lr=0.003650 Epoch[058] Batch [2649]/[3759] Speed: 131.868931 samples/sec accuracy=81.794811 loss=0.683701 lr=0.003648 Epoch[058] Batch [2699]/[3759] Speed: 124.676738 samples/sec accuracy=81.759838 loss=0.684720 lr=0.003646 Epoch[058] Batch [2749]/[3759] Speed: 128.411078 samples/sec accuracy=81.745455 loss=0.684779 lr=0.003644 Epoch[058] Batch [2799]/[3759] Speed: 124.566407 samples/sec accuracy=81.751116 loss=0.684750 lr=0.003642 Epoch[058] Batch [2849]/[3759] Speed: 126.444478 samples/sec accuracy=81.729167 loss=0.684950 lr=0.003640 Epoch[058] Batch [2899]/[3759] Speed: 124.592748 samples/sec accuracy=81.713362 loss=0.685403 lr=0.003638 Epoch[058] Batch [2949]/[3759] Speed: 124.395679 samples/sec accuracy=81.707627 loss=0.685260 lr=0.003636 Epoch[058] Batch [2999]/[3759] Speed: 123.703126 samples/sec accuracy=81.695312 loss=0.685858 lr=0.003634 Epoch[058] Batch [3049]/[3759] Speed: 130.413121 samples/sec accuracy=81.681352 loss=0.686427 lr=0.003632 Epoch[058] Batch [3099]/[3759] Speed: 120.401889 samples/sec accuracy=81.689012 loss=0.686360 lr=0.003630 Epoch[058] Batch [3149]/[3759] Speed: 131.094241 samples/sec accuracy=81.697421 loss=0.686350 lr=0.003628 Epoch[058] Batch [3199]/[3759] Speed: 113.773505 samples/sec accuracy=81.690430 loss=0.686670 lr=0.003626 Epoch[058] Batch [3249]/[3759] Speed: 136.413968 samples/sec accuracy=81.673558 loss=0.687346 lr=0.003624 Epoch[058] Batch [3299]/[3759] Speed: 119.000561 samples/sec accuracy=81.669981 loss=0.687653 lr=0.003622 Epoch[058] Batch [3349]/[3759] Speed: 128.095249 samples/sec accuracy=81.653918 loss=0.688138 lr=0.003620 Epoch[058] Batch [3399]/[3759] Speed: 131.837944 samples/sec accuracy=81.633732 loss=0.688717 lr=0.003618 Epoch[058] Batch [3449]/[3759] Speed: 113.490542 samples/sec accuracy=81.614130 loss=0.689542 lr=0.003616 Epoch[058] Batch [3499]/[3759] Speed: 134.128046 samples/sec accuracy=81.598661 loss=0.689774 lr=0.003614 Epoch[058] Batch [3549]/[3759] Speed: 127.451778 samples/sec accuracy=81.583187 loss=0.690465 lr=0.003612 Epoch[058] Batch [3599]/[3759] Speed: 120.179160 samples/sec accuracy=81.579861 loss=0.690902 lr=0.003610 Epoch[058] Batch [3649]/[3759] Speed: 122.825129 samples/sec accuracy=81.572774 loss=0.691117 lr=0.003608 Epoch[058] Batch [3699]/[3759] Speed: 124.463151 samples/sec accuracy=81.577280 loss=0.691211 lr=0.003606 Epoch[058] Batch [3749]/[3759] Speed: 149.992940 samples/sec accuracy=81.579167 loss=0.691655 lr=0.003604 Batch [0049]/[0303]: acc-top1=63.843750 acc-top5=86.156250 Batch [0099]/[0303]: acc-top1=64.656250 acc-top5=85.593750 Batch [0149]/[0303]: acc-top1=64.343750 acc-top5=85.083333 Batch [0199]/[0303]: acc-top1=64.070312 acc-top5=84.921875 Batch [0249]/[0303]: acc-top1=64.225000 acc-top5=84.875000 Batch [0299]/[0303]: acc-top1=64.135417 acc-top5=84.838542 [Epoch 058] training: accuracy=81.582535 loss=0.691580 [Epoch 058] speed: 125 samples/sec time cost: 2107.718805 [Epoch 058] validation: acc-top1=64.077970 acc-top5=84.823639 loss=2.208503 Epoch[059] Batch [0049]/[3760] Speed: 89.325360 samples/sec accuracy=84.125000 loss=0.611588 lr=0.003601 Epoch[059] Batch [0099]/[3760] Speed: 131.357625 samples/sec accuracy=83.171875 loss=0.630940 lr=0.003599 Epoch[059] Batch [0149]/[3760] Speed: 122.939999 samples/sec accuracy=82.739583 loss=0.644858 lr=0.003597 Epoch[059] Batch [0199]/[3760] Speed: 123.155463 samples/sec accuracy=82.968750 loss=0.638714 lr=0.003595 Epoch[059] Batch [0249]/[3760] Speed: 130.260762 samples/sec accuracy=82.981250 loss=0.640259 lr=0.003593 Epoch[059] Batch [0299]/[3760] Speed: 123.201796 samples/sec accuracy=83.057292 loss=0.634281 lr=0.003591 Epoch[059] Batch [0349]/[3760] Speed: 125.459067 samples/sec accuracy=83.129464 loss=0.632777 lr=0.003589 Epoch[059] Batch [0399]/[3760] Speed: 130.581864 samples/sec accuracy=83.042969 loss=0.637256 lr=0.003587 Epoch[059] Batch [0449]/[3760] Speed: 118.521647 samples/sec accuracy=82.975694 loss=0.640325 lr=0.003585 Epoch[059] Batch [0499]/[3760] Speed: 133.936111 samples/sec accuracy=83.021875 loss=0.638610 lr=0.003583 Epoch[059] Batch [0549]/[3760] Speed: 118.672975 samples/sec accuracy=83.031250 loss=0.639696 lr=0.003581 Epoch[059] Batch [0599]/[3760] Speed: 130.632293 samples/sec accuracy=82.973958 loss=0.642035 lr=0.003579 Epoch[059] Batch [0649]/[3760] Speed: 124.143940 samples/sec accuracy=82.896635 loss=0.642168 lr=0.003577 Epoch[059] Batch [0699]/[3760] Speed: 131.417558 samples/sec accuracy=82.892857 loss=0.642206 lr=0.003575 Epoch[059] Batch [0749]/[3760] Speed: 117.636813 samples/sec accuracy=82.827083 loss=0.645285 lr=0.003573 Epoch[059] Batch [0799]/[3760] Speed: 124.093626 samples/sec accuracy=82.865234 loss=0.644878 lr=0.003571 Epoch[059] Batch [0849]/[3760] Speed: 128.441918 samples/sec accuracy=82.799632 loss=0.646569 lr=0.003569 Epoch[059] Batch [0899]/[3760] Speed: 126.615504 samples/sec accuracy=82.795139 loss=0.646657 lr=0.003567 Epoch[059] Batch [0949]/[3760] Speed: 124.115979 samples/sec accuracy=82.713816 loss=0.648859 lr=0.003565 Epoch[059] Batch [0999]/[3760] Speed: 128.367302 samples/sec accuracy=82.768750 loss=0.647695 lr=0.003563 Epoch[059] Batch [1049]/[3760] Speed: 123.489533 samples/sec accuracy=82.819940 loss=0.646763 lr=0.003561 Epoch[059] Batch [1099]/[3760] Speed: 123.952842 samples/sec accuracy=82.789773 loss=0.647999 lr=0.003559 Epoch[059] Batch [1149]/[3760] Speed: 126.993233 samples/sec accuracy=82.732337 loss=0.649706 lr=0.003557 Epoch[059] Batch [1199]/[3760] Speed: 122.586567 samples/sec accuracy=82.664062 loss=0.650945 lr=0.003555 Epoch[059] Batch [1249]/[3760] Speed: 131.445155 samples/sec accuracy=82.640000 loss=0.652038 lr=0.003553 Epoch[059] Batch [1299]/[3760] Speed: 124.309095 samples/sec accuracy=82.622596 loss=0.652351 lr=0.003551 Epoch[059] Batch [1349]/[3760] Speed: 126.334290 samples/sec accuracy=82.618056 loss=0.653085 lr=0.003549 Epoch[059] Batch [1399]/[3760] Speed: 121.801446 samples/sec accuracy=82.568080 loss=0.655254 lr=0.003547 Epoch[059] Batch [1449]/[3760] Speed: 126.630589 samples/sec accuracy=82.572198 loss=0.654729 lr=0.003545 Epoch[059] Batch [1499]/[3760] Speed: 121.191590 samples/sec accuracy=82.557292 loss=0.654817 lr=0.003543 Epoch[059] Batch [1549]/[3760] Speed: 132.495627 samples/sec accuracy=82.552419 loss=0.655493 lr=0.003541 Epoch[059] Batch [1599]/[3760] Speed: 127.150041 samples/sec accuracy=82.536133 loss=0.656512 lr=0.003539 Epoch[059] Batch [1649]/[3760] Speed: 119.643476 samples/sec accuracy=82.489583 loss=0.658503 lr=0.003537 Epoch[059] Batch [1699]/[3760] Speed: 130.936164 samples/sec accuracy=82.487132 loss=0.658723 lr=0.003535 Epoch[059] Batch [1749]/[3760] Speed: 125.366512 samples/sec accuracy=82.502679 loss=0.658385 lr=0.003533 Epoch[059] Batch [1799]/[3760] Speed: 128.526163 samples/sec accuracy=82.459201 loss=0.659919 lr=0.003531 Epoch[059] Batch [1849]/[3760] Speed: 119.766841 samples/sec accuracy=82.441723 loss=0.660361 lr=0.003529 Epoch[059] Batch [1899]/[3760] Speed: 132.095668 samples/sec accuracy=82.413651 loss=0.661407 lr=0.003527 Epoch[059] Batch [1949]/[3760] Speed: 122.604419 samples/sec accuracy=82.446314 loss=0.660575 lr=0.003525 Epoch[059] Batch [1999]/[3760] Speed: 121.440787 samples/sec accuracy=82.420313 loss=0.662020 lr=0.003523 Epoch[059] Batch [2049]/[3760] Speed: 132.706042 samples/sec accuracy=82.417683 loss=0.662263 lr=0.003521 Epoch[059] Batch [2099]/[3760] Speed: 123.197211 samples/sec accuracy=82.404018 loss=0.663187 lr=0.003519 Epoch[059] Batch [2149]/[3760] Speed: 124.782304 samples/sec accuracy=82.390262 loss=0.663317 lr=0.003517 Epoch[059] Batch [2199]/[3760] Speed: 125.622503 samples/sec accuracy=82.382102 loss=0.663275 lr=0.003515 Epoch[059] Batch [2249]/[3760] Speed: 127.862973 samples/sec accuracy=82.358333 loss=0.664171 lr=0.003513 Epoch[059] Batch [2299]/[3760] Speed: 122.629173 samples/sec accuracy=82.343750 loss=0.664497 lr=0.003511 Epoch[059] Batch [2349]/[3760] Speed: 124.920260 samples/sec accuracy=82.301862 loss=0.665629 lr=0.003509 Epoch[059] Batch [2399]/[3760] Speed: 128.388811 samples/sec accuracy=82.285807 loss=0.666164 lr=0.003507 Epoch[059] Batch [2449]/[3760] Speed: 123.453084 samples/sec accuracy=82.274235 loss=0.666141 lr=0.003505 Epoch[059] Batch [2499]/[3760] Speed: 127.324173 samples/sec accuracy=82.256875 loss=0.666754 lr=0.003503 Epoch[059] Batch [2549]/[3760] Speed: 127.516501 samples/sec accuracy=82.243873 loss=0.666912 lr=0.003502 Epoch[059] Batch [2599]/[3760] Speed: 128.002699 samples/sec accuracy=82.228966 loss=0.667380 lr=0.003500 Epoch[059] Batch [2649]/[3760] Speed: 121.099008 samples/sec accuracy=82.205778 loss=0.667961 lr=0.003498 Epoch[059] Batch [2699]/[3760] Speed: 123.129738 samples/sec accuracy=82.180556 loss=0.668458 lr=0.003496 Epoch[059] Batch [2749]/[3760] Speed: 135.619712 samples/sec accuracy=82.171023 loss=0.668714 lr=0.003494 Epoch[059] Batch [2799]/[3760] Speed: 124.125670 samples/sec accuracy=82.167969 loss=0.668676 lr=0.003492 Epoch[059] Batch [2849]/[3760] Speed: 119.936538 samples/sec accuracy=82.156250 loss=0.669204 lr=0.003490 Epoch[059] Batch [2899]/[3760] Speed: 135.954295 samples/sec accuracy=82.128772 loss=0.669912 lr=0.003488 Epoch[059] Batch [2949]/[3760] Speed: 117.690195 samples/sec accuracy=82.096928 loss=0.670766 lr=0.003486 Epoch[059] Batch [2999]/[3760] Speed: 128.499627 samples/sec accuracy=82.086979 loss=0.671145 lr=0.003484 Epoch[059] Batch [3049]/[3760] Speed: 127.078419 samples/sec accuracy=82.093750 loss=0.671181 lr=0.003482 Epoch[059] Batch [3099]/[3760] Speed: 129.165206 samples/sec accuracy=82.094254 loss=0.671180 lr=0.003480 Epoch[059] Batch [3149]/[3760] Speed: 124.103368 samples/sec accuracy=82.079861 loss=0.671171 lr=0.003478 Epoch[059] Batch [3199]/[3760] Speed: 125.081424 samples/sec accuracy=82.089355 loss=0.671089 lr=0.003476 Epoch[059] Batch [3249]/[3760] Speed: 123.889848 samples/sec accuracy=82.067788 loss=0.671776 lr=0.003474 Epoch[059] Batch [3299]/[3760] Speed: 119.156895 samples/sec accuracy=82.065341 loss=0.671767 lr=0.003472 Epoch[059] Batch [3349]/[3760] Speed: 135.790534 samples/sec accuracy=82.078825 loss=0.671154 lr=0.003470 Epoch[059] Batch [3399]/[3760] Speed: 129.048040 samples/sec accuracy=82.095129 loss=0.670822 lr=0.003468 Epoch[059] Batch [3449]/[3760] Speed: 117.514170 samples/sec accuracy=82.070199 loss=0.671697 lr=0.003466 Epoch[059] Batch [3499]/[3760] Speed: 135.815750 samples/sec accuracy=82.057589 loss=0.672296 lr=0.003464 Epoch[059] Batch [3549]/[3760] Speed: 114.883610 samples/sec accuracy=82.052377 loss=0.672759 lr=0.003462 Epoch[059] Batch [3599]/[3760] Speed: 133.658091 samples/sec accuracy=82.052951 loss=0.673196 lr=0.003460 Epoch[059] Batch [3649]/[3760] Speed: 124.859993 samples/sec accuracy=82.044521 loss=0.673433 lr=0.003458 Epoch[059] Batch [3699]/[3760] Speed: 123.831941 samples/sec accuracy=82.025760 loss=0.674118 lr=0.003456 Epoch[059] Batch [3749]/[3760] Speed: 139.582106 samples/sec accuracy=82.017083 loss=0.674402 lr=0.003454 Batch [0049]/[0303]: acc-top1=65.531250 acc-top5=86.031250 Batch [0099]/[0303]: acc-top1=65.343750 acc-top5=85.812500 Batch [0149]/[0303]: acc-top1=65.135417 acc-top5=85.645833 Batch [0199]/[0303]: acc-top1=64.593750 acc-top5=85.554688 Batch [0249]/[0303]: acc-top1=64.825000 acc-top5=85.550000 Batch [0299]/[0303]: acc-top1=64.588542 acc-top5=85.427083 [Epoch 059] training: accuracy=82.015043 loss=0.674563 [Epoch 059] speed: 125 samples/sec time cost: 2107.897296 [Epoch 059] validation: acc-top1=64.526609 acc-top5=85.370256 loss=2.109649 Epoch[060] Batch [0049]/[3760] Speed: 90.309913 samples/sec accuracy=83.312500 loss=0.621051 lr=0.003451 Epoch[060] Batch [0099]/[3760] Speed: 132.126061 samples/sec accuracy=83.171875 loss=0.624010 lr=0.003449 Epoch[060] Batch [0149]/[3760] Speed: 120.481744 samples/sec accuracy=83.260417 loss=0.621460 lr=0.003447 Epoch[060] Batch [0199]/[3760] Speed: 128.887511 samples/sec accuracy=83.531250 loss=0.616431 lr=0.003445 Epoch[060] Batch [0249]/[3760] Speed: 121.679039 samples/sec accuracy=83.331250 loss=0.623287 lr=0.003443 Epoch[060] Batch [0299]/[3760] Speed: 128.871574 samples/sec accuracy=83.364583 loss=0.622594 lr=0.003441 Epoch[060] Batch [0349]/[3760] Speed: 119.470461 samples/sec accuracy=83.482143 loss=0.623327 lr=0.003439 Epoch[060] Batch [0399]/[3760] Speed: 130.493394 samples/sec accuracy=83.628906 loss=0.617317 lr=0.003437 Epoch[060] Batch [0449]/[3760] Speed: 125.953627 samples/sec accuracy=83.652778 loss=0.617332 lr=0.003435 Epoch[060] Batch [0499]/[3760] Speed: 119.656836 samples/sec accuracy=83.546875 loss=0.620320 lr=0.003433 Epoch[060] Batch [0549]/[3760] Speed: 134.624176 samples/sec accuracy=83.423295 loss=0.623135 lr=0.003432 Epoch[060] Batch [0599]/[3760] Speed: 120.869771 samples/sec accuracy=83.390625 loss=0.622886 lr=0.003430 Epoch[060] Batch [0649]/[3760] Speed: 128.862798 samples/sec accuracy=83.362981 loss=0.623132 lr=0.003428 Epoch[060] Batch [0699]/[3760] Speed: 125.186023 samples/sec accuracy=83.312500 loss=0.625264 lr=0.003426 Epoch[060] Batch [0749]/[3760] Speed: 124.152574 samples/sec accuracy=83.250000 loss=0.626745 lr=0.003424 Epoch[060] Batch [0799]/[3760] Speed: 123.121520 samples/sec accuracy=83.201172 loss=0.628681 lr=0.003422 Epoch[060] Batch [0849]/[3760] Speed: 131.047014 samples/sec accuracy=83.194853 loss=0.629421 lr=0.003420 Epoch[060] Batch [0899]/[3760] Speed: 118.505275 samples/sec accuracy=83.194444 loss=0.630980 lr=0.003418 Epoch[060] Batch [0949]/[3760] Speed: 131.355780 samples/sec accuracy=83.159539 loss=0.632526 lr=0.003416 Epoch[060] Batch [0999]/[3760] Speed: 126.061809 samples/sec accuracy=83.103125 loss=0.634868 lr=0.003414 Epoch[060] Batch [1049]/[3760] Speed: 121.880969 samples/sec accuracy=83.089286 loss=0.636340 lr=0.003412 Epoch[060] Batch [1099]/[3760] Speed: 132.932668 samples/sec accuracy=83.012784 loss=0.637767 lr=0.003410 Epoch[060] Batch [1149]/[3760] Speed: 121.334526 samples/sec accuracy=83.009511 loss=0.637575 lr=0.003408 Epoch[060] Batch [1199]/[3760] Speed: 126.683225 samples/sec accuracy=82.988281 loss=0.637655 lr=0.003406 Epoch[060] Batch [1249]/[3760] Speed: 129.314500 samples/sec accuracy=82.960000 loss=0.637266 lr=0.003404 Epoch[060] Batch [1299]/[3760] Speed: 118.657952 samples/sec accuracy=82.935096 loss=0.638081 lr=0.003402 Epoch[060] Batch [1349]/[3760] Speed: 133.604616 samples/sec accuracy=82.931713 loss=0.638657 lr=0.003400 Epoch[060] Batch [1399]/[3760] Speed: 117.095201 samples/sec accuracy=82.944196 loss=0.638487 lr=0.003398 Epoch[060] Batch [1449]/[3760] Speed: 128.607895 samples/sec accuracy=82.959052 loss=0.638833 lr=0.003396 Epoch[060] Batch [1499]/[3760] Speed: 129.042771 samples/sec accuracy=82.912500 loss=0.640783 lr=0.003394 Epoch[060] Batch [1549]/[3760] Speed: 125.395461 samples/sec accuracy=82.868952 loss=0.641829 lr=0.003392 Epoch[060] Batch [1599]/[3760] Speed: 124.791724 samples/sec accuracy=82.935547 loss=0.639278 lr=0.003390 Epoch[060] Batch [1649]/[3760] Speed: 125.854937 samples/sec accuracy=82.923295 loss=0.639796 lr=0.003388 Epoch[060] Batch [1699]/[3760] Speed: 119.868540 samples/sec accuracy=82.945772 loss=0.639882 lr=0.003386 Epoch[060] Batch [1749]/[3760] Speed: 135.506089 samples/sec accuracy=82.958036 loss=0.639551 lr=0.003384 Epoch[060] Batch [1799]/[3760] Speed: 120.847567 samples/sec accuracy=82.930556 loss=0.640297 lr=0.003382 Epoch[060] Batch [1849]/[3760] Speed: 129.400351 samples/sec accuracy=82.900338 loss=0.641090 lr=0.003380 Epoch[060] Batch [1899]/[3760] Speed: 124.157026 samples/sec accuracy=82.885691 loss=0.641751 lr=0.003378 Epoch[060] Batch [1949]/[3760] Speed: 124.190307 samples/sec accuracy=82.850962 loss=0.642571 lr=0.003376 Epoch[060] Batch [1999]/[3760] Speed: 125.078040 samples/sec accuracy=82.852344 loss=0.642849 lr=0.003374 Epoch[060] Batch [2049]/[3760] Speed: 127.084894 samples/sec accuracy=82.842226 loss=0.643713 lr=0.003372 Epoch[060] Batch [2099]/[3760] Speed: 130.311353 samples/sec accuracy=82.842262 loss=0.643776 lr=0.003370 Epoch[060] Batch [2149]/[3760] Speed: 122.961210 samples/sec accuracy=82.827035 loss=0.644606 lr=0.003368 Epoch[060] Batch [2199]/[3760] Speed: 123.230611 samples/sec accuracy=82.810369 loss=0.644992 lr=0.003366 Epoch[060] Batch [2249]/[3760] Speed: 129.969691 samples/sec accuracy=82.791667 loss=0.645383 lr=0.003364 Epoch[060] Batch [2299]/[3760] Speed: 123.467881 samples/sec accuracy=82.805027 loss=0.645368 lr=0.003362 Epoch[060] Batch [2349]/[3760] Speed: 125.617731 samples/sec accuracy=82.761968 loss=0.646796 lr=0.003360 Epoch[060] Batch [2399]/[3760] Speed: 127.120597 samples/sec accuracy=82.742839 loss=0.647057 lr=0.003358 Epoch[060] Batch [2449]/[3760] Speed: 123.488466 samples/sec accuracy=82.754464 loss=0.646992 lr=0.003356 Epoch[060] Batch [2499]/[3760] Speed: 126.067351 samples/sec accuracy=82.754375 loss=0.647124 lr=0.003354 Epoch[060] Batch [2549]/[3760] Speed: 123.716673 samples/sec accuracy=82.745098 loss=0.647267 lr=0.003352 Epoch[060] Batch [2599]/[3760] Speed: 123.215523 samples/sec accuracy=82.722957 loss=0.647204 lr=0.003350 Epoch[060] Batch [2649]/[3760] Speed: 131.966436 samples/sec accuracy=82.704009 loss=0.647869 lr=0.003348 Epoch[060] Batch [2699]/[3760] Speed: 122.638948 samples/sec accuracy=82.673032 loss=0.648913 lr=0.003346 Epoch[060] Batch [2749]/[3760] Speed: 126.073894 samples/sec accuracy=82.668182 loss=0.649193 lr=0.003344 Epoch[060] Batch [2799]/[3760] Speed: 127.562761 samples/sec accuracy=82.667969 loss=0.649201 lr=0.003343 Epoch[060] Batch [2849]/[3760] Speed: 131.994139 samples/sec accuracy=82.658991 loss=0.649539 lr=0.003341 Epoch[060] Batch [2899]/[3760] Speed: 117.021404 samples/sec accuracy=82.639547 loss=0.650277 lr=0.003339 Epoch[060] Batch [2949]/[3760] Speed: 128.380907 samples/sec accuracy=82.633475 loss=0.650519 lr=0.003337 Epoch[060] Batch [2999]/[3760] Speed: 127.670349 samples/sec accuracy=82.627083 loss=0.650953 lr=0.003335 Epoch[060] Batch [3049]/[3760] Speed: 127.239526 samples/sec accuracy=82.624488 loss=0.650915 lr=0.003333 Epoch[060] Batch [3099]/[3760] Speed: 123.825167 samples/sec accuracy=82.601310 loss=0.651859 lr=0.003331 Epoch[060] Batch [3149]/[3760] Speed: 127.452295 samples/sec accuracy=82.584325 loss=0.652421 lr=0.003329 Epoch[060] Batch [3199]/[3760] Speed: 121.748197 samples/sec accuracy=82.557617 loss=0.653473 lr=0.003327 Epoch[060] Batch [3249]/[3760] Speed: 127.592686 samples/sec accuracy=82.561538 loss=0.653141 lr=0.003325 Epoch[060] Batch [3299]/[3760] Speed: 127.523439 samples/sec accuracy=82.517519 loss=0.654316 lr=0.003323 Epoch[060] Batch [3349]/[3760] Speed: 121.039010 samples/sec accuracy=82.504198 loss=0.654956 lr=0.003321 Epoch[060] Batch [3399]/[3760] Speed: 132.144599 samples/sec accuracy=82.498621 loss=0.655056 lr=0.003319 Epoch[060] Batch [3449]/[3760] Speed: 118.057605 samples/sec accuracy=82.484601 loss=0.655515 lr=0.003317 Epoch[060] Batch [3499]/[3760] Speed: 133.311322 samples/sec accuracy=82.470982 loss=0.656187 lr=0.003315 Epoch[060] Batch [3549]/[3760] Speed: 119.251478 samples/sec accuracy=82.456426 loss=0.656694 lr=0.003313 Epoch[060] Batch [3599]/[3760] Speed: 131.344688 samples/sec accuracy=82.464410 loss=0.656742 lr=0.003311 Epoch[060] Batch [3649]/[3760] Speed: 127.446619 samples/sec accuracy=82.450342 loss=0.657172 lr=0.003309 Epoch[060] Batch [3699]/[3760] Speed: 122.749365 samples/sec accuracy=82.437922 loss=0.657728 lr=0.003307 Epoch[060] Batch [3749]/[3760] Speed: 143.229242 samples/sec accuracy=82.436250 loss=0.658170 lr=0.003305 Batch [0049]/[0303]: acc-top1=65.437500 acc-top5=86.468750 Batch [0099]/[0303]: acc-top1=66.093750 acc-top5=86.203125 Batch [0149]/[0303]: acc-top1=65.635417 acc-top5=85.937500 Batch [0199]/[0303]: acc-top1=65.046875 acc-top5=85.710938 Batch [0249]/[0303]: acc-top1=65.100000 acc-top5=85.731250 Batch [0299]/[0303]: acc-top1=65.052083 acc-top5=85.708333 [Epoch 060] training: accuracy=82.434342 loss=0.658132 [Epoch 060] speed: 125 samples/sec time cost: 2105.551659 [Epoch 060] validation: acc-top1=65.001031 acc-top5=85.643564 loss=2.162462 Epoch[061] Batch [0049]/[3759] Speed: 88.788665 samples/sec accuracy=84.687500 loss=0.578294 lr=0.003303 Epoch[061] Batch [0099]/[3759] Speed: 129.586731 samples/sec accuracy=84.515625 loss=0.583950 lr=0.003301 Epoch[061] Batch [0149]/[3759] Speed: 128.648564 samples/sec accuracy=84.104167 loss=0.585839 lr=0.003299 Epoch[061] Batch [0199]/[3759] Speed: 118.571000 samples/sec accuracy=83.703125 loss=0.594022 lr=0.003297 Epoch[061] Batch [0249]/[3759] Speed: 133.623491 samples/sec accuracy=83.681250 loss=0.596241 lr=0.003295 Epoch[061] Batch [0299]/[3759] Speed: 120.789914 samples/sec accuracy=83.723958 loss=0.602206 lr=0.003293 Epoch[061] Batch [0349]/[3759] Speed: 120.881564 samples/sec accuracy=83.669643 loss=0.603781 lr=0.003291 Epoch[061] Batch [0399]/[3759] Speed: 133.715025 samples/sec accuracy=83.578125 loss=0.607646 lr=0.003289 Epoch[061] Batch [0449]/[3759] Speed: 126.463948 samples/sec accuracy=83.510417 loss=0.609114 lr=0.003287 Epoch[061] Batch [0499]/[3759] Speed: 121.648037 samples/sec accuracy=83.475000 loss=0.608604 lr=0.003285 Epoch[061] Batch [0549]/[3759] Speed: 130.385771 samples/sec accuracy=83.468750 loss=0.609763 lr=0.003283 Epoch[061] Batch [0599]/[3759] Speed: 123.469069 samples/sec accuracy=83.463542 loss=0.610780 lr=0.003281 Epoch[061] Batch [0649]/[3759] Speed: 129.109092 samples/sec accuracy=83.545673 loss=0.607950 lr=0.003279 Epoch[061] Batch [0699]/[3759] Speed: 122.952952 samples/sec accuracy=83.495536 loss=0.609598 lr=0.003277 Epoch[061] Batch [0749]/[3759] Speed: 122.260408 samples/sec accuracy=83.458333 loss=0.610179 lr=0.003275 Epoch[061] Batch [0799]/[3759] Speed: 129.249114 samples/sec accuracy=83.435547 loss=0.611100 lr=0.003273 Epoch[061] Batch [0849]/[3759] Speed: 124.377112 samples/sec accuracy=83.354779 loss=0.613832 lr=0.003271 Epoch[061] Batch [0899]/[3759] Speed: 121.785808 samples/sec accuracy=83.315972 loss=0.615370 lr=0.003269 Epoch[061] Batch [0949]/[3759] Speed: 124.970478 samples/sec accuracy=83.309211 loss=0.615431 lr=0.003267 Epoch[061] Batch [0999]/[3759] Speed: 125.645560 samples/sec accuracy=83.351562 loss=0.615268 lr=0.003265 Epoch[061] Batch [1049]/[3759] Speed: 130.395350 samples/sec accuracy=83.352679 loss=0.615660 lr=0.003264 Epoch[061] Batch [1099]/[3759] Speed: 122.281203 samples/sec accuracy=83.339489 loss=0.615711 lr=0.003262 Epoch[061] Batch [1149]/[3759] Speed: 126.775530 samples/sec accuracy=83.313859 loss=0.616340 lr=0.003260 Epoch[061] Batch [1199]/[3759] Speed: 125.034781 samples/sec accuracy=83.259115 loss=0.617537 lr=0.003258 Epoch[061] Batch [1249]/[3759] Speed: 124.780114 samples/sec accuracy=83.273750 loss=0.618630 lr=0.003256 Epoch[061] Batch [1299]/[3759] Speed: 128.764190 samples/sec accuracy=83.282452 loss=0.618394 lr=0.003254 Epoch[061] Batch [1349]/[3759] Speed: 119.976778 samples/sec accuracy=83.293981 loss=0.618354 lr=0.003252 Epoch[061] Batch [1399]/[3759] Speed: 129.229890 samples/sec accuracy=83.276786 loss=0.619063 lr=0.003250 Epoch[061] Batch [1449]/[3759] Speed: 119.833721 samples/sec accuracy=83.235991 loss=0.619607 lr=0.003248 Epoch[061] Batch [1499]/[3759] Speed: 132.016860 samples/sec accuracy=83.237500 loss=0.620119 lr=0.003246 Epoch[061] Batch [1549]/[3759] Speed: 127.960483 samples/sec accuracy=83.199597 loss=0.621238 lr=0.003244 Epoch[061] Batch [1599]/[3759] Speed: 116.909989 samples/sec accuracy=83.160156 loss=0.622619 lr=0.003242 Epoch[061] Batch [1649]/[3759] Speed: 132.674556 samples/sec accuracy=83.157197 loss=0.622782 lr=0.003240 Epoch[061] Batch [1699]/[3759] Speed: 131.339318 samples/sec accuracy=83.136949 loss=0.623735 lr=0.003238 Epoch[061] Batch [1749]/[3759] Speed: 118.929262 samples/sec accuracy=83.126786 loss=0.624035 lr=0.003236 Epoch[061] Batch [1799]/[3759] Speed: 129.647843 samples/sec accuracy=83.100694 loss=0.624674 lr=0.003234 Epoch[061] Batch [1849]/[3759] Speed: 119.294087 samples/sec accuracy=83.096284 loss=0.625124 lr=0.003232 Epoch[061] Batch [1899]/[3759] Speed: 130.605030 samples/sec accuracy=83.115132 loss=0.624824 lr=0.003230 Epoch[061] Batch [1949]/[3759] Speed: 124.154241 samples/sec accuracy=83.115385 loss=0.625132 lr=0.003228 Epoch[061] Batch [1999]/[3759] Speed: 125.121018 samples/sec accuracy=83.127344 loss=0.624977 lr=0.003226 Epoch[061] Batch [2049]/[3759] Speed: 127.285513 samples/sec accuracy=83.102896 loss=0.625774 lr=0.003224 Epoch[061] Batch [2099]/[3759] Speed: 125.708681 samples/sec accuracy=83.107887 loss=0.626186 lr=0.003222 Epoch[061] Batch [2149]/[3759] Speed: 129.898114 samples/sec accuracy=83.066860 loss=0.627858 lr=0.003220 Epoch[061] Batch [2199]/[3759] Speed: 119.990305 samples/sec accuracy=83.045455 loss=0.628730 lr=0.003219 Epoch[061] Batch [2249]/[3759] Speed: 126.351581 samples/sec accuracy=83.042361 loss=0.628897 lr=0.003217 Epoch[061] Batch [2299]/[3759] Speed: 123.979906 samples/sec accuracy=83.039402 loss=0.628882 lr=0.003215 Epoch[061] Batch [2349]/[3759] Speed: 133.460370 samples/sec accuracy=83.035904 loss=0.628955 lr=0.003213 Epoch[061] Batch [2399]/[3759] Speed: 119.102116 samples/sec accuracy=83.037760 loss=0.628967 lr=0.003211 Epoch[061] Batch [2449]/[3759] Speed: 126.921961 samples/sec accuracy=83.061224 loss=0.628822 lr=0.003209 Epoch[061] Batch [2499]/[3759] Speed: 129.546860 samples/sec accuracy=83.072500 loss=0.628695 lr=0.003207 Epoch[061] Batch [2549]/[3759] Speed: 121.780326 samples/sec accuracy=83.082108 loss=0.628940 lr=0.003205 Epoch[061] Batch [2599]/[3759] Speed: 126.333633 samples/sec accuracy=83.034856 loss=0.630380 lr=0.003203 Epoch[061] Batch [2649]/[3759] Speed: 129.979611 samples/sec accuracy=83.022406 loss=0.630799 lr=0.003201 Epoch[061] Batch [2699]/[3759] Speed: 117.564770 samples/sec accuracy=83.020833 loss=0.631126 lr=0.003199 Epoch[061] Batch [2749]/[3759] Speed: 131.590948 samples/sec accuracy=83.010795 loss=0.631833 lr=0.003197 Epoch[061] Batch [2799]/[3759] Speed: 121.592778 samples/sec accuracy=83.000000 loss=0.632298 lr=0.003195 Epoch[061] Batch [2849]/[3759] Speed: 127.153780 samples/sec accuracy=82.986294 loss=0.632534 lr=0.003193 Epoch[061] Batch [2899]/[3759] Speed: 130.507021 samples/sec accuracy=82.987069 loss=0.632267 lr=0.003191 Epoch[061] Batch [2949]/[3759] Speed: 118.252959 samples/sec accuracy=82.982521 loss=0.632302 lr=0.003189 Epoch[061] Batch [2999]/[3759] Speed: 133.824648 samples/sec accuracy=82.965625 loss=0.633080 lr=0.003187 Epoch[061] Batch [3049]/[3759] Speed: 118.562536 samples/sec accuracy=82.967213 loss=0.632803 lr=0.003185 Epoch[061] Batch [3099]/[3759] Speed: 128.920835 samples/sec accuracy=82.956653 loss=0.633188 lr=0.003183 Epoch[061] Batch [3149]/[3759] Speed: 131.033703 samples/sec accuracy=82.951885 loss=0.633446 lr=0.003181 Epoch[061] Batch [3199]/[3759] Speed: 121.919773 samples/sec accuracy=82.957031 loss=0.633379 lr=0.003180 Epoch[061] Batch [3249]/[3759] Speed: 125.443950 samples/sec accuracy=82.953846 loss=0.633671 lr=0.003178 Epoch[061] Batch [3299]/[3759] Speed: 121.111413 samples/sec accuracy=82.932292 loss=0.634647 lr=0.003176 Epoch[061] Batch [3349]/[3759] Speed: 130.027753 samples/sec accuracy=82.923507 loss=0.635213 lr=0.003174 Epoch[061] Batch [3399]/[3759] Speed: 126.717799 samples/sec accuracy=82.938879 loss=0.635089 lr=0.003172 Epoch[061] Batch [3449]/[3759] Speed: 129.356745 samples/sec accuracy=82.931612 loss=0.635376 lr=0.003170 Epoch[061] Batch [3499]/[3759] Speed: 121.086593 samples/sec accuracy=82.932589 loss=0.635140 lr=0.003168 Epoch[061] Batch [3549]/[3759] Speed: 126.097487 samples/sec accuracy=82.926056 loss=0.635169 lr=0.003166 Epoch[061] Batch [3599]/[3759] Speed: 123.557046 samples/sec accuracy=82.926649 loss=0.635547 lr=0.003164 Epoch[061] Batch [3649]/[3759] Speed: 124.131298 samples/sec accuracy=82.926798 loss=0.635846 lr=0.003162 Epoch[061] Batch [3699]/[3759] Speed: 128.737373 samples/sec accuracy=82.926098 loss=0.635852 lr=0.003160 Epoch[061] Batch [3749]/[3759] Speed: 143.827961 samples/sec accuracy=82.899167 loss=0.636754 lr=0.003158 Batch [0049]/[0303]: acc-top1=64.968750 acc-top5=86.093750 Batch [0099]/[0303]: acc-top1=65.390625 acc-top5=86.000000 Batch [0149]/[0303]: acc-top1=64.979167 acc-top5=85.625000 Batch [0199]/[0303]: acc-top1=64.742188 acc-top5=85.445312 Batch [0249]/[0303]: acc-top1=64.912500 acc-top5=85.481250 Batch [0299]/[0303]: acc-top1=64.843750 acc-top5=85.468750 [Epoch 061] training: accuracy=82.892308 loss=0.636893 [Epoch 061] speed: 125 samples/sec time cost: 2108.337156 [Epoch 061] validation: acc-top1=64.774134 acc-top5=85.442450 loss=2.206588 Epoch[062] Batch [0049]/[3760] Speed: 88.859584 samples/sec accuracy=85.218750 loss=0.572182 lr=0.003156 Epoch[062] Batch [0099]/[3760] Speed: 132.450800 samples/sec accuracy=84.890625 loss=0.583100 lr=0.003154 Epoch[062] Batch [0149]/[3760] Speed: 120.824764 samples/sec accuracy=84.708333 loss=0.582447 lr=0.003152 Epoch[062] Batch [0199]/[3760] Speed: 128.434452 samples/sec accuracy=84.359375 loss=0.595403 lr=0.003150 Epoch[062] Batch [0249]/[3760] Speed: 124.552673 samples/sec accuracy=84.393750 loss=0.589473 lr=0.003148 Epoch[062] Batch [0299]/[3760] Speed: 123.050883 samples/sec accuracy=84.223958 loss=0.592938 lr=0.003146 Epoch[062] Batch [0349]/[3760] Speed: 130.914675 samples/sec accuracy=84.281250 loss=0.591779 lr=0.003144 Epoch[062] Batch [0399]/[3760] Speed: 116.269110 samples/sec accuracy=84.421875 loss=0.590627 lr=0.003142 Epoch[062] Batch [0449]/[3760] Speed: 134.150722 samples/sec accuracy=84.378472 loss=0.591752 lr=0.003140 Epoch[062] Batch [0499]/[3760] Speed: 124.006831 samples/sec accuracy=84.346875 loss=0.591833 lr=0.003138 Epoch[062] Batch [0549]/[3760] Speed: 127.588044 samples/sec accuracy=84.346591 loss=0.588826 lr=0.003136 Epoch[062] Batch [0599]/[3760] Speed: 125.334969 samples/sec accuracy=84.268229 loss=0.589862 lr=0.003135 Epoch[062] Batch [0649]/[3760] Speed: 122.695446 samples/sec accuracy=84.194712 loss=0.591081 lr=0.003133 Epoch[062] Batch [0699]/[3760] Speed: 129.869605 samples/sec accuracy=84.218750 loss=0.589299 lr=0.003131 Epoch[062] Batch [0749]/[3760] Speed: 124.946598 samples/sec accuracy=84.216667 loss=0.589405 lr=0.003129 Epoch[062] Batch [0799]/[3760] Speed: 125.457535 samples/sec accuracy=84.175781 loss=0.590830 lr=0.003127 Epoch[062] Batch [0849]/[3760] Speed: 126.763099 samples/sec accuracy=84.147059 loss=0.592154 lr=0.003125 Epoch[062] Batch [0899]/[3760] Speed: 126.382553 samples/sec accuracy=84.154514 loss=0.591848 lr=0.003123 Epoch[062] Batch [0949]/[3760] Speed: 122.825221 samples/sec accuracy=84.133224 loss=0.591775 lr=0.003121 Epoch[062] Batch [0999]/[3760] Speed: 122.319436 samples/sec accuracy=84.082813 loss=0.595060 lr=0.003119 Epoch[062] Batch [1049]/[3760] Speed: 125.500842 samples/sec accuracy=84.040179 loss=0.596788 lr=0.003117 Epoch[062] Batch [1099]/[3760] Speed: 128.956208 samples/sec accuracy=83.970170 loss=0.599803 lr=0.003115 Epoch[062] Batch [1149]/[3760] Speed: 127.661871 samples/sec accuracy=83.966033 loss=0.599587 lr=0.003113 Epoch[062] Batch [1199]/[3760] Speed: 122.719278 samples/sec accuracy=83.976562 loss=0.598416 lr=0.003111 Epoch[062] Batch [1249]/[3760] Speed: 124.405778 samples/sec accuracy=83.953750 loss=0.599004 lr=0.003109 Epoch[062] Batch [1299]/[3760] Speed: 126.295846 samples/sec accuracy=83.920673 loss=0.599686 lr=0.003107 Epoch[062] Batch [1349]/[3760] Speed: 122.332450 samples/sec accuracy=83.913194 loss=0.600133 lr=0.003105 Epoch[062] Batch [1399]/[3760] Speed: 131.889292 samples/sec accuracy=83.898438 loss=0.600205 lr=0.003104 Epoch[062] Batch [1449]/[3760] Speed: 121.919635 samples/sec accuracy=83.895474 loss=0.601205 lr=0.003102 Epoch[062] Batch [1499]/[3760] Speed: 124.647839 samples/sec accuracy=83.903125 loss=0.600417 lr=0.003100 Epoch[062] Batch [1549]/[3760] Speed: 136.567863 samples/sec accuracy=83.890121 loss=0.601089 lr=0.003098 Epoch[062] Batch [1599]/[3760] Speed: 113.844746 samples/sec accuracy=83.836914 loss=0.602483 lr=0.003096 Epoch[062] Batch [1649]/[3760] Speed: 132.133149 samples/sec accuracy=83.805871 loss=0.603641 lr=0.003094 Epoch[062] Batch [1699]/[3760] Speed: 125.805727 samples/sec accuracy=83.802390 loss=0.603432 lr=0.003092 Epoch[062] Batch [1749]/[3760] Speed: 119.492185 samples/sec accuracy=83.774107 loss=0.604191 lr=0.003090 Epoch[062] Batch [1799]/[3760] Speed: 130.475337 samples/sec accuracy=83.769097 loss=0.604725 lr=0.003088 Epoch[062] Batch [1849]/[3760] Speed: 124.731064 samples/sec accuracy=83.708615 loss=0.606608 lr=0.003086 Epoch[062] Batch [1899]/[3760] Speed: 124.690430 samples/sec accuracy=83.688322 loss=0.607592 lr=0.003084 Epoch[062] Batch [1949]/[3760] Speed: 129.593355 samples/sec accuracy=83.658654 loss=0.608329 lr=0.003082 Epoch[062] Batch [1999]/[3760] Speed: 121.152019 samples/sec accuracy=83.643750 loss=0.608847 lr=0.003080 Epoch[062] Batch [2049]/[3760] Speed: 133.400337 samples/sec accuracy=83.634146 loss=0.609608 lr=0.003078 Epoch[062] Batch [2099]/[3760] Speed: 116.388788 samples/sec accuracy=83.618304 loss=0.609806 lr=0.003077 Epoch[062] Batch [2149]/[3760] Speed: 127.300858 samples/sec accuracy=83.575581 loss=0.611349 lr=0.003075 Epoch[062] Batch [2199]/[3760] Speed: 122.797599 samples/sec accuracy=83.588778 loss=0.611217 lr=0.003073 Epoch[062] Batch [2249]/[3760] Speed: 127.271594 samples/sec accuracy=83.546528 loss=0.612604 lr=0.003071 Epoch[062] Batch [2299]/[3760] Speed: 132.721218 samples/sec accuracy=83.533967 loss=0.612768 lr=0.003069 Epoch[062] Batch [2349]/[3760] Speed: 122.415341 samples/sec accuracy=83.523936 loss=0.613143 lr=0.003067 Epoch[062] Batch [2399]/[3760] Speed: 128.028844 samples/sec accuracy=83.500000 loss=0.614183 lr=0.003065 Epoch[062] Batch [2449]/[3760] Speed: 119.694282 samples/sec accuracy=83.485969 loss=0.614813 lr=0.003063 Epoch[062] Batch [2499]/[3760] Speed: 128.164151 samples/sec accuracy=83.496875 loss=0.614449 lr=0.003061 Epoch[062] Batch [2549]/[3760] Speed: 128.667196 samples/sec accuracy=83.496936 loss=0.614920 lr=0.003059 Epoch[062] Batch [2599]/[3760] Speed: 122.715740 samples/sec accuracy=83.490986 loss=0.614999 lr=0.003057 Epoch[062] Batch [2649]/[3760] Speed: 127.224084 samples/sec accuracy=83.500590 loss=0.614834 lr=0.003055 Epoch[062] Batch [2699]/[3760] Speed: 122.782522 samples/sec accuracy=83.505208 loss=0.614922 lr=0.003053 Epoch[062] Batch [2749]/[3760] Speed: 121.271114 samples/sec accuracy=83.494318 loss=0.615630 lr=0.003051 Epoch[062] Batch [2799]/[3760] Speed: 128.552158 samples/sec accuracy=83.490513 loss=0.615700 lr=0.003050 Epoch[062] Batch [2849]/[3760] Speed: 126.243117 samples/sec accuracy=83.487939 loss=0.615766 lr=0.003048 Epoch[062] Batch [2899]/[3760] Speed: 129.330128 samples/sec accuracy=83.481142 loss=0.616045 lr=0.003046 Epoch[062] Batch [2949]/[3760] Speed: 128.887206 samples/sec accuracy=83.462394 loss=0.616737 lr=0.003044 Epoch[062] Batch [2999]/[3760] Speed: 122.815542 samples/sec accuracy=83.435417 loss=0.617811 lr=0.003042 Epoch[062] Batch [3049]/[3760] Speed: 127.829321 samples/sec accuracy=83.439037 loss=0.617829 lr=0.003040 Epoch[062] Batch [3099]/[3760] Speed: 121.530371 samples/sec accuracy=83.439012 loss=0.617860 lr=0.003038 Epoch[062] Batch [3149]/[3760] Speed: 125.539269 samples/sec accuracy=83.423611 loss=0.618393 lr=0.003036 Epoch[062] Batch [3199]/[3760] Speed: 125.839393 samples/sec accuracy=83.414062 loss=0.619155 lr=0.003034 Epoch[062] Batch [3249]/[3760] Speed: 127.207674 samples/sec accuracy=83.396635 loss=0.619668 lr=0.003032 Epoch[062] Batch [3299]/[3760] Speed: 122.998716 samples/sec accuracy=83.367898 loss=0.620387 lr=0.003030 Epoch[062] Batch [3349]/[3760] Speed: 126.824592 samples/sec accuracy=83.361007 loss=0.621104 lr=0.003028 Epoch[062] Batch [3399]/[3760] Speed: 127.404093 samples/sec accuracy=83.357996 loss=0.621295 lr=0.003026 Epoch[062] Batch [3449]/[3760] Speed: 127.339692 samples/sec accuracy=83.355978 loss=0.621151 lr=0.003025 Epoch[062] Batch [3499]/[3760] Speed: 122.515275 samples/sec accuracy=83.358036 loss=0.621041 lr=0.003023 Epoch[062] Batch [3549]/[3760] Speed: 125.539397 samples/sec accuracy=83.344630 loss=0.621501 lr=0.003021 Epoch[062] Batch [3599]/[3760] Speed: 125.211274 samples/sec accuracy=83.339410 loss=0.621940 lr=0.003019 Epoch[062] Batch [3649]/[3760] Speed: 121.241527 samples/sec accuracy=83.323630 loss=0.622522 lr=0.003017 Epoch[062] Batch [3699]/[3760] Speed: 130.075796 samples/sec accuracy=83.317568 loss=0.622885 lr=0.003015 Epoch[062] Batch [3749]/[3760] Speed: 142.739558 samples/sec accuracy=83.330000 loss=0.622493 lr=0.003013 Batch [0049]/[0303]: acc-top1=65.312500 acc-top5=85.531250 Batch [0099]/[0303]: acc-top1=65.937500 acc-top5=85.609375 Batch [0149]/[0303]: acc-top1=65.500000 acc-top5=85.729167 Batch [0199]/[0303]: acc-top1=65.015625 acc-top5=85.476562 Batch [0249]/[0303]: acc-top1=65.131250 acc-top5=85.456250 Batch [0299]/[0303]: acc-top1=65.093750 acc-top5=85.401042 [Epoch 062] training: accuracy=83.330286 loss=0.622514 [Epoch 062] speed: 125 samples/sec time cost: 2108.652557 [Epoch 062] validation: acc-top1=65.057756 acc-top5=85.370256 loss=2.194503 Epoch[063] Batch [0049]/[3760] Speed: 89.158107 samples/sec accuracy=83.437500 loss=0.586195 lr=0.003011 Epoch[063] Batch [0099]/[3760] Speed: 130.659603 samples/sec accuracy=84.328125 loss=0.571369 lr=0.003009 Epoch[063] Batch [0149]/[3760] Speed: 123.120137 samples/sec accuracy=84.343750 loss=0.575000 lr=0.003007 Epoch[063] Batch [0199]/[3760] Speed: 128.084048 samples/sec accuracy=84.445312 loss=0.577644 lr=0.003005 Epoch[063] Batch [0249]/[3760] Speed: 119.227520 samples/sec accuracy=84.456250 loss=0.577173 lr=0.003003 Epoch[063] Batch [0299]/[3760] Speed: 125.828545 samples/sec accuracy=84.541667 loss=0.575214 lr=0.003001 Epoch[063] Batch [0349]/[3760] Speed: 134.327785 samples/sec accuracy=84.415179 loss=0.578568 lr=0.002999 Epoch[063] Batch [0399]/[3760] Speed: 122.056970 samples/sec accuracy=84.472656 loss=0.578339 lr=0.002997 Epoch[063] Batch [0449]/[3760] Speed: 124.648458 samples/sec accuracy=84.597222 loss=0.576104 lr=0.002995 Epoch[063] Batch [0499]/[3760] Speed: 125.464396 samples/sec accuracy=84.675000 loss=0.574861 lr=0.002994 Epoch[063] Batch [0549]/[3760] Speed: 129.884253 samples/sec accuracy=84.636364 loss=0.576766 lr=0.002992 Epoch[063] Batch [0599]/[3760] Speed: 123.887125 samples/sec accuracy=84.645833 loss=0.575318 lr=0.002990 Epoch[063] Batch [0649]/[3760] Speed: 122.680192 samples/sec accuracy=84.574519 loss=0.577728 lr=0.002988 Epoch[063] Batch [0699]/[3760] Speed: 124.676667 samples/sec accuracy=84.598214 loss=0.577172 lr=0.002986 Epoch[063] Batch [0749]/[3760] Speed: 127.915468 samples/sec accuracy=84.714583 loss=0.573276 lr=0.002984 Epoch[063] Batch [0799]/[3760] Speed: 128.554426 samples/sec accuracy=84.750000 loss=0.573642 lr=0.002982 Epoch[063] Batch [0849]/[3760] Speed: 120.218681 samples/sec accuracy=84.724265 loss=0.573993 lr=0.002980 Epoch[063] Batch [0899]/[3760] Speed: 132.717386 samples/sec accuracy=84.628472 loss=0.575890 lr=0.002978 Epoch[063] Batch [0949]/[3760] Speed: 117.514597 samples/sec accuracy=84.605263 loss=0.576283 lr=0.002976 Epoch[063] Batch [0999]/[3760] Speed: 134.209857 samples/sec accuracy=84.617188 loss=0.576257 lr=0.002974 Epoch[063] Batch [1049]/[3760] Speed: 117.754917 samples/sec accuracy=84.572917 loss=0.578443 lr=0.002972 Epoch[063] Batch [1099]/[3760] Speed: 132.141059 samples/sec accuracy=84.498580 loss=0.580507 lr=0.002971 Epoch[063] Batch [1149]/[3760] Speed: 128.344063 samples/sec accuracy=84.495924 loss=0.580825 lr=0.002969 Epoch[063] Batch [1199]/[3760] Speed: 119.690648 samples/sec accuracy=84.470052 loss=0.581152 lr=0.002967 Epoch[063] Batch [1249]/[3760] Speed: 131.439842 samples/sec accuracy=84.462500 loss=0.580852 lr=0.002965 Epoch[063] Batch [1299]/[3760] Speed: 121.358049 samples/sec accuracy=84.382212 loss=0.582966 lr=0.002963 Epoch[063] Batch [1349]/[3760] Speed: 128.346632 samples/sec accuracy=84.370370 loss=0.583569 lr=0.002961 Epoch[063] Batch [1399]/[3760] Speed: 126.823809 samples/sec accuracy=84.359375 loss=0.584784 lr=0.002959 Epoch[063] Batch [1449]/[3760] Speed: 124.905551 samples/sec accuracy=84.323276 loss=0.586643 lr=0.002957 Epoch[063] Batch [1499]/[3760] Speed: 127.276764 samples/sec accuracy=84.298958 loss=0.587393 lr=0.002955 Epoch[063] Batch [1549]/[3760] Speed: 122.438912 samples/sec accuracy=84.284274 loss=0.588303 lr=0.002953 Epoch[063] Batch [1599]/[3760] Speed: 132.756674 samples/sec accuracy=84.279297 loss=0.588327 lr=0.002951 Epoch[063] Batch [1649]/[3760] Speed: 116.123182 samples/sec accuracy=84.292614 loss=0.588149 lr=0.002950 Epoch[063] Batch [1699]/[3760] Speed: 135.188552 samples/sec accuracy=84.298713 loss=0.587604 lr=0.002948 Epoch[063] Batch [1749]/[3760] Speed: 125.875532 samples/sec accuracy=84.287500 loss=0.588496 lr=0.002946 Epoch[063] Batch [1799]/[3760] Speed: 115.314866 samples/sec accuracy=84.268229 loss=0.589310 lr=0.002944 Epoch[063] Batch [1849]/[3760] Speed: 133.888670 samples/sec accuracy=84.275338 loss=0.589096 lr=0.002942 Epoch[063] Batch [1899]/[3760] Speed: 133.622388 samples/sec accuracy=84.257401 loss=0.589539 lr=0.002940 Epoch[063] Batch [1949]/[3760] Speed: 117.624465 samples/sec accuracy=84.263622 loss=0.589640 lr=0.002938 Epoch[063] Batch [1999]/[3760] Speed: 127.742046 samples/sec accuracy=84.225000 loss=0.590790 lr=0.002936 Epoch[063] Batch [2049]/[3760] Speed: 125.810535 samples/sec accuracy=84.188262 loss=0.592122 lr=0.002934 Epoch[063] Batch [2099]/[3760] Speed: 122.811502 samples/sec accuracy=84.206101 loss=0.591407 lr=0.002932 Epoch[063] Batch [2149]/[3760] Speed: 129.729405 samples/sec accuracy=84.173692 loss=0.591839 lr=0.002931 Epoch[063] Batch [2199]/[3760] Speed: 119.481066 samples/sec accuracy=84.142045 loss=0.592682 lr=0.002929 Epoch[063] Batch [2249]/[3760] Speed: 128.926876 samples/sec accuracy=84.136806 loss=0.593049 lr=0.002927 Epoch[063] Batch [2299]/[3760] Speed: 127.754774 samples/sec accuracy=84.120924 loss=0.594134 lr=0.002925 Epoch[063] Batch [2349]/[3760] Speed: 125.791000 samples/sec accuracy=84.112367 loss=0.594408 lr=0.002923 Epoch[063] Batch [2399]/[3760] Speed: 127.538476 samples/sec accuracy=84.099609 loss=0.594849 lr=0.002921 Epoch[063] Batch [2449]/[3760] Speed: 123.196422 samples/sec accuracy=84.072704 loss=0.595072 lr=0.002919 Epoch[063] Batch [2499]/[3760] Speed: 121.704619 samples/sec accuracy=84.071250 loss=0.595353 lr=0.002917 Epoch[063] Batch [2549]/[3760] Speed: 129.502333 samples/sec accuracy=84.081495 loss=0.595335 lr=0.002915 Epoch[063] Batch [2599]/[3760] Speed: 120.895576 samples/sec accuracy=84.078125 loss=0.595383 lr=0.002913 Epoch[063] Batch [2649]/[3760] Speed: 128.881828 samples/sec accuracy=84.070755 loss=0.595575 lr=0.002912 Epoch[063] Batch [2699]/[3760] Speed: 118.909490 samples/sec accuracy=84.053241 loss=0.596365 lr=0.002910 Epoch[063] Batch [2749]/[3760] Speed: 131.254155 samples/sec accuracy=84.038636 loss=0.596551 lr=0.002908 Epoch[063] Batch [2799]/[3760] Speed: 130.168211 samples/sec accuracy=84.031250 loss=0.597061 lr=0.002906 Epoch[063] Batch [2849]/[3760] Speed: 120.605331 samples/sec accuracy=84.010965 loss=0.597826 lr=0.002904 Epoch[063] Batch [2899]/[3760] Speed: 127.443040 samples/sec accuracy=84.011315 loss=0.597822 lr=0.002902 Epoch[063] Batch [2949]/[3760] Speed: 122.361903 samples/sec accuracy=84.001589 loss=0.597786 lr=0.002900 Epoch[063] Batch [2999]/[3760] Speed: 120.876464 samples/sec accuracy=83.987500 loss=0.598328 lr=0.002898 Epoch[063] Batch [3049]/[3760] Speed: 136.581864 samples/sec accuracy=83.973361 loss=0.598660 lr=0.002896 Epoch[063] Batch [3099]/[3760] Speed: 116.418896 samples/sec accuracy=83.968246 loss=0.598571 lr=0.002894 Epoch[063] Batch [3149]/[3760] Speed: 130.420371 samples/sec accuracy=83.954365 loss=0.599192 lr=0.002893 Epoch[063] Batch [3199]/[3760] Speed: 133.702055 samples/sec accuracy=83.950684 loss=0.599369 lr=0.002891 Epoch[063] Batch [3249]/[3760] Speed: 114.411295 samples/sec accuracy=83.939904 loss=0.599936 lr=0.002889 Epoch[063] Batch [3299]/[3760] Speed: 133.799830 samples/sec accuracy=83.938447 loss=0.600370 lr=0.002887 Epoch[063] Batch [3349]/[3760] Speed: 116.937753 samples/sec accuracy=83.951959 loss=0.600230 lr=0.002885 Epoch[063] Batch [3399]/[3760] Speed: 133.460983 samples/sec accuracy=83.951287 loss=0.600293 lr=0.002883 Epoch[063] Batch [3449]/[3760] Speed: 131.894978 samples/sec accuracy=83.937953 loss=0.600685 lr=0.002881 Epoch[063] Batch [3499]/[3760] Speed: 116.344585 samples/sec accuracy=83.912500 loss=0.601607 lr=0.002879 Epoch[063] Batch [3549]/[3760] Speed: 131.066491 samples/sec accuracy=83.897007 loss=0.602162 lr=0.002877 Epoch[063] Batch [3599]/[3760] Speed: 120.290415 samples/sec accuracy=83.909288 loss=0.602029 lr=0.002876 Epoch[063] Batch [3649]/[3760] Speed: 130.446846 samples/sec accuracy=83.893836 loss=0.602523 lr=0.002874 Epoch[063] Batch [3699]/[3760] Speed: 118.080263 samples/sec accuracy=83.898226 loss=0.602596 lr=0.002872 Epoch[063] Batch [3749]/[3760] Speed: 147.532721 samples/sec accuracy=83.885417 loss=0.602925 lr=0.002870 Batch [0049]/[0303]: acc-top1=64.343750 acc-top5=85.812500 Batch [0099]/[0303]: acc-top1=64.843750 acc-top5=85.843750 Batch [0149]/[0303]: acc-top1=64.822917 acc-top5=85.770833 Batch [0199]/[0303]: acc-top1=64.539062 acc-top5=85.695312 Batch [0249]/[0303]: acc-top1=64.731250 acc-top5=85.531250 Batch [0299]/[0303]: acc-top1=64.604167 acc-top5=85.463542 [Epoch 063] training: accuracy=83.883394 loss=0.602996 [Epoch 063] speed: 125 samples/sec time cost: 2109.510731 [Epoch 063] validation: acc-top1=64.557550 acc-top5=85.432137 loss=2.158692 Epoch[064] Batch [0049]/[3759] Speed: 87.882547 samples/sec accuracy=83.687500 loss=0.592243 lr=0.002868 Epoch[064] Batch [0099]/[3759] Speed: 131.864477 samples/sec accuracy=84.593750 loss=0.568090 lr=0.002866 Epoch[064] Batch [0149]/[3759] Speed: 119.502552 samples/sec accuracy=85.020833 loss=0.554779 lr=0.002864 Epoch[064] Batch [0199]/[3759] Speed: 128.477066 samples/sec accuracy=84.843750 loss=0.563801 lr=0.002862 Epoch[064] Batch [0249]/[3759] Speed: 128.385775 samples/sec accuracy=84.718750 loss=0.566557 lr=0.002860 Epoch[064] Batch [0299]/[3759] Speed: 123.959558 samples/sec accuracy=84.807292 loss=0.564066 lr=0.002858 Epoch[064] Batch [0349]/[3759] Speed: 125.037352 samples/sec accuracy=84.834821 loss=0.559174 lr=0.002856 Epoch[064] Batch [0399]/[3759] Speed: 123.428563 samples/sec accuracy=84.699219 loss=0.561958 lr=0.002854 Epoch[064] Batch [0449]/[3759] Speed: 123.381545 samples/sec accuracy=84.718750 loss=0.565107 lr=0.002852 Epoch[064] Batch [0499]/[3759] Speed: 128.911941 samples/sec accuracy=84.696875 loss=0.566172 lr=0.002851 Epoch[064] Batch [0549]/[3759] Speed: 123.891552 samples/sec accuracy=84.696023 loss=0.564823 lr=0.002849 Epoch[064] Batch [0599]/[3759] Speed: 127.375811 samples/sec accuracy=84.729167 loss=0.564455 lr=0.002847 Epoch[064] Batch [0649]/[3759] Speed: 122.495030 samples/sec accuracy=84.716346 loss=0.564910 lr=0.002845 Epoch[064] Batch [0699]/[3759] Speed: 129.662713 samples/sec accuracy=84.792411 loss=0.563000 lr=0.002843 Epoch[064] Batch [0749]/[3759] Speed: 117.374051 samples/sec accuracy=84.791667 loss=0.564699 lr=0.002841 Epoch[064] Batch [0799]/[3759] Speed: 132.449051 samples/sec accuracy=84.720703 loss=0.566501 lr=0.002839 Epoch[064] Batch [0849]/[3759] Speed: 127.147269 samples/sec accuracy=84.704044 loss=0.567228 lr=0.002837 Epoch[064] Batch [0899]/[3759] Speed: 124.901085 samples/sec accuracy=84.723958 loss=0.566845 lr=0.002836 Epoch[064] Batch [0949]/[3759] Speed: 124.665642 samples/sec accuracy=84.731908 loss=0.567234 lr=0.002834 Epoch[064] Batch [0999]/[3759] Speed: 123.416872 samples/sec accuracy=84.735938 loss=0.566512 lr=0.002832 Epoch[064] Batch [1049]/[3759] Speed: 117.858042 samples/sec accuracy=84.745536 loss=0.566251 lr=0.002830 Epoch[064] Batch [1099]/[3759] Speed: 133.251267 samples/sec accuracy=84.723011 loss=0.567117 lr=0.002828 Epoch[064] Batch [1149]/[3759] Speed: 126.374432 samples/sec accuracy=84.707880 loss=0.567969 lr=0.002826 Epoch[064] Batch [1199]/[3759] Speed: 120.840862 samples/sec accuracy=84.636719 loss=0.570298 lr=0.002824 Epoch[064] Batch [1249]/[3759] Speed: 127.732821 samples/sec accuracy=84.598750 loss=0.571486 lr=0.002822 Epoch[064] Batch [1299]/[3759] Speed: 131.792827 samples/sec accuracy=84.563702 loss=0.573060 lr=0.002820 Epoch[064] Batch [1349]/[3759] Speed: 115.954795 samples/sec accuracy=84.543981 loss=0.574109 lr=0.002819 Epoch[064] Batch [1399]/[3759] Speed: 128.290732 samples/sec accuracy=84.568080 loss=0.573993 lr=0.002817 Epoch[064] Batch [1449]/[3759] Speed: 129.302953 samples/sec accuracy=84.530172 loss=0.574886 lr=0.002815 Epoch[064] Batch [1499]/[3759] Speed: 119.558792 samples/sec accuracy=84.534375 loss=0.575193 lr=0.002813 Epoch[064] Batch [1549]/[3759] Speed: 128.153890 samples/sec accuracy=84.584677 loss=0.573572 lr=0.002811 Epoch[064] Batch [1599]/[3759] Speed: 122.065947 samples/sec accuracy=84.596680 loss=0.573541 lr=0.002809 Epoch[064] Batch [1649]/[3759] Speed: 125.532213 samples/sec accuracy=84.557765 loss=0.574921 lr=0.002807 Epoch[064] Batch [1699]/[3759] Speed: 130.909701 samples/sec accuracy=84.540441 loss=0.575244 lr=0.002805 Epoch[064] Batch [1749]/[3759] Speed: 128.458004 samples/sec accuracy=84.532143 loss=0.575528 lr=0.002804 Epoch[064] Batch [1799]/[3759] Speed: 119.985425 samples/sec accuracy=84.522569 loss=0.576107 lr=0.002802 Epoch[064] Batch [1849]/[3759] Speed: 130.597300 samples/sec accuracy=84.526182 loss=0.576058 lr=0.002800 Epoch[064] Batch [1899]/[3759] Speed: 120.738401 samples/sec accuracy=84.526316 loss=0.576493 lr=0.002798 Epoch[064] Batch [1949]/[3759] Speed: 128.602833 samples/sec accuracy=84.526442 loss=0.576771 lr=0.002796 Epoch[064] Batch [1999]/[3759] Speed: 120.823473 samples/sec accuracy=84.521875 loss=0.577011 lr=0.002794 Epoch[064] Batch [2049]/[3759] Speed: 131.393038 samples/sec accuracy=84.514482 loss=0.577368 lr=0.002792 Epoch[064] Batch [2099]/[3759] Speed: 122.266053 samples/sec accuracy=84.492560 loss=0.578084 lr=0.002790 Epoch[064] Batch [2149]/[3759] Speed: 127.336133 samples/sec accuracy=84.499273 loss=0.577970 lr=0.002789 Epoch[064] Batch [2199]/[3759] Speed: 133.192857 samples/sec accuracy=84.498580 loss=0.577869 lr=0.002787 Epoch[064] Batch [2249]/[3759] Speed: 118.458066 samples/sec accuracy=84.488889 loss=0.578031 lr=0.002785 Epoch[064] Batch [2299]/[3759] Speed: 133.036513 samples/sec accuracy=84.507473 loss=0.577578 lr=0.002783 Epoch[064] Batch [2349]/[3759] Speed: 115.157672 samples/sec accuracy=84.496676 loss=0.578036 lr=0.002781 Epoch[064] Batch [2399]/[3759] Speed: 134.515845 samples/sec accuracy=84.480469 loss=0.578398 lr=0.002779 Epoch[064] Batch [2449]/[3759] Speed: 116.526972 samples/sec accuracy=84.463648 loss=0.578862 lr=0.002777 Epoch[064] Batch [2499]/[3759] Speed: 131.413264 samples/sec accuracy=84.454375 loss=0.579218 lr=0.002775 Epoch[064] Batch [2549]/[3759] Speed: 130.338512 samples/sec accuracy=84.452206 loss=0.579317 lr=0.002774 Epoch[064] Batch [2599]/[3759] Speed: 117.789391 samples/sec accuracy=84.426082 loss=0.579873 lr=0.002772 Epoch[064] Batch [2649]/[3759] Speed: 132.652111 samples/sec accuracy=84.439858 loss=0.579476 lr=0.002770 Epoch[064] Batch [2699]/[3759] Speed: 118.138239 samples/sec accuracy=84.425926 loss=0.579879 lr=0.002768 Epoch[064] Batch [2749]/[3759] Speed: 132.510997 samples/sec accuracy=84.418750 loss=0.580181 lr=0.002766 Epoch[064] Batch [2799]/[3759] Speed: 128.527663 samples/sec accuracy=84.419085 loss=0.580157 lr=0.002764 Epoch[064] Batch [2849]/[3759] Speed: 120.846734 samples/sec accuracy=84.416667 loss=0.580419 lr=0.002762 Epoch[064] Batch [2899]/[3759] Speed: 130.345034 samples/sec accuracy=84.398168 loss=0.581385 lr=0.002760 Epoch[064] Batch [2949]/[3759] Speed: 120.296376 samples/sec accuracy=84.386123 loss=0.581783 lr=0.002759 Epoch[064] Batch [2999]/[3759] Speed: 124.737691 samples/sec accuracy=84.367188 loss=0.582467 lr=0.002757 Epoch[064] Batch [3049]/[3759] Speed: 129.640527 samples/sec accuracy=84.363217 loss=0.582542 lr=0.002755 Epoch[064] Batch [3099]/[3759] Speed: 123.964705 samples/sec accuracy=84.354335 loss=0.582764 lr=0.002753 Epoch[064] Batch [3149]/[3759] Speed: 124.839191 samples/sec accuracy=84.338294 loss=0.582792 lr=0.002751 Epoch[064] Batch [3199]/[3759] Speed: 123.846189 samples/sec accuracy=84.329590 loss=0.583024 lr=0.002749 Epoch[064] Batch [3249]/[3759] Speed: 127.098452 samples/sec accuracy=84.327885 loss=0.583150 lr=0.002747 Epoch[064] Batch [3299]/[3759] Speed: 129.263091 samples/sec accuracy=84.324337 loss=0.583276 lr=0.002746 Epoch[064] Batch [3349]/[3759] Speed: 118.233780 samples/sec accuracy=84.295243 loss=0.584049 lr=0.002744 Epoch[064] Batch [3399]/[3759] Speed: 134.413377 samples/sec accuracy=84.293658 loss=0.584335 lr=0.002742 Epoch[064] Batch [3449]/[3759] Speed: 125.823780 samples/sec accuracy=84.292120 loss=0.584184 lr=0.002740 Epoch[064] Batch [3499]/[3759] Speed: 122.693277 samples/sec accuracy=84.273661 loss=0.584898 lr=0.002738 Epoch[064] Batch [3549]/[3759] Speed: 127.573215 samples/sec accuracy=84.284331 loss=0.584461 lr=0.002736 Epoch[064] Batch [3599]/[3759] Speed: 121.406323 samples/sec accuracy=84.292101 loss=0.584407 lr=0.002734 Epoch[064] Batch [3649]/[3759] Speed: 129.396475 samples/sec accuracy=84.288099 loss=0.584612 lr=0.002733 Epoch[064] Batch [3699]/[3759] Speed: 129.597765 samples/sec accuracy=84.272804 loss=0.585220 lr=0.002731 Epoch[064] Batch [3749]/[3759] Speed: 138.854717 samples/sec accuracy=84.282500 loss=0.585104 lr=0.002729 Batch [0049]/[0303]: acc-top1=64.875000 acc-top5=86.437500 Batch [0099]/[0303]: acc-top1=65.609375 acc-top5=85.890625 Batch [0149]/[0303]: acc-top1=65.104167 acc-top5=85.697917 Batch [0199]/[0303]: acc-top1=64.718750 acc-top5=85.484375 Batch [0249]/[0303]: acc-top1=64.856250 acc-top5=85.443750 Batch [0299]/[0303]: acc-top1=64.796875 acc-top5=85.427083 [Epoch 064] training: accuracy=84.273577 loss=0.585302 [Epoch 064] speed: 125 samples/sec time cost: 2109.421861 [Epoch 064] validation: acc-top1=64.722566 acc-top5=85.375413 loss=2.195283 Epoch[065] Batch [0049]/[3760] Speed: 89.562271 samples/sec accuracy=84.562500 loss=0.562683 lr=0.002727 Epoch[065] Batch [0099]/[3760] Speed: 129.077659 samples/sec accuracy=84.765625 loss=0.554414 lr=0.002725 Epoch[065] Batch [0149]/[3760] Speed: 125.964084 samples/sec accuracy=85.385417 loss=0.545903 lr=0.002723 Epoch[065] Batch [0199]/[3760] Speed: 125.126460 samples/sec accuracy=85.750000 loss=0.537188 lr=0.002721 Epoch[065] Batch [0249]/[3760] Speed: 124.573716 samples/sec accuracy=85.525000 loss=0.544398 lr=0.002719 Epoch[065] Batch [0299]/[3760] Speed: 132.681939 samples/sec accuracy=85.572917 loss=0.543340 lr=0.002717 Epoch[065] Batch [0349]/[3760] Speed: 116.275021 samples/sec accuracy=85.705357 loss=0.540633 lr=0.002715 Epoch[065] Batch [0399]/[3760] Speed: 133.358179 samples/sec accuracy=85.722656 loss=0.538905 lr=0.002714 Epoch[065] Batch [0449]/[3760] Speed: 118.501852 samples/sec accuracy=85.673611 loss=0.540462 lr=0.002712 Epoch[065] Batch [0499]/[3760] Speed: 131.282601 samples/sec accuracy=85.637500 loss=0.539625 lr=0.002710 Epoch[065] Batch [0549]/[3760] Speed: 122.299105 samples/sec accuracy=85.602273 loss=0.541378 lr=0.002708 Epoch[065] Batch [0599]/[3760] Speed: 129.687631 samples/sec accuracy=85.617188 loss=0.541721 lr=0.002706 Epoch[065] Batch [0649]/[3760] Speed: 118.344765 samples/sec accuracy=85.540865 loss=0.543922 lr=0.002704 Epoch[065] Batch [0699]/[3760] Speed: 130.065456 samples/sec accuracy=85.497768 loss=0.545439 lr=0.002702 Epoch[065] Batch [0749]/[3760] Speed: 126.509097 samples/sec accuracy=85.514583 loss=0.545008 lr=0.002701 Epoch[065] Batch [0799]/[3760] Speed: 127.585770 samples/sec accuracy=85.488281 loss=0.544934 lr=0.002699 Epoch[065] Batch [0849]/[3760] Speed: 126.094470 samples/sec accuracy=85.470588 loss=0.546726 lr=0.002697 Epoch[065] Batch [0899]/[3760] Speed: 119.738606 samples/sec accuracy=85.376736 loss=0.549245 lr=0.002695 Epoch[065] Batch [0949]/[3760] Speed: 133.424075 samples/sec accuracy=85.386513 loss=0.549073 lr=0.002693 Epoch[065] Batch [0999]/[3760] Speed: 121.553020 samples/sec accuracy=85.395313 loss=0.548846 lr=0.002691 Epoch[065] Batch [1049]/[3760] Speed: 127.652586 samples/sec accuracy=85.367560 loss=0.549195 lr=0.002689 Epoch[065] Batch [1099]/[3760] Speed: 123.693441 samples/sec accuracy=85.322443 loss=0.550685 lr=0.002688 Epoch[065] Batch [1149]/[3760] Speed: 121.751645 samples/sec accuracy=85.288043 loss=0.551764 lr=0.002686 Epoch[065] Batch [1199]/[3760] Speed: 130.324810 samples/sec accuracy=85.294271 loss=0.551509 lr=0.002684 Epoch[065] Batch [1249]/[3760] Speed: 126.500658 samples/sec accuracy=85.280000 loss=0.552224 lr=0.002682 Epoch[065] Batch [1299]/[3760] Speed: 123.442524 samples/sec accuracy=85.294471 loss=0.552106 lr=0.002680 Epoch[065] Batch [1349]/[3760] Speed: 129.071096 samples/sec accuracy=85.295139 loss=0.552496 lr=0.002678 Epoch[065] Batch [1399]/[3760] Speed: 127.523234 samples/sec accuracy=85.289062 loss=0.552323 lr=0.002676 Epoch[065] Batch [1449]/[3760] Speed: 123.925442 samples/sec accuracy=85.259698 loss=0.553359 lr=0.002675 Epoch[065] Batch [1499]/[3760] Speed: 128.366427 samples/sec accuracy=85.267708 loss=0.553161 lr=0.002673 Epoch[065] Batch [1549]/[3760] Speed: 124.902318 samples/sec accuracy=85.236895 loss=0.553628 lr=0.002671 Epoch[065] Batch [1599]/[3760] Speed: 124.024087 samples/sec accuracy=85.200195 loss=0.555304 lr=0.002669 Epoch[065] Batch [1649]/[3760] Speed: 128.622109 samples/sec accuracy=85.199811 loss=0.555216 lr=0.002667 Epoch[065] Batch [1699]/[3760] Speed: 119.120144 samples/sec accuracy=85.198529 loss=0.555383 lr=0.002665 Epoch[065] Batch [1749]/[3760] Speed: 130.735876 samples/sec accuracy=85.187500 loss=0.555513 lr=0.002664 Epoch[065] Batch [1799]/[3760] Speed: 119.401731 samples/sec accuracy=85.207465 loss=0.555341 lr=0.002662 Epoch[065] Batch [1849]/[3760] Speed: 133.008516 samples/sec accuracy=85.200169 loss=0.556059 lr=0.002660 Epoch[065] Batch [1899]/[3760] Speed: 122.907360 samples/sec accuracy=85.197368 loss=0.555517 lr=0.002658 Epoch[065] Batch [1949]/[3760] Speed: 125.439385 samples/sec accuracy=85.179487 loss=0.556138 lr=0.002656 Epoch[065] Batch [1999]/[3760] Speed: 131.423554 samples/sec accuracy=85.196094 loss=0.555706 lr=0.002654 Epoch[065] Batch [2049]/[3760] Speed: 118.948836 samples/sec accuracy=85.189024 loss=0.555650 lr=0.002652 Epoch[065] Batch [2099]/[3760] Speed: 127.654728 samples/sec accuracy=85.179315 loss=0.556018 lr=0.002651 Epoch[065] Batch [2149]/[3760] Speed: 126.090042 samples/sec accuracy=85.159157 loss=0.556514 lr=0.002649 Epoch[065] Batch [2199]/[3760] Speed: 123.796155 samples/sec accuracy=85.154119 loss=0.557050 lr=0.002647 Epoch[065] Batch [2249]/[3760] Speed: 128.253454 samples/sec accuracy=85.137500 loss=0.557383 lr=0.002645 Epoch[065] Batch [2299]/[3760] Speed: 123.838661 samples/sec accuracy=85.099864 loss=0.558780 lr=0.002643 Epoch[065] Batch [2349]/[3760] Speed: 124.535185 samples/sec accuracy=85.089096 loss=0.558885 lr=0.002641 Epoch[065] Batch [2399]/[3760] Speed: 132.443755 samples/sec accuracy=85.076823 loss=0.559568 lr=0.002640 Epoch[065] Batch [2449]/[3760] Speed: 125.491719 samples/sec accuracy=85.046556 loss=0.560211 lr=0.002638 Epoch[065] Batch [2499]/[3760] Speed: 122.547510 samples/sec accuracy=85.020000 loss=0.560641 lr=0.002636 Epoch[065] Batch [2549]/[3760] Speed: 130.288263 samples/sec accuracy=84.995711 loss=0.561308 lr=0.002634 Epoch[065] Batch [2599]/[3760] Speed: 121.478997 samples/sec accuracy=85.012620 loss=0.561287 lr=0.002632 Epoch[065] Batch [2649]/[3760] Speed: 126.853219 samples/sec accuracy=84.980542 loss=0.562230 lr=0.002630 Epoch[065] Batch [2699]/[3760] Speed: 132.149293 samples/sec accuracy=84.971644 loss=0.562555 lr=0.002629 Epoch[065] Batch [2749]/[3760] Speed: 120.788303 samples/sec accuracy=84.973864 loss=0.562562 lr=0.002627 Epoch[065] Batch [2799]/[3760] Speed: 125.247594 samples/sec accuracy=84.955915 loss=0.562859 lr=0.002625 Epoch[065] Batch [2849]/[3760] Speed: 128.723191 samples/sec accuracy=84.948465 loss=0.563297 lr=0.002623 Epoch[065] Batch [2899]/[3760] Speed: 125.177526 samples/sec accuracy=84.940194 loss=0.563685 lr=0.002621 Epoch[065] Batch [2949]/[3760] Speed: 126.807018 samples/sec accuracy=84.913665 loss=0.564364 lr=0.002619 Epoch[065] Batch [2999]/[3760] Speed: 127.099581 samples/sec accuracy=84.905729 loss=0.564454 lr=0.002618 Epoch[065] Batch [3049]/[3760] Speed: 120.152320 samples/sec accuracy=84.893955 loss=0.564701 lr=0.002616 Epoch[065] Batch [3099]/[3760] Speed: 126.710008 samples/sec accuracy=84.872480 loss=0.564908 lr=0.002614 Epoch[065] Batch [3149]/[3760] Speed: 127.619561 samples/sec accuracy=84.863591 loss=0.565308 lr=0.002612 Epoch[065] Batch [3199]/[3760] Speed: 122.749695 samples/sec accuracy=84.853027 loss=0.565539 lr=0.002610 Epoch[065] Batch [3249]/[3760] Speed: 129.476617 samples/sec accuracy=84.848077 loss=0.565772 lr=0.002608 Epoch[065] Batch [3299]/[3760] Speed: 119.089460 samples/sec accuracy=84.837595 loss=0.566351 lr=0.002606 Epoch[065] Batch [3349]/[3760] Speed: 132.257152 samples/sec accuracy=84.826026 loss=0.566654 lr=0.002605 Epoch[065] Batch [3399]/[3760] Speed: 127.661594 samples/sec accuracy=84.821691 loss=0.566846 lr=0.002603 Epoch[065] Batch [3449]/[3760] Speed: 123.968728 samples/sec accuracy=84.822917 loss=0.567197 lr=0.002601 Epoch[065] Batch [3499]/[3760] Speed: 122.279985 samples/sec accuracy=84.812500 loss=0.567523 lr=0.002599 Epoch[065] Batch [3549]/[3760] Speed: 130.879454 samples/sec accuracy=84.809419 loss=0.567439 lr=0.002597 Epoch[065] Batch [3599]/[3760] Speed: 125.005788 samples/sec accuracy=84.808594 loss=0.567486 lr=0.002595 Epoch[065] Batch [3649]/[3760] Speed: 123.173978 samples/sec accuracy=84.812500 loss=0.567751 lr=0.002594 Epoch[065] Batch [3699]/[3760] Speed: 124.892141 samples/sec accuracy=84.799409 loss=0.568097 lr=0.002592 Epoch[065] Batch [3749]/[3760] Speed: 142.306507 samples/sec accuracy=84.794167 loss=0.568100 lr=0.002590 Batch [0049]/[0303]: acc-top1=64.062500 acc-top5=86.031250 Batch [0099]/[0303]: acc-top1=64.718750 acc-top5=86.031250 Batch [0149]/[0303]: acc-top1=64.416667 acc-top5=85.479167 Batch [0199]/[0303]: acc-top1=64.250000 acc-top5=85.359375 Batch [0249]/[0303]: acc-top1=64.418750 acc-top5=85.318750 Batch [0299]/[0303]: acc-top1=64.515625 acc-top5=85.322917 [Epoch 065] training: accuracy=84.796792 loss=0.568013 [Epoch 065] speed: 125 samples/sec time cost: 2105.575249 [Epoch 065] validation: acc-top1=64.444101 acc-top5=85.277434 loss=2.195121 Epoch[066] Batch [0049]/[3759] Speed: 89.707628 samples/sec accuracy=84.968750 loss=0.553225 lr=0.002588 Epoch[066] Batch [0099]/[3759] Speed: 130.462262 samples/sec accuracy=85.125000 loss=0.544489 lr=0.002586 Epoch[066] Batch [0149]/[3759] Speed: 120.127286 samples/sec accuracy=85.468750 loss=0.540259 lr=0.002584 Epoch[066] Batch [0199]/[3759] Speed: 128.310995 samples/sec accuracy=85.609375 loss=0.533689 lr=0.002582 Epoch[066] Batch [0249]/[3759] Speed: 132.759868 samples/sec accuracy=85.537500 loss=0.541488 lr=0.002580 Epoch[066] Batch [0299]/[3759] Speed: 115.964319 samples/sec accuracy=85.432292 loss=0.545976 lr=0.002579 Epoch[066] Batch [0349]/[3759] Speed: 134.194421 samples/sec accuracy=85.531250 loss=0.543030 lr=0.002577 Epoch[066] Batch [0399]/[3759] Speed: 120.493573 samples/sec accuracy=85.378906 loss=0.547282 lr=0.002575 Epoch[066] Batch [0449]/[3759] Speed: 126.555061 samples/sec accuracy=85.461806 loss=0.543993 lr=0.002573 Epoch[066] Batch [0499]/[3759] Speed: 130.829767 samples/sec accuracy=85.487500 loss=0.542422 lr=0.002571 Epoch[066] Batch [0549]/[3759] Speed: 118.196688 samples/sec accuracy=85.468750 loss=0.541606 lr=0.002570 Epoch[066] Batch [0599]/[3759] Speed: 128.415108 samples/sec accuracy=85.473958 loss=0.541754 lr=0.002568 Epoch[066] Batch [0649]/[3759] Speed: 126.346184 samples/sec accuracy=85.435096 loss=0.542549 lr=0.002566 Epoch[066] Batch [0699]/[3759] Speed: 126.169770 samples/sec accuracy=85.448661 loss=0.542811 lr=0.002564 Epoch[066] Batch [0749]/[3759] Speed: 128.334690 samples/sec accuracy=85.460417 loss=0.540853 lr=0.002562 Epoch[066] Batch [0799]/[3759] Speed: 119.581612 samples/sec accuracy=85.519531 loss=0.537968 lr=0.002560 Epoch[066] Batch [0849]/[3759] Speed: 129.770499 samples/sec accuracy=85.573529 loss=0.536699 lr=0.002559 Epoch[066] Batch [0899]/[3759] Speed: 126.268635 samples/sec accuracy=85.524306 loss=0.538062 lr=0.002557 Epoch[066] Batch [0949]/[3759] Speed: 122.920044 samples/sec accuracy=85.485197 loss=0.540305 lr=0.002555 Epoch[066] Batch [0999]/[3759] Speed: 128.063661 samples/sec accuracy=85.517188 loss=0.539804 lr=0.002553 Epoch[066] Batch [1049]/[3759] Speed: 123.216236 samples/sec accuracy=85.565476 loss=0.539188 lr=0.002551 Epoch[066] Batch [1099]/[3759] Speed: 126.140973 samples/sec accuracy=85.568182 loss=0.540175 lr=0.002549 Epoch[066] Batch [1149]/[3759] Speed: 125.224700 samples/sec accuracy=85.544837 loss=0.540763 lr=0.002548 Epoch[066] Batch [1199]/[3759] Speed: 125.555251 samples/sec accuracy=85.561198 loss=0.540501 lr=0.002546 Epoch[066] Batch [1249]/[3759] Speed: 124.363533 samples/sec accuracy=85.522500 loss=0.541611 lr=0.002544 Epoch[066] Batch [1299]/[3759] Speed: 130.528117 samples/sec accuracy=85.510817 loss=0.541852 lr=0.002542 Epoch[066] Batch [1349]/[3759] Speed: 124.032692 samples/sec accuracy=85.472222 loss=0.542168 lr=0.002540 Epoch[066] Batch [1399]/[3759] Speed: 123.490644 samples/sec accuracy=85.464286 loss=0.542296 lr=0.002539 Epoch[066] Batch [1449]/[3759] Speed: 126.807754 samples/sec accuracy=85.484914 loss=0.541771 lr=0.002537 Epoch[066] Batch [1499]/[3759] Speed: 127.808530 samples/sec accuracy=85.513542 loss=0.540923 lr=0.002535 Epoch[066] Batch [1549]/[3759] Speed: 120.695697 samples/sec accuracy=85.511089 loss=0.540987 lr=0.002533 Epoch[066] Batch [1599]/[3759] Speed: 126.189422 samples/sec accuracy=85.535156 loss=0.540574 lr=0.002531 Epoch[066] Batch [1649]/[3759] Speed: 133.253733 samples/sec accuracy=85.535038 loss=0.540110 lr=0.002529 Epoch[066] Batch [1699]/[3759] Speed: 121.303027 samples/sec accuracy=85.517463 loss=0.540741 lr=0.002528 Epoch[066] Batch [1749]/[3759] Speed: 129.080601 samples/sec accuracy=85.495536 loss=0.541709 lr=0.002526 Epoch[066] Batch [1799]/[3759] Speed: 123.461857 samples/sec accuracy=85.487847 loss=0.541506 lr=0.002524 Epoch[066] Batch [1849]/[3759] Speed: 127.193496 samples/sec accuracy=85.460304 loss=0.542737 lr=0.002522 Epoch[066] Batch [1899]/[3759] Speed: 120.760354 samples/sec accuracy=85.467928 loss=0.543089 lr=0.002520 Epoch[066] Batch [1949]/[3759] Speed: 129.358302 samples/sec accuracy=85.465545 loss=0.543643 lr=0.002519 Epoch[066] Batch [1999]/[3759] Speed: 129.677265 samples/sec accuracy=85.425781 loss=0.544379 lr=0.002517 Epoch[066] Batch [2049]/[3759] Speed: 123.030674 samples/sec accuracy=85.409299 loss=0.544405 lr=0.002515 Epoch[066] Batch [2099]/[3759] Speed: 127.149168 samples/sec accuracy=85.422619 loss=0.544308 lr=0.002513 Epoch[066] Batch [2149]/[3759] Speed: 122.222827 samples/sec accuracy=85.404797 loss=0.543965 lr=0.002511 Epoch[066] Batch [2199]/[3759] Speed: 130.043768 samples/sec accuracy=85.424716 loss=0.543234 lr=0.002509 Epoch[066] Batch [2249]/[3759] Speed: 117.767693 samples/sec accuracy=85.420833 loss=0.542806 lr=0.002508 Epoch[066] Batch [2299]/[3759] Speed: 131.006022 samples/sec accuracy=85.411685 loss=0.542784 lr=0.002506 Epoch[066] Batch [2349]/[3759] Speed: 120.336374 samples/sec accuracy=85.401596 loss=0.543274 lr=0.002504 Epoch[066] Batch [2399]/[3759] Speed: 128.698172 samples/sec accuracy=85.380859 loss=0.543676 lr=0.002502 Epoch[066] Batch [2449]/[3759] Speed: 134.319585 samples/sec accuracy=85.374362 loss=0.543841 lr=0.002500 Epoch[066] Batch [2499]/[3759] Speed: 121.873041 samples/sec accuracy=85.360625 loss=0.544308 lr=0.002499 Epoch[066] Batch [2549]/[3759] Speed: 123.330574 samples/sec accuracy=85.371936 loss=0.544135 lr=0.002497 Epoch[066] Batch [2599]/[3759] Speed: 124.167115 samples/sec accuracy=85.359375 loss=0.544597 lr=0.002495 Epoch[066] Batch [2649]/[3759] Speed: 123.948317 samples/sec accuracy=85.349646 loss=0.545140 lr=0.002493 Epoch[066] Batch [2699]/[3759] Speed: 125.823099 samples/sec accuracy=85.351852 loss=0.545191 lr=0.002491 Epoch[066] Batch [2749]/[3759] Speed: 127.155824 samples/sec accuracy=85.356818 loss=0.545511 lr=0.002490 Epoch[066] Batch [2799]/[3759] Speed: 127.711983 samples/sec accuracy=85.349330 loss=0.545786 lr=0.002488 Epoch[066] Batch [2849]/[3759] Speed: 122.875436 samples/sec accuracy=85.334430 loss=0.546664 lr=0.002486 Epoch[066] Batch [2899]/[3759] Speed: 127.535311 samples/sec accuracy=85.339440 loss=0.546493 lr=0.002484 Epoch[066] Batch [2949]/[3759] Speed: 126.455320 samples/sec accuracy=85.343220 loss=0.546432 lr=0.002482 Epoch[066] Batch [2999]/[3759] Speed: 122.488570 samples/sec accuracy=85.346875 loss=0.546371 lr=0.002481 Epoch[066] Batch [3049]/[3759] Speed: 129.354159 samples/sec accuracy=85.327357 loss=0.546777 lr=0.002479 Epoch[066] Batch [3099]/[3759] Speed: 119.475720 samples/sec accuracy=85.305444 loss=0.547403 lr=0.002477 Epoch[066] Batch [3149]/[3759] Speed: 132.788034 samples/sec accuracy=85.313492 loss=0.547020 lr=0.002475 Epoch[066] Batch [3199]/[3759] Speed: 128.584334 samples/sec accuracy=85.293945 loss=0.547534 lr=0.002473 Epoch[066] Batch [3249]/[3759] Speed: 118.237597 samples/sec accuracy=85.281731 loss=0.548152 lr=0.002472 Epoch[066] Batch [3299]/[3759] Speed: 128.403732 samples/sec accuracy=85.278409 loss=0.548127 lr=0.002470 Epoch[066] Batch [3349]/[3759] Speed: 124.253069 samples/sec accuracy=85.257929 loss=0.548745 lr=0.002468 Epoch[066] Batch [3399]/[3759] Speed: 132.480901 samples/sec accuracy=85.250460 loss=0.548842 lr=0.002466 Epoch[066] Batch [3449]/[3759] Speed: 124.221428 samples/sec accuracy=85.238225 loss=0.549032 lr=0.002464 Epoch[066] Batch [3499]/[3759] Speed: 121.832090 samples/sec accuracy=85.233036 loss=0.548934 lr=0.002463 Epoch[066] Batch [3549]/[3759] Speed: 128.878277 samples/sec accuracy=85.234595 loss=0.548852 lr=0.002461 Epoch[066] Batch [3599]/[3759] Speed: 123.209847 samples/sec accuracy=85.217882 loss=0.549394 lr=0.002459 Epoch[066] Batch [3649]/[3759] Speed: 125.098795 samples/sec accuracy=85.197346 loss=0.550482 lr=0.002457 Epoch[066] Batch [3699]/[3759] Speed: 125.948268 samples/sec accuracy=85.191301 loss=0.550749 lr=0.002455 Epoch[066] Batch [3749]/[3759] Speed: 143.153611 samples/sec accuracy=85.172917 loss=0.550890 lr=0.002454 Batch [0049]/[0303]: acc-top1=65.281250 acc-top5=86.250000 Batch [0099]/[0303]: acc-top1=65.140625 acc-top5=85.984375 Batch [0149]/[0303]: acc-top1=65.000000 acc-top5=85.895833 Batch [0199]/[0303]: acc-top1=64.445312 acc-top5=85.515625 Batch [0249]/[0303]: acc-top1=64.450000 acc-top5=85.525000 Batch [0299]/[0303]: acc-top1=64.395833 acc-top5=85.468750 [Epoch 066] training: accuracy=85.173500 loss=0.550901 [Epoch 066] speed: 125 samples/sec time cost: 2107.135891 [Epoch 066] validation: acc-top1=64.356436 acc-top5=85.452764 loss=2.260438 Epoch[067] Batch [0049]/[3760] Speed: 89.534299 samples/sec accuracy=84.750000 loss=0.555172 lr=0.002451 Epoch[067] Batch [0099]/[3760] Speed: 128.976283 samples/sec accuracy=86.078125 loss=0.518004 lr=0.002450 Epoch[067] Batch [0149]/[3760] Speed: 121.293911 samples/sec accuracy=85.625000 loss=0.520162 lr=0.002448 Epoch[067] Batch [0199]/[3760] Speed: 132.501021 samples/sec accuracy=85.617188 loss=0.518929 lr=0.002446 Epoch[067] Batch [0249]/[3760] Speed: 127.230972 samples/sec accuracy=85.793750 loss=0.516812 lr=0.002444 Epoch[067] Batch [0299]/[3760] Speed: 122.919095 samples/sec accuracy=85.776042 loss=0.522458 lr=0.002442 Epoch[067] Batch [0349]/[3760] Speed: 126.031973 samples/sec accuracy=85.763393 loss=0.522515 lr=0.002441 Epoch[067] Batch [0399]/[3760] Speed: 120.694742 samples/sec accuracy=85.847656 loss=0.520643 lr=0.002439 Epoch[067] Batch [0449]/[3760] Speed: 128.947840 samples/sec accuracy=85.875000 loss=0.521985 lr=0.002437 Epoch[067] Batch [0499]/[3760] Speed: 125.130147 samples/sec accuracy=85.881250 loss=0.523018 lr=0.002435 Epoch[067] Batch [0549]/[3760] Speed: 117.317390 samples/sec accuracy=85.971591 loss=0.519850 lr=0.002433 Epoch[067] Batch [0599]/[3760] Speed: 133.752771 samples/sec accuracy=86.059896 loss=0.518435 lr=0.002432 Epoch[067] Batch [0649]/[3760] Speed: 126.381318 samples/sec accuracy=86.026442 loss=0.520565 lr=0.002430 Epoch[067] Batch [0699]/[3760] Speed: 123.292992 samples/sec accuracy=86.111607 loss=0.518321 lr=0.002428 Epoch[067] Batch [0749]/[3760] Speed: 133.176659 samples/sec accuracy=86.139583 loss=0.517373 lr=0.002426 Epoch[067] Batch [0799]/[3760] Speed: 116.987264 samples/sec accuracy=86.156250 loss=0.516674 lr=0.002425 Epoch[067] Batch [0849]/[3760] Speed: 128.453462 samples/sec accuracy=86.202206 loss=0.516525 lr=0.002423 Epoch[067] Batch [0899]/[3760] Speed: 122.133094 samples/sec accuracy=86.204861 loss=0.516693 lr=0.002421 Epoch[067] Batch [0949]/[3760] Speed: 128.395880 samples/sec accuracy=86.213816 loss=0.516211 lr=0.002419 Epoch[067] Batch [0999]/[3760] Speed: 126.887822 samples/sec accuracy=86.179688 loss=0.517068 lr=0.002417 Epoch[067] Batch [1049]/[3760] Speed: 124.671302 samples/sec accuracy=86.196429 loss=0.517288 lr=0.002416 Epoch[067] Batch [1099]/[3760] Speed: 128.098418 samples/sec accuracy=86.176136 loss=0.517634 lr=0.002414 Epoch[067] Batch [1149]/[3760] Speed: 116.171735 samples/sec accuracy=86.156250 loss=0.517667 lr=0.002412 Epoch[067] Batch [1199]/[3760] Speed: 132.861950 samples/sec accuracy=86.162760 loss=0.518199 lr=0.002410 Epoch[067] Batch [1249]/[3760] Speed: 127.288113 samples/sec accuracy=86.148750 loss=0.517966 lr=0.002408 Epoch[067] Batch [1299]/[3760] Speed: 119.448528 samples/sec accuracy=86.164663 loss=0.517940 lr=0.002407 Epoch[067] Batch [1349]/[3760] Speed: 132.730433 samples/sec accuracy=86.146991 loss=0.518542 lr=0.002405 Epoch[067] Batch [1399]/[3760] Speed: 118.853627 samples/sec accuracy=86.123884 loss=0.519560 lr=0.002403 Epoch[067] Batch [1449]/[3760] Speed: 128.315978 samples/sec accuracy=86.096983 loss=0.520280 lr=0.002401 Epoch[067] Batch [1499]/[3760] Speed: 122.237944 samples/sec accuracy=86.127083 loss=0.519769 lr=0.002399 Epoch[067] Batch [1549]/[3760] Speed: 131.906228 samples/sec accuracy=86.163306 loss=0.518465 lr=0.002398 Epoch[067] Batch [1599]/[3760] Speed: 128.855436 samples/sec accuracy=86.174805 loss=0.518391 lr=0.002396 Epoch[067] Batch [1649]/[3760] Speed: 116.748440 samples/sec accuracy=86.160038 loss=0.518705 lr=0.002394 Epoch[067] Batch [1699]/[3760] Speed: 131.164640 samples/sec accuracy=86.178309 loss=0.518137 lr=0.002392 Epoch[067] Batch [1749]/[3760] Speed: 122.464031 samples/sec accuracy=86.150000 loss=0.519070 lr=0.002391 Epoch[067] Batch [1799]/[3760] Speed: 124.606696 samples/sec accuracy=86.102431 loss=0.520659 lr=0.002389 Epoch[067] Batch [1849]/[3760] Speed: 127.600288 samples/sec accuracy=86.114865 loss=0.520161 lr=0.002387 Epoch[067] Batch [1899]/[3760] Speed: 122.953432 samples/sec accuracy=86.113487 loss=0.520246 lr=0.002385 Epoch[067] Batch [1949]/[3760] Speed: 128.580539 samples/sec accuracy=86.112179 loss=0.520402 lr=0.002383 Epoch[067] Batch [1999]/[3760] Speed: 127.792024 samples/sec accuracy=86.095313 loss=0.520626 lr=0.002382 Epoch[067] Batch [2049]/[3760] Speed: 121.038588 samples/sec accuracy=86.092226 loss=0.521201 lr=0.002380 Epoch[067] Batch [2099]/[3760] Speed: 131.785157 samples/sec accuracy=86.054315 loss=0.521852 lr=0.002378 Epoch[067] Batch [2149]/[3760] Speed: 121.649355 samples/sec accuracy=86.045058 loss=0.522100 lr=0.002376 Epoch[067] Batch [2199]/[3760] Speed: 126.541468 samples/sec accuracy=86.023438 loss=0.522898 lr=0.002375 Epoch[067] Batch [2249]/[3760] Speed: 131.616178 samples/sec accuracy=86.025694 loss=0.522458 lr=0.002373 Epoch[067] Batch [2299]/[3760] Speed: 121.211175 samples/sec accuracy=86.023777 loss=0.522480 lr=0.002371 Epoch[067] Batch [2349]/[3760] Speed: 127.155146 samples/sec accuracy=86.001330 loss=0.523219 lr=0.002369 Epoch[067] Batch [2399]/[3760] Speed: 122.269005 samples/sec accuracy=86.024740 loss=0.522460 lr=0.002367 Epoch[067] Batch [2449]/[3760] Speed: 125.335533 samples/sec accuracy=86.010842 loss=0.522759 lr=0.002366 Epoch[067] Batch [2499]/[3760] Speed: 123.091804 samples/sec accuracy=85.989375 loss=0.523176 lr=0.002364 Epoch[067] Batch [2549]/[3760] Speed: 126.701276 samples/sec accuracy=85.984069 loss=0.523430 lr=0.002362 Epoch[067] Batch [2599]/[3760] Speed: 131.854903 samples/sec accuracy=85.992188 loss=0.523489 lr=0.002360 Epoch[067] Batch [2649]/[3760] Speed: 117.327335 samples/sec accuracy=86.002358 loss=0.523352 lr=0.002359 Epoch[067] Batch [2699]/[3760] Speed: 134.266150 samples/sec accuracy=85.984954 loss=0.523605 lr=0.002357 Epoch[067] Batch [2749]/[3760] Speed: 119.022843 samples/sec accuracy=85.982955 loss=0.523846 lr=0.002355 Epoch[067] Batch [2799]/[3760] Speed: 125.229269 samples/sec accuracy=85.974888 loss=0.524381 lr=0.002353 Epoch[067] Batch [2849]/[3760] Speed: 126.852118 samples/sec accuracy=85.980811 loss=0.524374 lr=0.002351 Epoch[067] Batch [2899]/[3760] Speed: 126.076323 samples/sec accuracy=85.963901 loss=0.524971 lr=0.002350 Epoch[067] Batch [2949]/[3760] Speed: 121.102574 samples/sec accuracy=85.947564 loss=0.525255 lr=0.002348 Epoch[067] Batch [2999]/[3760] Speed: 132.470499 samples/sec accuracy=85.946354 loss=0.525233 lr=0.002346 Epoch[067] Batch [3049]/[3760] Speed: 120.564308 samples/sec accuracy=85.934426 loss=0.525544 lr=0.002344 Epoch[067] Batch [3099]/[3760] Speed: 132.828610 samples/sec accuracy=85.933972 loss=0.525465 lr=0.002343 Epoch[067] Batch [3149]/[3760] Speed: 120.516042 samples/sec accuracy=85.931052 loss=0.525681 lr=0.002341 Epoch[067] Batch [3199]/[3760] Speed: 129.056910 samples/sec accuracy=85.924316 loss=0.525828 lr=0.002339 Epoch[067] Batch [3249]/[3760] Speed: 130.008359 samples/sec accuracy=85.903365 loss=0.526245 lr=0.002337 Epoch[067] Batch [3299]/[3760] Speed: 120.339220 samples/sec accuracy=85.900568 loss=0.526399 lr=0.002336 Epoch[067] Batch [3349]/[3760] Speed: 129.095894 samples/sec accuracy=85.890392 loss=0.526594 lr=0.002334 Epoch[067] Batch [3399]/[3760] Speed: 123.742971 samples/sec accuracy=85.892463 loss=0.526790 lr=0.002332 Epoch[067] Batch [3449]/[3760] Speed: 126.789741 samples/sec accuracy=85.858243 loss=0.527577 lr=0.002330 Epoch[067] Batch [3499]/[3760] Speed: 124.675649 samples/sec accuracy=85.852232 loss=0.527979 lr=0.002328 Epoch[067] Batch [3549]/[3760] Speed: 131.978219 samples/sec accuracy=85.836268 loss=0.528298 lr=0.002327 Epoch[067] Batch [3599]/[3760] Speed: 119.215688 samples/sec accuracy=85.834635 loss=0.528317 lr=0.002325 Epoch[067] Batch [3649]/[3760] Speed: 126.671697 samples/sec accuracy=85.841182 loss=0.528181 lr=0.002323 Epoch[067] Batch [3699]/[3760] Speed: 126.412085 samples/sec accuracy=85.831503 loss=0.528258 lr=0.002321 Epoch[067] Batch [3749]/[3760] Speed: 146.014587 samples/sec accuracy=85.818750 loss=0.528729 lr=0.002320 Batch [0049]/[0303]: acc-top1=66.343750 acc-top5=86.437500 Batch [0099]/[0303]: acc-top1=66.265625 acc-top5=86.078125 Batch [0149]/[0303]: acc-top1=65.968750 acc-top5=85.843750 Batch [0199]/[0303]: acc-top1=65.570312 acc-top5=85.687500 Batch [0249]/[0303]: acc-top1=65.675000 acc-top5=85.562500 Batch [0299]/[0303]: acc-top1=65.604167 acc-top5=85.588542 [Epoch 067] training: accuracy=85.823637 loss=0.528657 [Epoch 067] speed: 125 samples/sec time cost: 2107.765176 [Epoch 067] validation: acc-top1=65.537335 acc-top5=85.576526 loss=2.139090 Epoch[068] Batch [0049]/[3760] Speed: 89.250569 samples/sec accuracy=87.312500 loss=0.498534 lr=0.002318 Epoch[068] Batch [0099]/[3760] Speed: 131.373988 samples/sec accuracy=87.250000 loss=0.487509 lr=0.002316 Epoch[068] Batch [0149]/[3760] Speed: 121.773626 samples/sec accuracy=87.125000 loss=0.492481 lr=0.002314 Epoch[068] Batch [0199]/[3760] Speed: 127.949922 samples/sec accuracy=87.132812 loss=0.489363 lr=0.002312 Epoch[068] Batch [0249]/[3760] Speed: 128.367685 samples/sec accuracy=87.200000 loss=0.488363 lr=0.002310 Epoch[068] Batch [0299]/[3760] Speed: 121.191508 samples/sec accuracy=87.166667 loss=0.487722 lr=0.002309 Epoch[068] Batch [0349]/[3760] Speed: 130.080309 samples/sec accuracy=87.165179 loss=0.486910 lr=0.002307 Epoch[068] Batch [0399]/[3760] Speed: 125.398418 samples/sec accuracy=87.203125 loss=0.484917 lr=0.002305 Epoch[068] Batch [0449]/[3760] Speed: 119.293619 samples/sec accuracy=87.152778 loss=0.487960 lr=0.002303 Epoch[068] Batch [0499]/[3760] Speed: 128.911653 samples/sec accuracy=87.043750 loss=0.490195 lr=0.002302 Epoch[068] Batch [0549]/[3760] Speed: 124.768832 samples/sec accuracy=86.971591 loss=0.491904 lr=0.002300 Epoch[068] Batch [0599]/[3760] Speed: 128.759643 samples/sec accuracy=86.953125 loss=0.492695 lr=0.002298 Epoch[068] Batch [0649]/[3760] Speed: 124.838260 samples/sec accuracy=86.875000 loss=0.495100 lr=0.002296 Epoch[068] Batch [0699]/[3760] Speed: 131.039303 samples/sec accuracy=86.819196 loss=0.495560 lr=0.002295 Epoch[068] Batch [0749]/[3760] Speed: 120.939456 samples/sec accuracy=86.818750 loss=0.496417 lr=0.002293 Epoch[068] Batch [0799]/[3760] Speed: 125.255807 samples/sec accuracy=86.794922 loss=0.497437 lr=0.002291 Epoch[068] Batch [0849]/[3760] Speed: 128.060715 samples/sec accuracy=86.799632 loss=0.498611 lr=0.002289 Epoch[068] Batch [0899]/[3760] Speed: 119.471210 samples/sec accuracy=86.756944 loss=0.499015 lr=0.002288 Epoch[068] Batch [0949]/[3760] Speed: 129.302006 samples/sec accuracy=86.761513 loss=0.499910 lr=0.002286 Epoch[068] Batch [0999]/[3760] Speed: 122.249504 samples/sec accuracy=86.689063 loss=0.501149 lr=0.002284 Epoch[068] Batch [1049]/[3760] Speed: 127.668555 samples/sec accuracy=86.699405 loss=0.501646 lr=0.002282 Epoch[068] Batch [1099]/[3760] Speed: 132.079219 samples/sec accuracy=86.687500 loss=0.501289 lr=0.002281 Epoch[068] Batch [1149]/[3760] Speed: 119.701604 samples/sec accuracy=86.698370 loss=0.500774 lr=0.002279 Epoch[068] Batch [1199]/[3760] Speed: 130.972819 samples/sec accuracy=86.678385 loss=0.500994 lr=0.002277 Epoch[068] Batch [1249]/[3760] Speed: 117.566175 samples/sec accuracy=86.671250 loss=0.501229 lr=0.002275 Epoch[068] Batch [1299]/[3760] Speed: 131.835185 samples/sec accuracy=86.664663 loss=0.500998 lr=0.002274 Epoch[068] Batch [1349]/[3760] Speed: 126.203437 samples/sec accuracy=86.644676 loss=0.500905 lr=0.002272 Epoch[068] Batch [1399]/[3760] Speed: 123.535403 samples/sec accuracy=86.633929 loss=0.500522 lr=0.002270 Epoch[068] Batch [1449]/[3760] Speed: 130.221284 samples/sec accuracy=86.659483 loss=0.500118 lr=0.002268 Epoch[068] Batch [1499]/[3760] Speed: 122.956288 samples/sec accuracy=86.638542 loss=0.501378 lr=0.002267 Epoch[068] Batch [1549]/[3760] Speed: 128.314213 samples/sec accuracy=86.588710 loss=0.502668 lr=0.002265 Epoch[068] Batch [1599]/[3760] Speed: 123.297259 samples/sec accuracy=86.602539 loss=0.501574 lr=0.002263 Epoch[068] Batch [1649]/[3760] Speed: 122.448606 samples/sec accuracy=86.581439 loss=0.501840 lr=0.002261 Epoch[068] Batch [1699]/[3760] Speed: 131.040736 samples/sec accuracy=86.571691 loss=0.502405 lr=0.002260 Epoch[068] Batch [1749]/[3760] Speed: 117.833808 samples/sec accuracy=86.559821 loss=0.503303 lr=0.002258 Epoch[068] Batch [1799]/[3760] Speed: 133.583068 samples/sec accuracy=86.556424 loss=0.503013 lr=0.002256 Epoch[068] Batch [1849]/[3760] Speed: 117.634313 samples/sec accuracy=86.543074 loss=0.503306 lr=0.002254 Epoch[068] Batch [1899]/[3760] Speed: 129.354120 samples/sec accuracy=86.539474 loss=0.503373 lr=0.002253 Epoch[068] Batch [1949]/[3760] Speed: 133.930894 samples/sec accuracy=86.511218 loss=0.503608 lr=0.002251 Epoch[068] Batch [1999]/[3760] Speed: 117.972552 samples/sec accuracy=86.478125 loss=0.504551 lr=0.002249 Epoch[068] Batch [2049]/[3760] Speed: 130.191824 samples/sec accuracy=86.456555 loss=0.505397 lr=0.002247 Epoch[068] Batch [2099]/[3760] Speed: 121.026647 samples/sec accuracy=86.465774 loss=0.505806 lr=0.002246 Epoch[068] Batch [2149]/[3760] Speed: 129.749942 samples/sec accuracy=86.447674 loss=0.506276 lr=0.002244 Epoch[068] Batch [2199]/[3760] Speed: 126.229026 samples/sec accuracy=86.448864 loss=0.506247 lr=0.002242 Epoch[068] Batch [2249]/[3760] Speed: 123.862427 samples/sec accuracy=86.440278 loss=0.506003 lr=0.002240 Epoch[068] Batch [2299]/[3760] Speed: 123.705307 samples/sec accuracy=86.451087 loss=0.505890 lr=0.002239 Epoch[068] Batch [2349]/[3760] Speed: 128.156749 samples/sec accuracy=86.432181 loss=0.506257 lr=0.002237 Epoch[068] Batch [2399]/[3760] Speed: 118.509632 samples/sec accuracy=86.448568 loss=0.506074 lr=0.002235 Epoch[068] Batch [2449]/[3760] Speed: 130.376634 samples/sec accuracy=86.431760 loss=0.506243 lr=0.002233 Epoch[068] Batch [2499]/[3760] Speed: 119.843882 samples/sec accuracy=86.415000 loss=0.506728 lr=0.002232 Epoch[068] Batch [2549]/[3760] Speed: 132.749933 samples/sec accuracy=86.393382 loss=0.507445 lr=0.002230 Epoch[068] Batch [2599]/[3760] Speed: 127.159678 samples/sec accuracy=86.398438 loss=0.507561 lr=0.002228 Epoch[068] Batch [2649]/[3760] Speed: 122.024273 samples/sec accuracy=86.388561 loss=0.507935 lr=0.002226 Epoch[068] Batch [2699]/[3760] Speed: 125.037779 samples/sec accuracy=86.394097 loss=0.507953 lr=0.002225 Epoch[068] Batch [2749]/[3760] Speed: 122.448214 samples/sec accuracy=86.385795 loss=0.508153 lr=0.002223 Epoch[068] Batch [2799]/[3760] Speed: 128.241952 samples/sec accuracy=86.387835 loss=0.508378 lr=0.002221 Epoch[068] Batch [2849]/[3760] Speed: 127.282811 samples/sec accuracy=86.389254 loss=0.508454 lr=0.002220 Epoch[068] Batch [2899]/[3760] Speed: 125.381508 samples/sec accuracy=86.376078 loss=0.508740 lr=0.002218 Epoch[068] Batch [2949]/[3760] Speed: 126.036800 samples/sec accuracy=86.373941 loss=0.509020 lr=0.002216 Epoch[068] Batch [2999]/[3760] Speed: 119.706022 samples/sec accuracy=86.362500 loss=0.509399 lr=0.002214 Epoch[068] Batch [3049]/[3760] Speed: 130.391019 samples/sec accuracy=86.360656 loss=0.509193 lr=0.002213 Epoch[068] Batch [3099]/[3760] Speed: 132.476944 samples/sec accuracy=86.371976 loss=0.509138 lr=0.002211 Epoch[068] Batch [3149]/[3760] Speed: 119.272028 samples/sec accuracy=86.379464 loss=0.508936 lr=0.002209 Epoch[068] Batch [3199]/[3760] Speed: 130.218191 samples/sec accuracy=86.365723 loss=0.509479 lr=0.002207 Epoch[068] Batch [3249]/[3760] Speed: 121.924981 samples/sec accuracy=86.345192 loss=0.509865 lr=0.002206 Epoch[068] Batch [3299]/[3760] Speed: 125.034625 samples/sec accuracy=86.344697 loss=0.509844 lr=0.002204 Epoch[068] Batch [3349]/[3760] Speed: 126.238169 samples/sec accuracy=86.340951 loss=0.510149 lr=0.002202 Epoch[068] Batch [3399]/[3760] Speed: 126.330837 samples/sec accuracy=86.330423 loss=0.510165 lr=0.002200 Epoch[068] Batch [3449]/[3760] Speed: 123.350447 samples/sec accuracy=86.335145 loss=0.510203 lr=0.002199 Epoch[068] Batch [3499]/[3760] Speed: 128.724835 samples/sec accuracy=86.339286 loss=0.510327 lr=0.002197 Epoch[068] Batch [3549]/[3760] Speed: 122.466389 samples/sec accuracy=86.341549 loss=0.510319 lr=0.002195 Epoch[068] Batch [3599]/[3760] Speed: 126.086626 samples/sec accuracy=86.335503 loss=0.510337 lr=0.002194 Epoch[068] Batch [3649]/[3760] Speed: 127.908343 samples/sec accuracy=86.325342 loss=0.510450 lr=0.002192 Epoch[068] Batch [3699]/[3760] Speed: 124.056357 samples/sec accuracy=86.317990 loss=0.510707 lr=0.002190 Epoch[068] Batch [3749]/[3760] Speed: 144.104786 samples/sec accuracy=86.297083 loss=0.511223 lr=0.002188 Batch [0049]/[0303]: acc-top1=65.968750 acc-top5=86.312500 Batch [0099]/[0303]: acc-top1=66.375000 acc-top5=86.203125 Batch [0149]/[0303]: acc-top1=65.895833 acc-top5=85.927083 Batch [0199]/[0303]: acc-top1=65.304688 acc-top5=85.765625 Batch [0249]/[0303]: acc-top1=65.356250 acc-top5=85.812500 Batch [0299]/[0303]: acc-top1=65.442708 acc-top5=85.734375 [Epoch 068] training: accuracy=86.296127 loss=0.511358 [Epoch 068] speed: 125 samples/sec time cost: 2107.715181 [Epoch 068] validation: acc-top1=65.413573 acc-top5=85.710602 loss=2.204265 Epoch[069] Batch [0049]/[3759] Speed: 89.355452 samples/sec accuracy=87.750000 loss=0.484496 lr=0.002186 Epoch[069] Batch [0099]/[3759] Speed: 126.928746 samples/sec accuracy=87.312500 loss=0.487660 lr=0.002185 Epoch[069] Batch [0149]/[3759] Speed: 125.054858 samples/sec accuracy=87.437500 loss=0.481801 lr=0.002183 Epoch[069] Batch [0199]/[3759] Speed: 130.236777 samples/sec accuracy=87.273438 loss=0.482256 lr=0.002181 Epoch[069] Batch [0249]/[3759] Speed: 121.042236 samples/sec accuracy=87.475000 loss=0.476446 lr=0.002179 Epoch[069] Batch [0299]/[3759] Speed: 123.977276 samples/sec accuracy=87.572917 loss=0.471748 lr=0.002178 Epoch[069] Batch [0349]/[3759] Speed: 127.405887 samples/sec accuracy=87.620536 loss=0.470887 lr=0.002176 Epoch[069] Batch [0399]/[3759] Speed: 126.307667 samples/sec accuracy=87.476562 loss=0.475986 lr=0.002174 Epoch[069] Batch [0449]/[3759] Speed: 123.826744 samples/sec accuracy=87.454861 loss=0.475521 lr=0.002172 Epoch[069] Batch [0499]/[3759] Speed: 126.638783 samples/sec accuracy=87.425000 loss=0.477474 lr=0.002171 Epoch[069] Batch [0549]/[3759] Speed: 123.718940 samples/sec accuracy=87.454545 loss=0.477482 lr=0.002169 Epoch[069] Batch [0599]/[3759] Speed: 125.141761 samples/sec accuracy=87.458333 loss=0.478213 lr=0.002167 Epoch[069] Batch [0649]/[3759] Speed: 128.803091 samples/sec accuracy=87.389423 loss=0.480408 lr=0.002166 Epoch[069] Batch [0699]/[3759] Speed: 118.756760 samples/sec accuracy=87.399554 loss=0.481615 lr=0.002164 Epoch[069] Batch [0749]/[3759] Speed: 130.910843 samples/sec accuracy=87.410417 loss=0.480450 lr=0.002162 Epoch[069] Batch [0799]/[3759] Speed: 126.689183 samples/sec accuracy=87.404297 loss=0.480642 lr=0.002160 Epoch[069] Batch [0849]/[3759] Speed: 119.555764 samples/sec accuracy=87.402574 loss=0.479694 lr=0.002159 Epoch[069] Batch [0899]/[3759] Speed: 128.084389 samples/sec accuracy=87.364583 loss=0.481105 lr=0.002157 Epoch[069] Batch [0949]/[3759] Speed: 126.713508 samples/sec accuracy=87.365132 loss=0.481692 lr=0.002155 Epoch[069] Batch [0999]/[3759] Speed: 122.309022 samples/sec accuracy=87.351562 loss=0.481588 lr=0.002154 Epoch[069] Batch [1049]/[3759] Speed: 126.686626 samples/sec accuracy=87.334821 loss=0.481481 lr=0.002152 Epoch[069] Batch [1099]/[3759] Speed: 127.586502 samples/sec accuracy=87.319602 loss=0.481456 lr=0.002150 Epoch[069] Batch [1149]/[3759] Speed: 120.646302 samples/sec accuracy=87.292120 loss=0.481877 lr=0.002148 Epoch[069] Batch [1199]/[3759] Speed: 128.049980 samples/sec accuracy=87.279948 loss=0.481891 lr=0.002147 Epoch[069] Batch [1249]/[3759] Speed: 133.925612 samples/sec accuracy=87.286250 loss=0.481066 lr=0.002145 Epoch[069] Batch [1299]/[3759] Speed: 116.165659 samples/sec accuracy=87.269231 loss=0.481168 lr=0.002143 Epoch[069] Batch [1349]/[3759] Speed: 126.945337 samples/sec accuracy=87.277778 loss=0.480367 lr=0.002142 Epoch[069] Batch [1399]/[3759] Speed: 129.879331 samples/sec accuracy=87.258929 loss=0.481659 lr=0.002140 Epoch[069] Batch [1449]/[3759] Speed: 122.052713 samples/sec accuracy=87.260776 loss=0.481639 lr=0.002138 Epoch[069] Batch [1499]/[3759] Speed: 126.402372 samples/sec accuracy=87.216667 loss=0.482760 lr=0.002136 Epoch[069] Batch [1549]/[3759] Speed: 123.412223 samples/sec accuracy=87.219758 loss=0.482208 lr=0.002135 Epoch[069] Batch [1599]/[3759] Speed: 127.729834 samples/sec accuracy=87.208984 loss=0.482169 lr=0.002133 Epoch[069] Batch [1649]/[3759] Speed: 126.137067 samples/sec accuracy=87.191288 loss=0.482615 lr=0.002131 Epoch[069] Batch [1699]/[3759] Speed: 123.500634 samples/sec accuracy=87.186581 loss=0.482591 lr=0.002130 Epoch[069] Batch [1749]/[3759] Speed: 128.735650 samples/sec accuracy=87.171429 loss=0.483133 lr=0.002128 Epoch[069] Batch [1799]/[3759] Speed: 122.772136 samples/sec accuracy=87.152778 loss=0.483680 lr=0.002126 Epoch[069] Batch [1849]/[3759] Speed: 126.455687 samples/sec accuracy=87.130912 loss=0.484186 lr=0.002124 Epoch[069] Batch [1899]/[3759] Speed: 123.864490 samples/sec accuracy=87.132401 loss=0.483995 lr=0.002123 Epoch[069] Batch [1949]/[3759] Speed: 128.062667 samples/sec accuracy=87.105769 loss=0.484942 lr=0.002121 Epoch[069] Batch [1999]/[3759] Speed: 128.366062 samples/sec accuracy=87.103906 loss=0.484911 lr=0.002119 Epoch[069] Batch [2049]/[3759] Speed: 123.148325 samples/sec accuracy=87.094512 loss=0.485457 lr=0.002118 Epoch[069] Batch [2099]/[3759] Speed: 124.958395 samples/sec accuracy=87.090774 loss=0.485388 lr=0.002116 Epoch[069] Batch [2149]/[3759] Speed: 122.314125 samples/sec accuracy=87.097384 loss=0.485272 lr=0.002114 Epoch[069] Batch [2199]/[3759] Speed: 130.406643 samples/sec accuracy=87.101562 loss=0.485060 lr=0.002112 Epoch[069] Batch [2249]/[3759] Speed: 121.001206 samples/sec accuracy=87.081944 loss=0.485314 lr=0.002111 Epoch[069] Batch [2299]/[3759] Speed: 128.994894 samples/sec accuracy=87.082880 loss=0.485664 lr=0.002109 Epoch[069] Batch [2349]/[3759] Speed: 127.164203 samples/sec accuracy=87.077793 loss=0.485584 lr=0.002107 Epoch[069] Batch [2399]/[3759] Speed: 124.073289 samples/sec accuracy=87.067708 loss=0.485793 lr=0.002106 Epoch[069] Batch [2449]/[3759] Speed: 124.658864 samples/sec accuracy=87.048469 loss=0.486541 lr=0.002104 Epoch[069] Batch [2499]/[3759] Speed: 130.062078 samples/sec accuracy=87.050625 loss=0.486306 lr=0.002102 Epoch[069] Batch [2549]/[3759] Speed: 124.126055 samples/sec accuracy=87.051471 loss=0.486142 lr=0.002101 Epoch[069] Batch [2599]/[3759] Speed: 121.064563 samples/sec accuracy=87.061298 loss=0.486020 lr=0.002099 Epoch[069] Batch [2649]/[3759] Speed: 124.865503 samples/sec accuracy=87.023585 loss=0.487077 lr=0.002097 Epoch[069] Batch [2699]/[3759] Speed: 129.762962 samples/sec accuracy=87.010417 loss=0.488120 lr=0.002095 Epoch[069] Batch [2749]/[3759] Speed: 119.227397 samples/sec accuracy=87.004545 loss=0.488430 lr=0.002094 Epoch[069] Batch [2799]/[3759] Speed: 127.913952 samples/sec accuracy=87.005580 loss=0.488499 lr=0.002092 Epoch[069] Batch [2849]/[3759] Speed: 122.023377 samples/sec accuracy=86.994518 loss=0.489154 lr=0.002090 Epoch[069] Batch [2899]/[3759] Speed: 124.938823 samples/sec accuracy=86.979526 loss=0.489644 lr=0.002089 Epoch[069] Batch [2949]/[3759] Speed: 127.648023 samples/sec accuracy=86.973517 loss=0.489846 lr=0.002087 Epoch[069] Batch [2999]/[3759] Speed: 124.601117 samples/sec accuracy=86.968229 loss=0.490012 lr=0.002085 Epoch[069] Batch [3049]/[3759] Speed: 126.287415 samples/sec accuracy=86.952869 loss=0.490319 lr=0.002084 Epoch[069] Batch [3099]/[3759] Speed: 124.314662 samples/sec accuracy=86.951109 loss=0.490301 lr=0.002082 Epoch[069] Batch [3149]/[3759] Speed: 128.099889 samples/sec accuracy=86.948909 loss=0.490272 lr=0.002080 Epoch[069] Batch [3199]/[3759] Speed: 129.221443 samples/sec accuracy=86.931641 loss=0.490793 lr=0.002078 Epoch[069] Batch [3249]/[3759] Speed: 122.008497 samples/sec accuracy=86.925962 loss=0.490602 lr=0.002077 Epoch[069] Batch [3299]/[3759] Speed: 130.174517 samples/sec accuracy=86.920928 loss=0.490828 lr=0.002075 Epoch[069] Batch [3349]/[3759] Speed: 114.707991 samples/sec accuracy=86.909515 loss=0.491218 lr=0.002073 Epoch[069] Batch [3399]/[3759] Speed: 133.380744 samples/sec accuracy=86.897059 loss=0.491812 lr=0.002072 Epoch[069] Batch [3449]/[3759] Speed: 125.400770 samples/sec accuracy=86.889493 loss=0.492010 lr=0.002070 Epoch[069] Batch [3499]/[3759] Speed: 121.036026 samples/sec accuracy=86.879464 loss=0.492468 lr=0.002068 Epoch[069] Batch [3549]/[3759] Speed: 132.965633 samples/sec accuracy=86.878521 loss=0.492188 lr=0.002067 Epoch[069] Batch [3599]/[3759] Speed: 117.294748 samples/sec accuracy=86.874132 loss=0.492497 lr=0.002065 Epoch[069] Batch [3649]/[3759] Speed: 126.106769 samples/sec accuracy=86.871575 loss=0.492513 lr=0.002063 Epoch[069] Batch [3699]/[3759] Speed: 134.390591 samples/sec accuracy=86.868243 loss=0.492615 lr=0.002062 Epoch[069] Batch [3749]/[3759] Speed: 137.121722 samples/sec accuracy=86.866667 loss=0.492647 lr=0.002060 Batch [0049]/[0303]: acc-top1=66.562500 acc-top5=86.625000 Batch [0099]/[0303]: acc-top1=66.390625 acc-top5=86.453125 Batch [0149]/[0303]: acc-top1=65.916667 acc-top5=86.104167 Batch [0199]/[0303]: acc-top1=65.335938 acc-top5=85.851562 Batch [0249]/[0303]: acc-top1=65.443750 acc-top5=85.793750 Batch [0299]/[0303]: acc-top1=65.484375 acc-top5=85.781250 [Epoch 069] training: accuracy=86.866520 loss=0.492599 [Epoch 069] speed: 125 samples/sec time cost: 2110.865965 [Epoch 069] validation: acc-top1=65.444513 acc-top5=85.762170 loss=2.245128 Epoch[070] Batch [0049]/[3760] Speed: 88.446305 samples/sec accuracy=87.218750 loss=0.471276 lr=0.002058 Epoch[070] Batch [0099]/[3760] Speed: 133.633089 samples/sec accuracy=87.015625 loss=0.493647 lr=0.002056 Epoch[070] Batch [0149]/[3760] Speed: 121.695262 samples/sec accuracy=87.270833 loss=0.487242 lr=0.002054 Epoch[070] Batch [0199]/[3760] Speed: 127.677397 samples/sec accuracy=87.617188 loss=0.475506 lr=0.002053 Epoch[070] Batch [0249]/[3760] Speed: 126.902879 samples/sec accuracy=87.656250 loss=0.470753 lr=0.002051 Epoch[070] Batch [0299]/[3760] Speed: 122.135182 samples/sec accuracy=87.734375 loss=0.469497 lr=0.002049 Epoch[070] Batch [0349]/[3760] Speed: 125.334150 samples/sec accuracy=87.575893 loss=0.472632 lr=0.002048 Epoch[070] Batch [0399]/[3760] Speed: 127.881932 samples/sec accuracy=87.675781 loss=0.470595 lr=0.002046 Epoch[070] Batch [0449]/[3760] Speed: 120.603720 samples/sec accuracy=87.743056 loss=0.468456 lr=0.002044 Epoch[070] Batch [0499]/[3760] Speed: 127.489905 samples/sec accuracy=87.696875 loss=0.469512 lr=0.002043 Epoch[070] Batch [0549]/[3760] Speed: 128.549858 samples/sec accuracy=87.619318 loss=0.470229 lr=0.002041 Epoch[070] Batch [0599]/[3760] Speed: 120.689480 samples/sec accuracy=87.695312 loss=0.468120 lr=0.002039 Epoch[070] Batch [0649]/[3760] Speed: 132.375686 samples/sec accuracy=87.757212 loss=0.465862 lr=0.002038 Epoch[070] Batch [0699]/[3760] Speed: 119.353132 samples/sec accuracy=87.772321 loss=0.464316 lr=0.002036 Epoch[070] Batch [0749]/[3760] Speed: 130.040523 samples/sec accuracy=87.743750 loss=0.464708 lr=0.002034 Epoch[070] Batch [0799]/[3760] Speed: 121.565107 samples/sec accuracy=87.740234 loss=0.464473 lr=0.002033 Epoch[070] Batch [0849]/[3760] Speed: 130.692766 samples/sec accuracy=87.753676 loss=0.463648 lr=0.002031 Epoch[070] Batch [0899]/[3760] Speed: 120.085151 samples/sec accuracy=87.755208 loss=0.462720 lr=0.002029 Epoch[070] Batch [0949]/[3760] Speed: 132.281399 samples/sec accuracy=87.743421 loss=0.463194 lr=0.002028 Epoch[070] Batch [0999]/[3760] Speed: 114.938568 samples/sec accuracy=87.770313 loss=0.462506 lr=0.002026 Epoch[070] Batch [1049]/[3760] Speed: 134.126962 samples/sec accuracy=87.775298 loss=0.462710 lr=0.002024 Epoch[070] Batch [1099]/[3760] Speed: 122.088479 samples/sec accuracy=87.748580 loss=0.463636 lr=0.002022 Epoch[070] Batch [1149]/[3760] Speed: 122.233984 samples/sec accuracy=87.717391 loss=0.463725 lr=0.002021 Epoch[070] Batch [1199]/[3760] Speed: 136.756606 samples/sec accuracy=87.677083 loss=0.464117 lr=0.002019 Epoch[070] Batch [1249]/[3760] Speed: 119.158834 samples/sec accuracy=87.667500 loss=0.464838 lr=0.002017 Epoch[070] Batch [1299]/[3760] Speed: 129.162289 samples/sec accuracy=87.662260 loss=0.464422 lr=0.002016 Epoch[070] Batch [1349]/[3760] Speed: 119.883154 samples/sec accuracy=87.643519 loss=0.464573 lr=0.002014 Epoch[070] Batch [1399]/[3760] Speed: 127.911803 samples/sec accuracy=87.636161 loss=0.465011 lr=0.002012 Epoch[070] Batch [1449]/[3760] Speed: 130.270927 samples/sec accuracy=87.632543 loss=0.465361 lr=0.002011 Epoch[070] Batch [1499]/[3760] Speed: 127.385670 samples/sec accuracy=87.609375 loss=0.465652 lr=0.002009 Epoch[070] Batch [1549]/[3760] Speed: 125.297105 samples/sec accuracy=87.614919 loss=0.465706 lr=0.002007 Epoch[070] Batch [1599]/[3760] Speed: 123.103974 samples/sec accuracy=87.597656 loss=0.465905 lr=0.002006 Epoch[070] Batch [1649]/[3760] Speed: 125.620246 samples/sec accuracy=87.593750 loss=0.466189 lr=0.002004 Epoch[070] Batch [1699]/[3760] Speed: 129.227198 samples/sec accuracy=87.578125 loss=0.466725 lr=0.002002 Epoch[070] Batch [1749]/[3760] Speed: 127.559574 samples/sec accuracy=87.563393 loss=0.466844 lr=0.002001 Epoch[070] Batch [1799]/[3760] Speed: 119.910912 samples/sec accuracy=87.573785 loss=0.466404 lr=0.001999 Epoch[070] Batch [1849]/[3760] Speed: 128.687196 samples/sec accuracy=87.576858 loss=0.466386 lr=0.001997 Epoch[070] Batch [1899]/[3760] Speed: 130.667951 samples/sec accuracy=87.551809 loss=0.467298 lr=0.001996 Epoch[070] Batch [1949]/[3760] Speed: 119.808252 samples/sec accuracy=87.566506 loss=0.467222 lr=0.001994 Epoch[070] Batch [1999]/[3760] Speed: 128.016087 samples/sec accuracy=87.563281 loss=0.467216 lr=0.001992 Epoch[070] Batch [2049]/[3760] Speed: 123.541408 samples/sec accuracy=87.554116 loss=0.467573 lr=0.001991 Epoch[070] Batch [2099]/[3760] Speed: 124.837043 samples/sec accuracy=87.549851 loss=0.467932 lr=0.001989 Epoch[070] Batch [2149]/[3760] Speed: 128.070874 samples/sec accuracy=87.546512 loss=0.468310 lr=0.001987 Epoch[070] Batch [2199]/[3760] Speed: 118.756174 samples/sec accuracy=87.528409 loss=0.468712 lr=0.001986 Epoch[070] Batch [2249]/[3760] Speed: 133.129572 samples/sec accuracy=87.537500 loss=0.468695 lr=0.001984 Epoch[070] Batch [2299]/[3760] Speed: 125.437658 samples/sec accuracy=87.523098 loss=0.469273 lr=0.001982 Epoch[070] Batch [2349]/[3760] Speed: 121.031671 samples/sec accuracy=87.533245 loss=0.469267 lr=0.001981 Epoch[070] Batch [2399]/[3760] Speed: 131.707380 samples/sec accuracy=87.524089 loss=0.469044 lr=0.001979 Epoch[070] Batch [2449]/[3760] Speed: 126.821090 samples/sec accuracy=87.505740 loss=0.469355 lr=0.001977 Epoch[070] Batch [2499]/[3760] Speed: 121.934190 samples/sec accuracy=87.480000 loss=0.469684 lr=0.001976 Epoch[070] Batch [2549]/[3760] Speed: 128.154616 samples/sec accuracy=87.456495 loss=0.470226 lr=0.001974 Epoch[070] Batch [2599]/[3760] Speed: 124.628548 samples/sec accuracy=87.453726 loss=0.470461 lr=0.001972 Epoch[070] Batch [2649]/[3760] Speed: 125.306632 samples/sec accuracy=87.447524 loss=0.470766 lr=0.001971 Epoch[070] Batch [2699]/[3760] Speed: 122.999999 samples/sec accuracy=87.450810 loss=0.470551 lr=0.001969 Epoch[070] Batch [2749]/[3760] Speed: 129.912620 samples/sec accuracy=87.469318 loss=0.470368 lr=0.001967 Epoch[070] Batch [2799]/[3760] Speed: 123.432171 samples/sec accuracy=87.468750 loss=0.470602 lr=0.001966 Epoch[070] Batch [2849]/[3760] Speed: 124.392076 samples/sec accuracy=87.490680 loss=0.470001 lr=0.001964 Epoch[070] Batch [2899]/[3760] Speed: 125.319174 samples/sec accuracy=87.467134 loss=0.470392 lr=0.001962 Epoch[070] Batch [2949]/[3760] Speed: 124.616302 samples/sec accuracy=87.449153 loss=0.470828 lr=0.001961 Epoch[070] Batch [2999]/[3760] Speed: 130.474460 samples/sec accuracy=87.460938 loss=0.470422 lr=0.001959 Epoch[070] Batch [3049]/[3760] Speed: 125.487975 samples/sec accuracy=87.446209 loss=0.470987 lr=0.001957 Epoch[070] Batch [3099]/[3760] Speed: 122.622393 samples/sec accuracy=87.450101 loss=0.470737 lr=0.001956 Epoch[070] Batch [3149]/[3760] Speed: 125.171405 samples/sec accuracy=87.448909 loss=0.470957 lr=0.001954 Epoch[070] Batch [3199]/[3760] Speed: 127.968327 samples/sec accuracy=87.428223 loss=0.471725 lr=0.001952 Epoch[070] Batch [3249]/[3760] Speed: 121.841908 samples/sec accuracy=87.413462 loss=0.472026 lr=0.001951 Epoch[070] Batch [3299]/[3760] Speed: 128.913113 samples/sec accuracy=87.398201 loss=0.472428 lr=0.001949 Epoch[070] Batch [3349]/[3760] Speed: 120.813355 samples/sec accuracy=87.392724 loss=0.472661 lr=0.001947 Epoch[070] Batch [3399]/[3760] Speed: 126.208877 samples/sec accuracy=87.392463 loss=0.472620 lr=0.001946 Epoch[070] Batch [3449]/[3760] Speed: 127.777971 samples/sec accuracy=87.390851 loss=0.472717 lr=0.001944 Epoch[070] Batch [3499]/[3760] Speed: 122.032657 samples/sec accuracy=87.383036 loss=0.473085 lr=0.001943 Epoch[070] Batch [3549]/[3760] Speed: 118.671236 samples/sec accuracy=87.387324 loss=0.472694 lr=0.001941 Epoch[070] Batch [3599]/[3760] Speed: 133.914244 samples/sec accuracy=87.385851 loss=0.472948 lr=0.001939 Epoch[070] Batch [3649]/[3760] Speed: 129.067690 samples/sec accuracy=87.387842 loss=0.472893 lr=0.001938 Epoch[070] Batch [3699]/[3760] Speed: 117.582380 samples/sec accuracy=87.366554 loss=0.473411 lr=0.001936 Epoch[070] Batch [3749]/[3760] Speed: 149.318501 samples/sec accuracy=87.356667 loss=0.473727 lr=0.001934 Batch [0049]/[0303]: acc-top1=65.718750 acc-top5=86.250000 Batch [0099]/[0303]: acc-top1=66.125000 acc-top5=86.328125 Batch [0149]/[0303]: acc-top1=65.854167 acc-top5=85.968750 Batch [0199]/[0303]: acc-top1=65.429688 acc-top5=85.757812 Batch [0249]/[0303]: acc-top1=65.381250 acc-top5=85.700000 Batch [0299]/[0303]: acc-top1=65.302083 acc-top5=85.656250 [Epoch 070] training: accuracy=87.352892 loss=0.473854 [Epoch 070] speed: 125 samples/sec time cost: 2108.623695 [Epoch 070] validation: acc-top1=65.227929 acc-top5=85.643564 loss=2.189826 Epoch[071] Batch [0049]/[3760] Speed: 86.291758 samples/sec accuracy=87.062500 loss=0.470751 lr=0.001932 Epoch[071] Batch [0099]/[3760] Speed: 138.850632 samples/sec accuracy=87.609375 loss=0.453240 lr=0.001931 Epoch[071] Batch [0149]/[3760] Speed: 120.052594 samples/sec accuracy=88.354167 loss=0.442546 lr=0.001929 Epoch[071] Batch [0199]/[3760] Speed: 126.423292 samples/sec accuracy=88.273438 loss=0.442880 lr=0.001927 Epoch[071] Batch [0249]/[3760] Speed: 121.533090 samples/sec accuracy=88.337500 loss=0.439565 lr=0.001926 Epoch[071] Batch [0299]/[3760] Speed: 128.135958 samples/sec accuracy=88.427083 loss=0.438480 lr=0.001924 Epoch[071] Batch [0349]/[3760] Speed: 127.038054 samples/sec accuracy=88.183036 loss=0.445259 lr=0.001922 Epoch[071] Batch [0399]/[3760] Speed: 123.090002 samples/sec accuracy=88.152344 loss=0.447076 lr=0.001921 Epoch[071] Batch [0449]/[3760] Speed: 127.532083 samples/sec accuracy=88.180556 loss=0.444815 lr=0.001919 Epoch[071] Batch [0499]/[3760] Speed: 125.575896 samples/sec accuracy=88.190625 loss=0.444263 lr=0.001917 Epoch[071] Batch [0549]/[3760] Speed: 122.335755 samples/sec accuracy=88.173295 loss=0.446297 lr=0.001916 Epoch[071] Batch [0599]/[3760] Speed: 127.643921 samples/sec accuracy=88.229167 loss=0.445865 lr=0.001914 Epoch[071] Batch [0649]/[3760] Speed: 129.060516 samples/sec accuracy=88.245192 loss=0.445792 lr=0.001913 Epoch[071] Batch [0699]/[3760] Speed: 120.510481 samples/sec accuracy=88.254464 loss=0.445525 lr=0.001911 Epoch[071] Batch [0749]/[3760] Speed: 126.649062 samples/sec accuracy=88.250000 loss=0.445613 lr=0.001909 Epoch[071] Batch [0799]/[3760] Speed: 125.270550 samples/sec accuracy=88.205078 loss=0.446126 lr=0.001908 Epoch[071] Batch [0849]/[3760] Speed: 127.458854 samples/sec accuracy=88.183824 loss=0.446632 lr=0.001906 Epoch[071] Batch [0899]/[3760] Speed: 127.273524 samples/sec accuracy=88.133681 loss=0.448362 lr=0.001904 Epoch[071] Batch [0949]/[3760] Speed: 126.740722 samples/sec accuracy=88.166118 loss=0.447746 lr=0.001903 Epoch[071] Batch [0999]/[3760] Speed: 119.073627 samples/sec accuracy=88.175000 loss=0.447684 lr=0.001901 Epoch[071] Batch [1049]/[3760] Speed: 133.172809 samples/sec accuracy=88.181548 loss=0.447424 lr=0.001899 Epoch[071] Batch [1099]/[3760] Speed: 120.807778 samples/sec accuracy=88.174716 loss=0.447374 lr=0.001898 Epoch[071] Batch [1149]/[3760] Speed: 129.278680 samples/sec accuracy=88.218750 loss=0.446206 lr=0.001896 Epoch[071] Batch [1199]/[3760] Speed: 122.183556 samples/sec accuracy=88.207031 loss=0.446368 lr=0.001894 Epoch[071] Batch [1249]/[3760] Speed: 129.235749 samples/sec accuracy=88.206250 loss=0.446659 lr=0.001893 Epoch[071] Batch [1299]/[3760] Speed: 119.148359 samples/sec accuracy=88.163462 loss=0.447902 lr=0.001891 Epoch[071] Batch [1349]/[3760] Speed: 127.008247 samples/sec accuracy=88.173611 loss=0.448391 lr=0.001890 Epoch[071] Batch [1399]/[3760] Speed: 133.335212 samples/sec accuracy=88.167411 loss=0.448389 lr=0.001888 Epoch[071] Batch [1449]/[3760] Speed: 119.081282 samples/sec accuracy=88.164871 loss=0.448752 lr=0.001886 Epoch[071] Batch [1499]/[3760] Speed: 128.155464 samples/sec accuracy=88.161458 loss=0.449236 lr=0.001885 Epoch[071] Batch [1549]/[3760] Speed: 125.125062 samples/sec accuracy=88.156250 loss=0.449487 lr=0.001883 Epoch[071] Batch [1599]/[3760] Speed: 123.789882 samples/sec accuracy=88.151367 loss=0.449874 lr=0.001881 Epoch[071] Batch [1649]/[3760] Speed: 124.636299 samples/sec accuracy=88.100379 loss=0.451013 lr=0.001880 Epoch[071] Batch [1699]/[3760] Speed: 127.635481 samples/sec accuracy=88.099265 loss=0.451069 lr=0.001878 Epoch[071] Batch [1749]/[3760] Speed: 124.807403 samples/sec accuracy=88.065179 loss=0.451627 lr=0.001876 Epoch[071] Batch [1799]/[3760] Speed: 127.602794 samples/sec accuracy=88.052951 loss=0.451297 lr=0.001875 Epoch[071] Batch [1849]/[3760] Speed: 127.723365 samples/sec accuracy=88.044764 loss=0.451649 lr=0.001873 Epoch[071] Batch [1899]/[3760] Speed: 117.541090 samples/sec accuracy=88.033717 loss=0.452153 lr=0.001872 Epoch[071] Batch [1949]/[3760] Speed: 132.482092 samples/sec accuracy=88.053686 loss=0.452023 lr=0.001870 Epoch[071] Batch [1999]/[3760] Speed: 119.323298 samples/sec accuracy=88.052344 loss=0.451941 lr=0.001868 Epoch[071] Batch [2049]/[3760] Speed: 132.060688 samples/sec accuracy=88.035061 loss=0.451923 lr=0.001867 Epoch[071] Batch [2099]/[3760] Speed: 119.561879 samples/sec accuracy=88.033482 loss=0.451559 lr=0.001865 Epoch[071] Batch [2149]/[3760] Speed: 130.550818 samples/sec accuracy=88.024709 loss=0.451748 lr=0.001863 Epoch[071] Batch [2199]/[3760] Speed: 122.387633 samples/sec accuracy=88.012074 loss=0.451699 lr=0.001862 Epoch[071] Batch [2249]/[3760] Speed: 133.831684 samples/sec accuracy=87.977083 loss=0.452579 lr=0.001860 Epoch[071] Batch [2299]/[3760] Speed: 119.204668 samples/sec accuracy=87.989130 loss=0.452238 lr=0.001859 Epoch[071] Batch [2349]/[3760] Speed: 134.587900 samples/sec accuracy=87.966755 loss=0.452727 lr=0.001857 Epoch[071] Batch [2399]/[3760] Speed: 117.624266 samples/sec accuracy=87.965495 loss=0.452891 lr=0.001855 Epoch[071] Batch [2449]/[3760] Speed: 130.256854 samples/sec accuracy=87.961735 loss=0.453065 lr=0.001854 Epoch[071] Batch [2499]/[3760] Speed: 121.388544 samples/sec accuracy=87.980625 loss=0.452684 lr=0.001852 Epoch[071] Batch [2549]/[3760] Speed: 127.922152 samples/sec accuracy=87.967525 loss=0.453229 lr=0.001850 Epoch[071] Batch [2599]/[3760] Speed: 129.585210 samples/sec accuracy=87.971154 loss=0.453399 lr=0.001849 Epoch[071] Batch [2649]/[3760] Speed: 121.654236 samples/sec accuracy=87.952241 loss=0.453792 lr=0.001847 Epoch[071] Batch [2699]/[3760] Speed: 129.574736 samples/sec accuracy=87.936921 loss=0.454059 lr=0.001846 Epoch[071] Batch [2749]/[3760] Speed: 122.439671 samples/sec accuracy=87.940909 loss=0.453597 lr=0.001844 Epoch[071] Batch [2799]/[3760] Speed: 120.503017 samples/sec accuracy=87.935268 loss=0.453719 lr=0.001842 Epoch[071] Batch [2849]/[3760] Speed: 131.674649 samples/sec accuracy=87.937500 loss=0.453645 lr=0.001841 Epoch[071] Batch [2899]/[3760] Speed: 132.788034 samples/sec accuracy=87.923491 loss=0.453994 lr=0.001839 Epoch[071] Batch [2949]/[3760] Speed: 117.835257 samples/sec accuracy=87.911547 loss=0.454579 lr=0.001837 Epoch[071] Batch [2999]/[3760] Speed: 130.796650 samples/sec accuracy=87.913542 loss=0.454594 lr=0.001836 Epoch[071] Batch [3049]/[3760] Speed: 118.156303 samples/sec accuracy=87.912910 loss=0.454453 lr=0.001834 Epoch[071] Batch [3099]/[3760] Speed: 128.539138 samples/sec accuracy=87.908770 loss=0.454657 lr=0.001833 Epoch[071] Batch [3149]/[3760] Speed: 127.850681 samples/sec accuracy=87.914187 loss=0.454624 lr=0.001831 Epoch[071] Batch [3199]/[3760] Speed: 116.358392 samples/sec accuracy=87.906738 loss=0.454770 lr=0.001829 Epoch[071] Batch [3249]/[3760] Speed: 133.005675 samples/sec accuracy=87.903365 loss=0.454684 lr=0.001828 Epoch[071] Batch [3299]/[3760] Speed: 121.336514 samples/sec accuracy=87.899621 loss=0.454691 lr=0.001826 Epoch[071] Batch [3349]/[3760] Speed: 126.547458 samples/sec accuracy=87.883396 loss=0.454983 lr=0.001825 Epoch[071] Batch [3399]/[3760] Speed: 133.737385 samples/sec accuracy=87.866728 loss=0.455555 lr=0.001823 Epoch[071] Batch [3449]/[3760] Speed: 114.612707 samples/sec accuracy=87.850543 loss=0.455788 lr=0.001821 Epoch[071] Batch [3499]/[3760] Speed: 130.676217 samples/sec accuracy=87.850000 loss=0.455837 lr=0.001820 Epoch[071] Batch [3549]/[3760] Speed: 126.570229 samples/sec accuracy=87.858275 loss=0.455688 lr=0.001818 Epoch[071] Batch [3599]/[3760] Speed: 125.937408 samples/sec accuracy=87.850260 loss=0.456191 lr=0.001816 Epoch[071] Batch [3649]/[3760] Speed: 125.493109 samples/sec accuracy=87.847603 loss=0.456245 lr=0.001815 Epoch[071] Batch [3699]/[3760] Speed: 125.530831 samples/sec accuracy=87.838260 loss=0.456491 lr=0.001813 Epoch[071] Batch [3749]/[3760] Speed: 142.180810 samples/sec accuracy=87.831250 loss=0.456798 lr=0.001812 Batch [0049]/[0303]: acc-top1=65.750000 acc-top5=85.937500 Batch [0099]/[0303]: acc-top1=66.046875 acc-top5=85.781250 Batch [0149]/[0303]: acc-top1=65.906250 acc-top5=85.822917 Batch [0199]/[0303]: acc-top1=65.468750 acc-top5=85.679688 Batch [0249]/[0303]: acc-top1=65.462500 acc-top5=85.631250 Batch [0299]/[0303]: acc-top1=65.276042 acc-top5=85.614583 [Epoch 071] training: accuracy=87.834940 loss=0.456703 [Epoch 071] speed: 125 samples/sec time cost: 2108.838188 [Epoch 071] validation: acc-top1=65.248556 acc-top5=85.561056 loss=2.238071 Epoch[072] Batch [0049]/[3759] Speed: 90.596030 samples/sec accuracy=88.468750 loss=0.428744 lr=0.001810 Epoch[072] Batch [0099]/[3759] Speed: 128.093022 samples/sec accuracy=89.296875 loss=0.408690 lr=0.001808 Epoch[072] Batch [0149]/[3759] Speed: 121.950375 samples/sec accuracy=88.937500 loss=0.411348 lr=0.001807 Epoch[072] Batch [0199]/[3759] Speed: 124.036949 samples/sec accuracy=88.820312 loss=0.414059 lr=0.001805 Epoch[072] Batch [0249]/[3759] Speed: 131.115488 samples/sec accuracy=88.862500 loss=0.416302 lr=0.001803 Epoch[072] Batch [0299]/[3759] Speed: 124.105659 samples/sec accuracy=88.979167 loss=0.414014 lr=0.001802 Epoch[072] Batch [0349]/[3759] Speed: 121.607122 samples/sec accuracy=88.870536 loss=0.414836 lr=0.001800 Epoch[072] Batch [0399]/[3759] Speed: 132.302296 samples/sec accuracy=88.832031 loss=0.416511 lr=0.001798 Epoch[072] Batch [0449]/[3759] Speed: 120.935611 samples/sec accuracy=88.802083 loss=0.417531 lr=0.001797 Epoch[072] Batch [0499]/[3759] Speed: 125.276035 samples/sec accuracy=88.884375 loss=0.417512 lr=0.001795 Epoch[072] Batch [0549]/[3759] Speed: 126.196104 samples/sec accuracy=88.863636 loss=0.420079 lr=0.001794 Epoch[072] Batch [0599]/[3759] Speed: 128.382869 samples/sec accuracy=88.802083 loss=0.421671 lr=0.001792 Epoch[072] Batch [0649]/[3759] Speed: 121.230545 samples/sec accuracy=88.800481 loss=0.423108 lr=0.001790 Epoch[072] Batch [0699]/[3759] Speed: 125.703233 samples/sec accuracy=88.816964 loss=0.422681 lr=0.001789 Epoch[072] Batch [0749]/[3759] Speed: 129.381295 samples/sec accuracy=88.804167 loss=0.423870 lr=0.001787 Epoch[072] Batch [0799]/[3759] Speed: 119.311053 samples/sec accuracy=88.808594 loss=0.423860 lr=0.001786 Epoch[072] Batch [0849]/[3759] Speed: 133.141765 samples/sec accuracy=88.751838 loss=0.425190 lr=0.001784 Epoch[072] Batch [0899]/[3759] Speed: 120.980395 samples/sec accuracy=88.753472 loss=0.425775 lr=0.001782 Epoch[072] Batch [0949]/[3759] Speed: 126.989310 samples/sec accuracy=88.792763 loss=0.425075 lr=0.001781 Epoch[072] Batch [0999]/[3759] Speed: 131.176535 samples/sec accuracy=88.782812 loss=0.425218 lr=0.001779 Epoch[072] Batch [1049]/[3759] Speed: 119.548117 samples/sec accuracy=88.751488 loss=0.425788 lr=0.001778 Epoch[072] Batch [1099]/[3759] Speed: 133.346367 samples/sec accuracy=88.769886 loss=0.425205 lr=0.001776 Epoch[072] Batch [1149]/[3759] Speed: 119.331250 samples/sec accuracy=88.752717 loss=0.426406 lr=0.001774 Epoch[072] Batch [1199]/[3759] Speed: 128.369561 samples/sec accuracy=88.729167 loss=0.426929 lr=0.001773 Epoch[072] Batch [1249]/[3759] Speed: 121.347248 samples/sec accuracy=88.747500 loss=0.427077 lr=0.001771 Epoch[072] Batch [1299]/[3759] Speed: 128.475749 samples/sec accuracy=88.717548 loss=0.427806 lr=0.001770 Epoch[072] Batch [1349]/[3759] Speed: 123.409803 samples/sec accuracy=88.701389 loss=0.428210 lr=0.001768 Epoch[072] Batch [1399]/[3759] Speed: 129.768500 samples/sec accuracy=88.687500 loss=0.428684 lr=0.001767 Epoch[072] Batch [1449]/[3759] Speed: 126.203531 samples/sec accuracy=88.686422 loss=0.427955 lr=0.001765 Epoch[072] Batch [1499]/[3759] Speed: 124.551008 samples/sec accuracy=88.647917 loss=0.429573 lr=0.001763 Epoch[072] Batch [1549]/[3759] Speed: 124.832552 samples/sec accuracy=88.609879 loss=0.430756 lr=0.001762 Epoch[072] Batch [1599]/[3759] Speed: 126.820505 samples/sec accuracy=88.585938 loss=0.431240 lr=0.001760 Epoch[072] Batch [1649]/[3759] Speed: 129.795061 samples/sec accuracy=88.576705 loss=0.431212 lr=0.001759 Epoch[072] Batch [1699]/[3759] Speed: 119.846029 samples/sec accuracy=88.568015 loss=0.431224 lr=0.001757 Epoch[072] Batch [1749]/[3759] Speed: 132.981936 samples/sec accuracy=88.560714 loss=0.431641 lr=0.001755 Epoch[072] Batch [1799]/[3759] Speed: 115.028540 samples/sec accuracy=88.564236 loss=0.431322 lr=0.001754 Epoch[072] Batch [1849]/[3759] Speed: 132.984234 samples/sec accuracy=88.570946 loss=0.431106 lr=0.001752 Epoch[072] Batch [1899]/[3759] Speed: 126.278384 samples/sec accuracy=88.578947 loss=0.430903 lr=0.001751 Epoch[072] Batch [1949]/[3759] Speed: 126.023899 samples/sec accuracy=88.576122 loss=0.430836 lr=0.001749 Epoch[072] Batch [1999]/[3759] Speed: 131.434537 samples/sec accuracy=88.575000 loss=0.430879 lr=0.001747 Epoch[072] Batch [2049]/[3759] Speed: 115.613415 samples/sec accuracy=88.554878 loss=0.431585 lr=0.001746 Epoch[072] Batch [2099]/[3759] Speed: 136.722530 samples/sec accuracy=88.554315 loss=0.431665 lr=0.001744 Epoch[072] Batch [2149]/[3759] Speed: 118.274015 samples/sec accuracy=88.558140 loss=0.431638 lr=0.001743 Epoch[072] Batch [2199]/[3759] Speed: 126.467216 samples/sec accuracy=88.557528 loss=0.431652 lr=0.001741 Epoch[072] Batch [2249]/[3759] Speed: 119.534715 samples/sec accuracy=88.546528 loss=0.432000 lr=0.001739 Epoch[072] Batch [2299]/[3759] Speed: 132.506594 samples/sec accuracy=88.557065 loss=0.431804 lr=0.001738 Epoch[072] Batch [2349]/[3759] Speed: 127.854386 samples/sec accuracy=88.531915 loss=0.432658 lr=0.001736 Epoch[072] Batch [2399]/[3759] Speed: 120.906349 samples/sec accuracy=88.534505 loss=0.432346 lr=0.001735 Epoch[072] Batch [2449]/[3759] Speed: 131.583116 samples/sec accuracy=88.530612 loss=0.432735 lr=0.001733 Epoch[072] Batch [2499]/[3759] Speed: 121.313974 samples/sec accuracy=88.518750 loss=0.432755 lr=0.001732 Epoch[072] Batch [2549]/[3759] Speed: 124.259505 samples/sec accuracy=88.523897 loss=0.432490 lr=0.001730 Epoch[072] Batch [2599]/[3759] Speed: 128.302178 samples/sec accuracy=88.498197 loss=0.433469 lr=0.001728 Epoch[072] Batch [2649]/[3759] Speed: 122.064987 samples/sec accuracy=88.482901 loss=0.433662 lr=0.001727 Epoch[072] Batch [2699]/[3759] Speed: 127.499162 samples/sec accuracy=88.488426 loss=0.433323 lr=0.001725 Epoch[072] Batch [2749]/[3759] Speed: 122.656467 samples/sec accuracy=88.478409 loss=0.433424 lr=0.001724 Epoch[072] Batch [2799]/[3759] Speed: 127.245479 samples/sec accuracy=88.473772 loss=0.433552 lr=0.001722 Epoch[072] Batch [2849]/[3759] Speed: 127.668893 samples/sec accuracy=88.473684 loss=0.433707 lr=0.001721 Epoch[072] Batch [2899]/[3759] Speed: 121.811460 samples/sec accuracy=88.463362 loss=0.433975 lr=0.001719 Epoch[072] Batch [2949]/[3759] Speed: 124.342297 samples/sec accuracy=88.467161 loss=0.434169 lr=0.001717 Epoch[072] Batch [2999]/[3759] Speed: 123.821107 samples/sec accuracy=88.460417 loss=0.434376 lr=0.001716 Epoch[072] Batch [3049]/[3759] Speed: 125.689928 samples/sec accuracy=88.456455 loss=0.434452 lr=0.001714 Epoch[072] Batch [3099]/[3759] Speed: 129.409698 samples/sec accuracy=88.455645 loss=0.434592 lr=0.001713 Epoch[072] Batch [3149]/[3759] Speed: 124.524617 samples/sec accuracy=88.461310 loss=0.434792 lr=0.001711 Epoch[072] Batch [3199]/[3759] Speed: 129.451893 samples/sec accuracy=88.463867 loss=0.434602 lr=0.001709 Epoch[072] Batch [3249]/[3759] Speed: 114.691934 samples/sec accuracy=88.470673 loss=0.434664 lr=0.001708 Epoch[072] Batch [3299]/[3759] Speed: 136.086092 samples/sec accuracy=88.473485 loss=0.434647 lr=0.001706 Epoch[072] Batch [3349]/[3759] Speed: 124.387459 samples/sec accuracy=88.474813 loss=0.434573 lr=0.001705 Epoch[072] Batch [3399]/[3759] Speed: 121.558494 samples/sec accuracy=88.469669 loss=0.434799 lr=0.001703 Epoch[072] Batch [3449]/[3759] Speed: 132.893212 samples/sec accuracy=88.454710 loss=0.435333 lr=0.001702 Epoch[072] Batch [3499]/[3759] Speed: 117.150021 samples/sec accuracy=88.442411 loss=0.435531 lr=0.001700 Epoch[072] Batch [3549]/[3759] Speed: 130.026184 samples/sec accuracy=88.426937 loss=0.435824 lr=0.001698 Epoch[072] Batch [3599]/[3759] Speed: 130.028991 samples/sec accuracy=88.424913 loss=0.436047 lr=0.001697 Epoch[072] Batch [3649]/[3759] Speed: 123.584787 samples/sec accuracy=88.413527 loss=0.436480 lr=0.001695 Epoch[072] Batch [3699]/[3759] Speed: 124.117213 samples/sec accuracy=88.402449 loss=0.436640 lr=0.001694 Epoch[072] Batch [3749]/[3759] Speed: 145.225803 samples/sec accuracy=88.406250 loss=0.436348 lr=0.001692 Batch [0049]/[0303]: acc-top1=65.500000 acc-top5=86.593750 Batch [0099]/[0303]: acc-top1=65.812500 acc-top5=86.140625 Batch [0149]/[0303]: acc-top1=65.479167 acc-top5=85.760417 Batch [0199]/[0303]: acc-top1=65.046875 acc-top5=85.617188 Batch [0249]/[0303]: acc-top1=65.237500 acc-top5=85.681250 Batch [0299]/[0303]: acc-top1=65.130208 acc-top5=85.734375 [Epoch 072] training: accuracy=88.408653 loss=0.436391 [Epoch 072] speed: 125 samples/sec time cost: 2108.559795 [Epoch 072] validation: acc-top1=65.124794 acc-top5=85.705446 loss=2.185008 Epoch[073] Batch [0049]/[3760] Speed: 90.071960 samples/sec accuracy=89.625000 loss=0.391738 lr=0.001690 Epoch[073] Batch [0099]/[3760] Speed: 127.709987 samples/sec accuracy=89.078125 loss=0.407848 lr=0.001689 Epoch[073] Batch [0149]/[3760] Speed: 127.456367 samples/sec accuracy=89.041667 loss=0.408386 lr=0.001687 Epoch[073] Batch [0199]/[3760] Speed: 120.525610 samples/sec accuracy=89.218750 loss=0.407043 lr=0.001686 Epoch[073] Batch [0249]/[3760] Speed: 131.945321 samples/sec accuracy=89.343750 loss=0.403738 lr=0.001684 Epoch[073] Batch [0299]/[3760] Speed: 126.335815 samples/sec accuracy=89.307292 loss=0.405509 lr=0.001683 Epoch[073] Batch [0349]/[3760] Speed: 122.338738 samples/sec accuracy=89.156250 loss=0.409086 lr=0.001681 Epoch[073] Batch [0399]/[3760] Speed: 124.749093 samples/sec accuracy=89.234375 loss=0.407413 lr=0.001679 Epoch[073] Batch [0449]/[3760] Speed: 131.437786 samples/sec accuracy=89.305556 loss=0.406462 lr=0.001678 Epoch[073] Batch [0499]/[3760] Speed: 116.613875 samples/sec accuracy=89.331250 loss=0.405980 lr=0.001676 Epoch[073] Batch [0549]/[3760] Speed: 133.107750 samples/sec accuracy=89.284091 loss=0.407556 lr=0.001675 Epoch[073] Batch [0599]/[3760] Speed: 133.506438 samples/sec accuracy=89.294271 loss=0.407438 lr=0.001673 Epoch[073] Batch [0649]/[3760] Speed: 116.092600 samples/sec accuracy=89.293269 loss=0.407449 lr=0.001672 Epoch[073] Batch [0699]/[3760] Speed: 131.125445 samples/sec accuracy=89.245536 loss=0.407246 lr=0.001670 Epoch[073] Batch [0749]/[3760] Speed: 121.127958 samples/sec accuracy=89.260417 loss=0.408411 lr=0.001669 Epoch[073] Batch [0799]/[3760] Speed: 128.128389 samples/sec accuracy=89.328125 loss=0.407856 lr=0.001667 Epoch[073] Batch [0849]/[3760] Speed: 119.153611 samples/sec accuracy=89.330882 loss=0.407640 lr=0.001665 Epoch[073] Batch [0899]/[3760] Speed: 133.876254 samples/sec accuracy=89.286458 loss=0.408793 lr=0.001664 Epoch[073] Batch [0949]/[3760] Speed: 125.867272 samples/sec accuracy=89.299342 loss=0.409009 lr=0.001662 Epoch[073] Batch [0999]/[3760] Speed: 118.014288 samples/sec accuracy=89.285938 loss=0.409497 lr=0.001661 Epoch[073] Batch [1049]/[3760] Speed: 134.334462 samples/sec accuracy=89.272321 loss=0.409517 lr=0.001659 Epoch[073] Batch [1099]/[3760] Speed: 117.230716 samples/sec accuracy=89.259943 loss=0.410129 lr=0.001658 Epoch[073] Batch [1149]/[3760] Speed: 131.173074 samples/sec accuracy=89.251359 loss=0.410121 lr=0.001656 Epoch[073] Batch [1199]/[3760] Speed: 129.656678 samples/sec accuracy=89.196615 loss=0.411143 lr=0.001655 Epoch[073] Batch [1249]/[3760] Speed: 119.771098 samples/sec accuracy=89.178750 loss=0.411556 lr=0.001653 Epoch[073] Batch [1299]/[3760] Speed: 123.554000 samples/sec accuracy=89.195913 loss=0.410805 lr=0.001651 Epoch[073] Batch [1349]/[3760] Speed: 131.029350 samples/sec accuracy=89.218750 loss=0.410580 lr=0.001650 Epoch[073] Batch [1399]/[3760] Speed: 123.036392 samples/sec accuracy=89.186384 loss=0.411627 lr=0.001648 Epoch[073] Batch [1449]/[3760] Speed: 124.511659 samples/sec accuracy=89.167026 loss=0.411837 lr=0.001647 Epoch[073] Batch [1499]/[3760] Speed: 131.256687 samples/sec accuracy=89.144792 loss=0.412164 lr=0.001645 Epoch[073] Batch [1549]/[3760] Speed: 116.036031 samples/sec accuracy=89.125000 loss=0.412502 lr=0.001644 Epoch[073] Batch [1599]/[3760] Speed: 132.753082 samples/sec accuracy=89.125000 loss=0.412374 lr=0.001642 Epoch[073] Batch [1649]/[3760] Speed: 120.450183 samples/sec accuracy=89.133523 loss=0.412385 lr=0.001641 Epoch[073] Batch [1699]/[3760] Speed: 127.238860 samples/sec accuracy=89.114890 loss=0.413168 lr=0.001639 Epoch[073] Batch [1749]/[3760] Speed: 127.004487 samples/sec accuracy=89.127679 loss=0.412635 lr=0.001637 Epoch[073] Batch [1799]/[3760] Speed: 123.273243 samples/sec accuracy=89.118924 loss=0.412488 lr=0.001636 Epoch[073] Batch [1849]/[3760] Speed: 124.011306 samples/sec accuracy=89.092905 loss=0.413603 lr=0.001634 Epoch[073] Batch [1899]/[3760] Speed: 125.791158 samples/sec accuracy=89.074836 loss=0.413862 lr=0.001633 Epoch[073] Batch [1949]/[3760] Speed: 130.685403 samples/sec accuracy=89.049679 loss=0.414736 lr=0.001631 Epoch[073] Batch [1999]/[3760] Speed: 119.330036 samples/sec accuracy=89.053125 loss=0.414385 lr=0.001630 Epoch[073] Batch [2049]/[3760] Speed: 135.541682 samples/sec accuracy=89.035061 loss=0.414714 lr=0.001628 Epoch[073] Batch [2099]/[3760] Speed: 115.792071 samples/sec accuracy=89.027530 loss=0.415387 lr=0.001627 Epoch[073] Batch [2149]/[3760] Speed: 129.991777 samples/sec accuracy=89.000000 loss=0.416083 lr=0.001625 Epoch[073] Batch [2199]/[3760] Speed: 122.351147 samples/sec accuracy=89.014915 loss=0.416149 lr=0.001624 Epoch[073] Batch [2249]/[3760] Speed: 130.607476 samples/sec accuracy=88.996528 loss=0.416742 lr=0.001622 Epoch[073] Batch [2299]/[3760] Speed: 128.392332 samples/sec accuracy=88.980299 loss=0.417025 lr=0.001620 Epoch[073] Batch [2349]/[3760] Speed: 124.304469 samples/sec accuracy=88.981383 loss=0.416917 lr=0.001619 Epoch[073] Batch [2399]/[3760] Speed: 127.698924 samples/sec accuracy=88.976562 loss=0.417212 lr=0.001617 Epoch[073] Batch [2449]/[3760] Speed: 117.807251 samples/sec accuracy=88.973852 loss=0.417227 lr=0.001616 Epoch[073] Batch [2499]/[3760] Speed: 129.109788 samples/sec accuracy=88.961875 loss=0.417546 lr=0.001614 Epoch[073] Batch [2549]/[3760] Speed: 126.878608 samples/sec accuracy=88.943015 loss=0.417992 lr=0.001613 Epoch[073] Batch [2599]/[3760] Speed: 121.757056 samples/sec accuracy=88.940505 loss=0.417995 lr=0.001611 Epoch[073] Batch [2649]/[3760] Speed: 129.384168 samples/sec accuracy=88.920991 loss=0.418543 lr=0.001610 Epoch[073] Batch [2699]/[3760] Speed: 121.897590 samples/sec accuracy=88.896412 loss=0.419166 lr=0.001608 Epoch[073] Batch [2749]/[3760] Speed: 130.282131 samples/sec accuracy=88.894886 loss=0.419241 lr=0.001607 Epoch[073] Batch [2799]/[3760] Speed: 122.926797 samples/sec accuracy=88.875000 loss=0.419976 lr=0.001605 Epoch[073] Batch [2849]/[3760] Speed: 128.328619 samples/sec accuracy=88.866228 loss=0.419824 lr=0.001604 Epoch[073] Batch [2899]/[3760] Speed: 126.651855 samples/sec accuracy=88.850754 loss=0.420010 lr=0.001602 Epoch[073] Batch [2949]/[3760] Speed: 123.536945 samples/sec accuracy=88.841631 loss=0.420211 lr=0.001601 Epoch[073] Batch [2999]/[3760] Speed: 127.341910 samples/sec accuracy=88.835417 loss=0.420500 lr=0.001599 Epoch[073] Batch [3049]/[3760] Speed: 118.643958 samples/sec accuracy=88.831455 loss=0.420657 lr=0.001597 Epoch[073] Batch [3099]/[3760] Speed: 134.374161 samples/sec accuracy=88.821069 loss=0.421010 lr=0.001596 Epoch[073] Batch [3149]/[3760] Speed: 118.318264 samples/sec accuracy=88.829861 loss=0.420646 lr=0.001594 Epoch[073] Batch [3199]/[3760] Speed: 130.146835 samples/sec accuracy=88.813477 loss=0.421175 lr=0.001593 Epoch[073] Batch [3249]/[3760] Speed: 125.504584 samples/sec accuracy=88.804808 loss=0.421428 lr=0.001591 Epoch[073] Batch [3299]/[3760] Speed: 125.393445 samples/sec accuracy=88.811553 loss=0.421188 lr=0.001590 Epoch[073] Batch [3349]/[3760] Speed: 123.969911 samples/sec accuracy=88.806903 loss=0.421061 lr=0.001588 Epoch[073] Batch [3399]/[3760] Speed: 125.729483 samples/sec accuracy=88.809283 loss=0.421347 lr=0.001587 Epoch[073] Batch [3449]/[3760] Speed: 127.714991 samples/sec accuracy=88.810688 loss=0.421232 lr=0.001585 Epoch[073] Batch [3499]/[3760] Speed: 121.858830 samples/sec accuracy=88.790625 loss=0.421741 lr=0.001584 Epoch[073] Batch [3549]/[3760] Speed: 128.852566 samples/sec accuracy=88.790053 loss=0.421663 lr=0.001582 Epoch[073] Batch [3599]/[3760] Speed: 120.908941 samples/sec accuracy=88.791667 loss=0.421566 lr=0.001581 Epoch[073] Batch [3649]/[3760] Speed: 128.812526 samples/sec accuracy=88.784247 loss=0.421833 lr=0.001579 Epoch[073] Batch [3699]/[3760] Speed: 129.761514 samples/sec accuracy=88.795186 loss=0.421818 lr=0.001578 Epoch[073] Batch [3749]/[3760] Speed: 139.744387 samples/sec accuracy=88.804167 loss=0.421756 lr=0.001576 Batch [0049]/[0303]: acc-top1=66.187500 acc-top5=86.718750 Batch [0099]/[0303]: acc-top1=66.703125 acc-top5=86.453125 Batch [0149]/[0303]: acc-top1=66.322917 acc-top5=86.177083 Batch [0199]/[0303]: acc-top1=65.804688 acc-top5=85.859375 Batch [0249]/[0303]: acc-top1=65.975000 acc-top5=85.900000 Batch [0299]/[0303]: acc-top1=65.901042 acc-top5=85.968750 [Epoch 073] training: accuracy=88.804023 loss=0.421706 [Epoch 073] speed: 125 samples/sec time cost: 2108.215122 [Epoch 073] validation: acc-top1=65.846741 acc-top5=85.932343 loss=2.154335 Epoch[074] Batch [0049]/[3760] Speed: 89.512488 samples/sec accuracy=90.375000 loss=0.387147 lr=0.001574 Epoch[074] Batch [0099]/[3760] Speed: 124.706846 samples/sec accuracy=89.890625 loss=0.398410 lr=0.001573 Epoch[074] Batch [0149]/[3760] Speed: 120.638970 samples/sec accuracy=90.125000 loss=0.387482 lr=0.001571 Epoch[074] Batch [0199]/[3760] Speed: 134.407794 samples/sec accuracy=90.132812 loss=0.380512 lr=0.001570 Epoch[074] Batch [0249]/[3760] Speed: 120.570470 samples/sec accuracy=89.912500 loss=0.383769 lr=0.001568 Epoch[074] Batch [0299]/[3760] Speed: 128.106284 samples/sec accuracy=89.843750 loss=0.385621 lr=0.001567 Epoch[074] Batch [0349]/[3760] Speed: 125.550493 samples/sec accuracy=89.883929 loss=0.383534 lr=0.001565 Epoch[074] Batch [0399]/[3760] Speed: 122.557810 samples/sec accuracy=89.855469 loss=0.384591 lr=0.001564 Epoch[074] Batch [0449]/[3760] Speed: 127.264435 samples/sec accuracy=89.881944 loss=0.385474 lr=0.001562 Epoch[074] Batch [0499]/[3760] Speed: 130.728401 samples/sec accuracy=89.856250 loss=0.385407 lr=0.001561 Epoch[074] Batch [0549]/[3760] Speed: 122.185750 samples/sec accuracy=89.923295 loss=0.384292 lr=0.001559 Epoch[074] Batch [0599]/[3760] Speed: 128.178389 samples/sec accuracy=89.916667 loss=0.385588 lr=0.001558 Epoch[074] Batch [0649]/[3760] Speed: 119.561582 samples/sec accuracy=89.971154 loss=0.383641 lr=0.001556 Epoch[074] Batch [0699]/[3760] Speed: 129.360434 samples/sec accuracy=89.904018 loss=0.384490 lr=0.001555 Epoch[074] Batch [0749]/[3760] Speed: 129.974151 samples/sec accuracy=89.889583 loss=0.385376 lr=0.001553 Epoch[074] Batch [0799]/[3760] Speed: 118.929573 samples/sec accuracy=89.822266 loss=0.388324 lr=0.001551 Epoch[074] Batch [0849]/[3760] Speed: 129.485648 samples/sec accuracy=89.740809 loss=0.390352 lr=0.001550 Epoch[074] Batch [0899]/[3760] Speed: 131.824357 samples/sec accuracy=89.763889 loss=0.390579 lr=0.001548 Epoch[074] Batch [0949]/[3760] Speed: 121.359477 samples/sec accuracy=89.725329 loss=0.391879 lr=0.001547 Epoch[074] Batch [0999]/[3760] Speed: 129.264566 samples/sec accuracy=89.696875 loss=0.393230 lr=0.001545 Epoch[074] Batch [1049]/[3760] Speed: 124.358649 samples/sec accuracy=89.712798 loss=0.393244 lr=0.001544 Epoch[074] Batch [1099]/[3760] Speed: 126.637472 samples/sec accuracy=89.711648 loss=0.393204 lr=0.001542 Epoch[074] Batch [1149]/[3760] Speed: 123.150563 samples/sec accuracy=89.699728 loss=0.393138 lr=0.001541 Epoch[074] Batch [1199]/[3760] Speed: 127.233841 samples/sec accuracy=89.628906 loss=0.395351 lr=0.001539 Epoch[074] Batch [1249]/[3760] Speed: 129.688227 samples/sec accuracy=89.601250 loss=0.396446 lr=0.001538 Epoch[074] Batch [1299]/[3760] Speed: 123.180947 samples/sec accuracy=89.603365 loss=0.396399 lr=0.001536 Epoch[074] Batch [1349]/[3760] Speed: 127.253366 samples/sec accuracy=89.592593 loss=0.396724 lr=0.001535 Epoch[074] Batch [1399]/[3760] Speed: 123.212277 samples/sec accuracy=89.582589 loss=0.396822 lr=0.001533 Epoch[074] Batch [1449]/[3760] Speed: 126.417815 samples/sec accuracy=89.585129 loss=0.397050 lr=0.001532 Epoch[074] Batch [1499]/[3760] Speed: 124.676151 samples/sec accuracy=89.600000 loss=0.396905 lr=0.001530 Epoch[074] Batch [1549]/[3760] Speed: 127.385414 samples/sec accuracy=89.588710 loss=0.396990 lr=0.001529 Epoch[074] Batch [1599]/[3760] Speed: 124.558399 samples/sec accuracy=89.554688 loss=0.397760 lr=0.001527 Epoch[074] Batch [1649]/[3760] Speed: 122.741337 samples/sec accuracy=89.551136 loss=0.397378 lr=0.001526 Epoch[074] Batch [1699]/[3760] Speed: 132.515844 samples/sec accuracy=89.526654 loss=0.397423 lr=0.001524 Epoch[074] Batch [1749]/[3760] Speed: 119.326282 samples/sec accuracy=89.556250 loss=0.396229 lr=0.001523 Epoch[074] Batch [1799]/[3760] Speed: 129.718252 samples/sec accuracy=89.577257 loss=0.395750 lr=0.001521 Epoch[074] Batch [1849]/[3760] Speed: 124.751514 samples/sec accuracy=89.594595 loss=0.395498 lr=0.001520 Epoch[074] Batch [1899]/[3760] Speed: 124.484132 samples/sec accuracy=89.602796 loss=0.395123 lr=0.001518 Epoch[074] Batch [1949]/[3760] Speed: 126.756983 samples/sec accuracy=89.618590 loss=0.395014 lr=0.001517 Epoch[074] Batch [1999]/[3760] Speed: 129.677085 samples/sec accuracy=89.614844 loss=0.395158 lr=0.001515 Epoch[074] Batch [2049]/[3760] Speed: 121.198801 samples/sec accuracy=89.616616 loss=0.395177 lr=0.001514 Epoch[074] Batch [2099]/[3760] Speed: 128.872402 samples/sec accuracy=89.610119 loss=0.395285 lr=0.001512 Epoch[074] Batch [2149]/[3760] Speed: 122.999692 samples/sec accuracy=89.605378 loss=0.395492 lr=0.001511 Epoch[074] Batch [2199]/[3760] Speed: 122.341192 samples/sec accuracy=89.601562 loss=0.395773 lr=0.001509 Epoch[074] Batch [2249]/[3760] Speed: 131.572053 samples/sec accuracy=89.580556 loss=0.396522 lr=0.001508 Epoch[074] Batch [2299]/[3760] Speed: 123.962371 samples/sec accuracy=89.581522 loss=0.396704 lr=0.001506 Epoch[074] Batch [2349]/[3760] Speed: 126.062735 samples/sec accuracy=89.582447 loss=0.396688 lr=0.001505 Epoch[074] Batch [2399]/[3760] Speed: 127.810246 samples/sec accuracy=89.567057 loss=0.396826 lr=0.001503 Epoch[074] Batch [2449]/[3760] Speed: 121.987598 samples/sec accuracy=89.566964 loss=0.397123 lr=0.001502 Epoch[074] Batch [2499]/[3760] Speed: 126.605039 samples/sec accuracy=89.540000 loss=0.398128 lr=0.001500 Epoch[074] Batch [2549]/[3760] Speed: 126.703103 samples/sec accuracy=89.520221 loss=0.398677 lr=0.001499 Epoch[074] Batch [2599]/[3760] Speed: 122.361185 samples/sec accuracy=89.511418 loss=0.398972 lr=0.001497 Epoch[074] Batch [2649]/[3760] Speed: 133.476210 samples/sec accuracy=89.505307 loss=0.399375 lr=0.001496 Epoch[074] Batch [2699]/[3760] Speed: 122.934676 samples/sec accuracy=89.483796 loss=0.399893 lr=0.001494 Epoch[074] Batch [2749]/[3760] Speed: 126.018095 samples/sec accuracy=89.477273 loss=0.399945 lr=0.001493 Epoch[074] Batch [2799]/[3760] Speed: 120.159420 samples/sec accuracy=89.465402 loss=0.400311 lr=0.001491 Epoch[074] Batch [2849]/[3760] Speed: 129.159786 samples/sec accuracy=89.441886 loss=0.400816 lr=0.001490 Epoch[074] Batch [2899]/[3760] Speed: 120.031423 samples/sec accuracy=89.426724 loss=0.401258 lr=0.001488 Epoch[074] Batch [2949]/[3760] Speed: 126.080755 samples/sec accuracy=89.417373 loss=0.401643 lr=0.001487 Epoch[074] Batch [2999]/[3760] Speed: 134.692898 samples/sec accuracy=89.429688 loss=0.401309 lr=0.001486 Epoch[074] Batch [3049]/[3760] Speed: 116.166653 samples/sec accuracy=89.417520 loss=0.401556 lr=0.001484 Epoch[074] Batch [3099]/[3760] Speed: 131.188729 samples/sec accuracy=89.393649 loss=0.402242 lr=0.001483 Epoch[074] Batch [3149]/[3760] Speed: 127.702004 samples/sec accuracy=89.393849 loss=0.402473 lr=0.001481 Epoch[074] Batch [3199]/[3760] Speed: 117.472056 samples/sec accuracy=89.398438 loss=0.402324 lr=0.001480 Epoch[074] Batch [3249]/[3760] Speed: 134.753747 samples/sec accuracy=89.387500 loss=0.402675 lr=0.001478 Epoch[074] Batch [3299]/[3760] Speed: 120.946907 samples/sec accuracy=89.386364 loss=0.402594 lr=0.001477 Epoch[074] Batch [3349]/[3760] Speed: 125.952914 samples/sec accuracy=89.374534 loss=0.402907 lr=0.001475 Epoch[074] Batch [3399]/[3760] Speed: 128.207069 samples/sec accuracy=89.348805 loss=0.403687 lr=0.001474 Epoch[074] Batch [3449]/[3760] Speed: 122.825697 samples/sec accuracy=89.333786 loss=0.403963 lr=0.001472 Epoch[074] Batch [3499]/[3760] Speed: 127.571508 samples/sec accuracy=89.325446 loss=0.404403 lr=0.001471 Epoch[074] Batch [3549]/[3760] Speed: 123.902042 samples/sec accuracy=89.327905 loss=0.404285 lr=0.001469 Epoch[074] Batch [3599]/[3760] Speed: 123.367425 samples/sec accuracy=89.322483 loss=0.404336 lr=0.001468 Epoch[074] Batch [3649]/[3760] Speed: 124.089820 samples/sec accuracy=89.330479 loss=0.404335 lr=0.001466 Epoch[074] Batch [3699]/[3760] Speed: 133.778073 samples/sec accuracy=89.330659 loss=0.404237 lr=0.001465 Epoch[074] Batch [3749]/[3760] Speed: 136.749971 samples/sec accuracy=89.326667 loss=0.404300 lr=0.001463 Batch [0049]/[0303]: acc-top1=65.593750 acc-top5=86.625000 Batch [0099]/[0303]: acc-top1=65.562500 acc-top5=86.359375 Batch [0149]/[0303]: acc-top1=65.645833 acc-top5=86.000000 Batch [0199]/[0303]: acc-top1=65.085938 acc-top5=85.789062 Batch [0249]/[0303]: acc-top1=65.212500 acc-top5=85.731250 Batch [0299]/[0303]: acc-top1=65.244792 acc-top5=85.760417 [Epoch 074] training: accuracy=89.331366 loss=0.404155 [Epoch 074] speed: 125 samples/sec time cost: 2106.492487 [Epoch 074] validation: acc-top1=65.196988 acc-top5=85.741543 loss=2.158580 Epoch[075] Batch [0049]/[3759] Speed: 90.090316 samples/sec accuracy=91.375000 loss=0.357594 lr=0.001462 Epoch[075] Batch [0099]/[3759] Speed: 127.419573 samples/sec accuracy=90.781250 loss=0.368886 lr=0.001460 Epoch[075] Batch [0149]/[3759] Speed: 125.839572 samples/sec accuracy=90.750000 loss=0.368178 lr=0.001459 Epoch[075] Batch [0199]/[3759] Speed: 125.295096 samples/sec accuracy=90.882812 loss=0.366648 lr=0.001457 Epoch[075] Batch [0249]/[3759] Speed: 133.152488 samples/sec accuracy=90.643750 loss=0.372039 lr=0.001456 Epoch[075] Batch [0299]/[3759] Speed: 117.631260 samples/sec accuracy=90.526042 loss=0.371987 lr=0.001454 Epoch[075] Batch [0349]/[3759] Speed: 134.583167 samples/sec accuracy=90.477679 loss=0.372654 lr=0.001453 Epoch[075] Batch [0399]/[3759] Speed: 118.088906 samples/sec accuracy=90.519531 loss=0.371950 lr=0.001451 Epoch[075] Batch [0449]/[3759] Speed: 132.053645 samples/sec accuracy=90.447917 loss=0.373853 lr=0.001450 Epoch[075] Batch [0499]/[3759] Speed: 122.229891 samples/sec accuracy=90.412500 loss=0.373365 lr=0.001448 Epoch[075] Batch [0549]/[3759] Speed: 126.658641 samples/sec accuracy=90.377841 loss=0.373629 lr=0.001447 Epoch[075] Batch [0599]/[3759] Speed: 127.134224 samples/sec accuracy=90.351562 loss=0.373230 lr=0.001445 Epoch[075] Batch [0649]/[3759] Speed: 133.143300 samples/sec accuracy=90.350962 loss=0.374228 lr=0.001444 Epoch[075] Batch [0699]/[3759] Speed: 116.914669 samples/sec accuracy=90.252232 loss=0.376640 lr=0.001442 Epoch[075] Batch [0749]/[3759] Speed: 129.632373 samples/sec accuracy=90.193750 loss=0.377734 lr=0.001441 Epoch[075] Batch [0799]/[3759] Speed: 121.323836 samples/sec accuracy=90.173828 loss=0.378945 lr=0.001439 Epoch[075] Batch [0849]/[3759] Speed: 126.707145 samples/sec accuracy=90.178309 loss=0.378746 lr=0.001438 Epoch[075] Batch [0899]/[3759] Speed: 130.568753 samples/sec accuracy=90.204861 loss=0.378305 lr=0.001437 Epoch[075] Batch [0949]/[3759] Speed: 118.392438 samples/sec accuracy=90.175987 loss=0.379002 lr=0.001435 Epoch[075] Batch [0999]/[3759] Speed: 132.998268 samples/sec accuracy=90.139062 loss=0.379392 lr=0.001434 Epoch[075] Batch [1049]/[3759] Speed: 122.095608 samples/sec accuracy=90.089286 loss=0.380444 lr=0.001432 Epoch[075] Batch [1099]/[3759] Speed: 126.673791 samples/sec accuracy=90.096591 loss=0.381118 lr=0.001431 Epoch[075] Batch [1149]/[3759] Speed: 127.323473 samples/sec accuracy=90.133152 loss=0.380453 lr=0.001429 Epoch[075] Batch [1199]/[3759] Speed: 119.184989 samples/sec accuracy=90.106771 loss=0.381132 lr=0.001428 Epoch[075] Batch [1249]/[3759] Speed: 131.787613 samples/sec accuracy=90.077500 loss=0.381907 lr=0.001426 Epoch[075] Batch [1299]/[3759] Speed: 126.393223 samples/sec accuracy=90.078125 loss=0.381772 lr=0.001425 Epoch[075] Batch [1349]/[3759] Speed: 120.949792 samples/sec accuracy=90.072917 loss=0.381965 lr=0.001423 Epoch[075] Batch [1399]/[3759] Speed: 134.367284 samples/sec accuracy=90.081473 loss=0.381868 lr=0.001422 Epoch[075] Batch [1449]/[3759] Speed: 117.412167 samples/sec accuracy=90.072198 loss=0.381628 lr=0.001420 Epoch[075] Batch [1499]/[3759] Speed: 131.269262 samples/sec accuracy=90.068750 loss=0.381712 lr=0.001419 Epoch[075] Batch [1549]/[3759] Speed: 124.499336 samples/sec accuracy=90.044355 loss=0.381520 lr=0.001418 Epoch[075] Batch [1599]/[3759] Speed: 122.267028 samples/sec accuracy=90.017578 loss=0.381747 lr=0.001416 Epoch[075] Batch [1649]/[3759] Speed: 128.811138 samples/sec accuracy=89.989583 loss=0.382232 lr=0.001415 Epoch[075] Batch [1699]/[3759] Speed: 119.111675 samples/sec accuracy=90.008272 loss=0.381948 lr=0.001413 Epoch[075] Batch [1749]/[3759] Speed: 134.218708 samples/sec accuracy=89.973214 loss=0.382824 lr=0.001412 Epoch[075] Batch [1799]/[3759] Speed: 121.007124 samples/sec accuracy=89.981771 loss=0.383075 lr=0.001410 Epoch[075] Batch [1849]/[3759] Speed: 127.936651 samples/sec accuracy=89.939189 loss=0.384044 lr=0.001409 Epoch[075] Batch [1899]/[3759] Speed: 126.655271 samples/sec accuracy=89.947368 loss=0.383566 lr=0.001407 Epoch[075] Batch [1949]/[3759] Speed: 121.652826 samples/sec accuracy=89.933494 loss=0.383689 lr=0.001406 Epoch[075] Batch [1999]/[3759] Speed: 123.516865 samples/sec accuracy=89.923438 loss=0.383650 lr=0.001404 Epoch[075] Batch [2049]/[3759] Speed: 134.973455 samples/sec accuracy=89.950457 loss=0.383448 lr=0.001403 Epoch[075] Batch [2099]/[3759] Speed: 116.230893 samples/sec accuracy=89.956845 loss=0.383526 lr=0.001402 Epoch[075] Batch [2149]/[3759] Speed: 131.810063 samples/sec accuracy=89.962936 loss=0.383706 lr=0.001400 Epoch[075] Batch [2199]/[3759] Speed: 119.663019 samples/sec accuracy=89.949574 loss=0.383606 lr=0.001399 Epoch[075] Batch [2249]/[3759] Speed: 127.292925 samples/sec accuracy=89.947917 loss=0.383151 lr=0.001397 Epoch[075] Batch [2299]/[3759] Speed: 134.866450 samples/sec accuracy=89.967391 loss=0.382998 lr=0.001396 Epoch[075] Batch [2349]/[3759] Speed: 115.582703 samples/sec accuracy=89.953457 loss=0.383349 lr=0.001394 Epoch[075] Batch [2399]/[3759] Speed: 133.580901 samples/sec accuracy=89.939453 loss=0.383743 lr=0.001393 Epoch[075] Batch [2449]/[3759] Speed: 118.863907 samples/sec accuracy=89.931122 loss=0.384353 lr=0.001391 Epoch[075] Batch [2499]/[3759] Speed: 129.037111 samples/sec accuracy=89.938750 loss=0.384421 lr=0.001390 Epoch[075] Batch [2549]/[3759] Speed: 124.753205 samples/sec accuracy=89.932598 loss=0.384737 lr=0.001388 Epoch[075] Batch [2599]/[3759] Speed: 129.754098 samples/sec accuracy=89.931490 loss=0.384585 lr=0.001387 Epoch[075] Batch [2649]/[3759] Speed: 117.812188 samples/sec accuracy=89.909198 loss=0.384987 lr=0.001386 Epoch[075] Batch [2699]/[3759] Speed: 129.582405 samples/sec accuracy=89.917824 loss=0.384756 lr=0.001384 Epoch[075] Batch [2749]/[3759] Speed: 124.765104 samples/sec accuracy=89.906250 loss=0.384922 lr=0.001383 Epoch[075] Batch [2799]/[3759] Speed: 130.221323 samples/sec accuracy=89.902344 loss=0.385191 lr=0.001381 Epoch[075] Batch [2849]/[3759] Speed: 122.845700 samples/sec accuracy=89.898575 loss=0.385134 lr=0.001380 Epoch[075] Batch [2899]/[3759] Speed: 126.489718 samples/sec accuracy=89.877155 loss=0.385742 lr=0.001378 Epoch[075] Batch [2949]/[3759] Speed: 125.989857 samples/sec accuracy=89.887712 loss=0.385264 lr=0.001377 Epoch[075] Batch [2999]/[3759] Speed: 122.908024 samples/sec accuracy=89.883854 loss=0.385490 lr=0.001376 Epoch[075] Batch [3049]/[3759] Speed: 126.034671 samples/sec accuracy=89.875512 loss=0.385511 lr=0.001374 Epoch[075] Batch [3099]/[3759] Speed: 124.286052 samples/sec accuracy=89.855343 loss=0.385881 lr=0.001373 Epoch[075] Batch [3149]/[3759] Speed: 122.781453 samples/sec accuracy=89.851687 loss=0.386139 lr=0.001371 Epoch[075] Batch [3199]/[3759] Speed: 132.935680 samples/sec accuracy=89.841797 loss=0.386278 lr=0.001370 Epoch[075] Batch [3249]/[3759] Speed: 120.266066 samples/sec accuracy=89.844712 loss=0.386094 lr=0.001368 Epoch[075] Batch [3299]/[3759] Speed: 128.913222 samples/sec accuracy=89.844697 loss=0.386210 lr=0.001367 Epoch[075] Batch [3349]/[3759] Speed: 124.681028 samples/sec accuracy=89.833489 loss=0.386487 lr=0.001365 Epoch[075] Batch [3399]/[3759] Speed: 124.307919 samples/sec accuracy=89.847426 loss=0.386223 lr=0.001364 Epoch[075] Batch [3449]/[3759] Speed: 127.072056 samples/sec accuracy=89.847373 loss=0.386055 lr=0.001363 Epoch[075] Batch [3499]/[3759] Speed: 131.033176 samples/sec accuracy=89.826339 loss=0.386522 lr=0.001361 Epoch[075] Batch [3549]/[3759] Speed: 117.689394 samples/sec accuracy=89.826585 loss=0.386628 lr=0.001360 Epoch[075] Batch [3599]/[3759] Speed: 131.708993 samples/sec accuracy=89.821181 loss=0.386750 lr=0.001358 Epoch[075] Batch [3649]/[3759] Speed: 122.109537 samples/sec accuracy=89.811216 loss=0.387137 lr=0.001357 Epoch[075] Batch [3699]/[3759] Speed: 123.392990 samples/sec accuracy=89.817990 loss=0.387312 lr=0.001355 Epoch[075] Batch [3749]/[3759] Speed: 149.114491 samples/sec accuracy=89.822500 loss=0.387313 lr=0.001354 Batch [0049]/[0303]: acc-top1=66.687500 acc-top5=86.468750 Batch [0099]/[0303]: acc-top1=66.593750 acc-top5=86.328125 Batch [0149]/[0303]: acc-top1=66.114583 acc-top5=86.197917 Batch [0199]/[0303]: acc-top1=65.789062 acc-top5=85.859375 Batch [0249]/[0303]: acc-top1=65.956250 acc-top5=85.806250 Batch [0299]/[0303]: acc-top1=65.911458 acc-top5=85.869792 [Epoch 075] training: accuracy=89.824006 loss=0.387262 [Epoch 075] speed: 125 samples/sec time cost: 2106.035665 [Epoch 075] validation: acc-top1=65.857054 acc-top5=85.849835 loss=2.216069 Epoch[076] Batch [0049]/[3760] Speed: 89.445889 samples/sec accuracy=90.687500 loss=0.356224 lr=0.001352 Epoch[076] Batch [0099]/[3760] Speed: 129.995462 samples/sec accuracy=90.484375 loss=0.368408 lr=0.001351 Epoch[076] Batch [0149]/[3760] Speed: 116.584634 samples/sec accuracy=90.479167 loss=0.365868 lr=0.001349 Epoch[076] Batch [0199]/[3760] Speed: 133.114949 samples/sec accuracy=90.539062 loss=0.365421 lr=0.001348 Epoch[076] Batch [0249]/[3760] Speed: 121.338115 samples/sec accuracy=90.662500 loss=0.364222 lr=0.001347 Epoch[076] Batch [0299]/[3760] Speed: 121.681920 samples/sec accuracy=90.713542 loss=0.362334 lr=0.001345 Epoch[076] Batch [0349]/[3760] Speed: 129.967468 samples/sec accuracy=90.553571 loss=0.364647 lr=0.001344 Epoch[076] Batch [0399]/[3760] Speed: 127.986179 samples/sec accuracy=90.496094 loss=0.364898 lr=0.001342 Epoch[076] Batch [0449]/[3760] Speed: 121.985872 samples/sec accuracy=90.527778 loss=0.362764 lr=0.001341 Epoch[076] Batch [0499]/[3760] Speed: 132.767813 samples/sec accuracy=90.562500 loss=0.362707 lr=0.001339 Epoch[076] Batch [0549]/[3760] Speed: 119.896051 samples/sec accuracy=90.571023 loss=0.362786 lr=0.001338 Epoch[076] Batch [0599]/[3760] Speed: 125.352066 samples/sec accuracy=90.513021 loss=0.363397 lr=0.001337 Epoch[076] Batch [0649]/[3760] Speed: 132.037736 samples/sec accuracy=90.524038 loss=0.362600 lr=0.001335 Epoch[076] Batch [0699]/[3760] Speed: 122.800248 samples/sec accuracy=90.542411 loss=0.363069 lr=0.001334 Epoch[076] Batch [0749]/[3760] Speed: 128.329001 samples/sec accuracy=90.531250 loss=0.362569 lr=0.001332 Epoch[076] Batch [0799]/[3760] Speed: 118.522130 samples/sec accuracy=90.507812 loss=0.362754 lr=0.001331 Epoch[076] Batch [0849]/[3760] Speed: 129.936145 samples/sec accuracy=90.461397 loss=0.363908 lr=0.001330 Epoch[076] Batch [0899]/[3760] Speed: 123.403639 samples/sec accuracy=90.480903 loss=0.363327 lr=0.001328 Epoch[076] Batch [0949]/[3760] Speed: 132.518543 samples/sec accuracy=90.455592 loss=0.364160 lr=0.001327 Epoch[076] Batch [0999]/[3760] Speed: 121.409010 samples/sec accuracy=90.448437 loss=0.365118 lr=0.001325 Epoch[076] Batch [1049]/[3760] Speed: 126.086343 samples/sec accuracy=90.480655 loss=0.364628 lr=0.001324 Epoch[076] Batch [1099]/[3760] Speed: 124.092487 samples/sec accuracy=90.421875 loss=0.366739 lr=0.001322 Epoch[076] Batch [1149]/[3760] Speed: 123.784365 samples/sec accuracy=90.427989 loss=0.367000 lr=0.001321 Epoch[076] Batch [1199]/[3760] Speed: 127.164950 samples/sec accuracy=90.436198 loss=0.366672 lr=0.001320 Epoch[076] Batch [1249]/[3760] Speed: 121.822394 samples/sec accuracy=90.380000 loss=0.368217 lr=0.001318 Epoch[076] Batch [1299]/[3760] Speed: 126.880122 samples/sec accuracy=90.391827 loss=0.367978 lr=0.001317 Epoch[076] Batch [1349]/[3760] Speed: 121.151900 samples/sec accuracy=90.390046 loss=0.367960 lr=0.001315 Epoch[076] Batch [1399]/[3760] Speed: 131.020665 samples/sec accuracy=90.366071 loss=0.368285 lr=0.001314 Epoch[076] Batch [1449]/[3760] Speed: 127.893179 samples/sec accuracy=90.378233 loss=0.368207 lr=0.001313 Epoch[076] Batch [1499]/[3760] Speed: 117.880857 samples/sec accuracy=90.362500 loss=0.368771 lr=0.001311 Epoch[076] Batch [1549]/[3760] Speed: 132.117480 samples/sec accuracy=90.344758 loss=0.369326 lr=0.001310 Epoch[076] Batch [1599]/[3760] Speed: 128.493246 samples/sec accuracy=90.349609 loss=0.369467 lr=0.001308 Epoch[076] Batch [1649]/[3760] Speed: 122.088758 samples/sec accuracy=90.358902 loss=0.368552 lr=0.001307 Epoch[076] Batch [1699]/[3760] Speed: 116.158039 samples/sec accuracy=90.341912 loss=0.368838 lr=0.001305 Epoch[076] Batch [1749]/[3760] Speed: 136.241344 samples/sec accuracy=90.311607 loss=0.369646 lr=0.001304 Epoch[076] Batch [1799]/[3760] Speed: 134.436463 samples/sec accuracy=90.303819 loss=0.369687 lr=0.001303 Epoch[076] Batch [1849]/[3760] Speed: 115.328796 samples/sec accuracy=90.318412 loss=0.369534 lr=0.001301 Epoch[076] Batch [1899]/[3760] Speed: 130.099030 samples/sec accuracy=90.334704 loss=0.369575 lr=0.001300 Epoch[076] Batch [1949]/[3760] Speed: 123.587081 samples/sec accuracy=90.355769 loss=0.369084 lr=0.001298 Epoch[076] Batch [1999]/[3760] Speed: 124.350253 samples/sec accuracy=90.354687 loss=0.369080 lr=0.001297 Epoch[076] Batch [2049]/[3760] Speed: 126.964421 samples/sec accuracy=90.352896 loss=0.369149 lr=0.001296 Epoch[076] Batch [2099]/[3760] Speed: 120.746337 samples/sec accuracy=90.352679 loss=0.368941 lr=0.001294 Epoch[076] Batch [2149]/[3760] Speed: 131.365616 samples/sec accuracy=90.357558 loss=0.368736 lr=0.001293 Epoch[076] Batch [2199]/[3760] Speed: 125.277187 samples/sec accuracy=90.345881 loss=0.369169 lr=0.001291 Epoch[076] Batch [2249]/[3760] Speed: 127.956208 samples/sec accuracy=90.343750 loss=0.369460 lr=0.001290 Epoch[076] Batch [2299]/[3760] Speed: 123.408067 samples/sec accuracy=90.355299 loss=0.369231 lr=0.001289 Epoch[076] Batch [2349]/[3760] Speed: 123.114019 samples/sec accuracy=90.357713 loss=0.369408 lr=0.001287 Epoch[076] Batch [2399]/[3760] Speed: 130.857680 samples/sec accuracy=90.359375 loss=0.369106 lr=0.001286 Epoch[076] Batch [2449]/[3760] Speed: 123.172643 samples/sec accuracy=90.338648 loss=0.369661 lr=0.001284 Epoch[076] Batch [2499]/[3760] Speed: 128.547236 samples/sec accuracy=90.331250 loss=0.369833 lr=0.001283 Epoch[076] Batch [2549]/[3760] Speed: 123.204770 samples/sec accuracy=90.302083 loss=0.370663 lr=0.001282 Epoch[076] Batch [2599]/[3760] Speed: 129.899959 samples/sec accuracy=90.303486 loss=0.370594 lr=0.001280 Epoch[076] Batch [2649]/[3760] Speed: 118.044692 samples/sec accuracy=90.281840 loss=0.370968 lr=0.001279 Epoch[076] Batch [2699]/[3760] Speed: 133.555900 samples/sec accuracy=90.255787 loss=0.371850 lr=0.001277 Epoch[076] Batch [2749]/[3760] Speed: 122.877031 samples/sec accuracy=90.262500 loss=0.371745 lr=0.001276 Epoch[076] Batch [2799]/[3760] Speed: 127.151586 samples/sec accuracy=90.250000 loss=0.372144 lr=0.001275 Epoch[076] Batch [2849]/[3760] Speed: 126.746065 samples/sec accuracy=90.243421 loss=0.372081 lr=0.001273 Epoch[076] Batch [2899]/[3760] Speed: 123.277849 samples/sec accuracy=90.247845 loss=0.372266 lr=0.001272 Epoch[076] Batch [2949]/[3760] Speed: 130.575874 samples/sec accuracy=90.245763 loss=0.372104 lr=0.001271 Epoch[076] Batch [2999]/[3760] Speed: 119.239789 samples/sec accuracy=90.229167 loss=0.372199 lr=0.001269 Epoch[076] Batch [3049]/[3760] Speed: 129.990497 samples/sec accuracy=90.223873 loss=0.372161 lr=0.001268 Epoch[076] Batch [3099]/[3760] Speed: 130.125940 samples/sec accuracy=90.228327 loss=0.371813 lr=0.001266 Epoch[076] Batch [3149]/[3760] Speed: 121.736556 samples/sec accuracy=90.215774 loss=0.372178 lr=0.001265 Epoch[076] Batch [3199]/[3760] Speed: 129.046560 samples/sec accuracy=90.198730 loss=0.372682 lr=0.001264 Epoch[076] Batch [3249]/[3760] Speed: 121.032317 samples/sec accuracy=90.191827 loss=0.373057 lr=0.001262 Epoch[076] Batch [3299]/[3760] Speed: 127.289813 samples/sec accuracy=90.190341 loss=0.372982 lr=0.001261 Epoch[076] Batch [3349]/[3760] Speed: 129.115267 samples/sec accuracy=90.187034 loss=0.373299 lr=0.001259 Epoch[076] Batch [3399]/[3760] Speed: 126.321980 samples/sec accuracy=90.185662 loss=0.373323 lr=0.001258 Epoch[076] Batch [3449]/[3760] Speed: 123.773206 samples/sec accuracy=90.173913 loss=0.374043 lr=0.001257 Epoch[076] Batch [3499]/[3760] Speed: 129.620647 samples/sec accuracy=90.175893 loss=0.374191 lr=0.001255 Epoch[076] Batch [3549]/[3760] Speed: 123.315006 samples/sec accuracy=90.170335 loss=0.374274 lr=0.001254 Epoch[076] Batch [3599]/[3760] Speed: 127.024670 samples/sec accuracy=90.166667 loss=0.374591 lr=0.001252 Epoch[076] Batch [3649]/[3760] Speed: 121.649836 samples/sec accuracy=90.157534 loss=0.374892 lr=0.001251 Epoch[076] Batch [3699]/[3760] Speed: 131.474197 samples/sec accuracy=90.157095 loss=0.374919 lr=0.001250 Epoch[076] Batch [3749]/[3760] Speed: 140.166797 samples/sec accuracy=90.161667 loss=0.374858 lr=0.001248 Batch [0049]/[0303]: acc-top1=66.218750 acc-top5=86.625000 Batch [0099]/[0303]: acc-top1=66.468750 acc-top5=86.671875 Batch [0149]/[0303]: acc-top1=66.281250 acc-top5=86.270833 Batch [0199]/[0303]: acc-top1=65.929688 acc-top5=85.945312 Batch [0249]/[0303]: acc-top1=65.993750 acc-top5=85.918750 Batch [0299]/[0303]: acc-top1=65.859375 acc-top5=86.072917 [Epoch 076] training: accuracy=90.164561 loss=0.374808 [Epoch 076] speed: 125 samples/sec time cost: 2105.635430 [Epoch 076] validation: acc-top1=65.815800 acc-top5=86.050949 loss=2.200567 Epoch[077] Batch [0049]/[3760] Speed: 89.286664 samples/sec accuracy=90.687500 loss=0.366654 lr=0.001247 Epoch[077] Batch [0099]/[3760] Speed: 131.081128 samples/sec accuracy=90.750000 loss=0.359513 lr=0.001245 Epoch[077] Batch [0149]/[3760] Speed: 125.211550 samples/sec accuracy=90.875000 loss=0.351745 lr=0.001244 Epoch[077] Batch [0199]/[3760] Speed: 120.142885 samples/sec accuracy=91.156250 loss=0.346210 lr=0.001243 Epoch[077] Batch [0249]/[3760] Speed: 128.401115 samples/sec accuracy=91.150000 loss=0.345889 lr=0.001241 Epoch[077] Batch [0299]/[3760] Speed: 129.285837 samples/sec accuracy=91.046875 loss=0.350282 lr=0.001240 Epoch[077] Batch [0349]/[3760] Speed: 124.295634 samples/sec accuracy=91.133929 loss=0.347862 lr=0.001238 Epoch[077] Batch [0399]/[3760] Speed: 120.617776 samples/sec accuracy=91.035156 loss=0.349933 lr=0.001237 Epoch[077] Batch [0449]/[3760] Speed: 128.913446 samples/sec accuracy=90.989583 loss=0.350611 lr=0.001236 Epoch[077] Batch [0499]/[3760] Speed: 124.772090 samples/sec accuracy=90.968750 loss=0.351671 lr=0.001234 Epoch[077] Batch [0549]/[3760] Speed: 120.474787 samples/sec accuracy=90.877841 loss=0.354724 lr=0.001233 Epoch[077] Batch [0599]/[3760] Speed: 131.465618 samples/sec accuracy=90.981771 loss=0.352633 lr=0.001232 Epoch[077] Batch [0649]/[3760] Speed: 121.553057 samples/sec accuracy=91.038462 loss=0.351100 lr=0.001230 Epoch[077] Batch [0699]/[3760] Speed: 133.746154 samples/sec accuracy=90.997768 loss=0.351562 lr=0.001229 Epoch[077] Batch [0749]/[3760] Speed: 119.727112 samples/sec accuracy=91.012500 loss=0.350150 lr=0.001227 Epoch[077] Batch [0799]/[3760] Speed: 126.838066 samples/sec accuracy=91.039062 loss=0.349928 lr=0.001226 Epoch[077] Batch [0849]/[3760] Speed: 129.400862 samples/sec accuracy=91.001838 loss=0.350832 lr=0.001225 Epoch[077] Batch [0899]/[3760] Speed: 126.112570 samples/sec accuracy=90.994792 loss=0.349460 lr=0.001223 Epoch[077] Batch [0949]/[3760] Speed: 119.322077 samples/sec accuracy=90.991776 loss=0.349348 lr=0.001222 Epoch[077] Batch [0999]/[3760] Speed: 134.478440 samples/sec accuracy=90.970312 loss=0.350015 lr=0.001221 Epoch[077] Batch [1049]/[3760] Speed: 116.322825 samples/sec accuracy=90.961310 loss=0.350018 lr=0.001219 Epoch[077] Batch [1099]/[3760] Speed: 129.281021 samples/sec accuracy=90.967330 loss=0.349883 lr=0.001218 Epoch[077] Batch [1149]/[3760] Speed: 127.200555 samples/sec accuracy=90.936141 loss=0.350884 lr=0.001216 Epoch[077] Batch [1199]/[3760] Speed: 120.789519 samples/sec accuracy=90.927083 loss=0.351991 lr=0.001215 Epoch[077] Batch [1249]/[3760] Speed: 131.703759 samples/sec accuracy=90.908750 loss=0.351972 lr=0.001214 Epoch[077] Batch [1299]/[3760] Speed: 118.797503 samples/sec accuracy=90.891827 loss=0.352430 lr=0.001212 Epoch[077] Batch [1349]/[3760] Speed: 127.830582 samples/sec accuracy=90.861111 loss=0.353469 lr=0.001211 Epoch[077] Batch [1399]/[3760] Speed: 127.298141 samples/sec accuracy=90.842634 loss=0.353734 lr=0.001210 Epoch[077] Batch [1449]/[3760] Speed: 125.053240 samples/sec accuracy=90.836207 loss=0.353462 lr=0.001208 Epoch[077] Batch [1499]/[3760] Speed: 124.542052 samples/sec accuracy=90.828125 loss=0.353389 lr=0.001207 Epoch[077] Batch [1549]/[3760] Speed: 126.107770 samples/sec accuracy=90.825605 loss=0.353032 lr=0.001206 Epoch[077] Batch [1599]/[3760] Speed: 131.763103 samples/sec accuracy=90.801758 loss=0.353833 lr=0.001204 Epoch[077] Batch [1649]/[3760] Speed: 119.198361 samples/sec accuracy=90.807765 loss=0.354204 lr=0.001203 Epoch[077] Batch [1699]/[3760] Speed: 129.565836 samples/sec accuracy=90.793199 loss=0.354725 lr=0.001201 Epoch[077] Batch [1749]/[3760] Speed: 122.832529 samples/sec accuracy=90.797321 loss=0.354209 lr=0.001200 Epoch[077] Batch [1799]/[3760] Speed: 128.517777 samples/sec accuracy=90.776910 loss=0.355138 lr=0.001199 Epoch[077] Batch [1849]/[3760] Speed: 121.785944 samples/sec accuracy=90.798986 loss=0.354845 lr=0.001197 Epoch[077] Batch [1899]/[3760] Speed: 127.633737 samples/sec accuracy=90.769737 loss=0.355462 lr=0.001196 Epoch[077] Batch [1949]/[3760] Speed: 122.910307 samples/sec accuracy=90.784455 loss=0.355108 lr=0.001195 Epoch[077] Batch [1999]/[3760] Speed: 131.469339 samples/sec accuracy=90.779687 loss=0.355196 lr=0.001193 Epoch[077] Batch [2049]/[3760] Speed: 122.185443 samples/sec accuracy=90.767530 loss=0.355452 lr=0.001192 Epoch[077] Batch [2099]/[3760] Speed: 125.330068 samples/sec accuracy=90.748512 loss=0.355745 lr=0.001191 Epoch[077] Batch [2149]/[3760] Speed: 122.320146 samples/sec accuracy=90.742006 loss=0.355854 lr=0.001189 Epoch[077] Batch [2199]/[3760] Speed: 134.782744 samples/sec accuracy=90.713068 loss=0.356828 lr=0.001188 Epoch[077] Batch [2249]/[3760] Speed: 118.065966 samples/sec accuracy=90.723611 loss=0.356521 lr=0.001187 Epoch[077] Batch [2299]/[3760] Speed: 132.534620 samples/sec accuracy=90.718071 loss=0.356917 lr=0.001185 Epoch[077] Batch [2349]/[3760] Speed: 117.261611 samples/sec accuracy=90.724734 loss=0.356889 lr=0.001184 Epoch[077] Batch [2399]/[3760] Speed: 129.107206 samples/sec accuracy=90.704427 loss=0.357534 lr=0.001183 Epoch[077] Batch [2449]/[3760] Speed: 125.983339 samples/sec accuracy=90.705995 loss=0.357733 lr=0.001181 Epoch[077] Batch [2499]/[3760] Speed: 127.214755 samples/sec accuracy=90.711250 loss=0.357555 lr=0.001180 Epoch[077] Batch [2549]/[3760] Speed: 127.742966 samples/sec accuracy=90.704044 loss=0.357355 lr=0.001178 Epoch[077] Batch [2599]/[3760] Speed: 121.006354 samples/sec accuracy=90.696514 loss=0.357236 lr=0.001177 Epoch[077] Batch [2649]/[3760] Speed: 131.253953 samples/sec accuracy=90.705189 loss=0.357431 lr=0.001176 Epoch[077] Batch [2699]/[3760] Speed: 124.675724 samples/sec accuracy=90.694444 loss=0.357954 lr=0.001174 Epoch[077] Batch [2749]/[3760] Speed: 121.821899 samples/sec accuracy=90.676136 loss=0.358410 lr=0.001173 Epoch[077] Batch [2799]/[3760] Speed: 132.285173 samples/sec accuracy=90.665179 loss=0.358736 lr=0.001172 Epoch[077] Batch [2849]/[3760] Speed: 121.998056 samples/sec accuracy=90.658991 loss=0.358844 lr=0.001170 Epoch[077] Batch [2899]/[3760] Speed: 125.058837 samples/sec accuracy=90.659483 loss=0.358918 lr=0.001169 Epoch[077] Batch [2949]/[3760] Speed: 129.035146 samples/sec accuracy=90.679555 loss=0.358423 lr=0.001168 Epoch[077] Batch [2999]/[3760] Speed: 116.656794 samples/sec accuracy=90.682292 loss=0.358256 lr=0.001166 Epoch[077] Batch [3049]/[3760] Speed: 133.811299 samples/sec accuracy=90.670594 loss=0.358687 lr=0.001165 Epoch[077] Batch [3099]/[3760] Speed: 121.163369 samples/sec accuracy=90.660786 loss=0.358755 lr=0.001164 Epoch[077] Batch [3149]/[3760] Speed: 126.979736 samples/sec accuracy=90.665179 loss=0.358741 lr=0.001162 Epoch[077] Batch [3199]/[3760] Speed: 131.824744 samples/sec accuracy=90.678223 loss=0.358781 lr=0.001161 Epoch[077] Batch [3249]/[3760] Speed: 123.888315 samples/sec accuracy=90.677404 loss=0.358952 lr=0.001160 Epoch[077] Batch [3299]/[3760] Speed: 124.119271 samples/sec accuracy=90.688447 loss=0.358815 lr=0.001158 Epoch[077] Batch [3349]/[3760] Speed: 123.679330 samples/sec accuracy=90.688899 loss=0.358917 lr=0.001157 Epoch[077] Batch [3399]/[3760] Speed: 125.336060 samples/sec accuracy=90.689338 loss=0.358793 lr=0.001156 Epoch[077] Batch [3449]/[3760] Speed: 128.698568 samples/sec accuracy=90.679348 loss=0.359087 lr=0.001154 Epoch[077] Batch [3499]/[3760] Speed: 123.279886 samples/sec accuracy=90.669643 loss=0.359216 lr=0.001153 Epoch[077] Batch [3549]/[3760] Speed: 131.602825 samples/sec accuracy=90.657570 loss=0.359297 lr=0.001152 Epoch[077] Batch [3599]/[3760] Speed: 117.437900 samples/sec accuracy=90.650608 loss=0.359573 lr=0.001150 Epoch[077] Batch [3649]/[3760] Speed: 128.586576 samples/sec accuracy=90.648116 loss=0.359802 lr=0.001149 Epoch[077] Batch [3699]/[3760] Speed: 122.658523 samples/sec accuracy=90.637247 loss=0.360175 lr=0.001148 Epoch[077] Batch [3749]/[3760] Speed: 142.057591 samples/sec accuracy=90.632500 loss=0.360158 lr=0.001146 Batch [0049]/[0303]: acc-top1=65.718750 acc-top5=86.937500 Batch [0099]/[0303]: acc-top1=66.406250 acc-top5=86.609375 Batch [0149]/[0303]: acc-top1=66.333333 acc-top5=86.385417 Batch [0199]/[0303]: acc-top1=65.906250 acc-top5=86.156250 Batch [0249]/[0303]: acc-top1=66.150000 acc-top5=86.100000 Batch [0299]/[0303]: acc-top1=66.166667 acc-top5=86.125000 [Epoch 077] training: accuracy=90.632064 loss=0.360165 [Epoch 077] speed: 125 samples/sec time cost: 2109.621798 [Epoch 077] validation: acc-top1=66.099422 acc-top5=86.087046 loss=2.162162 Epoch[078] Batch [0049]/[3759] Speed: 88.369692 samples/sec accuracy=91.562500 loss=0.333868 lr=0.001145 Epoch[078] Batch [0099]/[3759] Speed: 131.123721 samples/sec accuracy=91.328125 loss=0.342384 lr=0.001143 Epoch[078] Batch [0149]/[3759] Speed: 130.687821 samples/sec accuracy=91.354167 loss=0.336237 lr=0.001142 Epoch[078] Batch [0199]/[3759] Speed: 118.895941 samples/sec accuracy=91.257812 loss=0.337275 lr=0.001141 Epoch[078] Batch [0249]/[3759] Speed: 132.290915 samples/sec accuracy=91.331250 loss=0.334837 lr=0.001139 Epoch[078] Batch [0299]/[3759] Speed: 115.948170 samples/sec accuracy=91.187500 loss=0.336978 lr=0.001138 Epoch[078] Batch [0349]/[3759] Speed: 134.578498 samples/sec accuracy=91.187500 loss=0.335703 lr=0.001137 Epoch[078] Batch [0399]/[3759] Speed: 117.521391 samples/sec accuracy=91.292969 loss=0.332791 lr=0.001135 Epoch[078] Batch [0449]/[3759] Speed: 130.945506 samples/sec accuracy=91.208333 loss=0.335002 lr=0.001134 Epoch[078] Batch [0499]/[3759] Speed: 128.805815 samples/sec accuracy=91.303125 loss=0.331643 lr=0.001133 Epoch[078] Batch [0549]/[3759] Speed: 121.983356 samples/sec accuracy=91.335227 loss=0.332356 lr=0.001131 Epoch[078] Batch [0599]/[3759] Speed: 128.236744 samples/sec accuracy=91.346354 loss=0.333001 lr=0.001130 Epoch[078] Batch [0649]/[3759] Speed: 123.876579 samples/sec accuracy=91.278846 loss=0.333985 lr=0.001129 Epoch[078] Batch [0699]/[3759] Speed: 125.781412 samples/sec accuracy=91.276786 loss=0.335543 lr=0.001127 Epoch[078] Batch [0749]/[3759] Speed: 123.907807 samples/sec accuracy=91.260417 loss=0.336141 lr=0.001126 Epoch[078] Batch [0799]/[3759] Speed: 130.542186 samples/sec accuracy=91.263672 loss=0.336167 lr=0.001125 Epoch[078] Batch [0849]/[3759] Speed: 118.679198 samples/sec accuracy=91.244485 loss=0.336470 lr=0.001124 Epoch[078] Batch [0899]/[3759] Speed: 132.394635 samples/sec accuracy=91.262153 loss=0.335909 lr=0.001122 Epoch[078] Batch [0949]/[3759] Speed: 118.145027 samples/sec accuracy=91.261513 loss=0.336186 lr=0.001121 Epoch[078] Batch [0999]/[3759] Speed: 129.793667 samples/sec accuracy=91.246875 loss=0.336789 lr=0.001120 Epoch[078] Batch [1049]/[3759] Speed: 120.717674 samples/sec accuracy=91.235119 loss=0.337734 lr=0.001118 Epoch[078] Batch [1099]/[3759] Speed: 129.569736 samples/sec accuracy=91.207386 loss=0.338154 lr=0.001117 Epoch[078] Batch [1149]/[3759] Speed: 121.901345 samples/sec accuracy=91.182065 loss=0.338466 lr=0.001116 Epoch[078] Batch [1199]/[3759] Speed: 135.302808 samples/sec accuracy=91.175781 loss=0.338237 lr=0.001114 Epoch[078] Batch [1249]/[3759] Speed: 119.883683 samples/sec accuracy=91.187500 loss=0.337956 lr=0.001113 Epoch[078] Batch [1299]/[3759] Speed: 128.683257 samples/sec accuracy=91.147837 loss=0.338993 lr=0.001112 Epoch[078] Batch [1349]/[3759] Speed: 125.919647 samples/sec accuracy=91.120370 loss=0.339153 lr=0.001110 Epoch[078] Batch [1399]/[3759] Speed: 125.712993 samples/sec accuracy=91.082589 loss=0.339891 lr=0.001109 Epoch[078] Batch [1449]/[3759] Speed: 126.135200 samples/sec accuracy=91.091595 loss=0.339978 lr=0.001108 Epoch[078] Batch [1499]/[3759] Speed: 124.492510 samples/sec accuracy=91.103125 loss=0.340066 lr=0.001106 Epoch[078] Batch [1549]/[3759] Speed: 125.768243 samples/sec accuracy=91.109879 loss=0.339623 lr=0.001105 Epoch[078] Batch [1599]/[3759] Speed: 123.886051 samples/sec accuracy=91.103516 loss=0.339878 lr=0.001104 Epoch[078] Batch [1649]/[3759] Speed: 127.399529 samples/sec accuracy=91.108902 loss=0.340228 lr=0.001102 Epoch[078] Batch [1699]/[3759] Speed: 129.588688 samples/sec accuracy=91.114890 loss=0.340006 lr=0.001101 Epoch[078] Batch [1749]/[3759] Speed: 120.480729 samples/sec accuracy=91.125893 loss=0.339824 lr=0.001100 Epoch[078] Batch [1799]/[3759] Speed: 124.433354 samples/sec accuracy=91.125000 loss=0.339630 lr=0.001099 Epoch[078] Batch [1849]/[3759] Speed: 123.731219 samples/sec accuracy=91.098818 loss=0.340507 lr=0.001097 Epoch[078] Batch [1899]/[3759] Speed: 127.310329 samples/sec accuracy=91.084704 loss=0.340673 lr=0.001096 Epoch[078] Batch [1949]/[3759] Speed: 130.646445 samples/sec accuracy=91.077724 loss=0.340761 lr=0.001095 Epoch[078] Batch [1999]/[3759] Speed: 120.631866 samples/sec accuracy=91.086719 loss=0.340824 lr=0.001093 Epoch[078] Batch [2049]/[3759] Speed: 129.568142 samples/sec accuracy=91.063262 loss=0.341426 lr=0.001092 Epoch[078] Batch [2099]/[3759] Speed: 129.430905 samples/sec accuracy=91.080357 loss=0.341279 lr=0.001091 Epoch[078] Batch [2149]/[3759] Speed: 122.673802 samples/sec accuracy=91.069767 loss=0.341660 lr=0.001089 Epoch[078] Batch [2199]/[3759] Speed: 128.857784 samples/sec accuracy=91.058239 loss=0.341955 lr=0.001088 Epoch[078] Batch [2249]/[3759] Speed: 116.774887 samples/sec accuracy=91.061111 loss=0.342091 lr=0.001087 Epoch[078] Batch [2299]/[3759] Speed: 133.685541 samples/sec accuracy=91.057745 loss=0.341965 lr=0.001086 Epoch[078] Batch [2349]/[3759] Speed: 128.240486 samples/sec accuracy=91.045878 loss=0.342443 lr=0.001084 Epoch[078] Batch [2399]/[3759] Speed: 119.152382 samples/sec accuracy=91.050781 loss=0.342083 lr=0.001083 Epoch[078] Batch [2449]/[3759] Speed: 134.372704 samples/sec accuracy=91.043367 loss=0.342243 lr=0.001082 Epoch[078] Batch [2499]/[3759] Speed: 117.269493 samples/sec accuracy=91.045625 loss=0.342407 lr=0.001080 Epoch[078] Batch [2549]/[3759] Speed: 135.121854 samples/sec accuracy=91.034314 loss=0.342349 lr=0.001079 Epoch[078] Batch [2599]/[3759] Speed: 123.363114 samples/sec accuracy=91.036058 loss=0.342487 lr=0.001078 Epoch[078] Batch [2649]/[3759] Speed: 124.688590 samples/sec accuracy=91.044222 loss=0.342447 lr=0.001076 Epoch[078] Batch [2699]/[3759] Speed: 134.195643 samples/sec accuracy=91.043403 loss=0.342643 lr=0.001075 Epoch[078] Batch [2749]/[3759] Speed: 116.482524 samples/sec accuracy=91.030114 loss=0.342924 lr=0.001074 Epoch[078] Batch [2799]/[3759] Speed: 124.808288 samples/sec accuracy=91.036272 loss=0.342637 lr=0.001073 Epoch[078] Batch [2849]/[3759] Speed: 125.357888 samples/sec accuracy=91.036732 loss=0.342722 lr=0.001071 Epoch[078] Batch [2899]/[3759] Speed: 120.267470 samples/sec accuracy=91.046336 loss=0.342580 lr=0.001070 Epoch[078] Batch [2949]/[3759] Speed: 135.537377 samples/sec accuracy=91.028602 loss=0.342872 lr=0.001069 Epoch[078] Batch [2999]/[3759] Speed: 122.035902 samples/sec accuracy=91.038021 loss=0.342889 lr=0.001067 Epoch[078] Batch [3049]/[3759] Speed: 130.364082 samples/sec accuracy=91.032275 loss=0.343233 lr=0.001066 Epoch[078] Batch [3099]/[3759] Speed: 126.233717 samples/sec accuracy=91.022177 loss=0.343285 lr=0.001065 Epoch[078] Batch [3149]/[3759] Speed: 118.440231 samples/sec accuracy=91.029762 loss=0.343129 lr=0.001064 Epoch[078] Batch [3199]/[3759] Speed: 132.341771 samples/sec accuracy=91.041016 loss=0.342897 lr=0.001062 Epoch[078] Batch [3249]/[3759] Speed: 123.313603 samples/sec accuracy=91.036538 loss=0.343271 lr=0.001061 Epoch[078] Batch [3299]/[3759] Speed: 126.687721 samples/sec accuracy=91.035038 loss=0.343259 lr=0.001060 Epoch[078] Batch [3349]/[3759] Speed: 127.065703 samples/sec accuracy=91.035448 loss=0.343301 lr=0.001058 Epoch[078] Batch [3399]/[3759] Speed: 124.360325 samples/sec accuracy=91.048713 loss=0.343012 lr=0.001057 Epoch[078] Batch [3449]/[3759] Speed: 125.828276 samples/sec accuracy=91.048460 loss=0.342921 lr=0.001056 Epoch[078] Batch [3499]/[3759] Speed: 127.281809 samples/sec accuracy=91.042411 loss=0.343078 lr=0.001055 Epoch[078] Batch [3549]/[3759] Speed: 127.447948 samples/sec accuracy=91.035211 loss=0.343269 lr=0.001053 Epoch[078] Batch [3599]/[3759] Speed: 122.046939 samples/sec accuracy=91.039062 loss=0.343197 lr=0.001052 Epoch[078] Batch [3649]/[3759] Speed: 127.945181 samples/sec accuracy=91.040668 loss=0.343107 lr=0.001051 Epoch[078] Batch [3699]/[3759] Speed: 121.240864 samples/sec accuracy=91.043497 loss=0.343015 lr=0.001049 Epoch[078] Batch [3749]/[3759] Speed: 149.655182 samples/sec accuracy=91.042500 loss=0.343089 lr=0.001048 Batch [0049]/[0303]: acc-top1=65.625000 acc-top5=86.812500 Batch [0099]/[0303]: acc-top1=66.218750 acc-top5=86.484375 Batch [0149]/[0303]: acc-top1=65.833333 acc-top5=86.187500 Batch [0199]/[0303]: acc-top1=65.492188 acc-top5=85.906250 Batch [0249]/[0303]: acc-top1=65.662500 acc-top5=85.887500 Batch [0299]/[0303]: acc-top1=65.630208 acc-top5=85.916667 [Epoch 078] training: accuracy=91.042747 loss=0.343129 [Epoch 078] speed: 125 samples/sec time cost: 2104.500210 [Epoch 078] validation: acc-top1=65.594059 acc-top5=85.891089 loss=2.237285 Epoch[079] Batch [0049]/[3760] Speed: 90.666696 samples/sec accuracy=91.343750 loss=0.321358 lr=0.001047 Epoch[079] Batch [0099]/[3760] Speed: 129.950175 samples/sec accuracy=91.500000 loss=0.318598 lr=0.001045 Epoch[079] Batch [0149]/[3760] Speed: 116.525181 samples/sec accuracy=91.333333 loss=0.327568 lr=0.001044 Epoch[079] Batch [0199]/[3760] Speed: 132.894846 samples/sec accuracy=91.500000 loss=0.321263 lr=0.001043 Epoch[079] Batch [0249]/[3760] Speed: 122.190898 samples/sec accuracy=91.375000 loss=0.326730 lr=0.001042 Epoch[079] Batch [0299]/[3760] Speed: 126.817370 samples/sec accuracy=91.536458 loss=0.320857 lr=0.001040 Epoch[079] Batch [0349]/[3760] Speed: 127.243914 samples/sec accuracy=91.544643 loss=0.321480 lr=0.001039 Epoch[079] Batch [0399]/[3760] Speed: 120.711401 samples/sec accuracy=91.542969 loss=0.321289 lr=0.001038 Epoch[079] Batch [0449]/[3760] Speed: 124.212787 samples/sec accuracy=91.631944 loss=0.319341 lr=0.001036 Epoch[079] Batch [0499]/[3760] Speed: 134.905506 samples/sec accuracy=91.490625 loss=0.323485 lr=0.001035 Epoch[079] Batch [0549]/[3760] Speed: 119.527371 samples/sec accuracy=91.482955 loss=0.323450 lr=0.001034 Epoch[079] Batch [0599]/[3760] Speed: 122.745425 samples/sec accuracy=91.458333 loss=0.324338 lr=0.001033 Epoch[079] Batch [0649]/[3760] Speed: 128.844065 samples/sec accuracy=91.459135 loss=0.325451 lr=0.001031 Epoch[079] Batch [0699]/[3760] Speed: 120.566859 samples/sec accuracy=91.475446 loss=0.325563 lr=0.001030 Epoch[079] Batch [0749]/[3760] Speed: 129.159663 samples/sec accuracy=91.500000 loss=0.325053 lr=0.001029 Epoch[079] Batch [0799]/[3760] Speed: 124.397210 samples/sec accuracy=91.558594 loss=0.323461 lr=0.001028 Epoch[079] Batch [0849]/[3760] Speed: 129.895303 samples/sec accuracy=91.584559 loss=0.322906 lr=0.001026 Epoch[079] Batch [0899]/[3760] Speed: 121.121633 samples/sec accuracy=91.564236 loss=0.322954 lr=0.001025 Epoch[079] Batch [0949]/[3760] Speed: 126.313972 samples/sec accuracy=91.565789 loss=0.323113 lr=0.001024 Epoch[079] Batch [0999]/[3760] Speed: 122.351846 samples/sec accuracy=91.584375 loss=0.323368 lr=0.001022 Epoch[079] Batch [1049]/[3760] Speed: 127.321041 samples/sec accuracy=91.583333 loss=0.323517 lr=0.001021 Epoch[079] Batch [1099]/[3760] Speed: 130.509130 samples/sec accuracy=91.555398 loss=0.323966 lr=0.001020 Epoch[079] Batch [1149]/[3760] Speed: 117.285713 samples/sec accuracy=91.559783 loss=0.323943 lr=0.001019 Epoch[079] Batch [1199]/[3760] Speed: 132.710639 samples/sec accuracy=91.553385 loss=0.323845 lr=0.001017 Epoch[079] Batch [1249]/[3760] Speed: 126.458989 samples/sec accuracy=91.568750 loss=0.323033 lr=0.001016 Epoch[079] Batch [1299]/[3760] Speed: 125.470138 samples/sec accuracy=91.582933 loss=0.323129 lr=0.001015 Epoch[079] Batch [1349]/[3760] Speed: 130.998013 samples/sec accuracy=91.571759 loss=0.323851 lr=0.001014 Epoch[079] Batch [1399]/[3760] Speed: 117.661911 samples/sec accuracy=91.581473 loss=0.324162 lr=0.001012 Epoch[079] Batch [1449]/[3760] Speed: 128.648786 samples/sec accuracy=91.579741 loss=0.324160 lr=0.001011 Epoch[079] Batch [1499]/[3760] Speed: 127.061164 samples/sec accuracy=91.576042 loss=0.324495 lr=0.001010 Epoch[079] Batch [1549]/[3760] Speed: 124.680088 samples/sec accuracy=91.580645 loss=0.324508 lr=0.001009 Epoch[079] Batch [1599]/[3760] Speed: 124.114709 samples/sec accuracy=91.584961 loss=0.324493 lr=0.001007 Epoch[079] Batch [1649]/[3760] Speed: 128.820741 samples/sec accuracy=91.564394 loss=0.324937 lr=0.001006 Epoch[079] Batch [1699]/[3760] Speed: 117.561025 samples/sec accuracy=91.562500 loss=0.324825 lr=0.001005 Epoch[079] Batch [1749]/[3760] Speed: 131.762658 samples/sec accuracy=91.554464 loss=0.324905 lr=0.001004 Epoch[079] Batch [1799]/[3760] Speed: 130.557687 samples/sec accuracy=91.536458 loss=0.325770 lr=0.001002 Epoch[079] Batch [1849]/[3760] Speed: 118.604694 samples/sec accuracy=91.544764 loss=0.326018 lr=0.001001 Epoch[079] Batch [1899]/[3760] Speed: 134.817946 samples/sec accuracy=91.562500 loss=0.325988 lr=0.001000 Epoch[079] Batch [1949]/[3760] Speed: 114.978233 samples/sec accuracy=91.552083 loss=0.326423 lr=0.000999 Epoch[079] Batch [1999]/[3760] Speed: 137.489517 samples/sec accuracy=91.550000 loss=0.326521 lr=0.000997 Epoch[079] Batch [2049]/[3760] Speed: 117.267811 samples/sec accuracy=91.560976 loss=0.326564 lr=0.000996 Epoch[079] Batch [2099]/[3760] Speed: 126.084131 samples/sec accuracy=91.560268 loss=0.326629 lr=0.000995 Epoch[079] Batch [2149]/[3760] Speed: 126.950939 samples/sec accuracy=91.567587 loss=0.326433 lr=0.000994 Epoch[079] Batch [2199]/[3760] Speed: 126.630430 samples/sec accuracy=91.556818 loss=0.326702 lr=0.000992 Epoch[079] Batch [2249]/[3760] Speed: 130.813082 samples/sec accuracy=91.556250 loss=0.326915 lr=0.000991 Epoch[079] Batch [2299]/[3760] Speed: 117.457151 samples/sec accuracy=91.560462 loss=0.326954 lr=0.000990 Epoch[079] Batch [2349]/[3760] Speed: 132.438592 samples/sec accuracy=91.547207 loss=0.327051 lr=0.000989 Epoch[079] Batch [2399]/[3760] Speed: 122.145244 samples/sec accuracy=91.527344 loss=0.327880 lr=0.000987 Epoch[079] Batch [2449]/[3760] Speed: 128.192443 samples/sec accuracy=91.525510 loss=0.327819 lr=0.000986 Epoch[079] Batch [2499]/[3760] Speed: 122.350893 samples/sec accuracy=91.534375 loss=0.327737 lr=0.000985 Epoch[079] Batch [2549]/[3760] Speed: 127.462318 samples/sec accuracy=91.531863 loss=0.327613 lr=0.000984 Epoch[079] Batch [2599]/[3760] Speed: 126.163579 samples/sec accuracy=91.529447 loss=0.327808 lr=0.000982 Epoch[079] Batch [2649]/[3760] Speed: 121.704234 samples/sec accuracy=91.534198 loss=0.327618 lr=0.000981 Epoch[079] Batch [2699]/[3760] Speed: 131.678456 samples/sec accuracy=91.543403 loss=0.327438 lr=0.000980 Epoch[079] Batch [2749]/[3760] Speed: 125.383411 samples/sec accuracy=91.530682 loss=0.328082 lr=0.000979 Epoch[079] Batch [2799]/[3760] Speed: 123.097502 samples/sec accuracy=91.532924 loss=0.328289 lr=0.000977 Epoch[079] Batch [2849]/[3760] Speed: 128.715580 samples/sec accuracy=91.535088 loss=0.328242 lr=0.000976 Epoch[079] Batch [2899]/[3760] Speed: 121.264404 samples/sec accuracy=91.530172 loss=0.328280 lr=0.000975 Epoch[079] Batch [2949]/[3760] Speed: 128.531214 samples/sec accuracy=91.534958 loss=0.328161 lr=0.000974 Epoch[079] Batch [2999]/[3760] Speed: 122.004848 samples/sec accuracy=91.541146 loss=0.327931 lr=0.000972 Epoch[079] Batch [3049]/[3760] Speed: 127.059223 samples/sec accuracy=91.531762 loss=0.328316 lr=0.000971 Epoch[079] Batch [3099]/[3760] Speed: 120.000991 samples/sec accuracy=91.525202 loss=0.328150 lr=0.000970 Epoch[079] Batch [3149]/[3760] Speed: 132.707604 samples/sec accuracy=91.531746 loss=0.328255 lr=0.000969 Epoch[079] Batch [3199]/[3760] Speed: 121.543127 samples/sec accuracy=91.527832 loss=0.328231 lr=0.000967 Epoch[079] Batch [3249]/[3760] Speed: 130.724110 samples/sec accuracy=91.521154 loss=0.328469 lr=0.000966 Epoch[079] Batch [3299]/[3760] Speed: 120.133268 samples/sec accuracy=91.514678 loss=0.328618 lr=0.000965 Epoch[079] Batch [3349]/[3760] Speed: 131.253502 samples/sec accuracy=91.503731 loss=0.329062 lr=0.000964 Epoch[079] Batch [3399]/[3760] Speed: 123.747360 samples/sec accuracy=91.501379 loss=0.329224 lr=0.000962 Epoch[079] Batch [3449]/[3760] Speed: 122.041311 samples/sec accuracy=91.502264 loss=0.329493 lr=0.000961 Epoch[079] Batch [3499]/[3760] Speed: 133.949327 samples/sec accuracy=91.504911 loss=0.329495 lr=0.000960 Epoch[079] Batch [3549]/[3760] Speed: 121.849534 samples/sec accuracy=91.511444 loss=0.329267 lr=0.000959 Epoch[079] Batch [3599]/[3760] Speed: 128.253190 samples/sec accuracy=91.497396 loss=0.329586 lr=0.000958 Epoch[079] Batch [3649]/[3760] Speed: 123.535654 samples/sec accuracy=91.495291 loss=0.329740 lr=0.000956 Epoch[079] Batch [3699]/[3760] Speed: 123.452174 samples/sec accuracy=91.497466 loss=0.329802 lr=0.000955 Epoch[079] Batch [3749]/[3760] Speed: 146.557030 samples/sec accuracy=91.477500 loss=0.330135 lr=0.000954 Batch [0049]/[0303]: acc-top1=66.437500 acc-top5=87.187500 Batch [0099]/[0303]: acc-top1=67.031250 acc-top5=86.750000 Batch [0149]/[0303]: acc-top1=66.604167 acc-top5=86.520833 Batch [0199]/[0303]: acc-top1=66.234375 acc-top5=86.148438 Batch [0249]/[0303]: acc-top1=66.275000 acc-top5=86.168750 Batch [0299]/[0303]: acc-top1=66.223958 acc-top5=86.166667 [Epoch 079] training: accuracy=91.478557 loss=0.330111 [Epoch 079] speed: 125 samples/sec time cost: 2106.836680 [Epoch 079] validation: acc-top1=66.197401 acc-top5=86.138614 loss=2.165625 Epoch[080] Batch [0049]/[3760] Speed: 90.601575 samples/sec accuracy=92.281250 loss=0.306266 lr=0.000952 Epoch[080] Batch [0099]/[3760] Speed: 129.095476 samples/sec accuracy=92.125000 loss=0.310737 lr=0.000951 Epoch[080] Batch [0149]/[3760] Speed: 122.969013 samples/sec accuracy=92.020833 loss=0.310606 lr=0.000950 Epoch[080] Batch [0199]/[3760] Speed: 126.834383 samples/sec accuracy=92.070312 loss=0.309049 lr=0.000949 Epoch[080] Batch [0249]/[3760] Speed: 123.632909 samples/sec accuracy=92.112500 loss=0.308377 lr=0.000947 Epoch[080] Batch [0299]/[3760] Speed: 129.282505 samples/sec accuracy=92.208333 loss=0.305933 lr=0.000946 Epoch[080] Batch [0349]/[3760] Speed: 128.986935 samples/sec accuracy=92.214286 loss=0.306448 lr=0.000945 Epoch[080] Batch [0399]/[3760] Speed: 124.822392 samples/sec accuracy=92.160156 loss=0.307237 lr=0.000944 Epoch[080] Batch [0449]/[3760] Speed: 117.709163 samples/sec accuracy=92.159722 loss=0.308368 lr=0.000943 Epoch[080] Batch [0499]/[3760] Speed: 136.132204 samples/sec accuracy=92.106250 loss=0.309946 lr=0.000941 Epoch[080] Batch [0549]/[3760] Speed: 119.823347 samples/sec accuracy=92.034091 loss=0.312163 lr=0.000940 Epoch[080] Batch [0599]/[3760] Speed: 124.748577 samples/sec accuracy=92.026042 loss=0.312584 lr=0.000939 Epoch[080] Batch [0649]/[3760] Speed: 132.728513 samples/sec accuracy=92.026442 loss=0.311852 lr=0.000938 Epoch[080] Batch [0699]/[3760] Speed: 117.864789 samples/sec accuracy=92.013393 loss=0.311846 lr=0.000937 Epoch[080] Batch [0749]/[3760] Speed: 130.852357 samples/sec accuracy=92.018750 loss=0.311587 lr=0.000935 Epoch[080] Batch [0799]/[3760] Speed: 128.847435 samples/sec accuracy=92.005859 loss=0.311964 lr=0.000934 Epoch[080] Batch [0849]/[3760] Speed: 120.614015 samples/sec accuracy=91.990809 loss=0.311856 lr=0.000933 Epoch[080] Batch [0899]/[3760] Speed: 128.848046 samples/sec accuracy=92.006944 loss=0.310664 lr=0.000932 Epoch[080] Batch [0949]/[3760] Speed: 118.615540 samples/sec accuracy=91.972039 loss=0.312324 lr=0.000930 Epoch[080] Batch [0999]/[3760] Speed: 136.755907 samples/sec accuracy=91.951562 loss=0.313578 lr=0.000929 Epoch[080] Batch [1049]/[3760] Speed: 120.751457 samples/sec accuracy=91.937500 loss=0.314051 lr=0.000928 Epoch[080] Batch [1099]/[3760] Speed: 127.755732 samples/sec accuracy=91.913352 loss=0.314555 lr=0.000927 Epoch[080] Batch [1149]/[3760] Speed: 125.821439 samples/sec accuracy=91.903533 loss=0.315027 lr=0.000926 Epoch[080] Batch [1199]/[3760] Speed: 129.283640 samples/sec accuracy=91.891927 loss=0.315355 lr=0.000924 Epoch[080] Batch [1249]/[3760] Speed: 123.336669 samples/sec accuracy=91.875000 loss=0.315390 lr=0.000923 Epoch[080] Batch [1299]/[3760] Speed: 118.978363 samples/sec accuracy=91.883413 loss=0.315533 lr=0.000922 Epoch[080] Batch [1349]/[3760] Speed: 132.995287 samples/sec accuracy=91.927083 loss=0.314806 lr=0.000921 Epoch[080] Batch [1399]/[3760] Speed: 123.545934 samples/sec accuracy=91.928571 loss=0.314520 lr=0.000920 Epoch[080] Batch [1449]/[3760] Speed: 123.305739 samples/sec accuracy=91.906250 loss=0.314760 lr=0.000918 Epoch[080] Batch [1499]/[3760] Speed: 128.339731 samples/sec accuracy=91.907292 loss=0.315321 lr=0.000917 Epoch[080] Batch [1549]/[3760] Speed: 122.813075 samples/sec accuracy=91.915323 loss=0.314705 lr=0.000916 Epoch[080] Batch [1599]/[3760] Speed: 129.646796 samples/sec accuracy=91.891602 loss=0.315212 lr=0.000915 Epoch[080] Batch [1649]/[3760] Speed: 119.528767 samples/sec accuracy=91.900568 loss=0.315178 lr=0.000914 Epoch[080] Batch [1699]/[3760] Speed: 126.192958 samples/sec accuracy=91.882353 loss=0.315598 lr=0.000912 Epoch[080] Batch [1749]/[3760] Speed: 127.053963 samples/sec accuracy=91.860714 loss=0.315987 lr=0.000911 Epoch[080] Batch [1799]/[3760] Speed: 118.909508 samples/sec accuracy=91.838542 loss=0.316555 lr=0.000910 Epoch[080] Batch [1849]/[3760] Speed: 131.678555 samples/sec accuracy=91.840372 loss=0.316589 lr=0.000909 Epoch[080] Batch [1899]/[3760] Speed: 120.746207 samples/sec accuracy=91.836349 loss=0.317009 lr=0.000907 Epoch[080] Batch [1949]/[3760] Speed: 128.160547 samples/sec accuracy=91.845353 loss=0.316882 lr=0.000906 Epoch[080] Batch [1999]/[3760] Speed: 130.773796 samples/sec accuracy=91.875781 loss=0.316124 lr=0.000905 Epoch[080] Batch [2049]/[3760] Speed: 117.171349 samples/sec accuracy=91.878811 loss=0.316099 lr=0.000904 Epoch[080] Batch [2099]/[3760] Speed: 128.113899 samples/sec accuracy=91.881696 loss=0.316284 lr=0.000903 Epoch[080] Batch [2149]/[3760] Speed: 131.718615 samples/sec accuracy=91.882994 loss=0.316381 lr=0.000901 Epoch[080] Batch [2199]/[3760] Speed: 122.550470 samples/sec accuracy=91.891335 loss=0.315960 lr=0.000900 Epoch[080] Batch [2249]/[3760] Speed: 128.020036 samples/sec accuracy=91.895833 loss=0.315873 lr=0.000899 Epoch[080] Batch [2299]/[3760] Speed: 120.259122 samples/sec accuracy=91.878397 loss=0.316268 lr=0.000898 Epoch[080] Batch [2349]/[3760] Speed: 133.022078 samples/sec accuracy=91.874335 loss=0.316309 lr=0.000897 Epoch[080] Batch [2399]/[3760] Speed: 120.191133 samples/sec accuracy=91.866536 loss=0.316558 lr=0.000896 Epoch[080] Batch [2449]/[3760] Speed: 132.002770 samples/sec accuracy=91.871811 loss=0.316424 lr=0.000894 Epoch[080] Batch [2499]/[3760] Speed: 120.206507 samples/sec accuracy=91.870625 loss=0.316405 lr=0.000893 Epoch[080] Batch [2549]/[3760] Speed: 127.557156 samples/sec accuracy=91.863358 loss=0.316605 lr=0.000892 Epoch[080] Batch [2599]/[3760] Speed: 128.021075 samples/sec accuracy=91.859976 loss=0.316425 lr=0.000891 Epoch[080] Batch [2649]/[3760] Speed: 119.513674 samples/sec accuracy=91.852594 loss=0.316754 lr=0.000890 Epoch[080] Batch [2699]/[3760] Speed: 133.541971 samples/sec accuracy=91.843750 loss=0.316998 lr=0.000888 Epoch[080] Batch [2749]/[3760] Speed: 124.833979 samples/sec accuracy=91.857386 loss=0.316403 lr=0.000887 Epoch[080] Batch [2799]/[3760] Speed: 124.198570 samples/sec accuracy=91.853237 loss=0.316406 lr=0.000886 Epoch[080] Batch [2849]/[3760] Speed: 125.970891 samples/sec accuracy=91.857456 loss=0.315945 lr=0.000885 Epoch[080] Batch [2899]/[3760] Speed: 124.426080 samples/sec accuracy=91.877694 loss=0.315546 lr=0.000884 Epoch[080] Batch [2949]/[3760] Speed: 121.060487 samples/sec accuracy=91.879237 loss=0.315547 lr=0.000882 Epoch[080] Batch [2999]/[3760] Speed: 124.752318 samples/sec accuracy=91.877083 loss=0.315643 lr=0.000881 Epoch[080] Batch [3049]/[3760] Speed: 126.708624 samples/sec accuracy=91.878074 loss=0.315692 lr=0.000880 Epoch[080] Batch [3099]/[3760] Speed: 124.866179 samples/sec accuracy=91.876008 loss=0.315832 lr=0.000879 Epoch[080] Batch [3149]/[3760] Speed: 123.348128 samples/sec accuracy=91.859623 loss=0.316235 lr=0.000878 Epoch[080] Batch [3199]/[3760] Speed: 133.724810 samples/sec accuracy=91.863281 loss=0.316042 lr=0.000877 Epoch[080] Batch [3249]/[3760] Speed: 121.863747 samples/sec accuracy=91.855769 loss=0.316199 lr=0.000875 Epoch[080] Batch [3299]/[3760] Speed: 126.667815 samples/sec accuracy=91.850379 loss=0.316276 lr=0.000874 Epoch[080] Batch [3349]/[3760] Speed: 127.880039 samples/sec accuracy=91.849813 loss=0.316504 lr=0.000873 Epoch[080] Batch [3399]/[3760] Speed: 126.825565 samples/sec accuracy=91.845588 loss=0.316755 lr=0.000872 Epoch[080] Batch [3449]/[3760] Speed: 122.352998 samples/sec accuracy=91.846467 loss=0.316781 lr=0.000871 Epoch[080] Batch [3499]/[3760] Speed: 127.375305 samples/sec accuracy=91.837054 loss=0.316934 lr=0.000869 Epoch[080] Batch [3549]/[3760] Speed: 121.868818 samples/sec accuracy=91.835387 loss=0.317033 lr=0.000868 Epoch[080] Batch [3599]/[3760] Speed: 127.269983 samples/sec accuracy=91.827691 loss=0.317230 lr=0.000867 Epoch[080] Batch [3649]/[3760] Speed: 129.785767 samples/sec accuracy=91.833048 loss=0.317122 lr=0.000866 Epoch[080] Batch [3699]/[3760] Speed: 126.442302 samples/sec accuracy=91.830236 loss=0.317108 lr=0.000865 Epoch[080] Batch [3749]/[3760] Speed: 138.193646 samples/sec accuracy=91.832500 loss=0.316915 lr=0.000864 Batch [0049]/[0303]: acc-top1=66.937500 acc-top5=86.562500 Batch [0099]/[0303]: acc-top1=67.218750 acc-top5=86.375000 Batch [0149]/[0303]: acc-top1=66.916667 acc-top5=86.385417 Batch [0199]/[0303]: acc-top1=66.367188 acc-top5=86.078125 Batch [0249]/[0303]: acc-top1=66.381250 acc-top5=86.043750 Batch [0299]/[0303]: acc-top1=66.406250 acc-top5=85.937500 [Epoch 080] training: accuracy=91.833029 loss=0.316955 [Epoch 080] speed: 125 samples/sec time cost: 2106.214093 [Epoch 080] validation: acc-top1=66.377888 acc-top5=85.922030 loss=2.194312 Epoch[081] Batch [0049]/[3759] Speed: 87.602570 samples/sec accuracy=92.218750 loss=0.312285 lr=0.000862 Epoch[081] Batch [0099]/[3759] Speed: 132.558466 samples/sec accuracy=92.531250 loss=0.305780 lr=0.000861 Epoch[081] Batch [0149]/[3759] Speed: 120.664526 samples/sec accuracy=92.354167 loss=0.303125 lr=0.000860 Epoch[081] Batch [0199]/[3759] Speed: 126.247147 samples/sec accuracy=92.414062 loss=0.301781 lr=0.000859 Epoch[081] Batch [0249]/[3759] Speed: 128.887029 samples/sec accuracy=92.456250 loss=0.297983 lr=0.000857 Epoch[081] Batch [0299]/[3759] Speed: 124.347540 samples/sec accuracy=92.427083 loss=0.299504 lr=0.000856 Epoch[081] Batch [0349]/[3759] Speed: 129.197511 samples/sec accuracy=92.473214 loss=0.297531 lr=0.000855 Epoch[081] Batch [0399]/[3759] Speed: 117.193470 samples/sec accuracy=92.437500 loss=0.297002 lr=0.000854 Epoch[081] Batch [0449]/[3759] Speed: 131.107559 samples/sec accuracy=92.434028 loss=0.297336 lr=0.000853 Epoch[081] Batch [0499]/[3759] Speed: 124.029594 samples/sec accuracy=92.462500 loss=0.297456 lr=0.000852 Epoch[081] Batch [0549]/[3759] Speed: 125.460984 samples/sec accuracy=92.485795 loss=0.297173 lr=0.000850 Epoch[081] Batch [0599]/[3759] Speed: 130.992960 samples/sec accuracy=92.505208 loss=0.296882 lr=0.000849 Epoch[081] Batch [0649]/[3759] Speed: 119.952875 samples/sec accuracy=92.423077 loss=0.298431 lr=0.000848 Epoch[081] Batch [0699]/[3759] Speed: 126.970999 samples/sec accuracy=92.444196 loss=0.297969 lr=0.000847 Epoch[081] Batch [0749]/[3759] Speed: 131.721682 samples/sec accuracy=92.383333 loss=0.299709 lr=0.000846 Epoch[081] Batch [0799]/[3759] Speed: 120.828920 samples/sec accuracy=92.341797 loss=0.299911 lr=0.000845 Epoch[081] Batch [0849]/[3759] Speed: 130.661524 samples/sec accuracy=92.397059 loss=0.298439 lr=0.000843 Epoch[081] Batch [0899]/[3759] Speed: 123.206667 samples/sec accuracy=92.373264 loss=0.299225 lr=0.000842 Epoch[081] Batch [0949]/[3759] Speed: 123.960027 samples/sec accuracy=92.366776 loss=0.299290 lr=0.000841 Epoch[081] Batch [0999]/[3759] Speed: 126.269671 samples/sec accuracy=92.376563 loss=0.298526 lr=0.000840 Epoch[081] Batch [1049]/[3759] Speed: 129.783796 samples/sec accuracy=92.328869 loss=0.299586 lr=0.000839 Epoch[081] Batch [1099]/[3759] Speed: 118.030573 samples/sec accuracy=92.335227 loss=0.299730 lr=0.000838 Epoch[081] Batch [1149]/[3759] Speed: 135.197074 samples/sec accuracy=92.370924 loss=0.298904 lr=0.000837 Epoch[081] Batch [1199]/[3759] Speed: 122.552595 samples/sec accuracy=92.389323 loss=0.298597 lr=0.000835 Epoch[081] Batch [1249]/[3759] Speed: 123.723562 samples/sec accuracy=92.400000 loss=0.297978 lr=0.000834 Epoch[081] Batch [1299]/[3759] Speed: 123.312930 samples/sec accuracy=92.412260 loss=0.297705 lr=0.000833 Epoch[081] Batch [1349]/[3759] Speed: 131.040869 samples/sec accuracy=92.437500 loss=0.297714 lr=0.000832 Epoch[081] Batch [1399]/[3759] Speed: 119.542518 samples/sec accuracy=92.434152 loss=0.298057 lr=0.000831 Epoch[081] Batch [1449]/[3759] Speed: 126.630388 samples/sec accuracy=92.426724 loss=0.297605 lr=0.000830 Epoch[081] Batch [1499]/[3759] Speed: 127.771799 samples/sec accuracy=92.436458 loss=0.297690 lr=0.000828 Epoch[081] Batch [1549]/[3759] Speed: 124.638665 samples/sec accuracy=92.440524 loss=0.297569 lr=0.000827 Epoch[081] Batch [1599]/[3759] Speed: 124.914947 samples/sec accuracy=92.416992 loss=0.297739 lr=0.000826 Epoch[081] Batch [1649]/[3759] Speed: 126.189977 samples/sec accuracy=92.390152 loss=0.298379 lr=0.000825 Epoch[081] Batch [1699]/[3759] Speed: 117.126851 samples/sec accuracy=92.407169 loss=0.298234 lr=0.000824 Epoch[081] Batch [1749]/[3759] Speed: 134.550140 samples/sec accuracy=92.401786 loss=0.298427 lr=0.000823 Epoch[081] Batch [1799]/[3759] Speed: 124.101821 samples/sec accuracy=92.396701 loss=0.298807 lr=0.000822 Epoch[081] Batch [1849]/[3759] Speed: 125.372657 samples/sec accuracy=92.385135 loss=0.299317 lr=0.000820 Epoch[081] Batch [1899]/[3759] Speed: 129.097078 samples/sec accuracy=92.390625 loss=0.299043 lr=0.000819 Epoch[081] Batch [1949]/[3759] Speed: 122.601824 samples/sec accuracy=92.383814 loss=0.299301 lr=0.000818 Epoch[081] Batch [1999]/[3759] Speed: 128.938273 samples/sec accuracy=92.375000 loss=0.299564 lr=0.000817 Epoch[081] Batch [2049]/[3759] Speed: 123.805644 samples/sec accuracy=92.359756 loss=0.299822 lr=0.000816 Epoch[081] Batch [2099]/[3759] Speed: 125.154671 samples/sec accuracy=92.394345 loss=0.298967 lr=0.000815 Epoch[081] Batch [2149]/[3759] Speed: 128.194803 samples/sec accuracy=92.389535 loss=0.299113 lr=0.000814 Epoch[081] Batch [2199]/[3759] Speed: 126.476787 samples/sec accuracy=92.384943 loss=0.299239 lr=0.000812 Epoch[081] Batch [2249]/[3759] Speed: 120.600988 samples/sec accuracy=92.348611 loss=0.299671 lr=0.000811 Epoch[081] Batch [2299]/[3759] Speed: 126.491921 samples/sec accuracy=92.343071 loss=0.299696 lr=0.000810 Epoch[081] Batch [2349]/[3759] Speed: 127.994080 samples/sec accuracy=92.339096 loss=0.299924 lr=0.000809 Epoch[081] Batch [2399]/[3759] Speed: 128.235497 samples/sec accuracy=92.329427 loss=0.300021 lr=0.000808 Epoch[081] Batch [2449]/[3759] Speed: 126.170389 samples/sec accuracy=92.327168 loss=0.300357 lr=0.000807 Epoch[081] Batch [2499]/[3759] Speed: 123.646493 samples/sec accuracy=92.326250 loss=0.300506 lr=0.000806 Epoch[081] Batch [2549]/[3759] Speed: 124.628346 samples/sec accuracy=92.339461 loss=0.300249 lr=0.000804 Epoch[081] Batch [2599]/[3759] Speed: 131.368153 samples/sec accuracy=92.313702 loss=0.300630 lr=0.000803 Epoch[081] Batch [2649]/[3759] Speed: 120.482791 samples/sec accuracy=92.301887 loss=0.300927 lr=0.000802 Epoch[081] Batch [2699]/[3759] Speed: 126.578765 samples/sec accuracy=92.300926 loss=0.301052 lr=0.000801 Epoch[081] Batch [2749]/[3759] Speed: 127.760795 samples/sec accuracy=92.285227 loss=0.301409 lr=0.000800 Epoch[081] Batch [2799]/[3759] Speed: 115.615254 samples/sec accuracy=92.279576 loss=0.301878 lr=0.000799 Epoch[081] Batch [2849]/[3759] Speed: 135.102336 samples/sec accuracy=92.288377 loss=0.301753 lr=0.000798 Epoch[081] Batch [2899]/[3759] Speed: 123.799837 samples/sec accuracy=92.291487 loss=0.301459 lr=0.000796 Epoch[081] Batch [2949]/[3759] Speed: 120.804463 samples/sec accuracy=92.279131 loss=0.301630 lr=0.000795 Epoch[081] Batch [2999]/[3759] Speed: 130.901433 samples/sec accuracy=92.270833 loss=0.301992 lr=0.000794 Epoch[081] Batch [3049]/[3759] Speed: 124.388844 samples/sec accuracy=92.257684 loss=0.302324 lr=0.000793 Epoch[081] Batch [3099]/[3759] Speed: 128.426997 samples/sec accuracy=92.260585 loss=0.302252 lr=0.000792 Epoch[081] Batch [3149]/[3759] Speed: 127.408215 samples/sec accuracy=92.253472 loss=0.302336 lr=0.000791 Epoch[081] Batch [3199]/[3759] Speed: 123.844111 samples/sec accuracy=92.237793 loss=0.302595 lr=0.000790 Epoch[081] Batch [3249]/[3759] Speed: 121.010615 samples/sec accuracy=92.234615 loss=0.302687 lr=0.000789 Epoch[081] Batch [3299]/[3759] Speed: 130.533604 samples/sec accuracy=92.241951 loss=0.302603 lr=0.000787 Epoch[081] Batch [3349]/[3759] Speed: 130.297736 samples/sec accuracy=92.236007 loss=0.302796 lr=0.000786 Epoch[081] Batch [3399]/[3759] Speed: 119.996044 samples/sec accuracy=92.228860 loss=0.303168 lr=0.000785 Epoch[081] Batch [3449]/[3759] Speed: 128.913292 samples/sec accuracy=92.241848 loss=0.302811 lr=0.000784 Epoch[081] Batch [3499]/[3759] Speed: 123.407870 samples/sec accuracy=92.233036 loss=0.303138 lr=0.000783 Epoch[081] Batch [3549]/[3759] Speed: 125.576327 samples/sec accuracy=92.224472 loss=0.303188 lr=0.000782 Epoch[081] Batch [3599]/[3759] Speed: 126.795651 samples/sec accuracy=92.223090 loss=0.303298 lr=0.000781 Epoch[081] Batch [3649]/[3759] Speed: 121.626880 samples/sec accuracy=92.223887 loss=0.303436 lr=0.000780 Epoch[081] Batch [3699]/[3759] Speed: 126.647927 samples/sec accuracy=92.216216 loss=0.303677 lr=0.000778 Epoch[081] Batch [3749]/[3759] Speed: 146.494161 samples/sec accuracy=92.217500 loss=0.303704 lr=0.000777 Batch [0049]/[0303]: acc-top1=66.562500 acc-top5=86.562500 Batch [0099]/[0303]: acc-top1=66.984375 acc-top5=86.453125 Batch [0149]/[0303]: acc-top1=66.427083 acc-top5=86.322917 Batch [0199]/[0303]: acc-top1=66.007812 acc-top5=86.085938 Batch [0249]/[0303]: acc-top1=66.268750 acc-top5=86.093750 Batch [0299]/[0303]: acc-top1=66.192708 acc-top5=86.140625 [Epoch 081] training: accuracy=92.212024 loss=0.303957 [Epoch 081] speed: 125 samples/sec time cost: 2105.435704 [Epoch 081] validation: acc-top1=66.156147 acc-top5=86.128300 loss=2.207633 Epoch[082] Batch [0049]/[3760] Speed: 89.893290 samples/sec accuracy=92.531250 loss=0.296310 lr=0.000776 Epoch[082] Batch [0099]/[3760] Speed: 125.454338 samples/sec accuracy=92.765625 loss=0.287626 lr=0.000775 Epoch[082] Batch [0149]/[3760] Speed: 127.695899 samples/sec accuracy=92.625000 loss=0.288318 lr=0.000774 Epoch[082] Batch [0199]/[3760] Speed: 121.448045 samples/sec accuracy=92.562500 loss=0.290862 lr=0.000773 Epoch[082] Batch [0249]/[3760] Speed: 130.872038 samples/sec accuracy=92.612500 loss=0.287793 lr=0.000772 Epoch[082] Batch [0299]/[3760] Speed: 117.892521 samples/sec accuracy=92.729167 loss=0.284353 lr=0.000770 Epoch[082] Batch [0349]/[3760] Speed: 132.146304 samples/sec accuracy=92.754464 loss=0.284707 lr=0.000769 Epoch[082] Batch [0399]/[3760] Speed: 118.711942 samples/sec accuracy=92.667969 loss=0.285375 lr=0.000768 Epoch[082] Batch [0449]/[3760] Speed: 131.882417 samples/sec accuracy=92.680556 loss=0.285518 lr=0.000767 Epoch[082] Batch [0499]/[3760] Speed: 126.456544 samples/sec accuracy=92.693750 loss=0.285532 lr=0.000766 Epoch[082] Batch [0549]/[3760] Speed: 127.354928 samples/sec accuracy=92.764205 loss=0.283678 lr=0.000765 Epoch[082] Batch [0599]/[3760] Speed: 121.327551 samples/sec accuracy=92.692708 loss=0.285757 lr=0.000764 Epoch[082] Batch [0649]/[3760] Speed: 130.037962 samples/sec accuracy=92.699519 loss=0.285669 lr=0.000763 Epoch[082] Batch [0699]/[3760] Speed: 131.167241 samples/sec accuracy=92.638393 loss=0.287371 lr=0.000762 Epoch[082] Batch [0749]/[3760] Speed: 118.650393 samples/sec accuracy=92.635417 loss=0.287985 lr=0.000760 Epoch[082] Batch [0799]/[3760] Speed: 127.902939 samples/sec accuracy=92.628906 loss=0.289109 lr=0.000759 Epoch[082] Batch [0849]/[3760] Speed: 132.126509 samples/sec accuracy=92.599265 loss=0.289677 lr=0.000758 Epoch[082] Batch [0899]/[3760] Speed: 117.503320 samples/sec accuracy=92.592014 loss=0.289741 lr=0.000757 Epoch[082] Batch [0949]/[3760] Speed: 130.494622 samples/sec accuracy=92.583882 loss=0.289457 lr=0.000756 Epoch[082] Batch [0999]/[3760] Speed: 120.295955 samples/sec accuracy=92.581250 loss=0.290041 lr=0.000755 Epoch[082] Batch [1049]/[3760] Speed: 129.139079 samples/sec accuracy=92.581845 loss=0.290157 lr=0.000754 Epoch[082] Batch [1099]/[3760] Speed: 135.173371 samples/sec accuracy=92.578125 loss=0.289731 lr=0.000753 Epoch[082] Batch [1149]/[3760] Speed: 116.665932 samples/sec accuracy=92.603261 loss=0.288984 lr=0.000752 Epoch[082] Batch [1199]/[3760] Speed: 132.231717 samples/sec accuracy=92.621094 loss=0.288652 lr=0.000751 Epoch[082] Batch [1249]/[3760] Speed: 120.426100 samples/sec accuracy=92.596250 loss=0.289514 lr=0.000749 Epoch[082] Batch [1299]/[3760] Speed: 121.959516 samples/sec accuracy=92.602163 loss=0.290026 lr=0.000748 Epoch[082] Batch [1349]/[3760] Speed: 131.325751 samples/sec accuracy=92.616898 loss=0.289554 lr=0.000747 Epoch[082] Batch [1399]/[3760] Speed: 127.918209 samples/sec accuracy=92.595982 loss=0.290249 lr=0.000746 Epoch[082] Batch [1449]/[3760] Speed: 119.983668 samples/sec accuracy=92.592672 loss=0.290673 lr=0.000745 Epoch[082] Batch [1499]/[3760] Speed: 135.112630 samples/sec accuracy=92.576042 loss=0.291378 lr=0.000744 Epoch[082] Batch [1549]/[3760] Speed: 119.001714 samples/sec accuracy=92.584677 loss=0.291302 lr=0.000743 Epoch[082] Batch [1599]/[3760] Speed: 125.814987 samples/sec accuracy=92.582031 loss=0.291835 lr=0.000742 Epoch[082] Batch [1649]/[3760] Speed: 122.755453 samples/sec accuracy=92.587121 loss=0.291558 lr=0.000741 Epoch[082] Batch [1699]/[3760] Speed: 133.283963 samples/sec accuracy=92.590993 loss=0.291270 lr=0.000740 Epoch[082] Batch [1749]/[3760] Speed: 116.984286 samples/sec accuracy=92.593750 loss=0.290977 lr=0.000738 Epoch[082] Batch [1799]/[3760] Speed: 133.212838 samples/sec accuracy=92.578125 loss=0.291592 lr=0.000737 Epoch[082] Batch [1849]/[3760] Speed: 117.627879 samples/sec accuracy=92.591216 loss=0.291202 lr=0.000736 Epoch[082] Batch [1899]/[3760] Speed: 128.675351 samples/sec accuracy=92.562500 loss=0.291668 lr=0.000735 Epoch[082] Batch [1949]/[3760] Speed: 126.019926 samples/sec accuracy=92.568910 loss=0.291602 lr=0.000734 Epoch[082] Batch [1999]/[3760] Speed: 125.881238 samples/sec accuracy=92.553906 loss=0.291910 lr=0.000733 Epoch[082] Batch [2049]/[3760] Speed: 124.693855 samples/sec accuracy=92.559451 loss=0.291620 lr=0.000732 Epoch[082] Batch [2099]/[3760] Speed: 127.806222 samples/sec accuracy=92.566220 loss=0.291191 lr=0.000731 Epoch[082] Batch [2149]/[3760] Speed: 122.162007 samples/sec accuracy=92.561047 loss=0.291381 lr=0.000730 Epoch[082] Batch [2199]/[3760] Speed: 133.804121 samples/sec accuracy=92.569602 loss=0.291258 lr=0.000729 Epoch[082] Batch [2249]/[3760] Speed: 115.827430 samples/sec accuracy=92.564583 loss=0.291405 lr=0.000728 Epoch[082] Batch [2299]/[3760] Speed: 130.125968 samples/sec accuracy=92.550272 loss=0.291680 lr=0.000726 Epoch[082] Batch [2349]/[3760] Speed: 126.677429 samples/sec accuracy=92.540559 loss=0.292132 lr=0.000725 Epoch[082] Batch [2399]/[3760] Speed: 126.658987 samples/sec accuracy=92.531901 loss=0.292029 lr=0.000724 Epoch[082] Batch [2449]/[3760] Speed: 120.631227 samples/sec accuracy=92.533801 loss=0.291881 lr=0.000723 Epoch[082] Batch [2499]/[3760] Speed: 129.132932 samples/sec accuracy=92.530625 loss=0.291775 lr=0.000722 Epoch[082] Batch [2549]/[3760] Speed: 125.866025 samples/sec accuracy=92.523284 loss=0.292010 lr=0.000721 Epoch[082] Batch [2599]/[3760] Speed: 121.436769 samples/sec accuracy=92.522236 loss=0.291996 lr=0.000720 Epoch[082] Batch [2649]/[3760] Speed: 130.572385 samples/sec accuracy=92.508844 loss=0.292477 lr=0.000719 Epoch[082] Batch [2699]/[3760] Speed: 125.285435 samples/sec accuracy=92.510417 loss=0.292305 lr=0.000718 Epoch[082] Batch [2749]/[3760] Speed: 123.618168 samples/sec accuracy=92.499432 loss=0.292527 lr=0.000717 Epoch[082] Batch [2799]/[3760] Speed: 124.803672 samples/sec accuracy=92.495536 loss=0.292413 lr=0.000716 Epoch[082] Batch [2849]/[3760] Speed: 125.122328 samples/sec accuracy=92.499452 loss=0.292316 lr=0.000715 Epoch[082] Batch [2899]/[3760] Speed: 131.372044 samples/sec accuracy=92.501078 loss=0.292360 lr=0.000714 Epoch[082] Batch [2949]/[3760] Speed: 123.703362 samples/sec accuracy=92.515360 loss=0.292041 lr=0.000712 Epoch[082] Batch [2999]/[3760] Speed: 124.543867 samples/sec accuracy=92.516146 loss=0.292248 lr=0.000711 Epoch[082] Batch [3049]/[3760] Speed: 127.947963 samples/sec accuracy=92.510246 loss=0.292272 lr=0.000710 Epoch[082] Batch [3099]/[3760] Speed: 125.953352 samples/sec accuracy=92.514617 loss=0.292061 lr=0.000709 Epoch[082] Batch [3149]/[3760] Speed: 125.347668 samples/sec accuracy=92.516369 loss=0.291814 lr=0.000708 Epoch[082] Batch [3199]/[3760] Speed: 120.185838 samples/sec accuracy=92.517578 loss=0.291778 lr=0.000707 Epoch[082] Batch [3249]/[3760] Speed: 133.992231 samples/sec accuracy=92.514904 loss=0.291949 lr=0.000706 Epoch[082] Batch [3299]/[3760] Speed: 118.094695 samples/sec accuracy=92.522727 loss=0.291837 lr=0.000705 Epoch[082] Batch [3349]/[3760] Speed: 131.464114 samples/sec accuracy=92.517724 loss=0.291990 lr=0.000704 Epoch[082] Batch [3399]/[3760] Speed: 118.741861 samples/sec accuracy=92.510570 loss=0.292129 lr=0.000703 Epoch[082] Batch [3449]/[3760] Speed: 130.810578 samples/sec accuracy=92.506793 loss=0.292202 lr=0.000702 Epoch[082] Batch [3499]/[3760] Speed: 135.001347 samples/sec accuracy=92.502232 loss=0.292389 lr=0.000701 Epoch[082] Batch [3549]/[3760] Speed: 113.458055 samples/sec accuracy=92.498239 loss=0.292390 lr=0.000700 Epoch[082] Batch [3599]/[3760] Speed: 134.656740 samples/sec accuracy=92.493924 loss=0.292514 lr=0.000699 Epoch[082] Batch [3649]/[3760] Speed: 118.929066 samples/sec accuracy=92.493151 loss=0.292432 lr=0.000697 Epoch[082] Batch [3699]/[3760] Speed: 127.339335 samples/sec accuracy=92.485220 loss=0.292604 lr=0.000696 Epoch[082] Batch [3749]/[3760] Speed: 139.884994 samples/sec accuracy=92.486667 loss=0.292576 lr=0.000695 Batch [0049]/[0303]: acc-top1=67.000000 acc-top5=86.843750 Batch [0099]/[0303]: acc-top1=67.015625 acc-top5=86.437500 Batch [0149]/[0303]: acc-top1=66.781250 acc-top5=86.312500 Batch [0199]/[0303]: acc-top1=66.445312 acc-top5=85.960938 Batch [0249]/[0303]: acc-top1=66.656250 acc-top5=86.050000 Batch [0299]/[0303]: acc-top1=66.515625 acc-top5=86.020833 [Epoch 082] training: accuracy=92.487118 loss=0.292578 [Epoch 082] speed: 125 samples/sec time cost: 2107.710074 [Epoch 082] validation: acc-top1=66.496493 acc-top5=85.989068 loss=2.145449 Epoch[083] Batch [0049]/[3760] Speed: 88.219417 samples/sec accuracy=92.593750 loss=0.280381 lr=0.000694 Epoch[083] Batch [0099]/[3760] Speed: 134.567975 samples/sec accuracy=93.140625 loss=0.266033 lr=0.000693 Epoch[083] Batch [0149]/[3760] Speed: 118.459279 samples/sec accuracy=93.250000 loss=0.263419 lr=0.000692 Epoch[083] Batch [0199]/[3760] Speed: 132.127162 samples/sec accuracy=93.320312 loss=0.265879 lr=0.000691 Epoch[083] Batch [0249]/[3760] Speed: 129.836174 samples/sec accuracy=93.200000 loss=0.268643 lr=0.000690 Epoch[083] Batch [0299]/[3760] Speed: 112.628125 samples/sec accuracy=93.125000 loss=0.269710 lr=0.000689 Epoch[083] Batch [0349]/[3760] Speed: 135.313831 samples/sec accuracy=93.075893 loss=0.269468 lr=0.000688 Epoch[083] Batch [0399]/[3760] Speed: 121.646911 samples/sec accuracy=93.078125 loss=0.271268 lr=0.000687 Epoch[083] Batch [0449]/[3760] Speed: 127.101387 samples/sec accuracy=93.065972 loss=0.271609 lr=0.000686 Epoch[083] Batch [0499]/[3760] Speed: 128.200221 samples/sec accuracy=93.043750 loss=0.272821 lr=0.000685 Epoch[083] Batch [0549]/[3760] Speed: 125.682103 samples/sec accuracy=92.988636 loss=0.273768 lr=0.000683 Epoch[083] Batch [0599]/[3760] Speed: 128.561521 samples/sec accuracy=92.997396 loss=0.272782 lr=0.000682 Epoch[083] Batch [0649]/[3760] Speed: 121.980692 samples/sec accuracy=93.026442 loss=0.272584 lr=0.000681 Epoch[083] Batch [0699]/[3760] Speed: 124.764695 samples/sec accuracy=93.044643 loss=0.272185 lr=0.000680 Epoch[083] Batch [0749]/[3760] Speed: 130.588245 samples/sec accuracy=92.952083 loss=0.274394 lr=0.000679 Epoch[083] Batch [0799]/[3760] Speed: 119.497149 samples/sec accuracy=92.992188 loss=0.273314 lr=0.000678 Epoch[083] Batch [0849]/[3760] Speed: 133.123287 samples/sec accuracy=92.955882 loss=0.274480 lr=0.000677 Epoch[083] Batch [0899]/[3760] Speed: 117.570328 samples/sec accuracy=92.925347 loss=0.276054 lr=0.000676 Epoch[083] Batch [0949]/[3760] Speed: 131.703685 samples/sec accuracy=92.893092 loss=0.277227 lr=0.000675 Epoch[083] Batch [0999]/[3760] Speed: 127.476091 samples/sec accuracy=92.925000 loss=0.276534 lr=0.000674 Epoch[083] Batch [1049]/[3760] Speed: 118.654813 samples/sec accuracy=92.915179 loss=0.276585 lr=0.000673 Epoch[083] Batch [1099]/[3760] Speed: 126.436338 samples/sec accuracy=92.913352 loss=0.276928 lr=0.000672 Epoch[083] Batch [1149]/[3760] Speed: 129.578255 samples/sec accuracy=92.914402 loss=0.277228 lr=0.000671 Epoch[083] Batch [1199]/[3760] Speed: 126.107089 samples/sec accuracy=92.942708 loss=0.277202 lr=0.000670 Epoch[083] Batch [1249]/[3760] Speed: 125.869017 samples/sec accuracy=92.955000 loss=0.277121 lr=0.000669 Epoch[083] Batch [1299]/[3760] Speed: 126.884155 samples/sec accuracy=92.944712 loss=0.277141 lr=0.000668 Epoch[083] Batch [1349]/[3760] Speed: 120.827914 samples/sec accuracy=92.921296 loss=0.277522 lr=0.000667 Epoch[083] Batch [1399]/[3760] Speed: 127.003163 samples/sec accuracy=92.925223 loss=0.277368 lr=0.000666 Epoch[083] Batch [1449]/[3760] Speed: 127.257683 samples/sec accuracy=92.925647 loss=0.277824 lr=0.000665 Epoch[083] Batch [1499]/[3760] Speed: 129.861805 samples/sec accuracy=92.922917 loss=0.277879 lr=0.000664 Epoch[083] Batch [1549]/[3760] Speed: 118.025296 samples/sec accuracy=92.918347 loss=0.278126 lr=0.000663 Epoch[083] Batch [1599]/[3760] Speed: 131.570704 samples/sec accuracy=92.920898 loss=0.277660 lr=0.000662 Epoch[083] Batch [1649]/[3760] Speed: 121.522470 samples/sec accuracy=92.907197 loss=0.278040 lr=0.000660 Epoch[083] Batch [1699]/[3760] Speed: 131.807025 samples/sec accuracy=92.896140 loss=0.278402 lr=0.000659 Epoch[083] Batch [1749]/[3760] Speed: 120.443710 samples/sec accuracy=92.889286 loss=0.278747 lr=0.000658 Epoch[083] Batch [1799]/[3760] Speed: 125.753870 samples/sec accuracy=92.885417 loss=0.278769 lr=0.000657 Epoch[083] Batch [1849]/[3760] Speed: 129.045333 samples/sec accuracy=92.879223 loss=0.279029 lr=0.000656 Epoch[083] Batch [1899]/[3760] Speed: 119.216592 samples/sec accuracy=92.906250 loss=0.278509 lr=0.000655 Epoch[083] Batch [1949]/[3760] Speed: 128.509354 samples/sec accuracy=92.889423 loss=0.279113 lr=0.000654 Epoch[083] Batch [1999]/[3760] Speed: 125.629979 samples/sec accuracy=92.876563 loss=0.279768 lr=0.000653 Epoch[083] Batch [2049]/[3760] Speed: 130.593633 samples/sec accuracy=92.864329 loss=0.279824 lr=0.000652 Epoch[083] Batch [2099]/[3760] Speed: 116.491823 samples/sec accuracy=92.860119 loss=0.279961 lr=0.000651 Epoch[083] Batch [2149]/[3760] Speed: 131.880576 samples/sec accuracy=92.845930 loss=0.280063 lr=0.000650 Epoch[083] Batch [2199]/[3760] Speed: 122.480949 samples/sec accuracy=92.824574 loss=0.280682 lr=0.000649 Epoch[083] Batch [2249]/[3760] Speed: 126.739076 samples/sec accuracy=92.825000 loss=0.280777 lr=0.000648 Epoch[083] Batch [2299]/[3760] Speed: 118.056412 samples/sec accuracy=92.830163 loss=0.280881 lr=0.000647 Epoch[083] Batch [2349]/[3760] Speed: 132.605302 samples/sec accuracy=92.833777 loss=0.280847 lr=0.000646 Epoch[083] Batch [2399]/[3760] Speed: 131.796647 samples/sec accuracy=92.845052 loss=0.280612 lr=0.000645 Epoch[083] Batch [2449]/[3760] Speed: 116.079085 samples/sec accuracy=92.849490 loss=0.280719 lr=0.000644 Epoch[083] Batch [2499]/[3760] Speed: 130.328404 samples/sec accuracy=92.845625 loss=0.280922 lr=0.000643 Epoch[083] Batch [2549]/[3760] Speed: 114.983332 samples/sec accuracy=92.840686 loss=0.280942 lr=0.000642 Epoch[083] Batch [2599]/[3760] Speed: 136.236211 samples/sec accuracy=92.826923 loss=0.281295 lr=0.000641 Epoch[083] Batch [2649]/[3760] Speed: 121.927949 samples/sec accuracy=92.821934 loss=0.281278 lr=0.000640 Epoch[083] Batch [2699]/[3760] Speed: 126.251174 samples/sec accuracy=92.814236 loss=0.281566 lr=0.000639 Epoch[083] Batch [2749]/[3760] Speed: 132.019994 samples/sec accuracy=92.825000 loss=0.281405 lr=0.000638 Epoch[083] Batch [2799]/[3760] Speed: 118.598709 samples/sec accuracy=92.828683 loss=0.281326 lr=0.000637 Epoch[083] Batch [2849]/[3760] Speed: 129.980193 samples/sec accuracy=92.822917 loss=0.281161 lr=0.000636 Epoch[083] Batch [2899]/[3760] Speed: 123.080086 samples/sec accuracy=92.808728 loss=0.281613 lr=0.000635 Epoch[083] Batch [2949]/[3760] Speed: 128.526666 samples/sec accuracy=92.806674 loss=0.281516 lr=0.000634 Epoch[083] Batch [2999]/[3760] Speed: 124.544770 samples/sec accuracy=92.800521 loss=0.281738 lr=0.000633 Epoch[083] Batch [3049]/[3760] Speed: 126.081471 samples/sec accuracy=92.796107 loss=0.281814 lr=0.000632 Epoch[083] Batch [3099]/[3760] Speed: 127.666752 samples/sec accuracy=92.791331 loss=0.282272 lr=0.000631 Epoch[083] Batch [3149]/[3760] Speed: 118.800581 samples/sec accuracy=92.784226 loss=0.282519 lr=0.000630 Epoch[083] Batch [3199]/[3760] Speed: 124.144757 samples/sec accuracy=92.776855 loss=0.282856 lr=0.000629 Epoch[083] Batch [3249]/[3760] Speed: 133.505644 samples/sec accuracy=92.773077 loss=0.282892 lr=0.000628 Epoch[083] Batch [3299]/[3760] Speed: 125.555891 samples/sec accuracy=92.774621 loss=0.282909 lr=0.000627 Epoch[083] Batch [3349]/[3760] Speed: 125.463678 samples/sec accuracy=92.790578 loss=0.282615 lr=0.000626 Epoch[083] Batch [3399]/[3760] Speed: 126.470695 samples/sec accuracy=92.800551 loss=0.282364 lr=0.000625 Epoch[083] Batch [3449]/[3760] Speed: 122.926329 samples/sec accuracy=92.813859 loss=0.281899 lr=0.000624 Epoch[083] Batch [3499]/[3760] Speed: 125.457994 samples/sec accuracy=92.803571 loss=0.282303 lr=0.000623 Epoch[083] Batch [3549]/[3760] Speed: 125.954985 samples/sec accuracy=92.805898 loss=0.282262 lr=0.000622 Epoch[083] Batch [3599]/[3760] Speed: 127.090326 samples/sec accuracy=92.808160 loss=0.282391 lr=0.000621 Epoch[083] Batch [3649]/[3760] Speed: 125.280835 samples/sec accuracy=92.799229 loss=0.282434 lr=0.000620 Epoch[083] Batch [3699]/[3760] Speed: 126.577496 samples/sec accuracy=92.807010 loss=0.282205 lr=0.000619 Epoch[083] Batch [3749]/[3760] Speed: 142.880626 samples/sec accuracy=92.800417 loss=0.282245 lr=0.000618 Batch [0049]/[0303]: acc-top1=66.687500 acc-top5=86.468750 Batch [0099]/[0303]: acc-top1=67.234375 acc-top5=86.625000 Batch [0149]/[0303]: acc-top1=66.822917 acc-top5=86.375000 Batch [0199]/[0303]: acc-top1=66.359375 acc-top5=86.148438 Batch [0249]/[0303]: acc-top1=66.531250 acc-top5=86.187500 Batch [0299]/[0303]: acc-top1=66.505208 acc-top5=86.151042 [Epoch 083] training: accuracy=92.796709 loss=0.282322 [Epoch 083] speed: 125 samples/sec time cost: 2107.543801 [Epoch 083] validation: acc-top1=66.455239 acc-top5=86.117987 loss=2.168421 Epoch[084] Batch [0049]/[3759] Speed: 89.999986 samples/sec accuracy=93.437500 loss=0.252557 lr=0.000616 Epoch[084] Batch [0099]/[3759] Speed: 130.821713 samples/sec accuracy=93.406250 loss=0.253691 lr=0.000615 Epoch[084] Batch [0149]/[3759] Speed: 124.103360 samples/sec accuracy=93.427083 loss=0.258238 lr=0.000614 Epoch[084] Batch [0199]/[3759] Speed: 118.995234 samples/sec accuracy=93.421875 loss=0.258662 lr=0.000613 Epoch[084] Batch [0249]/[3759] Speed: 129.480192 samples/sec accuracy=93.418750 loss=0.261632 lr=0.000612 Epoch[084] Batch [0299]/[3759] Speed: 129.826348 samples/sec accuracy=93.427083 loss=0.261279 lr=0.000611 Epoch[084] Batch [0349]/[3759] Speed: 120.411981 samples/sec accuracy=93.401786 loss=0.260989 lr=0.000610 Epoch[084] Batch [0399]/[3759] Speed: 123.010615 samples/sec accuracy=93.296875 loss=0.263866 lr=0.000609 Epoch[084] Batch [0449]/[3759] Speed: 124.624021 samples/sec accuracy=93.190972 loss=0.265926 lr=0.000608 Epoch[084] Batch [0499]/[3759] Speed: 128.829610 samples/sec accuracy=93.181250 loss=0.267779 lr=0.000607 Epoch[084] Batch [0549]/[3759] Speed: 128.574534 samples/sec accuracy=93.173295 loss=0.269261 lr=0.000606 Epoch[084] Batch [0599]/[3759] Speed: 128.191339 samples/sec accuracy=93.148438 loss=0.268693 lr=0.000605 Epoch[084] Batch [0649]/[3759] Speed: 119.284953 samples/sec accuracy=93.110577 loss=0.269916 lr=0.000604 Epoch[084] Batch [0699]/[3759] Speed: 130.423581 samples/sec accuracy=93.118304 loss=0.269902 lr=0.000603 Epoch[084] Batch [0749]/[3759] Speed: 121.630052 samples/sec accuracy=93.114583 loss=0.271067 lr=0.000602 Epoch[084] Batch [0799]/[3759] Speed: 126.802575 samples/sec accuracy=93.173828 loss=0.269785 lr=0.000601 Epoch[084] Batch [0849]/[3759] Speed: 121.995006 samples/sec accuracy=93.172794 loss=0.270053 lr=0.000600 Epoch[084] Batch [0899]/[3759] Speed: 127.510127 samples/sec accuracy=93.175347 loss=0.270470 lr=0.000599 Epoch[084] Batch [0949]/[3759] Speed: 127.400872 samples/sec accuracy=93.169408 loss=0.270472 lr=0.000598 Epoch[084] Batch [0999]/[3759] Speed: 121.592995 samples/sec accuracy=93.129688 loss=0.271625 lr=0.000597 Epoch[084] Batch [1049]/[3759] Speed: 125.637006 samples/sec accuracy=93.159226 loss=0.270965 lr=0.000596 Epoch[084] Batch [1099]/[3759] Speed: 124.852878 samples/sec accuracy=93.174716 loss=0.270380 lr=0.000595 Epoch[084] Batch [1149]/[3759] Speed: 127.486538 samples/sec accuracy=93.163043 loss=0.270854 lr=0.000594 Epoch[084] Batch [1199]/[3759] Speed: 127.358891 samples/sec accuracy=93.201823 loss=0.270086 lr=0.000593 Epoch[084] Batch [1249]/[3759] Speed: 124.076132 samples/sec accuracy=93.207500 loss=0.270285 lr=0.000592 Epoch[084] Batch [1299]/[3759] Speed: 122.756692 samples/sec accuracy=93.162260 loss=0.270915 lr=0.000591 Epoch[084] Batch [1349]/[3759] Speed: 126.072850 samples/sec accuracy=93.163194 loss=0.270676 lr=0.000590 Epoch[084] Batch [1399]/[3759] Speed: 128.515145 samples/sec accuracy=93.165179 loss=0.270641 lr=0.000589 Epoch[084] Batch [1449]/[3759] Speed: 120.381571 samples/sec accuracy=93.154095 loss=0.270726 lr=0.000588 Epoch[084] Batch [1499]/[3759] Speed: 130.792958 samples/sec accuracy=93.156250 loss=0.270649 lr=0.000588 Epoch[084] Batch [1549]/[3759] Speed: 130.911854 samples/sec accuracy=93.174395 loss=0.270335 lr=0.000587 Epoch[084] Batch [1599]/[3759] Speed: 118.295116 samples/sec accuracy=93.166016 loss=0.270486 lr=0.000586 Epoch[084] Batch [1649]/[3759] Speed: 125.889903 samples/sec accuracy=93.171402 loss=0.270474 lr=0.000585 Epoch[084] Batch [1699]/[3759] Speed: 135.787387 samples/sec accuracy=93.147978 loss=0.270974 lr=0.000584 Epoch[084] Batch [1749]/[3759] Speed: 118.299307 samples/sec accuracy=93.162500 loss=0.270568 lr=0.000583 Epoch[084] Batch [1799]/[3759] Speed: 124.326556 samples/sec accuracy=93.171875 loss=0.270316 lr=0.000582 Epoch[084] Batch [1849]/[3759] Speed: 131.517422 samples/sec accuracy=93.174831 loss=0.270237 lr=0.000581 Epoch[084] Batch [1899]/[3759] Speed: 122.345483 samples/sec accuracy=93.148849 loss=0.270592 lr=0.000580 Epoch[084] Batch [1949]/[3759] Speed: 128.067831 samples/sec accuracy=93.138622 loss=0.271337 lr=0.000579 Epoch[084] Batch [1999]/[3759] Speed: 121.675540 samples/sec accuracy=93.131250 loss=0.271615 lr=0.000578 Epoch[084] Batch [2049]/[3759] Speed: 128.955607 samples/sec accuracy=93.120427 loss=0.272074 lr=0.000577 Epoch[084] Batch [2099]/[3759] Speed: 127.912377 samples/sec accuracy=93.125744 loss=0.271778 lr=0.000576 Epoch[084] Batch [2149]/[3759] Speed: 124.571057 samples/sec accuracy=93.117006 loss=0.271845 lr=0.000575 Epoch[084] Batch [2199]/[3759] Speed: 125.083591 samples/sec accuracy=93.098722 loss=0.271963 lr=0.000574 Epoch[084] Batch [2249]/[3759] Speed: 128.234522 samples/sec accuracy=93.093056 loss=0.272268 lr=0.000573 Epoch[084] Batch [2299]/[3759] Speed: 120.971284 samples/sec accuracy=93.125000 loss=0.271688 lr=0.000572 Epoch[084] Batch [2349]/[3759] Speed: 126.452324 samples/sec accuracy=93.109043 loss=0.272144 lr=0.000571 Epoch[084] Batch [2399]/[3759] Speed: 132.132798 samples/sec accuracy=93.117839 loss=0.272001 lr=0.000570 Epoch[084] Batch [2449]/[3759] Speed: 120.764395 samples/sec accuracy=93.126276 loss=0.271881 lr=0.000569 Epoch[084] Batch [2499]/[3759] Speed: 131.328509 samples/sec accuracy=93.110000 loss=0.272507 lr=0.000568 Epoch[084] Batch [2549]/[3759] Speed: 118.953134 samples/sec accuracy=93.111520 loss=0.272704 lr=0.000567 Epoch[084] Batch [2599]/[3759] Speed: 131.535490 samples/sec accuracy=93.102764 loss=0.272983 lr=0.000566 Epoch[084] Batch [2649]/[3759] Speed: 114.505741 samples/sec accuracy=93.112028 loss=0.272697 lr=0.000565 Epoch[084] Batch [2699]/[3759] Speed: 134.193302 samples/sec accuracy=93.107060 loss=0.272914 lr=0.000564 Epoch[084] Batch [2749]/[3759] Speed: 131.317800 samples/sec accuracy=93.096023 loss=0.273187 lr=0.000563 Epoch[084] Batch [2799]/[3759] Speed: 117.412710 samples/sec accuracy=93.102121 loss=0.272836 lr=0.000562 Epoch[084] Batch [2849]/[3759] Speed: 132.843294 samples/sec accuracy=93.108004 loss=0.272773 lr=0.000561 Epoch[084] Batch [2899]/[3759] Speed: 120.386944 samples/sec accuracy=93.106681 loss=0.272853 lr=0.000560 Epoch[084] Batch [2949]/[3759] Speed: 124.281351 samples/sec accuracy=93.116525 loss=0.272775 lr=0.000559 Epoch[084] Batch [2999]/[3759] Speed: 132.237166 samples/sec accuracy=93.116146 loss=0.272783 lr=0.000558 Epoch[084] Batch [3049]/[3759] Speed: 119.464940 samples/sec accuracy=93.105020 loss=0.273081 lr=0.000557 Epoch[084] Batch [3099]/[3759] Speed: 125.659229 samples/sec accuracy=93.111895 loss=0.272781 lr=0.000556 Epoch[084] Batch [3149]/[3759] Speed: 126.662860 samples/sec accuracy=93.108135 loss=0.272887 lr=0.000556 Epoch[084] Batch [3199]/[3759] Speed: 126.872191 samples/sec accuracy=93.114746 loss=0.272976 lr=0.000555 Epoch[084] Batch [3249]/[3759] Speed: 130.298192 samples/sec accuracy=93.117788 loss=0.272834 lr=0.000554 Epoch[084] Batch [3299]/[3759] Speed: 118.227910 samples/sec accuracy=93.107955 loss=0.273308 lr=0.000553 Epoch[084] Batch [3349]/[3759] Speed: 128.363092 samples/sec accuracy=93.108209 loss=0.273362 lr=0.000552 Epoch[084] Batch [3399]/[3759] Speed: 130.241197 samples/sec accuracy=93.102022 loss=0.273603 lr=0.000551 Epoch[084] Batch [3449]/[3759] Speed: 119.014391 samples/sec accuracy=93.100996 loss=0.273778 lr=0.000550 Epoch[084] Batch [3499]/[3759] Speed: 132.955545 samples/sec accuracy=93.102679 loss=0.273707 lr=0.000549 Epoch[084] Batch [3549]/[3759] Speed: 117.028887 samples/sec accuracy=93.106514 loss=0.273519 lr=0.000548 Epoch[084] Batch [3599]/[3759] Speed: 130.149709 samples/sec accuracy=93.116319 loss=0.273322 lr=0.000547 Epoch[084] Batch [3649]/[3759] Speed: 122.135871 samples/sec accuracy=93.122003 loss=0.273075 lr=0.000546 Epoch[084] Batch [3699]/[3759] Speed: 127.797249 samples/sec accuracy=93.121622 loss=0.273167 lr=0.000545 Epoch[084] Batch [3749]/[3759] Speed: 149.561309 samples/sec accuracy=93.119583 loss=0.273279 lr=0.000544 Batch [0049]/[0303]: acc-top1=66.750000 acc-top5=87.187500 Batch [0099]/[0303]: acc-top1=67.140625 acc-top5=86.703125 Batch [0149]/[0303]: acc-top1=66.666667 acc-top5=86.500000 Batch [0199]/[0303]: acc-top1=66.312500 acc-top5=86.210938 Batch [0249]/[0303]: acc-top1=66.412500 acc-top5=86.262500 Batch [0299]/[0303]: acc-top1=66.369792 acc-top5=86.260417 [Epoch 084] training: accuracy=93.113611 loss=0.273331 [Epoch 084] speed: 125 samples/sec time cost: 2107.349381 [Epoch 084] validation: acc-top1=66.316007 acc-top5=86.226279 loss=2.195326 Epoch[085] Batch [0049]/[3760] Speed: 88.812629 samples/sec accuracy=92.906250 loss=0.280940 lr=0.000543 Epoch[085] Batch [0099]/[3760] Speed: 135.386120 samples/sec accuracy=93.265625 loss=0.262919 lr=0.000542 Epoch[085] Batch [0149]/[3760] Speed: 121.697810 samples/sec accuracy=93.375000 loss=0.260306 lr=0.000541 Epoch[085] Batch [0199]/[3760] Speed: 125.776396 samples/sec accuracy=93.414062 loss=0.261825 lr=0.000540 Epoch[085] Batch [0249]/[3760] Speed: 126.676340 samples/sec accuracy=93.375000 loss=0.264151 lr=0.000539 Epoch[085] Batch [0299]/[3760] Speed: 127.995200 samples/sec accuracy=93.395833 loss=0.264037 lr=0.000538 Epoch[085] Batch [0349]/[3760] Speed: 116.195650 samples/sec accuracy=93.437500 loss=0.261880 lr=0.000537 Epoch[085] Batch [0399]/[3760] Speed: 134.255138 samples/sec accuracy=93.542969 loss=0.259584 lr=0.000536 Epoch[085] Batch [0449]/[3760] Speed: 125.338437 samples/sec accuracy=93.548611 loss=0.260333 lr=0.000535 Epoch[085] Batch [0499]/[3760] Speed: 121.524292 samples/sec accuracy=93.571875 loss=0.258567 lr=0.000534 Epoch[085] Batch [0549]/[3760] Speed: 126.794091 samples/sec accuracy=93.633523 loss=0.257688 lr=0.000534 Epoch[085] Batch [0599]/[3760] Speed: 127.475216 samples/sec accuracy=93.687500 loss=0.255674 lr=0.000533 Epoch[085] Batch [0649]/[3760] Speed: 123.331834 samples/sec accuracy=93.699519 loss=0.255864 lr=0.000532 Epoch[085] Batch [0699]/[3760] Speed: 128.830247 samples/sec accuracy=93.667411 loss=0.256452 lr=0.000531 Epoch[085] Batch [0749]/[3760] Speed: 115.728196 samples/sec accuracy=93.668750 loss=0.256123 lr=0.000530 Epoch[085] Batch [0799]/[3760] Speed: 133.087132 samples/sec accuracy=93.632812 loss=0.256625 lr=0.000529 Epoch[085] Batch [0849]/[3760] Speed: 129.304608 samples/sec accuracy=93.612132 loss=0.258271 lr=0.000528 Epoch[085] Batch [0899]/[3760] Speed: 121.390966 samples/sec accuracy=93.598958 loss=0.258413 lr=0.000527 Epoch[085] Batch [0949]/[3760] Speed: 129.548605 samples/sec accuracy=93.572368 loss=0.258902 lr=0.000526 Epoch[085] Batch [0999]/[3760] Speed: 124.066699 samples/sec accuracy=93.590625 loss=0.258202 lr=0.000525 Epoch[085] Batch [1049]/[3760] Speed: 125.238483 samples/sec accuracy=93.556548 loss=0.259359 lr=0.000524 Epoch[085] Batch [1099]/[3760] Speed: 121.309831 samples/sec accuracy=93.562500 loss=0.259387 lr=0.000523 Epoch[085] Batch [1149]/[3760] Speed: 131.462974 samples/sec accuracy=93.566576 loss=0.259355 lr=0.000522 Epoch[085] Batch [1199]/[3760] Speed: 125.010528 samples/sec accuracy=93.507812 loss=0.259945 lr=0.000521 Epoch[085] Batch [1249]/[3760] Speed: 123.627037 samples/sec accuracy=93.491250 loss=0.260178 lr=0.000520 Epoch[085] Batch [1299]/[3760] Speed: 124.584128 samples/sec accuracy=93.491587 loss=0.260289 lr=0.000520 Epoch[085] Batch [1349]/[3760] Speed: 123.461623 samples/sec accuracy=93.471065 loss=0.260647 lr=0.000519 Epoch[085] Batch [1399]/[3760] Speed: 130.323696 samples/sec accuracy=93.470982 loss=0.261145 lr=0.000518 Epoch[085] Batch [1449]/[3760] Speed: 125.646198 samples/sec accuracy=93.470905 loss=0.261316 lr=0.000517 Epoch[085] Batch [1499]/[3760] Speed: 124.718307 samples/sec accuracy=93.442708 loss=0.261836 lr=0.000516 Epoch[085] Batch [1549]/[3760] Speed: 127.794854 samples/sec accuracy=93.460685 loss=0.261551 lr=0.000515 Epoch[085] Batch [1599]/[3760] Speed: 118.746962 samples/sec accuracy=93.451172 loss=0.261419 lr=0.000514 Epoch[085] Batch [1649]/[3760] Speed: 133.527803 samples/sec accuracy=93.462121 loss=0.261199 lr=0.000513 Epoch[085] Batch [1699]/[3760] Speed: 122.664563 samples/sec accuracy=93.449449 loss=0.261345 lr=0.000512 Epoch[085] Batch [1749]/[3760] Speed: 125.188541 samples/sec accuracy=93.437500 loss=0.261219 lr=0.000511 Epoch[085] Batch [1799]/[3760] Speed: 127.941293 samples/sec accuracy=93.422743 loss=0.261638 lr=0.000510 Epoch[085] Batch [1849]/[3760] Speed: 122.981287 samples/sec accuracy=93.427365 loss=0.261681 lr=0.000509 Epoch[085] Batch [1899]/[3760] Speed: 127.762931 samples/sec accuracy=93.412829 loss=0.262223 lr=0.000508 Epoch[085] Batch [1949]/[3760] Speed: 125.900290 samples/sec accuracy=93.416667 loss=0.262187 lr=0.000508 Epoch[085] Batch [1999]/[3760] Speed: 127.363126 samples/sec accuracy=93.425000 loss=0.262077 lr=0.000507 Epoch[085] Batch [2049]/[3760] Speed: 125.679562 samples/sec accuracy=93.412348 loss=0.262496 lr=0.000506 Epoch[085] Batch [2099]/[3760] Speed: 124.449126 samples/sec accuracy=93.429315 loss=0.262154 lr=0.000505 Epoch[085] Batch [2149]/[3760] Speed: 121.553645 samples/sec accuracy=93.430959 loss=0.262004 lr=0.000504 Epoch[085] Batch [2199]/[3760] Speed: 120.927576 samples/sec accuracy=93.426136 loss=0.262000 lr=0.000503 Epoch[085] Batch [2249]/[3760] Speed: 132.386231 samples/sec accuracy=93.417361 loss=0.262056 lr=0.000502 Epoch[085] Batch [2299]/[3760] Speed: 126.692091 samples/sec accuracy=93.405571 loss=0.262564 lr=0.000501 Epoch[085] Batch [2349]/[3760] Speed: 122.304532 samples/sec accuracy=93.402261 loss=0.262760 lr=0.000500 Epoch[085] Batch [2399]/[3760] Speed: 130.681384 samples/sec accuracy=93.379557 loss=0.263054 lr=0.000499 Epoch[085] Batch [2449]/[3760] Speed: 124.763317 samples/sec accuracy=93.367985 loss=0.263286 lr=0.000498 Epoch[085] Batch [2499]/[3760] Speed: 121.950435 samples/sec accuracy=93.356250 loss=0.263536 lr=0.000497 Epoch[085] Batch [2549]/[3760] Speed: 123.434359 samples/sec accuracy=93.349265 loss=0.263815 lr=0.000497 Epoch[085] Batch [2599]/[3760] Speed: 131.686540 samples/sec accuracy=93.353966 loss=0.263637 lr=0.000496 Epoch[085] Batch [2649]/[3760] Speed: 118.278193 samples/sec accuracy=93.356722 loss=0.263602 lr=0.000495 Epoch[085] Batch [2699]/[3760] Speed: 132.449818 samples/sec accuracy=93.348380 loss=0.263840 lr=0.000494 Epoch[085] Batch [2749]/[3760] Speed: 121.741564 samples/sec accuracy=93.335227 loss=0.264183 lr=0.000493 Epoch[085] Batch [2799]/[3760] Speed: 123.956018 samples/sec accuracy=93.335938 loss=0.264008 lr=0.000492 Epoch[085] Batch [2849]/[3760] Speed: 130.468015 samples/sec accuracy=93.332785 loss=0.264315 lr=0.000491 Epoch[085] Batch [2899]/[3760] Speed: 119.926982 samples/sec accuracy=93.337284 loss=0.264238 lr=0.000490 Epoch[085] Batch [2949]/[3760] Speed: 134.117269 samples/sec accuracy=93.342161 loss=0.263988 lr=0.000489 Epoch[085] Batch [2999]/[3760] Speed: 117.626714 samples/sec accuracy=93.341667 loss=0.263979 lr=0.000488 Epoch[085] Batch [3049]/[3760] Speed: 131.799744 samples/sec accuracy=93.337602 loss=0.264060 lr=0.000488 Epoch[085] Batch [3099]/[3760] Speed: 129.410187 samples/sec accuracy=93.353327 loss=0.263693 lr=0.000487 Epoch[085] Batch [3149]/[3760] Speed: 119.184507 samples/sec accuracy=93.361111 loss=0.263553 lr=0.000486 Epoch[085] Batch [3199]/[3760] Speed: 128.404717 samples/sec accuracy=93.355469 loss=0.263814 lr=0.000485 Epoch[085] Batch [3249]/[3760] Speed: 123.832199 samples/sec accuracy=93.361058 loss=0.263768 lr=0.000484 Epoch[085] Batch [3299]/[3760] Speed: 127.110122 samples/sec accuracy=93.362689 loss=0.263939 lr=0.000483 Epoch[085] Batch [3349]/[3760] Speed: 131.326108 samples/sec accuracy=93.352612 loss=0.264235 lr=0.000482 Epoch[085] Batch [3399]/[3760] Speed: 116.278429 samples/sec accuracy=93.346967 loss=0.264333 lr=0.000481 Epoch[085] Batch [3449]/[3760] Speed: 132.672890 samples/sec accuracy=93.360507 loss=0.263870 lr=0.000480 Epoch[085] Batch [3499]/[3760] Speed: 118.984616 samples/sec accuracy=93.364732 loss=0.263778 lr=0.000479 Epoch[085] Batch [3549]/[3760] Speed: 131.917737 samples/sec accuracy=93.367518 loss=0.263760 lr=0.000479 Epoch[085] Batch [3599]/[3760] Speed: 121.101450 samples/sec accuracy=93.365017 loss=0.263655 lr=0.000478 Epoch[085] Batch [3649]/[3760] Speed: 125.590643 samples/sec accuracy=93.373288 loss=0.263502 lr=0.000477 Epoch[085] Batch [3699]/[3760] Speed: 130.762654 samples/sec accuracy=93.375000 loss=0.263483 lr=0.000476 Epoch[085] Batch [3749]/[3760] Speed: 139.866024 samples/sec accuracy=93.377500 loss=0.263351 lr=0.000475 Batch [0049]/[0303]: acc-top1=67.093750 acc-top5=86.343750 Batch [0099]/[0303]: acc-top1=67.453125 acc-top5=86.062500 Batch [0149]/[0303]: acc-top1=66.802083 acc-top5=86.041667 Batch [0199]/[0303]: acc-top1=66.265625 acc-top5=85.843750 Batch [0249]/[0303]: acc-top1=66.481250 acc-top5=85.893750 Batch [0299]/[0303]: acc-top1=66.406250 acc-top5=85.911458 [Epoch 085] training: accuracy=93.378906 loss=0.263337 [Epoch 085] speed: 125 samples/sec time cost: 2107.379532 [Epoch 085] validation: acc-top1=66.388201 acc-top5=85.885932 loss=2.161758 Epoch[086] Batch [0049]/[3760] Speed: 88.996800 samples/sec accuracy=93.593750 loss=0.257295 lr=0.000474 Epoch[086] Batch [0099]/[3760] Speed: 134.677224 samples/sec accuracy=93.468750 loss=0.263892 lr=0.000473 Epoch[086] Batch [0149]/[3760] Speed: 120.496792 samples/sec accuracy=93.697917 loss=0.256746 lr=0.000472 Epoch[086] Batch [0199]/[3760] Speed: 126.177121 samples/sec accuracy=93.640625 loss=0.257778 lr=0.000471 Epoch[086] Batch [0249]/[3760] Speed: 131.075574 samples/sec accuracy=93.812500 loss=0.255156 lr=0.000470 Epoch[086] Batch [0299]/[3760] Speed: 119.794176 samples/sec accuracy=93.843750 loss=0.253596 lr=0.000470 Epoch[086] Batch [0349]/[3760] Speed: 129.427455 samples/sec accuracy=93.839286 loss=0.254501 lr=0.000469 Epoch[086] Batch [0399]/[3760] Speed: 118.421825 samples/sec accuracy=93.878906 loss=0.252192 lr=0.000468 Epoch[086] Batch [0449]/[3760] Speed: 132.832423 samples/sec accuracy=93.902778 loss=0.253512 lr=0.000467 Epoch[086] Batch [0499]/[3760] Speed: 124.168560 samples/sec accuracy=93.971875 loss=0.251545 lr=0.000466 Epoch[086] Batch [0549]/[3760] Speed: 125.510912 samples/sec accuracy=93.917614 loss=0.251995 lr=0.000465 Epoch[086] Batch [0599]/[3760] Speed: 127.481660 samples/sec accuracy=93.890625 loss=0.253093 lr=0.000464 Epoch[086] Batch [0649]/[3760] Speed: 122.156024 samples/sec accuracy=93.841346 loss=0.253601 lr=0.000463 Epoch[086] Batch [0699]/[3760] Speed: 131.093095 samples/sec accuracy=93.792411 loss=0.254709 lr=0.000462 Epoch[086] Batch [0749]/[3760] Speed: 122.069661 samples/sec accuracy=93.731250 loss=0.257290 lr=0.000462 Epoch[086] Batch [0799]/[3760] Speed: 129.125851 samples/sec accuracy=93.728516 loss=0.256775 lr=0.000461 Epoch[086] Batch [0849]/[3760] Speed: 122.317156 samples/sec accuracy=93.729779 loss=0.256548 lr=0.000460 Epoch[086] Batch [0899]/[3760] Speed: 126.920041 samples/sec accuracy=93.748264 loss=0.255553 lr=0.000459 Epoch[086] Batch [0949]/[3760] Speed: 127.221945 samples/sec accuracy=93.723684 loss=0.255985 lr=0.000458 Epoch[086] Batch [0999]/[3760] Speed: 125.046314 samples/sec accuracy=93.762500 loss=0.255118 lr=0.000457 Epoch[086] Batch [1049]/[3760] Speed: 126.267189 samples/sec accuracy=93.770833 loss=0.254729 lr=0.000456 Epoch[086] Batch [1099]/[3760] Speed: 125.261464 samples/sec accuracy=93.740057 loss=0.255495 lr=0.000455 Epoch[086] Batch [1149]/[3760] Speed: 127.956183 samples/sec accuracy=93.737772 loss=0.255476 lr=0.000455 Epoch[086] Batch [1199]/[3760] Speed: 121.498550 samples/sec accuracy=93.692708 loss=0.256170 lr=0.000454 Epoch[086] Batch [1249]/[3760] Speed: 130.516237 samples/sec accuracy=93.702500 loss=0.255915 lr=0.000453 Epoch[086] Batch [1299]/[3760] Speed: 121.778425 samples/sec accuracy=93.661058 loss=0.256511 lr=0.000452 Epoch[086] Batch [1349]/[3760] Speed: 131.354065 samples/sec accuracy=93.642361 loss=0.256654 lr=0.000451 Epoch[086] Batch [1399]/[3760] Speed: 120.979664 samples/sec accuracy=93.654018 loss=0.256124 lr=0.000450 Epoch[086] Batch [1449]/[3760] Speed: 127.745294 samples/sec accuracy=93.678879 loss=0.255589 lr=0.000449 Epoch[086] Batch [1499]/[3760] Speed: 125.309803 samples/sec accuracy=93.695833 loss=0.255471 lr=0.000449 Epoch[086] Batch [1549]/[3760] Speed: 125.664981 samples/sec accuracy=93.682460 loss=0.255820 lr=0.000448 Epoch[086] Batch [1599]/[3760] Speed: 128.248352 samples/sec accuracy=93.647461 loss=0.256605 lr=0.000447 Epoch[086] Batch [1649]/[3760] Speed: 124.745583 samples/sec accuracy=93.636364 loss=0.256895 lr=0.000446 Epoch[086] Batch [1699]/[3760] Speed: 125.950339 samples/sec accuracy=93.622243 loss=0.257364 lr=0.000445 Epoch[086] Batch [1749]/[3760] Speed: 130.737192 samples/sec accuracy=93.593750 loss=0.257797 lr=0.000444 Epoch[086] Batch [1799]/[3760] Speed: 118.433301 samples/sec accuracy=93.598958 loss=0.257511 lr=0.000443 Epoch[086] Batch [1849]/[3760] Speed: 133.073174 samples/sec accuracy=93.603041 loss=0.257489 lr=0.000443 Epoch[086] Batch [1899]/[3760] Speed: 120.648553 samples/sec accuracy=93.605263 loss=0.257410 lr=0.000442 Epoch[086] Batch [1949]/[3760] Speed: 126.845990 samples/sec accuracy=93.616186 loss=0.257161 lr=0.000441 Epoch[086] Batch [1999]/[3760] Speed: 133.881306 samples/sec accuracy=93.615625 loss=0.257169 lr=0.000440 Epoch[086] Batch [2049]/[3760] Speed: 119.399039 samples/sec accuracy=93.621951 loss=0.257024 lr=0.000439 Epoch[086] Batch [2099]/[3760] Speed: 127.577902 samples/sec accuracy=93.607887 loss=0.257465 lr=0.000438 Epoch[086] Batch [2149]/[3760] Speed: 125.778885 samples/sec accuracy=93.611192 loss=0.257240 lr=0.000437 Epoch[086] Batch [2199]/[3760] Speed: 125.424938 samples/sec accuracy=93.594460 loss=0.257564 lr=0.000437 Epoch[086] Batch [2249]/[3760] Speed: 124.565961 samples/sec accuracy=93.596528 loss=0.257196 lr=0.000436 Epoch[086] Batch [2299]/[3760] Speed: 127.609347 samples/sec accuracy=93.598505 loss=0.257268 lr=0.000435 Epoch[086] Batch [2349]/[3760] Speed: 123.504003 samples/sec accuracy=93.607048 loss=0.256793 lr=0.000434 Epoch[086] Batch [2399]/[3760] Speed: 124.134413 samples/sec accuracy=93.615234 loss=0.256490 lr=0.000433 Epoch[086] Batch [2449]/[3760] Speed: 127.637714 samples/sec accuracy=93.618622 loss=0.256251 lr=0.000432 Epoch[086] Batch [2499]/[3760] Speed: 131.040216 samples/sec accuracy=93.625625 loss=0.255836 lr=0.000431 Epoch[086] Batch [2549]/[3760] Speed: 120.641560 samples/sec accuracy=93.616422 loss=0.255976 lr=0.000431 Epoch[086] Batch [2599]/[3760] Speed: 128.352464 samples/sec accuracy=93.621394 loss=0.256045 lr=0.000430 Epoch[086] Batch [2649]/[3760] Speed: 123.426948 samples/sec accuracy=93.619104 loss=0.255680 lr=0.000429 Epoch[086] Batch [2699]/[3760] Speed: 126.809660 samples/sec accuracy=93.615741 loss=0.255778 lr=0.000428 Epoch[086] Batch [2749]/[3760] Speed: 128.049212 samples/sec accuracy=93.614205 loss=0.255852 lr=0.000427 Epoch[086] Batch [2799]/[3760] Speed: 117.158487 samples/sec accuracy=93.622768 loss=0.255494 lr=0.000426 Epoch[086] Batch [2849]/[3760] Speed: 133.777177 samples/sec accuracy=93.623355 loss=0.255710 lr=0.000425 Epoch[086] Batch [2899]/[3760] Speed: 119.330331 samples/sec accuracy=93.625000 loss=0.255631 lr=0.000425 Epoch[086] Batch [2949]/[3760] Speed: 131.132307 samples/sec accuracy=93.609110 loss=0.255832 lr=0.000424 Epoch[086] Batch [2999]/[3760] Speed: 132.811609 samples/sec accuracy=93.607812 loss=0.255969 lr=0.000423 Epoch[086] Batch [3049]/[3760] Speed: 120.850317 samples/sec accuracy=93.605533 loss=0.256243 lr=0.000422 Epoch[086] Batch [3099]/[3760] Speed: 124.519362 samples/sec accuracy=93.599798 loss=0.256420 lr=0.000421 Epoch[086] Batch [3149]/[3760] Speed: 132.901901 samples/sec accuracy=93.607143 loss=0.256001 lr=0.000420 Epoch[086] Batch [3199]/[3760] Speed: 116.046437 samples/sec accuracy=93.614746 loss=0.255978 lr=0.000420 Epoch[086] Batch [3249]/[3760] Speed: 127.355313 samples/sec accuracy=93.608654 loss=0.256052 lr=0.000419 Epoch[086] Batch [3299]/[3760] Speed: 127.061176 samples/sec accuracy=93.600379 loss=0.256289 lr=0.000418 Epoch[086] Batch [3349]/[3760] Speed: 132.479559 samples/sec accuracy=93.602612 loss=0.256153 lr=0.000417 Epoch[086] Batch [3399]/[3760] Speed: 117.239567 samples/sec accuracy=93.600643 loss=0.256054 lr=0.000416 Epoch[086] Batch [3449]/[3760] Speed: 126.817026 samples/sec accuracy=93.602808 loss=0.255895 lr=0.000415 Epoch[086] Batch [3499]/[3760] Speed: 124.790475 samples/sec accuracy=93.607143 loss=0.255758 lr=0.000415 Epoch[086] Batch [3549]/[3760] Speed: 127.386712 samples/sec accuracy=93.610035 loss=0.255842 lr=0.000414 Epoch[086] Batch [3599]/[3760] Speed: 124.479460 samples/sec accuracy=93.616319 loss=0.255782 lr=0.000413 Epoch[086] Batch [3649]/[3760] Speed: 122.111866 samples/sec accuracy=93.617295 loss=0.255804 lr=0.000412 Epoch[086] Batch [3699]/[3760] Speed: 127.051080 samples/sec accuracy=93.612331 loss=0.255958 lr=0.000411 Epoch[086] Batch [3749]/[3760] Speed: 143.169063 samples/sec accuracy=93.601250 loss=0.256300 lr=0.000410 Batch [0049]/[0303]: acc-top1=66.843750 acc-top5=86.906250 Batch [0099]/[0303]: acc-top1=67.437500 acc-top5=86.703125 Batch [0149]/[0303]: acc-top1=67.229167 acc-top5=86.510417 Batch [0199]/[0303]: acc-top1=66.726562 acc-top5=86.289062 Batch [0249]/[0303]: acc-top1=66.818750 acc-top5=86.181250 Batch [0299]/[0303]: acc-top1=66.703125 acc-top5=86.265625 [Epoch 086] training: accuracy=93.603723 loss=0.256216 [Epoch 086] speed: 125 samples/sec time cost: 2103.831231 [Epoch 086] validation: acc-top1=66.651196 acc-top5=86.246906 loss=2.153038 Epoch[087] Batch [0049]/[3759] Speed: 89.587440 samples/sec accuracy=94.406250 loss=0.236175 lr=0.000409 Epoch[087] Batch [0099]/[3759] Speed: 125.735482 samples/sec accuracy=94.093750 loss=0.243862 lr=0.000409 Epoch[087] Batch [0149]/[3759] Speed: 129.814540 samples/sec accuracy=93.927083 loss=0.241371 lr=0.000408 Epoch[087] Batch [0199]/[3759] Speed: 121.591636 samples/sec accuracy=93.773438 loss=0.243905 lr=0.000407 Epoch[087] Batch [0249]/[3759] Speed: 128.314012 samples/sec accuracy=93.768750 loss=0.241661 lr=0.000406 Epoch[087] Batch [0299]/[3759] Speed: 126.295168 samples/sec accuracy=93.901042 loss=0.239880 lr=0.000405 Epoch[087] Batch [0349]/[3759] Speed: 122.550825 samples/sec accuracy=93.964286 loss=0.238917 lr=0.000404 Epoch[087] Batch [0399]/[3759] Speed: 127.396828 samples/sec accuracy=94.085938 loss=0.236986 lr=0.000404 Epoch[087] Batch [0449]/[3759] Speed: 121.370102 samples/sec accuracy=94.097222 loss=0.237077 lr=0.000403 Epoch[087] Batch [0499]/[3759] Speed: 127.047858 samples/sec accuracy=94.159375 loss=0.235599 lr=0.000402 Epoch[087] Batch [0549]/[3759] Speed: 123.289018 samples/sec accuracy=94.119318 loss=0.236952 lr=0.000401 Epoch[087] Batch [0599]/[3759] Speed: 131.264780 samples/sec accuracy=94.171875 loss=0.236442 lr=0.000400 Epoch[087] Batch [0649]/[3759] Speed: 130.645977 samples/sec accuracy=94.144231 loss=0.237833 lr=0.000400 Epoch[087] Batch [0699]/[3759] Speed: 117.058594 samples/sec accuracy=94.129464 loss=0.237318 lr=0.000399 Epoch[087] Batch [0749]/[3759] Speed: 133.853925 samples/sec accuracy=94.118750 loss=0.237838 lr=0.000398 Epoch[087] Batch [0799]/[3759] Speed: 126.855167 samples/sec accuracy=94.099609 loss=0.238643 lr=0.000397 Epoch[087] Batch [0849]/[3759] Speed: 118.985656 samples/sec accuracy=94.113971 loss=0.238034 lr=0.000396 Epoch[087] Batch [0899]/[3759] Speed: 132.894528 samples/sec accuracy=94.102431 loss=0.238917 lr=0.000395 Epoch[087] Batch [0949]/[3759] Speed: 116.361774 samples/sec accuracy=94.106908 loss=0.239683 lr=0.000395 Epoch[087] Batch [0999]/[3759] Speed: 128.795646 samples/sec accuracy=94.078125 loss=0.240146 lr=0.000394 Epoch[087] Batch [1049]/[3759] Speed: 128.185533 samples/sec accuracy=94.068452 loss=0.240082 lr=0.000393 Epoch[087] Batch [1099]/[3759] Speed: 121.835871 samples/sec accuracy=94.068182 loss=0.240311 lr=0.000392 Epoch[087] Batch [1149]/[3759] Speed: 132.985631 samples/sec accuracy=94.059783 loss=0.240757 lr=0.000391 Epoch[087] Batch [1199]/[3759] Speed: 120.290249 samples/sec accuracy=94.010417 loss=0.241568 lr=0.000391 Epoch[087] Batch [1249]/[3759] Speed: 127.465428 samples/sec accuracy=94.033750 loss=0.241019 lr=0.000390 Epoch[087] Batch [1299]/[3759] Speed: 126.564798 samples/sec accuracy=94.043269 loss=0.240863 lr=0.000389 Epoch[087] Batch [1349]/[3759] Speed: 124.205039 samples/sec accuracy=94.041667 loss=0.241322 lr=0.000388 Epoch[087] Batch [1399]/[3759] Speed: 130.462072 samples/sec accuracy=94.036830 loss=0.241829 lr=0.000387 Epoch[087] Batch [1449]/[3759] Speed: 122.454124 samples/sec accuracy=94.016164 loss=0.242691 lr=0.000387 Epoch[087] Batch [1499]/[3759] Speed: 123.173445 samples/sec accuracy=94.018750 loss=0.242765 lr=0.000386 Epoch[087] Batch [1549]/[3759] Speed: 128.963247 samples/sec accuracy=93.997984 loss=0.243227 lr=0.000385 Epoch[087] Batch [1599]/[3759] Speed: 121.059276 samples/sec accuracy=93.988281 loss=0.243553 lr=0.000384 Epoch[087] Batch [1649]/[3759] Speed: 124.997588 samples/sec accuracy=93.993371 loss=0.243399 lr=0.000383 Epoch[087] Batch [1699]/[3759] Speed: 128.140659 samples/sec accuracy=93.987132 loss=0.243619 lr=0.000383 Epoch[087] Batch [1749]/[3759] Speed: 124.577520 samples/sec accuracy=93.975000 loss=0.243842 lr=0.000382 Epoch[087] Batch [1799]/[3759] Speed: 125.305324 samples/sec accuracy=93.955729 loss=0.244418 lr=0.000381 Epoch[087] Batch [1849]/[3759] Speed: 129.961375 samples/sec accuracy=93.936655 loss=0.244977 lr=0.000380 Epoch[087] Batch [1899]/[3759] Speed: 120.809502 samples/sec accuracy=93.938322 loss=0.245075 lr=0.000379 Epoch[087] Batch [1949]/[3759] Speed: 126.578592 samples/sec accuracy=93.947917 loss=0.244976 lr=0.000379 Epoch[087] Batch [1999]/[3759] Speed: 125.135767 samples/sec accuracy=93.945312 loss=0.245072 lr=0.000378 Epoch[087] Batch [2049]/[3759] Speed: 124.681702 samples/sec accuracy=93.937500 loss=0.244999 lr=0.000377 Epoch[087] Batch [2099]/[3759] Speed: 119.454087 samples/sec accuracy=93.942708 loss=0.245160 lr=0.000376 Epoch[087] Batch [2149]/[3759] Speed: 136.831193 samples/sec accuracy=93.941134 loss=0.245456 lr=0.000375 Epoch[087] Batch [2199]/[3759] Speed: 125.112301 samples/sec accuracy=93.931108 loss=0.245665 lr=0.000375 Epoch[087] Batch [2249]/[3759] Speed: 123.569658 samples/sec accuracy=93.922222 loss=0.245618 lr=0.000374 Epoch[087] Batch [2299]/[3759] Speed: 131.045201 samples/sec accuracy=93.931386 loss=0.245561 lr=0.000373 Epoch[087] Batch [2349]/[3759] Speed: 123.486640 samples/sec accuracy=93.930186 loss=0.245754 lr=0.000372 Epoch[087] Batch [2399]/[3759] Speed: 126.958463 samples/sec accuracy=93.904948 loss=0.246332 lr=0.000371 Epoch[087] Batch [2449]/[3759] Speed: 120.939253 samples/sec accuracy=93.899872 loss=0.246413 lr=0.000371 Epoch[087] Batch [2499]/[3759] Speed: 128.442131 samples/sec accuracy=93.892500 loss=0.246571 lr=0.000370 Epoch[087] Batch [2549]/[3759] Speed: 124.702792 samples/sec accuracy=93.896446 loss=0.246456 lr=0.000369 Epoch[087] Batch [2599]/[3759] Speed: 126.778314 samples/sec accuracy=93.900841 loss=0.246352 lr=0.000368 Epoch[087] Batch [2649]/[3759] Speed: 122.530411 samples/sec accuracy=93.900354 loss=0.246414 lr=0.000367 Epoch[087] Batch [2699]/[3759] Speed: 132.825239 samples/sec accuracy=93.895255 loss=0.246505 lr=0.000367 Epoch[087] Batch [2749]/[3759] Speed: 119.150859 samples/sec accuracy=93.896591 loss=0.246671 lr=0.000366 Epoch[087] Batch [2799]/[3759] Speed: 128.425030 samples/sec accuracy=93.908482 loss=0.246498 lr=0.000365 Epoch[087] Batch [2849]/[3759] Speed: 122.232109 samples/sec accuracy=93.916667 loss=0.246207 lr=0.000364 Epoch[087] Batch [2899]/[3759] Speed: 129.842185 samples/sec accuracy=93.917565 loss=0.245923 lr=0.000364 Epoch[087] Batch [2949]/[3759] Speed: 130.422201 samples/sec accuracy=93.897775 loss=0.246598 lr=0.000363 Epoch[087] Batch [2999]/[3759] Speed: 119.413299 samples/sec accuracy=93.892188 loss=0.246786 lr=0.000362 Epoch[087] Batch [3049]/[3759] Speed: 124.459832 samples/sec accuracy=93.886270 loss=0.247139 lr=0.000361 Epoch[087] Batch [3099]/[3759] Speed: 126.503181 samples/sec accuracy=93.889617 loss=0.246979 lr=0.000360 Epoch[087] Batch [3149]/[3759] Speed: 129.446390 samples/sec accuracy=93.886409 loss=0.247006 lr=0.000360 Epoch[087] Batch [3199]/[3759] Speed: 126.208343 samples/sec accuracy=93.900879 loss=0.246486 lr=0.000359 Epoch[087] Batch [3249]/[3759] Speed: 124.796242 samples/sec accuracy=93.898077 loss=0.246559 lr=0.000358 Epoch[087] Batch [3299]/[3759] Speed: 126.514082 samples/sec accuracy=93.894413 loss=0.246588 lr=0.000357 Epoch[087] Batch [3349]/[3759] Speed: 121.398047 samples/sec accuracy=93.898787 loss=0.246420 lr=0.000357 Epoch[087] Batch [3399]/[3759] Speed: 129.354527 samples/sec accuracy=93.901654 loss=0.246292 lr=0.000356 Epoch[087] Batch [3449]/[3759] Speed: 121.876636 samples/sec accuracy=93.895380 loss=0.246504 lr=0.000355 Epoch[087] Batch [3499]/[3759] Speed: 132.596277 samples/sec accuracy=93.883929 loss=0.246675 lr=0.000354 Epoch[087] Batch [3549]/[3759] Speed: 119.223882 samples/sec accuracy=93.879401 loss=0.246821 lr=0.000353 Epoch[087] Batch [3599]/[3759] Speed: 130.459084 samples/sec accuracy=93.880642 loss=0.246761 lr=0.000353 Epoch[087] Batch [3649]/[3759] Speed: 115.282387 samples/sec accuracy=93.878425 loss=0.246792 lr=0.000352 Epoch[087] Batch [3699]/[3759] Speed: 131.498771 samples/sec accuracy=93.877534 loss=0.246824 lr=0.000351 Epoch[087] Batch [3749]/[3759] Speed: 149.407204 samples/sec accuracy=93.877917 loss=0.246918 lr=0.000350 Batch [0049]/[0303]: acc-top1=67.156250 acc-top5=87.156250 Batch [0099]/[0303]: acc-top1=67.281250 acc-top5=86.984375 Batch [0149]/[0303]: acc-top1=67.010417 acc-top5=86.739583 Batch [0199]/[0303]: acc-top1=66.578125 acc-top5=86.484375 Batch [0249]/[0303]: acc-top1=66.718750 acc-top5=86.418750 Batch [0299]/[0303]: acc-top1=66.630208 acc-top5=86.421875 [Epoch 087] training: accuracy=93.880520 loss=0.246803 [Epoch 087] speed: 125 samples/sec time cost: 2104.844138 [Epoch 087] validation: acc-top1=66.604785 acc-top5=86.375825 loss=2.187478 Epoch[088] Batch [0049]/[3760] Speed: 88.366199 samples/sec accuracy=95.062500 loss=0.224297 lr=0.000349 Epoch[088] Batch [0099]/[3760] Speed: 133.510304 samples/sec accuracy=94.734375 loss=0.227488 lr=0.000349 Epoch[088] Batch [0149]/[3760] Speed: 122.665235 samples/sec accuracy=94.427083 loss=0.233459 lr=0.000348 Epoch[088] Batch [0199]/[3760] Speed: 124.817459 samples/sec accuracy=94.367188 loss=0.234072 lr=0.000347 Epoch[088] Batch [0249]/[3760] Speed: 126.787016 samples/sec accuracy=94.225000 loss=0.235346 lr=0.000346 Epoch[088] Batch [0299]/[3760] Speed: 128.064646 samples/sec accuracy=94.197917 loss=0.233621 lr=0.000346 Epoch[088] Batch [0349]/[3760] Speed: 125.332774 samples/sec accuracy=94.125000 loss=0.236166 lr=0.000345 Epoch[088] Batch [0399]/[3760] Speed: 125.417054 samples/sec accuracy=94.164062 loss=0.235136 lr=0.000344 Epoch[088] Batch [0449]/[3760] Speed: 129.395653 samples/sec accuracy=94.131944 loss=0.237225 lr=0.000343 Epoch[088] Batch [0499]/[3760] Speed: 122.877632 samples/sec accuracy=94.068750 loss=0.239697 lr=0.000343 Epoch[088] Batch [0549]/[3760] Speed: 124.088847 samples/sec accuracy=93.968750 loss=0.243050 lr=0.000342 Epoch[088] Batch [0599]/[3760] Speed: 129.811343 samples/sec accuracy=93.955729 loss=0.244196 lr=0.000341 Epoch[088] Batch [0649]/[3760] Speed: 118.795090 samples/sec accuracy=93.915865 loss=0.244865 lr=0.000340 Epoch[088] Batch [0699]/[3760] Speed: 134.549168 samples/sec accuracy=93.928571 loss=0.245021 lr=0.000340 Epoch[088] Batch [0749]/[3760] Speed: 118.755867 samples/sec accuracy=93.968750 loss=0.244643 lr=0.000339 Epoch[088] Batch [0799]/[3760] Speed: 132.388951 samples/sec accuracy=93.939453 loss=0.244672 lr=0.000338 Epoch[088] Batch [0849]/[3760] Speed: 123.106156 samples/sec accuracy=94.007353 loss=0.242956 lr=0.000337 Epoch[088] Batch [0899]/[3760] Speed: 120.753571 samples/sec accuracy=94.027778 loss=0.242480 lr=0.000337 Epoch[088] Batch [0949]/[3760] Speed: 133.285536 samples/sec accuracy=94.016447 loss=0.242507 lr=0.000336 Epoch[088] Batch [0999]/[3760] Speed: 126.629951 samples/sec accuracy=94.012500 loss=0.242098 lr=0.000335 Epoch[088] Batch [1049]/[3760] Speed: 124.992724 samples/sec accuracy=94.028274 loss=0.241552 lr=0.000334 Epoch[088] Batch [1099]/[3760] Speed: 124.583461 samples/sec accuracy=94.004261 loss=0.242471 lr=0.000334 Epoch[088] Batch [1149]/[3760] Speed: 125.798212 samples/sec accuracy=94.025815 loss=0.241902 lr=0.000333 Epoch[088] Batch [1199]/[3760] Speed: 123.317196 samples/sec accuracy=94.022135 loss=0.242226 lr=0.000332 Epoch[088] Batch [1249]/[3760] Speed: 128.926885 samples/sec accuracy=94.021250 loss=0.242176 lr=0.000331 Epoch[088] Batch [1299]/[3760] Speed: 126.267245 samples/sec accuracy=94.021635 loss=0.242290 lr=0.000331 Epoch[088] Batch [1349]/[3760] Speed: 118.268992 samples/sec accuracy=94.006944 loss=0.243229 lr=0.000330 Epoch[088] Batch [1399]/[3760] Speed: 133.581961 samples/sec accuracy=94.002232 loss=0.243227 lr=0.000329 Epoch[088] Batch [1449]/[3760] Speed: 130.948138 samples/sec accuracy=94.022629 loss=0.242632 lr=0.000328 Epoch[088] Batch [1499]/[3760] Speed: 117.000428 samples/sec accuracy=94.017708 loss=0.242806 lr=0.000328 Epoch[088] Batch [1549]/[3760] Speed: 127.666007 samples/sec accuracy=94.005040 loss=0.243176 lr=0.000327 Epoch[088] Batch [1599]/[3760] Speed: 123.292288 samples/sec accuracy=94.008789 loss=0.242885 lr=0.000326 Epoch[088] Batch [1649]/[3760] Speed: 127.545081 samples/sec accuracy=94.017045 loss=0.242762 lr=0.000325 Epoch[088] Batch [1699]/[3760] Speed: 127.630616 samples/sec accuracy=94.006434 loss=0.242681 lr=0.000325 Epoch[088] Batch [1749]/[3760] Speed: 118.925895 samples/sec accuracy=94.007143 loss=0.242447 lr=0.000324 Epoch[088] Batch [1799]/[3760] Speed: 131.554610 samples/sec accuracy=94.000868 loss=0.242797 lr=0.000323 Epoch[088] Batch [1849]/[3760] Speed: 123.187815 samples/sec accuracy=94.004223 loss=0.242664 lr=0.000322 Epoch[088] Batch [1899]/[3760] Speed: 121.746330 samples/sec accuracy=94.004934 loss=0.242633 lr=0.000322 Epoch[088] Batch [1949]/[3760] Speed: 132.549515 samples/sec accuracy=94.000801 loss=0.242771 lr=0.000321 Epoch[088] Batch [1999]/[3760] Speed: 121.638204 samples/sec accuracy=93.995312 loss=0.243140 lr=0.000320 Epoch[088] Batch [2049]/[3760] Speed: 124.373283 samples/sec accuracy=94.002287 loss=0.243183 lr=0.000319 Epoch[088] Batch [2099]/[3760] Speed: 125.123561 samples/sec accuracy=93.992560 loss=0.243292 lr=0.000319 Epoch[088] Batch [2149]/[3760] Speed: 125.330214 samples/sec accuracy=93.998547 loss=0.242869 lr=0.000318 Epoch[088] Batch [2199]/[3760] Speed: 127.096804 samples/sec accuracy=94.009943 loss=0.242566 lr=0.000317 Epoch[088] Batch [2249]/[3760] Speed: 126.934765 samples/sec accuracy=94.014583 loss=0.242557 lr=0.000316 Epoch[088] Batch [2299]/[3760] Speed: 126.022972 samples/sec accuracy=94.016304 loss=0.242318 lr=0.000316 Epoch[088] Batch [2349]/[3760] Speed: 125.246967 samples/sec accuracy=94.018617 loss=0.242598 lr=0.000315 Epoch[088] Batch [2399]/[3760] Speed: 129.946951 samples/sec accuracy=94.024740 loss=0.242374 lr=0.000314 Epoch[088] Batch [2449]/[3760] Speed: 118.432277 samples/sec accuracy=94.028699 loss=0.242146 lr=0.000314 Epoch[088] Batch [2499]/[3760] Speed: 132.048434 samples/sec accuracy=94.031250 loss=0.242235 lr=0.000313 Epoch[088] Batch [2549]/[3760] Speed: 128.536293 samples/sec accuracy=94.026961 loss=0.242349 lr=0.000312 Epoch[088] Batch [2599]/[3760] Speed: 121.840284 samples/sec accuracy=94.018029 loss=0.242408 lr=0.000311 Epoch[088] Batch [2649]/[3760] Speed: 126.016781 samples/sec accuracy=94.015920 loss=0.242442 lr=0.000311 Epoch[088] Batch [2699]/[3760] Speed: 129.114029 samples/sec accuracy=94.004051 loss=0.242787 lr=0.000310 Epoch[088] Batch [2749]/[3760] Speed: 123.239202 samples/sec accuracy=94.007955 loss=0.242814 lr=0.000309 Epoch[088] Batch [2799]/[3760] Speed: 127.999952 samples/sec accuracy=94.013951 loss=0.242699 lr=0.000308 Epoch[088] Batch [2849]/[3760] Speed: 122.774147 samples/sec accuracy=94.028509 loss=0.242324 lr=0.000308 Epoch[088] Batch [2899]/[3760] Speed: 127.642915 samples/sec accuracy=94.043103 loss=0.241899 lr=0.000307 Epoch[088] Batch [2949]/[3760] Speed: 121.917100 samples/sec accuracy=94.053496 loss=0.241635 lr=0.000306 Epoch[088] Batch [2999]/[3760] Speed: 125.874728 samples/sec accuracy=94.070312 loss=0.241341 lr=0.000306 Epoch[088] Batch [3049]/[3760] Speed: 122.843005 samples/sec accuracy=94.076332 loss=0.241110 lr=0.000305 Epoch[088] Batch [3099]/[3760] Speed: 130.243946 samples/sec accuracy=94.070060 loss=0.241169 lr=0.000304 Epoch[088] Batch [3149]/[3760] Speed: 121.997320 samples/sec accuracy=94.071429 loss=0.241099 lr=0.000303 Epoch[088] Batch [3199]/[3760] Speed: 128.039509 samples/sec accuracy=94.069336 loss=0.241106 lr=0.000303 Epoch[088] Batch [3249]/[3760] Speed: 129.311036 samples/sec accuracy=94.072596 loss=0.240970 lr=0.000302 Epoch[088] Batch [3299]/[3760] Speed: 118.602279 samples/sec accuracy=94.061080 loss=0.241312 lr=0.000301 Epoch[088] Batch [3349]/[3760] Speed: 131.692007 samples/sec accuracy=94.062966 loss=0.241365 lr=0.000301 Epoch[088] Batch [3399]/[3760] Speed: 125.525760 samples/sec accuracy=94.060662 loss=0.241270 lr=0.000300 Epoch[088] Batch [3449]/[3760] Speed: 124.908607 samples/sec accuracy=94.052989 loss=0.241392 lr=0.000299 Epoch[088] Batch [3499]/[3760] Speed: 129.882315 samples/sec accuracy=94.045089 loss=0.241412 lr=0.000298 Epoch[088] Batch [3549]/[3760] Speed: 119.602606 samples/sec accuracy=94.046655 loss=0.241379 lr=0.000298 Epoch[088] Batch [3599]/[3760] Speed: 124.766406 samples/sec accuracy=94.052951 loss=0.241408 lr=0.000297 Epoch[088] Batch [3649]/[3760] Speed: 133.357762 samples/sec accuracy=94.050942 loss=0.241515 lr=0.000296 Epoch[088] Batch [3699]/[3760] Speed: 124.526013 samples/sec accuracy=94.044341 loss=0.241672 lr=0.000296 Epoch[088] Batch [3749]/[3760] Speed: 139.405596 samples/sec accuracy=94.041250 loss=0.241715 lr=0.000295 Batch [0049]/[0303]: acc-top1=67.125000 acc-top5=86.843750 Batch [0099]/[0303]: acc-top1=67.593750 acc-top5=86.484375 Batch [0149]/[0303]: acc-top1=67.229167 acc-top5=86.479167 Batch [0199]/[0303]: acc-top1=66.765625 acc-top5=86.273438 Batch [0249]/[0303]: acc-top1=66.937500 acc-top5=86.237500 Batch [0299]/[0303]: acc-top1=66.744792 acc-top5=86.250000 [Epoch 088] training: accuracy=94.043384 loss=0.241768 [Epoch 088] speed: 125 samples/sec time cost: 2105.419156 [Epoch 088] validation: acc-top1=66.723391 acc-top5=86.205652 loss=2.184523 Epoch[089] Batch [0049]/[3760] Speed: 88.758524 samples/sec accuracy=94.156250 loss=0.232084 lr=0.000294 Epoch[089] Batch [0099]/[3760] Speed: 133.726291 samples/sec accuracy=94.328125 loss=0.228730 lr=0.000293 Epoch[089] Batch [0149]/[3760] Speed: 119.354742 samples/sec accuracy=94.333333 loss=0.228966 lr=0.000293 Epoch[089] Batch [0199]/[3760] Speed: 129.578004 samples/sec accuracy=94.437500 loss=0.226198 lr=0.000292 Epoch[089] Batch [0249]/[3760] Speed: 125.039981 samples/sec accuracy=94.393750 loss=0.227341 lr=0.000291 Epoch[089] Batch [0299]/[3760] Speed: 122.486979 samples/sec accuracy=94.453125 loss=0.227298 lr=0.000291 Epoch[089] Batch [0349]/[3760] Speed: 131.776154 samples/sec accuracy=94.357143 loss=0.228095 lr=0.000290 Epoch[089] Batch [0399]/[3760] Speed: 121.556210 samples/sec accuracy=94.332031 loss=0.228688 lr=0.000289 Epoch[089] Batch [0449]/[3760] Speed: 124.772414 samples/sec accuracy=94.430556 loss=0.226433 lr=0.000288 Epoch[089] Batch [0499]/[3760] Speed: 131.351147 samples/sec accuracy=94.412500 loss=0.228125 lr=0.000288 Epoch[089] Batch [0549]/[3760] Speed: 122.272807 samples/sec accuracy=94.423295 loss=0.227411 lr=0.000287 Epoch[089] Batch [0599]/[3760] Speed: 130.059501 samples/sec accuracy=94.372396 loss=0.229227 lr=0.000286 Epoch[089] Batch [0649]/[3760] Speed: 119.637464 samples/sec accuracy=94.324519 loss=0.230241 lr=0.000286 Epoch[089] Batch [0699]/[3760] Speed: 129.562268 samples/sec accuracy=94.381696 loss=0.228576 lr=0.000285 Epoch[089] Batch [0749]/[3760] Speed: 124.460564 samples/sec accuracy=94.400000 loss=0.229118 lr=0.000284 Epoch[089] Batch [0799]/[3760] Speed: 127.401871 samples/sec accuracy=94.423828 loss=0.229155 lr=0.000284 Epoch[089] Batch [0849]/[3760] Speed: 127.228859 samples/sec accuracy=94.431985 loss=0.229007 lr=0.000283 Epoch[089] Batch [0899]/[3760] Speed: 121.882488 samples/sec accuracy=94.401042 loss=0.229945 lr=0.000282 Epoch[089] Batch [0949]/[3760] Speed: 130.979699 samples/sec accuracy=94.386513 loss=0.230352 lr=0.000281 Epoch[089] Batch [0999]/[3760] Speed: 119.016319 samples/sec accuracy=94.389062 loss=0.231148 lr=0.000281 Epoch[089] Batch [1049]/[3760] Speed: 134.133044 samples/sec accuracy=94.380952 loss=0.231427 lr=0.000280 Epoch[089] Batch [1099]/[3760] Speed: 117.400929 samples/sec accuracy=94.362216 loss=0.231782 lr=0.000279 Epoch[089] Batch [1149]/[3760] Speed: 130.968137 samples/sec accuracy=94.358696 loss=0.231498 lr=0.000279 Epoch[089] Batch [1199]/[3760] Speed: 126.243303 samples/sec accuracy=94.373698 loss=0.231436 lr=0.000278 Epoch[089] Batch [1249]/[3760] Speed: 125.739045 samples/sec accuracy=94.383750 loss=0.231439 lr=0.000277 Epoch[089] Batch [1299]/[3760] Speed: 125.750426 samples/sec accuracy=94.395433 loss=0.231462 lr=0.000277 Epoch[089] Batch [1349]/[3760] Speed: 120.507720 samples/sec accuracy=94.380787 loss=0.232314 lr=0.000276 Epoch[089] Batch [1399]/[3760] Speed: 134.894622 samples/sec accuracy=94.367188 loss=0.231886 lr=0.000275 Epoch[089] Batch [1449]/[3760] Speed: 124.981387 samples/sec accuracy=94.386853 loss=0.231091 lr=0.000275 Epoch[089] Batch [1499]/[3760] Speed: 121.985414 samples/sec accuracy=94.390625 loss=0.231554 lr=0.000274 Epoch[089] Batch [1549]/[3760] Speed: 127.573176 samples/sec accuracy=94.387097 loss=0.231569 lr=0.000273 Epoch[089] Batch [1599]/[3760] Speed: 123.068136 samples/sec accuracy=94.364258 loss=0.231974 lr=0.000273 Epoch[089] Batch [1649]/[3760] Speed: 126.535749 samples/sec accuracy=94.360795 loss=0.231977 lr=0.000272 Epoch[089] Batch [1699]/[3760] Speed: 126.534965 samples/sec accuracy=94.364890 loss=0.232183 lr=0.000271 Epoch[089] Batch [1749]/[3760] Speed: 118.446542 samples/sec accuracy=94.393750 loss=0.231276 lr=0.000271 Epoch[089] Batch [1799]/[3760] Speed: 132.317821 samples/sec accuracy=94.376736 loss=0.231894 lr=0.000270 Epoch[089] Batch [1849]/[3760] Speed: 126.580995 samples/sec accuracy=94.369932 loss=0.232119 lr=0.000269 Epoch[089] Batch [1899]/[3760] Speed: 123.561055 samples/sec accuracy=94.367599 loss=0.232214 lr=0.000268 Epoch[089] Batch [1949]/[3760] Speed: 124.779721 samples/sec accuracy=94.361378 loss=0.232546 lr=0.000268 Epoch[089] Batch [1999]/[3760] Speed: 128.735294 samples/sec accuracy=94.332031 loss=0.233316 lr=0.000267 Epoch[089] Batch [2049]/[3760] Speed: 118.139702 samples/sec accuracy=94.343750 loss=0.233029 lr=0.000266 Epoch[089] Batch [2099]/[3760] Speed: 137.457715 samples/sec accuracy=94.331845 loss=0.233278 lr=0.000266 Epoch[089] Batch [2149]/[3760] Speed: 116.859897 samples/sec accuracy=94.319767 loss=0.233481 lr=0.000265 Epoch[089] Batch [2199]/[3760] Speed: 130.599228 samples/sec accuracy=94.309659 loss=0.233405 lr=0.000264 Epoch[089] Batch [2249]/[3760] Speed: 115.740415 samples/sec accuracy=94.298611 loss=0.233633 lr=0.000264 Epoch[089] Batch [2299]/[3760] Speed: 136.682726 samples/sec accuracy=94.309783 loss=0.233296 lr=0.000263 Epoch[089] Batch [2349]/[3760] Speed: 127.140329 samples/sec accuracy=94.313830 loss=0.232908 lr=0.000262 Epoch[089] Batch [2399]/[3760] Speed: 128.353821 samples/sec accuracy=94.291016 loss=0.233477 lr=0.000262 Epoch[089] Batch [2449]/[3760] Speed: 121.731352 samples/sec accuracy=94.283801 loss=0.233558 lr=0.000261 Epoch[089] Batch [2499]/[3760] Speed: 127.077677 samples/sec accuracy=94.290000 loss=0.233185 lr=0.000260 Epoch[089] Batch [2549]/[3760] Speed: 124.489284 samples/sec accuracy=94.284314 loss=0.233281 lr=0.000260 Epoch[089] Batch [2599]/[3760] Speed: 123.822913 samples/sec accuracy=94.284255 loss=0.233306 lr=0.000259 Epoch[089] Batch [2649]/[3760] Speed: 127.569720 samples/sec accuracy=94.283019 loss=0.233431 lr=0.000258 Epoch[089] Batch [2699]/[3760] Speed: 121.541495 samples/sec accuracy=94.274306 loss=0.233680 lr=0.000258 Epoch[089] Batch [2749]/[3760] Speed: 128.193019 samples/sec accuracy=94.277273 loss=0.233497 lr=0.000257 Epoch[089] Batch [2799]/[3760] Speed: 122.044984 samples/sec accuracy=94.273438 loss=0.233546 lr=0.000256 Epoch[089] Batch [2849]/[3760] Speed: 125.695286 samples/sec accuracy=94.281250 loss=0.233317 lr=0.000256 Epoch[089] Batch [2899]/[3760] Speed: 133.540521 samples/sec accuracy=94.292026 loss=0.232736 lr=0.000255 Epoch[089] Batch [2949]/[3760] Speed: 124.371656 samples/sec accuracy=94.298199 loss=0.232552 lr=0.000254 Epoch[089] Batch [2999]/[3760] Speed: 128.517735 samples/sec accuracy=94.290625 loss=0.232670 lr=0.000254 Epoch[089] Batch [3049]/[3760] Speed: 121.618726 samples/sec accuracy=94.293033 loss=0.232549 lr=0.000253 Epoch[089] Batch [3099]/[3760] Speed: 129.833534 samples/sec accuracy=94.292843 loss=0.232471 lr=0.000253 Epoch[089] Batch [3149]/[3760] Speed: 124.804580 samples/sec accuracy=94.294643 loss=0.232594 lr=0.000252 Epoch[089] Batch [3199]/[3760] Speed: 130.368661 samples/sec accuracy=94.288086 loss=0.232889 lr=0.000251 Epoch[089] Batch [3249]/[3760] Speed: 123.285573 samples/sec accuracy=94.286538 loss=0.233007 lr=0.000251 Epoch[089] Batch [3299]/[3760] Speed: 124.947944 samples/sec accuracy=94.285038 loss=0.232787 lr=0.000250 Epoch[089] Batch [3349]/[3760] Speed: 120.296131 samples/sec accuracy=94.290578 loss=0.232572 lr=0.000249 Epoch[089] Batch [3399]/[3760] Speed: 136.279031 samples/sec accuracy=94.284467 loss=0.232606 lr=0.000249 Epoch[089] Batch [3449]/[3760] Speed: 115.001955 samples/sec accuracy=94.283514 loss=0.232777 lr=0.000248 Epoch[089] Batch [3499]/[3760] Speed: 135.115073 samples/sec accuracy=94.273661 loss=0.233070 lr=0.000247 Epoch[089] Batch [3549]/[3760] Speed: 120.080754 samples/sec accuracy=94.282570 loss=0.232850 lr=0.000247 Epoch[089] Batch [3599]/[3760] Speed: 129.227538 samples/sec accuracy=94.289497 loss=0.232744 lr=0.000246 Epoch[089] Batch [3649]/[3760] Speed: 131.265668 samples/sec accuracy=94.280394 loss=0.232748 lr=0.000245 Epoch[089] Batch [3699]/[3760] Speed: 114.909045 samples/sec accuracy=94.283784 loss=0.232655 lr=0.000245 Epoch[089] Batch [3749]/[3760] Speed: 152.071765 samples/sec accuracy=94.275000 loss=0.232901 lr=0.000244 Batch [0049]/[0303]: acc-top1=67.281250 acc-top5=86.906250 Batch [0099]/[0303]: acc-top1=67.609375 acc-top5=86.640625 Batch [0149]/[0303]: acc-top1=67.145833 acc-top5=86.531250 Batch [0199]/[0303]: acc-top1=66.507812 acc-top5=86.343750 Batch [0249]/[0303]: acc-top1=66.750000 acc-top5=86.306250 Batch [0299]/[0303]: acc-top1=66.734375 acc-top5=86.234375 [Epoch 089] training: accuracy=94.275682 loss=0.232935 [Epoch 089] speed: 125 samples/sec time cost: 2105.461010 [Epoch 089] validation: acc-top1=66.713078 acc-top5=86.195338 loss=2.173561 Epoch[090] Batch [0049]/[3759] Speed: 86.858008 samples/sec accuracy=94.656250 loss=0.207616 lr=0.000243 Epoch[090] Batch [0099]/[3759] Speed: 133.733007 samples/sec accuracy=94.500000 loss=0.215523 lr=0.000243 Epoch[090] Batch [0149]/[3759] Speed: 121.033390 samples/sec accuracy=94.614583 loss=0.217818 lr=0.000242 Epoch[090] Batch [0199]/[3759] Speed: 125.844122 samples/sec accuracy=94.695312 loss=0.214153 lr=0.000241 Epoch[090] Batch [0249]/[3759] Speed: 134.219543 samples/sec accuracy=94.681250 loss=0.216243 lr=0.000241 Epoch[090] Batch [0299]/[3759] Speed: 119.577736 samples/sec accuracy=94.583333 loss=0.219652 lr=0.000240 Epoch[090] Batch [0349]/[3759] Speed: 129.427035 samples/sec accuracy=94.625000 loss=0.217545 lr=0.000239 Epoch[090] Batch [0399]/[3759] Speed: 119.313855 samples/sec accuracy=94.539062 loss=0.220813 lr=0.000239 Epoch[090] Batch [0449]/[3759] Speed: 129.481478 samples/sec accuracy=94.555556 loss=0.220229 lr=0.000238 Epoch[090] Batch [0499]/[3759] Speed: 128.664884 samples/sec accuracy=94.515625 loss=0.222106 lr=0.000238 Epoch[090] Batch [0549]/[3759] Speed: 123.212687 samples/sec accuracy=94.534091 loss=0.222115 lr=0.000237 Epoch[090] Batch [0599]/[3759] Speed: 126.538549 samples/sec accuracy=94.523438 loss=0.222343 lr=0.000236 Epoch[090] Batch [0649]/[3759] Speed: 121.361350 samples/sec accuracy=94.473558 loss=0.223938 lr=0.000236 Epoch[090] Batch [0699]/[3759] Speed: 130.388165 samples/sec accuracy=94.479911 loss=0.224274 lr=0.000235 Epoch[090] Batch [0749]/[3759] Speed: 127.970074 samples/sec accuracy=94.454167 loss=0.225206 lr=0.000234 Epoch[090] Batch [0799]/[3759] Speed: 119.170632 samples/sec accuracy=94.486328 loss=0.224708 lr=0.000234 Epoch[090] Batch [0849]/[3759] Speed: 130.171401 samples/sec accuracy=94.488971 loss=0.224103 lr=0.000233 Epoch[090] Batch [0899]/[3759] Speed: 120.998792 samples/sec accuracy=94.496528 loss=0.224148 lr=0.000232 Epoch[090] Batch [0949]/[3759] Speed: 128.748613 samples/sec accuracy=94.495066 loss=0.225034 lr=0.000232 Epoch[090] Batch [0999]/[3759] Speed: 121.643294 samples/sec accuracy=94.539062 loss=0.223673 lr=0.000231 Epoch[090] Batch [1049]/[3759] Speed: 128.850092 samples/sec accuracy=94.516369 loss=0.224108 lr=0.000231 Epoch[090] Batch [1099]/[3759] Speed: 124.751412 samples/sec accuracy=94.517045 loss=0.224446 lr=0.000230 Epoch[090] Batch [1149]/[3759] Speed: 124.756568 samples/sec accuracy=94.516304 loss=0.224340 lr=0.000229 Epoch[090] Batch [1199]/[3759] Speed: 127.849850 samples/sec accuracy=94.506510 loss=0.224582 lr=0.000229 Epoch[090] Batch [1249]/[3759] Speed: 121.664489 samples/sec accuracy=94.505000 loss=0.224857 lr=0.000228 Epoch[090] Batch [1299]/[3759] Speed: 126.142954 samples/sec accuracy=94.512019 loss=0.224675 lr=0.000227 Epoch[090] Batch [1349]/[3759] Speed: 131.423135 samples/sec accuracy=94.512731 loss=0.225205 lr=0.000227 Epoch[090] Batch [1399]/[3759] Speed: 124.790352 samples/sec accuracy=94.495536 loss=0.226083 lr=0.000226 Epoch[090] Batch [1449]/[3759] Speed: 126.641598 samples/sec accuracy=94.510776 loss=0.225831 lr=0.000226 Epoch[090] Batch [1499]/[3759] Speed: 117.636452 samples/sec accuracy=94.505208 loss=0.226337 lr=0.000225 Epoch[090] Batch [1549]/[3759] Speed: 129.660770 samples/sec accuracy=94.506048 loss=0.226303 lr=0.000224 Epoch[090] Batch [1599]/[3759] Speed: 132.140203 samples/sec accuracy=94.500000 loss=0.226524 lr=0.000224 Epoch[090] Batch [1649]/[3759] Speed: 117.350549 samples/sec accuracy=94.498106 loss=0.226894 lr=0.000223 Epoch[090] Batch [1699]/[3759] Speed: 128.807930 samples/sec accuracy=94.487132 loss=0.226788 lr=0.000223 Epoch[090] Batch [1749]/[3759] Speed: 124.135294 samples/sec accuracy=94.480357 loss=0.226881 lr=0.000222 Epoch[090] Batch [1799]/[3759] Speed: 128.333338 samples/sec accuracy=94.478299 loss=0.226636 lr=0.000221 Epoch[090] Batch [1849]/[3759] Speed: 120.805286 samples/sec accuracy=94.474662 loss=0.226804 lr=0.000221 Epoch[090] Batch [1899]/[3759] Speed: 128.840769 samples/sec accuracy=94.449836 loss=0.227352 lr=0.000220 Epoch[090] Batch [1949]/[3759] Speed: 124.000087 samples/sec accuracy=94.455128 loss=0.227371 lr=0.000219 Epoch[090] Batch [1999]/[3759] Speed: 121.242451 samples/sec accuracy=94.452344 loss=0.227137 lr=0.000219 Epoch[090] Batch [2049]/[3759] Speed: 132.899314 samples/sec accuracy=94.437500 loss=0.227820 lr=0.000218 Epoch[090] Batch [2099]/[3759] Speed: 124.598098 samples/sec accuracy=94.438244 loss=0.227842 lr=0.000218 Epoch[090] Batch [2149]/[3759] Speed: 127.713615 samples/sec accuracy=94.424419 loss=0.228070 lr=0.000217 Epoch[090] Batch [2199]/[3759] Speed: 126.103169 samples/sec accuracy=94.421875 loss=0.228252 lr=0.000216 Epoch[090] Batch [2249]/[3759] Speed: 126.534044 samples/sec accuracy=94.408333 loss=0.228327 lr=0.000216 Epoch[090] Batch [2299]/[3759] Speed: 123.006243 samples/sec accuracy=94.409647 loss=0.228252 lr=0.000215 Epoch[090] Batch [2349]/[3759] Speed: 126.865172 samples/sec accuracy=94.414894 loss=0.228221 lr=0.000215 Epoch[090] Batch [2399]/[3759] Speed: 126.179426 samples/sec accuracy=94.415365 loss=0.228251 lr=0.000214 Epoch[090] Batch [2449]/[3759] Speed: 121.540153 samples/sec accuracy=94.427296 loss=0.228172 lr=0.000213 Epoch[090] Batch [2499]/[3759] Speed: 131.766859 samples/sec accuracy=94.426875 loss=0.228101 lr=0.000213 Epoch[090] Batch [2549]/[3759] Speed: 118.794741 samples/sec accuracy=94.421569 loss=0.227901 lr=0.000212 Epoch[090] Batch [2599]/[3759] Speed: 125.455165 samples/sec accuracy=94.407452 loss=0.228358 lr=0.000212 Epoch[090] Batch [2649]/[3759] Speed: 131.644964 samples/sec accuracy=94.407429 loss=0.228289 lr=0.000211 Epoch[090] Batch [2699]/[3759] Speed: 119.076842 samples/sec accuracy=94.416088 loss=0.228215 lr=0.000210 Epoch[090] Batch [2749]/[3759] Speed: 121.856010 samples/sec accuracy=94.430114 loss=0.227824 lr=0.000210 Epoch[090] Batch [2799]/[3759] Speed: 130.631133 samples/sec accuracy=94.430246 loss=0.227497 lr=0.000209 Epoch[090] Batch [2849]/[3759] Speed: 125.261671 samples/sec accuracy=94.414474 loss=0.227816 lr=0.000209 Epoch[090] Batch [2899]/[3759] Speed: 126.675619 samples/sec accuracy=94.407328 loss=0.227875 lr=0.000208 Epoch[090] Batch [2949]/[3759] Speed: 124.354771 samples/sec accuracy=94.398305 loss=0.228124 lr=0.000207 Epoch[090] Batch [2999]/[3759] Speed: 124.162578 samples/sec accuracy=94.386979 loss=0.228464 lr=0.000207 Epoch[090] Batch [3049]/[3759] Speed: 127.531124 samples/sec accuracy=94.385246 loss=0.228564 lr=0.000206 Epoch[090] Batch [3099]/[3759] Speed: 122.714838 samples/sec accuracy=94.382560 loss=0.228470 lr=0.000206 Epoch[090] Batch [3149]/[3759] Speed: 128.696726 samples/sec accuracy=94.387401 loss=0.228488 lr=0.000205 Epoch[090] Batch [3199]/[3759] Speed: 128.097600 samples/sec accuracy=94.385254 loss=0.228509 lr=0.000204 Epoch[090] Batch [3249]/[3759] Speed: 124.391760 samples/sec accuracy=94.392788 loss=0.228507 lr=0.000204 Epoch[090] Batch [3299]/[3759] Speed: 128.206609 samples/sec accuracy=94.392992 loss=0.228552 lr=0.000203 Epoch[090] Batch [3349]/[3759] Speed: 123.882711 samples/sec accuracy=94.390858 loss=0.228762 lr=0.000203 Epoch[090] Batch [3399]/[3759] Speed: 128.399074 samples/sec accuracy=94.397059 loss=0.228624 lr=0.000202 Epoch[090] Batch [3449]/[3759] Speed: 121.517595 samples/sec accuracy=94.395833 loss=0.228705 lr=0.000201 Epoch[090] Batch [3499]/[3759] Speed: 130.381306 samples/sec accuracy=94.389286 loss=0.228837 lr=0.000201 Epoch[090] Batch [3549]/[3759] Speed: 122.324932 samples/sec accuracy=94.386444 loss=0.228901 lr=0.000200 Epoch[090] Batch [3599]/[3759] Speed: 127.785056 samples/sec accuracy=94.385851 loss=0.228955 lr=0.000200 Epoch[090] Batch [3649]/[3759] Speed: 127.748086 samples/sec accuracy=94.382705 loss=0.229094 lr=0.000199 Epoch[090] Batch [3699]/[3759] Speed: 120.424346 samples/sec accuracy=94.385980 loss=0.229088 lr=0.000199 Epoch[090] Batch [3749]/[3759] Speed: 149.424749 samples/sec accuracy=94.378333 loss=0.229134 lr=0.000198 Batch [0049]/[0303]: acc-top1=66.968750 acc-top5=87.031250 Batch [0099]/[0303]: acc-top1=67.468750 acc-top5=86.703125 Batch [0149]/[0303]: acc-top1=66.947917 acc-top5=86.552083 Batch [0199]/[0303]: acc-top1=66.500000 acc-top5=86.367188 Batch [0249]/[0303]: acc-top1=66.700000 acc-top5=86.281250 Batch [0299]/[0303]: acc-top1=66.567708 acc-top5=86.380208 [Epoch 090] training: accuracy=94.378076 loss=0.229098 [Epoch 090] speed: 125 samples/sec time cost: 2107.876485 [Epoch 090] validation: acc-top1=66.558375 acc-top5=86.339728 loss=2.166001 Epoch[091] Batch [0049]/[3760] Speed: 90.399321 samples/sec accuracy=94.750000 loss=0.226162 lr=0.000197 Epoch[091] Batch [0099]/[3760] Speed: 133.007967 samples/sec accuracy=94.453125 loss=0.231553 lr=0.000197 Epoch[091] Batch [0149]/[3760] Speed: 120.088592 samples/sec accuracy=94.458333 loss=0.229189 lr=0.000196 Epoch[091] Batch [0199]/[3760] Speed: 126.477199 samples/sec accuracy=94.460938 loss=0.228563 lr=0.000196 Epoch[091] Batch [0249]/[3760] Speed: 125.646071 samples/sec accuracy=94.412500 loss=0.228290 lr=0.000195 Epoch[091] Batch [0299]/[3760] Speed: 124.659043 samples/sec accuracy=94.505208 loss=0.224555 lr=0.000194 Epoch[091] Batch [0349]/[3760] Speed: 122.687480 samples/sec accuracy=94.491071 loss=0.223571 lr=0.000194 Epoch[091] Batch [0399]/[3760] Speed: 129.971171 samples/sec accuracy=94.457031 loss=0.224957 lr=0.000193 Epoch[091] Batch [0449]/[3760] Speed: 126.981645 samples/sec accuracy=94.451389 loss=0.225344 lr=0.000193 Epoch[091] Batch [0499]/[3760] Speed: 127.760638 samples/sec accuracy=94.428125 loss=0.225554 lr=0.000192 Epoch[091] Batch [0549]/[3760] Speed: 123.441039 samples/sec accuracy=94.465909 loss=0.225409 lr=0.000191 Epoch[091] Batch [0599]/[3760] Speed: 123.650034 samples/sec accuracy=94.500000 loss=0.224141 lr=0.000191 Epoch[091] Batch [0649]/[3760] Speed: 129.463286 samples/sec accuracy=94.521635 loss=0.223154 lr=0.000190 Epoch[091] Batch [0699]/[3760] Speed: 122.323569 samples/sec accuracy=94.542411 loss=0.222916 lr=0.000190 Epoch[091] Batch [0749]/[3760] Speed: 126.282709 samples/sec accuracy=94.541667 loss=0.222538 lr=0.000189 Epoch[091] Batch [0799]/[3760] Speed: 131.239612 samples/sec accuracy=94.548828 loss=0.221939 lr=0.000189 Epoch[091] Batch [0849]/[3760] Speed: 120.911128 samples/sec accuracy=94.525735 loss=0.222522 lr=0.000188 Epoch[091] Batch [0899]/[3760] Speed: 130.647956 samples/sec accuracy=94.532986 loss=0.222796 lr=0.000187 Epoch[091] Batch [0949]/[3760] Speed: 123.568471 samples/sec accuracy=94.508224 loss=0.223404 lr=0.000187 Epoch[091] Batch [0999]/[3760] Speed: 122.545551 samples/sec accuracy=94.525000 loss=0.223514 lr=0.000186 Epoch[091] Batch [1049]/[3760] Speed: 132.780541 samples/sec accuracy=94.516369 loss=0.223819 lr=0.000186 Epoch[091] Batch [1099]/[3760] Speed: 119.781146 samples/sec accuracy=94.528409 loss=0.223662 lr=0.000185 Epoch[091] Batch [1149]/[3760] Speed: 127.926983 samples/sec accuracy=94.509511 loss=0.223874 lr=0.000185 Epoch[091] Batch [1199]/[3760] Speed: 121.294498 samples/sec accuracy=94.503906 loss=0.223988 lr=0.000184 Epoch[091] Batch [1249]/[3760] Speed: 133.052813 samples/sec accuracy=94.491250 loss=0.224713 lr=0.000184 Epoch[091] Batch [1299]/[3760] Speed: 122.330411 samples/sec accuracy=94.477163 loss=0.224729 lr=0.000183 Epoch[091] Batch [1349]/[3760] Speed: 126.020235 samples/sec accuracy=94.473380 loss=0.225231 lr=0.000182 Epoch[091] Batch [1399]/[3760] Speed: 122.905125 samples/sec accuracy=94.485491 loss=0.225017 lr=0.000182 Epoch[091] Batch [1449]/[3760] Speed: 127.082147 samples/sec accuracy=94.481681 loss=0.225260 lr=0.000181 Epoch[091] Batch [1499]/[3760] Speed: 124.651549 samples/sec accuracy=94.467708 loss=0.225431 lr=0.000181 Epoch[091] Batch [1549]/[3760] Speed: 125.035242 samples/sec accuracy=94.478831 loss=0.225213 lr=0.000180 Epoch[091] Batch [1599]/[3760] Speed: 129.016318 samples/sec accuracy=94.486328 loss=0.225016 lr=0.000180 Epoch[091] Batch [1649]/[3760] Speed: 127.373698 samples/sec accuracy=94.483902 loss=0.224819 lr=0.000179 Epoch[091] Batch [1699]/[3760] Speed: 122.338402 samples/sec accuracy=94.494485 loss=0.224544 lr=0.000179 Epoch[091] Batch [1749]/[3760] Speed: 123.675548 samples/sec accuracy=94.488393 loss=0.224734 lr=0.000178 Epoch[091] Batch [1799]/[3760] Speed: 127.508686 samples/sec accuracy=94.478299 loss=0.224860 lr=0.000177 Epoch[091] Batch [1849]/[3760] Speed: 125.403634 samples/sec accuracy=94.494088 loss=0.224444 lr=0.000177 Epoch[091] Batch [1899]/[3760] Speed: 128.717102 samples/sec accuracy=94.512336 loss=0.224261 lr=0.000176 Epoch[091] Batch [1949]/[3760] Speed: 120.968423 samples/sec accuracy=94.509615 loss=0.224504 lr=0.000176 Epoch[091] Batch [1999]/[3760] Speed: 124.823852 samples/sec accuracy=94.501563 loss=0.224615 lr=0.000175 Epoch[091] Batch [2049]/[3760] Speed: 129.421080 samples/sec accuracy=94.493902 loss=0.224711 lr=0.000175 Epoch[091] Batch [2099]/[3760] Speed: 122.885733 samples/sec accuracy=94.484375 loss=0.224948 lr=0.000174 Epoch[091] Batch [2149]/[3760] Speed: 128.570260 samples/sec accuracy=94.472384 loss=0.225190 lr=0.000174 Epoch[091] Batch [2199]/[3760] Speed: 124.406508 samples/sec accuracy=94.477983 loss=0.225041 lr=0.000173 Epoch[091] Batch [2249]/[3760] Speed: 124.697245 samples/sec accuracy=94.470139 loss=0.225308 lr=0.000172 Epoch[091] Batch [2299]/[3760] Speed: 130.344213 samples/sec accuracy=94.467391 loss=0.225661 lr=0.000172 Epoch[091] Batch [2349]/[3760] Speed: 117.735098 samples/sec accuracy=94.462766 loss=0.225796 lr=0.000171 Epoch[091] Batch [2399]/[3760] Speed: 132.085652 samples/sec accuracy=94.466146 loss=0.225726 lr=0.000171 Epoch[091] Batch [2449]/[3760] Speed: 118.518072 samples/sec accuracy=94.467474 loss=0.225676 lr=0.000170 Epoch[091] Batch [2499]/[3760] Speed: 130.251601 samples/sec accuracy=94.476250 loss=0.225287 lr=0.000170 Epoch[091] Batch [2549]/[3760] Speed: 122.275378 samples/sec accuracy=94.484681 loss=0.224784 lr=0.000169 Epoch[091] Batch [2599]/[3760] Speed: 124.025280 samples/sec accuracy=94.475361 loss=0.225112 lr=0.000169 Epoch[091] Batch [2649]/[3760] Speed: 134.573056 samples/sec accuracy=94.459906 loss=0.225361 lr=0.000168 Epoch[091] Batch [2699]/[3760] Speed: 118.630404 samples/sec accuracy=94.464120 loss=0.225223 lr=0.000168 Epoch[091] Batch [2749]/[3760] Speed: 132.976129 samples/sec accuracy=94.458523 loss=0.225341 lr=0.000167 Epoch[091] Batch [2799]/[3760] Speed: 124.720404 samples/sec accuracy=94.451451 loss=0.225629 lr=0.000167 Epoch[091] Batch [2849]/[3760] Speed: 121.046147 samples/sec accuracy=94.442434 loss=0.225824 lr=0.000166 Epoch[091] Batch [2899]/[3760] Speed: 129.653701 samples/sec accuracy=94.443427 loss=0.225686 lr=0.000165 Epoch[091] Batch [2949]/[3760] Speed: 118.116580 samples/sec accuracy=94.445975 loss=0.225677 lr=0.000165 Epoch[091] Batch [2999]/[3760] Speed: 126.915331 samples/sec accuracy=94.454167 loss=0.225678 lr=0.000164 Epoch[091] Batch [3049]/[3760] Speed: 131.004627 samples/sec accuracy=94.452869 loss=0.225639 lr=0.000164 Epoch[091] Batch [3099]/[3760] Speed: 127.419639 samples/sec accuracy=94.458669 loss=0.225592 lr=0.000163 Epoch[091] Batch [3149]/[3760] Speed: 123.040915 samples/sec accuracy=94.458829 loss=0.225528 lr=0.000163 Epoch[091] Batch [3199]/[3760] Speed: 125.758491 samples/sec accuracy=94.455078 loss=0.225540 lr=0.000162 Epoch[091] Batch [3249]/[3760] Speed: 125.908839 samples/sec accuracy=94.461058 loss=0.225266 lr=0.000162 Epoch[091] Batch [3299]/[3760] Speed: 124.777215 samples/sec accuracy=94.454545 loss=0.225243 lr=0.000161 Epoch[091] Batch [3349]/[3760] Speed: 127.763541 samples/sec accuracy=94.458955 loss=0.225128 lr=0.000161 Epoch[091] Batch [3399]/[3760] Speed: 124.968818 samples/sec accuracy=94.457261 loss=0.225215 lr=0.000160 Epoch[091] Batch [3449]/[3760] Speed: 129.616234 samples/sec accuracy=94.451087 loss=0.225236 lr=0.000160 Epoch[091] Batch [3499]/[3760] Speed: 119.033696 samples/sec accuracy=94.455804 loss=0.225149 lr=0.000159 Epoch[091] Batch [3549]/[3760] Speed: 127.624371 samples/sec accuracy=94.453345 loss=0.225325 lr=0.000159 Epoch[091] Batch [3599]/[3760] Speed: 127.263453 samples/sec accuracy=94.460938 loss=0.225060 lr=0.000158 Epoch[091] Batch [3649]/[3760] Speed: 132.034141 samples/sec accuracy=94.458048 loss=0.225151 lr=0.000158 Epoch[091] Batch [3699]/[3760] Speed: 118.906055 samples/sec accuracy=94.464949 loss=0.224905 lr=0.000157 Epoch[091] Batch [3749]/[3760] Speed: 144.414074 samples/sec accuracy=94.460417 loss=0.224876 lr=0.000157 Batch [0049]/[0303]: acc-top1=66.468750 acc-top5=86.937500 Batch [0099]/[0303]: acc-top1=67.140625 acc-top5=86.656250 Batch [0149]/[0303]: acc-top1=66.906250 acc-top5=86.802083 Batch [0199]/[0303]: acc-top1=66.445312 acc-top5=86.546875 Batch [0249]/[0303]: acc-top1=66.637500 acc-top5=86.406250 Batch [0299]/[0303]: acc-top1=66.567708 acc-top5=86.432292 [Epoch 091] training: accuracy=94.462267 loss=0.224796 [Epoch 091] speed: 125 samples/sec time cost: 2105.794638 [Epoch 091] validation: acc-top1=66.542904 acc-top5=86.396452 loss=2.183168 Epoch[092] Batch [0049]/[3760] Speed: 88.978821 samples/sec accuracy=93.718750 loss=0.243291 lr=0.000156 Epoch[092] Batch [0099]/[3760] Speed: 133.379626 samples/sec accuracy=94.203125 loss=0.233731 lr=0.000155 Epoch[092] Batch [0149]/[3760] Speed: 121.034953 samples/sec accuracy=94.281250 loss=0.230595 lr=0.000155 Epoch[092] Batch [0199]/[3760] Speed: 126.045176 samples/sec accuracy=94.421875 loss=0.226715 lr=0.000154 Epoch[092] Batch [0249]/[3760] Speed: 123.640422 samples/sec accuracy=94.412500 loss=0.225312 lr=0.000154 Epoch[092] Batch [0299]/[3760] Speed: 129.352005 samples/sec accuracy=94.468750 loss=0.224362 lr=0.000153 Epoch[092] Batch [0349]/[3760] Speed: 131.310350 samples/sec accuracy=94.468750 loss=0.222842 lr=0.000153 Epoch[092] Batch [0399]/[3760] Speed: 116.927280 samples/sec accuracy=94.531250 loss=0.221055 lr=0.000152 Epoch[092] Batch [0449]/[3760] Speed: 130.637401 samples/sec accuracy=94.524306 loss=0.222727 lr=0.000152 Epoch[092] Batch [0499]/[3760] Speed: 124.417006 samples/sec accuracy=94.518750 loss=0.221977 lr=0.000151 Epoch[092] Batch [0549]/[3760] Speed: 129.076936 samples/sec accuracy=94.593750 loss=0.221149 lr=0.000151 Epoch[092] Batch [0599]/[3760] Speed: 125.615815 samples/sec accuracy=94.638021 loss=0.220375 lr=0.000150 Epoch[092] Batch [0649]/[3760] Speed: 128.317752 samples/sec accuracy=94.591346 loss=0.222110 lr=0.000150 Epoch[092] Batch [0699]/[3760] Speed: 118.039173 samples/sec accuracy=94.555804 loss=0.222878 lr=0.000149 Epoch[092] Batch [0749]/[3760] Speed: 131.748326 samples/sec accuracy=94.637500 loss=0.221074 lr=0.000149 Epoch[092] Batch [0799]/[3760] Speed: 118.325014 samples/sec accuracy=94.582031 loss=0.222506 lr=0.000148 Epoch[092] Batch [0849]/[3760] Speed: 129.243469 samples/sec accuracy=94.595588 loss=0.221762 lr=0.000148 Epoch[092] Batch [0899]/[3760] Speed: 126.445481 samples/sec accuracy=94.583333 loss=0.221410 lr=0.000147 Epoch[092] Batch [0949]/[3760] Speed: 120.523939 samples/sec accuracy=94.600329 loss=0.220875 lr=0.000147 Epoch[092] Batch [0999]/[3760] Speed: 132.524876 samples/sec accuracy=94.606250 loss=0.220820 lr=0.000146 Epoch[092] Batch [1049]/[3760] Speed: 123.094112 samples/sec accuracy=94.633929 loss=0.220456 lr=0.000146 Epoch[092] Batch [1099]/[3760] Speed: 121.037204 samples/sec accuracy=94.627841 loss=0.220671 lr=0.000145 Epoch[092] Batch [1149]/[3760] Speed: 129.577397 samples/sec accuracy=94.638587 loss=0.220060 lr=0.000145 Epoch[092] Batch [1199]/[3760] Speed: 122.224228 samples/sec accuracy=94.644531 loss=0.220270 lr=0.000144 Epoch[092] Batch [1249]/[3760] Speed: 126.575114 samples/sec accuracy=94.661250 loss=0.219780 lr=0.000144 Epoch[092] Batch [1299]/[3760] Speed: 131.452739 samples/sec accuracy=94.641827 loss=0.220036 lr=0.000143 Epoch[092] Batch [1349]/[3760] Speed: 119.966566 samples/sec accuracy=94.643519 loss=0.220056 lr=0.000143 Epoch[092] Batch [1399]/[3760] Speed: 123.658293 samples/sec accuracy=94.645089 loss=0.220008 lr=0.000142 Epoch[092] Batch [1449]/[3760] Speed: 128.657370 samples/sec accuracy=94.645474 loss=0.219890 lr=0.000142 Epoch[092] Batch [1499]/[3760] Speed: 126.531266 samples/sec accuracy=94.655208 loss=0.219656 lr=0.000141 Epoch[092] Batch [1549]/[3760] Speed: 125.794416 samples/sec accuracy=94.642137 loss=0.220205 lr=0.000141 Epoch[092] Batch [1599]/[3760] Speed: 124.125900 samples/sec accuracy=94.656250 loss=0.220216 lr=0.000140 Epoch[092] Batch [1649]/[3760] Speed: 123.840353 samples/sec accuracy=94.662879 loss=0.220120 lr=0.000140 Epoch[092] Batch [1699]/[3760] Speed: 125.042016 samples/sec accuracy=94.655331 loss=0.220320 lr=0.000139 Epoch[092] Batch [1749]/[3760] Speed: 130.409921 samples/sec accuracy=94.660714 loss=0.220375 lr=0.000139 Epoch[092] Batch [1799]/[3760] Speed: 124.406639 samples/sec accuracy=94.662326 loss=0.220211 lr=0.000138 Epoch[092] Batch [1849]/[3760] Speed: 124.472928 samples/sec accuracy=94.662162 loss=0.220238 lr=0.000138 Epoch[092] Batch [1899]/[3760] Speed: 127.524890 samples/sec accuracy=94.667763 loss=0.220071 lr=0.000137 Epoch[092] Batch [1949]/[3760] Speed: 126.226179 samples/sec accuracy=94.653045 loss=0.220422 lr=0.000137 Epoch[092] Batch [1999]/[3760] Speed: 119.538194 samples/sec accuracy=94.647656 loss=0.220349 lr=0.000136 Epoch[092] Batch [2049]/[3760] Speed: 137.051322 samples/sec accuracy=94.657012 loss=0.220059 lr=0.000136 Epoch[092] Batch [2099]/[3760] Speed: 116.788158 samples/sec accuracy=94.653274 loss=0.220124 lr=0.000135 Epoch[092] Batch [2149]/[3760] Speed: 123.746297 samples/sec accuracy=94.638081 loss=0.220359 lr=0.000135 Epoch[092] Batch [2199]/[3760] Speed: 133.680215 samples/sec accuracy=94.623580 loss=0.221107 lr=0.000134 Epoch[092] Batch [2249]/[3760] Speed: 124.123534 samples/sec accuracy=94.611806 loss=0.221248 lr=0.000134 Epoch[092] Batch [2299]/[3760] Speed: 125.212060 samples/sec accuracy=94.593071 loss=0.221542 lr=0.000133 Epoch[092] Batch [2349]/[3760] Speed: 119.682429 samples/sec accuracy=94.597074 loss=0.221606 lr=0.000133 Epoch[092] Batch [2399]/[3760] Speed: 132.436437 samples/sec accuracy=94.591797 loss=0.221656 lr=0.000133 Epoch[092] Batch [2449]/[3760] Speed: 124.515575 samples/sec accuracy=94.607781 loss=0.221307 lr=0.000132 Epoch[092] Batch [2499]/[3760] Speed: 122.294750 samples/sec accuracy=94.606875 loss=0.221417 lr=0.000132 Epoch[092] Batch [2549]/[3760] Speed: 130.937182 samples/sec accuracy=94.607230 loss=0.221392 lr=0.000131 Epoch[092] Batch [2599]/[3760] Speed: 120.981028 samples/sec accuracy=94.605168 loss=0.221583 lr=0.000131 Epoch[092] Batch [2649]/[3760] Speed: 128.920835 samples/sec accuracy=94.606722 loss=0.221477 lr=0.000130 Epoch[092] Batch [2699]/[3760] Speed: 123.301536 samples/sec accuracy=94.596644 loss=0.221936 lr=0.000130 Epoch[092] Batch [2749]/[3760] Speed: 125.321265 samples/sec accuracy=94.602273 loss=0.221873 lr=0.000129 Epoch[092] Batch [2799]/[3760] Speed: 129.508417 samples/sec accuracy=94.603237 loss=0.222011 lr=0.000129 Epoch[092] Batch [2849]/[3760] Speed: 121.335082 samples/sec accuracy=94.594846 loss=0.222333 lr=0.000128 Epoch[092] Batch [2899]/[3760] Speed: 128.120580 samples/sec accuracy=94.581897 loss=0.222687 lr=0.000128 Epoch[092] Batch [2949]/[3760] Speed: 126.150895 samples/sec accuracy=94.585275 loss=0.222709 lr=0.000127 Epoch[092] Batch [2999]/[3760] Speed: 125.229670 samples/sec accuracy=94.584896 loss=0.222717 lr=0.000127 Epoch[092] Batch [3049]/[3760] Speed: 127.974690 samples/sec accuracy=94.579918 loss=0.222815 lr=0.000126 Epoch[092] Batch [3099]/[3760] Speed: 121.290940 samples/sec accuracy=94.576613 loss=0.222964 lr=0.000126 Epoch[092] Batch [3149]/[3760] Speed: 129.560193 samples/sec accuracy=94.587798 loss=0.222750 lr=0.000125 Epoch[092] Batch [3199]/[3760] Speed: 122.510335 samples/sec accuracy=94.580566 loss=0.222871 lr=0.000125 Epoch[092] Batch [3249]/[3760] Speed: 123.111251 samples/sec accuracy=94.573558 loss=0.223181 lr=0.000125 Epoch[092] Batch [3299]/[3760] Speed: 129.928221 samples/sec accuracy=94.576231 loss=0.223025 lr=0.000124 Epoch[092] Batch [3349]/[3760] Speed: 123.288599 samples/sec accuracy=94.575560 loss=0.222855 lr=0.000124 Epoch[092] Batch [3399]/[3760] Speed: 125.376134 samples/sec accuracy=94.574449 loss=0.222868 lr=0.000123 Epoch[092] Batch [3449]/[3760] Speed: 130.600808 samples/sec accuracy=94.580163 loss=0.222903 lr=0.000123 Epoch[092] Batch [3499]/[3760] Speed: 120.230690 samples/sec accuracy=94.587946 loss=0.222721 lr=0.000122 Epoch[092] Batch [3549]/[3760] Speed: 130.438702 samples/sec accuracy=94.590229 loss=0.222776 lr=0.000122 Epoch[092] Batch [3599]/[3760] Speed: 123.153765 samples/sec accuracy=94.593316 loss=0.222813 lr=0.000121 Epoch[092] Batch [3649]/[3760] Speed: 125.590655 samples/sec accuracy=94.596318 loss=0.222801 lr=0.000121 Epoch[092] Batch [3699]/[3760] Speed: 121.581685 samples/sec accuracy=94.598818 loss=0.222786 lr=0.000120 Epoch[092] Batch [3749]/[3760] Speed: 146.659856 samples/sec accuracy=94.599167 loss=0.222790 lr=0.000120 Batch [0049]/[0303]: acc-top1=67.062500 acc-top5=87.125000 Batch [0099]/[0303]: acc-top1=67.671875 acc-top5=86.890625 Batch [0149]/[0303]: acc-top1=67.322917 acc-top5=86.802083 Batch [0199]/[0303]: acc-top1=66.773438 acc-top5=86.585938 Batch [0249]/[0303]: acc-top1=67.000000 acc-top5=86.506250 Batch [0299]/[0303]: acc-top1=66.880208 acc-top5=86.546875 [Epoch 092] training: accuracy=94.599402 loss=0.222824 [Epoch 092] speed: 125 samples/sec time cost: 2107.170789 [Epoch 092] validation: acc-top1=66.862624 acc-top5=86.509901 loss=2.168026 Epoch[093] Batch [0049]/[3759] Speed: 89.633450 samples/sec accuracy=94.250000 loss=0.237690 lr=0.000119 Epoch[093] Batch [0099]/[3759] Speed: 128.804878 samples/sec accuracy=94.421875 loss=0.228081 lr=0.000119 Epoch[093] Batch [0149]/[3759] Speed: 123.459380 samples/sec accuracy=94.489583 loss=0.224589 lr=0.000118 Epoch[093] Batch [0199]/[3759] Speed: 123.217179 samples/sec accuracy=94.640625 loss=0.218725 lr=0.000118 Epoch[093] Batch [0249]/[3759] Speed: 125.822707 samples/sec accuracy=94.650000 loss=0.220029 lr=0.000118 Epoch[093] Batch [0299]/[3759] Speed: 121.825738 samples/sec accuracy=94.567708 loss=0.222223 lr=0.000117 Epoch[093] Batch [0349]/[3759] Speed: 130.592364 samples/sec accuracy=94.513393 loss=0.222861 lr=0.000117 Epoch[093] Batch [0399]/[3759] Speed: 121.905317 samples/sec accuracy=94.503906 loss=0.223732 lr=0.000116 Epoch[093] Batch [0449]/[3759] Speed: 127.265108 samples/sec accuracy=94.506944 loss=0.223871 lr=0.000116 Epoch[093] Batch [0499]/[3759] Speed: 123.502869 samples/sec accuracy=94.640625 loss=0.221252 lr=0.000115 Epoch[093] Batch [0549]/[3759] Speed: 122.277878 samples/sec accuracy=94.661932 loss=0.219985 lr=0.000115 Epoch[093] Batch [0599]/[3759] Speed: 133.725163 samples/sec accuracy=94.679688 loss=0.219400 lr=0.000114 Epoch[093] Batch [0649]/[3759] Speed: 117.887639 samples/sec accuracy=94.680288 loss=0.219933 lr=0.000114 Epoch[093] Batch [0699]/[3759] Speed: 130.665472 samples/sec accuracy=94.691964 loss=0.220043 lr=0.000114 Epoch[093] Batch [0749]/[3759] Speed: 119.569266 samples/sec accuracy=94.777083 loss=0.217930 lr=0.000113 Epoch[093] Batch [0799]/[3759] Speed: 132.537993 samples/sec accuracy=94.773438 loss=0.217574 lr=0.000113 Epoch[093] Batch [0849]/[3759] Speed: 118.643728 samples/sec accuracy=94.792279 loss=0.217165 lr=0.000112 Epoch[093] Batch [0899]/[3759] Speed: 129.149266 samples/sec accuracy=94.791667 loss=0.216625 lr=0.000112 Epoch[093] Batch [0949]/[3759] Speed: 132.412556 samples/sec accuracy=94.792763 loss=0.216617 lr=0.000111 Epoch[093] Batch [0999]/[3759] Speed: 119.471639 samples/sec accuracy=94.784375 loss=0.216869 lr=0.000111 Epoch[093] Batch [1049]/[3759] Speed: 132.598352 samples/sec accuracy=94.781250 loss=0.216867 lr=0.000110 Epoch[093] Batch [1099]/[3759] Speed: 121.685994 samples/sec accuracy=94.776989 loss=0.217298 lr=0.000110 Epoch[093] Batch [1149]/[3759] Speed: 125.310073 samples/sec accuracy=94.779891 loss=0.217418 lr=0.000110 Epoch[093] Batch [1199]/[3759] Speed: 124.782972 samples/sec accuracy=94.786458 loss=0.216950 lr=0.000109 Epoch[093] Batch [1249]/[3759] Speed: 130.907590 samples/sec accuracy=94.803750 loss=0.216669 lr=0.000109 Epoch[093] Batch [1299]/[3759] Speed: 120.286148 samples/sec accuracy=94.799279 loss=0.217017 lr=0.000108 Epoch[093] Batch [1349]/[3759] Speed: 121.063818 samples/sec accuracy=94.777778 loss=0.217651 lr=0.000108 Epoch[093] Batch [1399]/[3759] Speed: 134.422472 samples/sec accuracy=94.763393 loss=0.217542 lr=0.000107 Epoch[093] Batch [1449]/[3759] Speed: 128.936238 samples/sec accuracy=94.743534 loss=0.218112 lr=0.000107 Epoch[093] Batch [1499]/[3759] Speed: 119.374420 samples/sec accuracy=94.728125 loss=0.218226 lr=0.000107 Epoch[093] Batch [1549]/[3759] Speed: 132.116250 samples/sec accuracy=94.702621 loss=0.218817 lr=0.000106 Epoch[093] Batch [1599]/[3759] Speed: 121.351508 samples/sec accuracy=94.692383 loss=0.218743 lr=0.000106 Epoch[093] Batch [1649]/[3759] Speed: 126.705440 samples/sec accuracy=94.689394 loss=0.218869 lr=0.000105 Epoch[093] Batch [1699]/[3759] Speed: 120.813305 samples/sec accuracy=94.697610 loss=0.218802 lr=0.000105 Epoch[093] Batch [1749]/[3759] Speed: 132.847991 samples/sec accuracy=94.686607 loss=0.219068 lr=0.000104 Epoch[093] Batch [1799]/[3759] Speed: 118.369286 samples/sec accuracy=94.684896 loss=0.219140 lr=0.000104 Epoch[093] Batch [1849]/[3759] Speed: 125.393861 samples/sec accuracy=94.686655 loss=0.219211 lr=0.000104 Epoch[093] Batch [1899]/[3759] Speed: 134.734046 samples/sec accuracy=94.675164 loss=0.219783 lr=0.000103 Epoch[093] Batch [1949]/[3759] Speed: 117.833052 samples/sec accuracy=94.677885 loss=0.219889 lr=0.000103 Epoch[093] Batch [1999]/[3759] Speed: 130.975600 samples/sec accuracy=94.690625 loss=0.219737 lr=0.000102 Epoch[093] Batch [2049]/[3759] Speed: 121.594365 samples/sec accuracy=94.679878 loss=0.220331 lr=0.000102 Epoch[093] Batch [2099]/[3759] Speed: 130.119171 samples/sec accuracy=94.697917 loss=0.219769 lr=0.000102 Epoch[093] Batch [2149]/[3759] Speed: 125.485417 samples/sec accuracy=94.708576 loss=0.219601 lr=0.000101 Epoch[093] Batch [2199]/[3759] Speed: 122.878177 samples/sec accuracy=94.705966 loss=0.219668 lr=0.000101 Epoch[093] Batch [2249]/[3759] Speed: 131.767533 samples/sec accuracy=94.699306 loss=0.219722 lr=0.000100 Epoch[093] Batch [2299]/[3759] Speed: 123.095061 samples/sec accuracy=94.715353 loss=0.219395 lr=0.000100 Epoch[093] Batch [2349]/[3759] Speed: 123.185703 samples/sec accuracy=94.708112 loss=0.219493 lr=0.000099 Epoch[093] Batch [2399]/[3759] Speed: 131.655490 samples/sec accuracy=94.709635 loss=0.219221 lr=0.000099 Epoch[093] Batch [2449]/[3759] Speed: 120.730669 samples/sec accuracy=94.712372 loss=0.219242 lr=0.000099 Epoch[093] Batch [2499]/[3759] Speed: 130.115993 samples/sec accuracy=94.710000 loss=0.219501 lr=0.000098 Epoch[093] Batch [2549]/[3759] Speed: 121.403518 samples/sec accuracy=94.705882 loss=0.219630 lr=0.000098 Epoch[093] Batch [2599]/[3759] Speed: 124.816179 samples/sec accuracy=94.701322 loss=0.219730 lr=0.000097 Epoch[093] Batch [2649]/[3759] Speed: 132.379616 samples/sec accuracy=94.697524 loss=0.219764 lr=0.000097 Epoch[093] Batch [2699]/[3759] Speed: 117.056126 samples/sec accuracy=94.704282 loss=0.219612 lr=0.000097 Epoch[093] Batch [2749]/[3759] Speed: 132.955870 samples/sec accuracy=94.717045 loss=0.219446 lr=0.000096 Epoch[093] Batch [2799]/[3759] Speed: 117.767824 samples/sec accuracy=94.730469 loss=0.218994 lr=0.000096 Epoch[093] Batch [2849]/[3759] Speed: 133.517037 samples/sec accuracy=94.719298 loss=0.219254 lr=0.000095 Epoch[093] Batch [2899]/[3759] Speed: 123.442956 samples/sec accuracy=94.717672 loss=0.219318 lr=0.000095 Epoch[093] Batch [2949]/[3759] Speed: 127.236032 samples/sec accuracy=94.717691 loss=0.219177 lr=0.000095 Epoch[093] Batch [2999]/[3759] Speed: 132.284549 samples/sec accuracy=94.714583 loss=0.219288 lr=0.000094 Epoch[093] Batch [3049]/[3759] Speed: 118.938243 samples/sec accuracy=94.720799 loss=0.219109 lr=0.000094 Epoch[093] Batch [3099]/[3759] Speed: 125.433964 samples/sec accuracy=94.726310 loss=0.218870 lr=0.000093 Epoch[093] Batch [3149]/[3759] Speed: 128.251077 samples/sec accuracy=94.718750 loss=0.218946 lr=0.000093 Epoch[093] Batch [3199]/[3759] Speed: 120.208441 samples/sec accuracy=94.712402 loss=0.219068 lr=0.000092 Epoch[093] Batch [3249]/[3759] Speed: 131.071789 samples/sec accuracy=94.709135 loss=0.218990 lr=0.000092 Epoch[093] Batch [3299]/[3759] Speed: 121.689736 samples/sec accuracy=94.697917 loss=0.219201 lr=0.000092 Epoch[093] Batch [3349]/[3759] Speed: 129.347921 samples/sec accuracy=94.699160 loss=0.219354 lr=0.000091 Epoch[093] Batch [3399]/[3759] Speed: 122.698961 samples/sec accuracy=94.700827 loss=0.219262 lr=0.000091 Epoch[093] Batch [3449]/[3759] Speed: 129.896944 samples/sec accuracy=94.699728 loss=0.219272 lr=0.000091 Epoch[093] Batch [3499]/[3759] Speed: 124.217129 samples/sec accuracy=94.703125 loss=0.219281 lr=0.000090 Epoch[093] Batch [3549]/[3759] Speed: 125.261591 samples/sec accuracy=94.702465 loss=0.219271 lr=0.000090 Epoch[093] Batch [3599]/[3759] Speed: 132.365042 samples/sec accuracy=94.699219 loss=0.219494 lr=0.000089 Epoch[093] Batch [3649]/[3759] Speed: 122.629725 samples/sec accuracy=94.696918 loss=0.219521 lr=0.000089 Epoch[093] Batch [3699]/[3759] Speed: 123.581684 samples/sec accuracy=94.685389 loss=0.219727 lr=0.000089 Epoch[093] Batch [3749]/[3759] Speed: 147.081670 samples/sec accuracy=94.684167 loss=0.219705 lr=0.000088 Batch [0049]/[0303]: acc-top1=67.312500 acc-top5=86.937500 Batch [0099]/[0303]: acc-top1=67.625000 acc-top5=86.671875 Batch [0149]/[0303]: acc-top1=67.281250 acc-top5=86.583333 Batch [0199]/[0303]: acc-top1=66.609375 acc-top5=86.312500 Batch [0249]/[0303]: acc-top1=66.806250 acc-top5=86.250000 Batch [0299]/[0303]: acc-top1=66.723958 acc-top5=86.302083 [Epoch 093] training: accuracy=94.682761 loss=0.219738 [Epoch 093] speed: 125 samples/sec time cost: 2107.145706 [Epoch 093] validation: acc-top1=66.697607 acc-top5=86.262376 loss=2.165537 Epoch[094] Batch [0049]/[3760] Speed: 88.375885 samples/sec accuracy=95.593750 loss=0.202137 lr=0.000088 Epoch[094] Batch [0099]/[3760] Speed: 135.839542 samples/sec accuracy=95.203125 loss=0.209338 lr=0.000087 Epoch[094] Batch [0149]/[3760] Speed: 119.731547 samples/sec accuracy=95.281250 loss=0.206070 lr=0.000087 Epoch[094] Batch [0199]/[3760] Speed: 128.028222 samples/sec accuracy=95.148438 loss=0.210752 lr=0.000087 Epoch[094] Batch [0249]/[3760] Speed: 132.771057 samples/sec accuracy=94.918750 loss=0.215038 lr=0.000086 Epoch[094] Batch [0299]/[3760] Speed: 121.181008 samples/sec accuracy=94.880208 loss=0.215423 lr=0.000086 Epoch[094] Batch [0349]/[3760] Speed: 123.993085 samples/sec accuracy=94.825893 loss=0.215487 lr=0.000085 Epoch[094] Batch [0399]/[3760] Speed: 124.182451 samples/sec accuracy=94.882812 loss=0.213141 lr=0.000085 Epoch[094] Batch [0449]/[3760] Speed: 129.201898 samples/sec accuracy=94.913194 loss=0.214477 lr=0.000085 Epoch[094] Batch [0499]/[3760] Speed: 127.730801 samples/sec accuracy=94.959375 loss=0.213328 lr=0.000084 Epoch[094] Batch [0549]/[3760] Speed: 121.009047 samples/sec accuracy=94.997159 loss=0.212022 lr=0.000084 Epoch[094] Batch [0599]/[3760] Speed: 129.564002 samples/sec accuracy=95.041667 loss=0.212024 lr=0.000083 Epoch[094] Batch [0649]/[3760] Speed: 122.363293 samples/sec accuracy=95.062500 loss=0.211512 lr=0.000083 Epoch[094] Batch [0699]/[3760] Speed: 126.609691 samples/sec accuracy=95.044643 loss=0.211904 lr=0.000083 Epoch[094] Batch [0749]/[3760] Speed: 122.302789 samples/sec accuracy=95.054167 loss=0.211429 lr=0.000082 Epoch[094] Batch [0799]/[3760] Speed: 128.904403 samples/sec accuracy=95.046875 loss=0.211390 lr=0.000082 Epoch[094] Batch [0849]/[3760] Speed: 124.786718 samples/sec accuracy=95.016544 loss=0.212139 lr=0.000082 Epoch[094] Batch [0899]/[3760] Speed: 127.616618 samples/sec accuracy=94.975694 loss=0.212774 lr=0.000081 Epoch[094] Batch [0949]/[3760] Speed: 127.235905 samples/sec accuracy=94.949013 loss=0.213317 lr=0.000081 Epoch[094] Batch [0999]/[3760] Speed: 122.505252 samples/sec accuracy=94.950000 loss=0.213018 lr=0.000080 Epoch[094] Batch [1049]/[3760] Speed: 122.711339 samples/sec accuracy=94.977679 loss=0.212633 lr=0.000080 Epoch[094] Batch [1099]/[3760] Speed: 126.821097 samples/sec accuracy=94.977273 loss=0.212907 lr=0.000080 Epoch[094] Batch [1149]/[3760] Speed: 127.581005 samples/sec accuracy=94.972826 loss=0.213011 lr=0.000079 Epoch[094] Batch [1199]/[3760] Speed: 128.762678 samples/sec accuracy=94.964844 loss=0.213616 lr=0.000079 Epoch[094] Batch [1249]/[3760] Speed: 123.551661 samples/sec accuracy=94.937500 loss=0.213945 lr=0.000079 Epoch[094] Batch [1299]/[3760] Speed: 129.830493 samples/sec accuracy=94.938702 loss=0.214014 lr=0.000078 Epoch[094] Batch [1349]/[3760] Speed: 126.568264 samples/sec accuracy=94.908565 loss=0.214262 lr=0.000078 Epoch[094] Batch [1399]/[3760] Speed: 116.445004 samples/sec accuracy=94.879464 loss=0.214500 lr=0.000077 Epoch[094] Batch [1449]/[3760] Speed: 130.146805 samples/sec accuracy=94.872845 loss=0.214679 lr=0.000077 Epoch[094] Batch [1499]/[3760] Speed: 129.057707 samples/sec accuracy=94.881250 loss=0.214619 lr=0.000077 Epoch[094] Batch [1549]/[3760] Speed: 128.915292 samples/sec accuracy=94.882056 loss=0.214768 lr=0.000076 Epoch[094] Batch [1599]/[3760] Speed: 123.020923 samples/sec accuracy=94.882812 loss=0.214581 lr=0.000076 Epoch[094] Batch [1649]/[3760] Speed: 122.928870 samples/sec accuracy=94.894886 loss=0.214273 lr=0.000076 Epoch[094] Batch [1699]/[3760] Speed: 123.903222 samples/sec accuracy=94.858456 loss=0.215031 lr=0.000075 Epoch[094] Batch [1749]/[3760] Speed: 127.347920 samples/sec accuracy=94.867857 loss=0.214271 lr=0.000075 Epoch[094] Batch [1799]/[3760] Speed: 126.927034 samples/sec accuracy=94.861111 loss=0.214413 lr=0.000075 Epoch[094] Batch [1849]/[3760] Speed: 123.567010 samples/sec accuracy=94.859797 loss=0.214453 lr=0.000074 Epoch[094] Batch [1899]/[3760] Speed: 130.271340 samples/sec accuracy=94.870888 loss=0.214076 lr=0.000074 Epoch[094] Batch [1949]/[3760] Speed: 123.077652 samples/sec accuracy=94.868590 loss=0.214110 lr=0.000074 Epoch[094] Batch [1999]/[3760] Speed: 127.249559 samples/sec accuracy=94.862500 loss=0.214048 lr=0.000073 Epoch[094] Batch [2049]/[3760] Speed: 121.959900 samples/sec accuracy=94.853659 loss=0.214169 lr=0.000073 Epoch[094] Batch [2099]/[3760] Speed: 130.183404 samples/sec accuracy=94.851190 loss=0.214214 lr=0.000072 Epoch[094] Batch [2149]/[3760] Speed: 121.242252 samples/sec accuracy=94.839390 loss=0.214468 lr=0.000072 Epoch[094] Batch [2199]/[3760] Speed: 130.324196 samples/sec accuracy=94.832386 loss=0.214787 lr=0.000072 Epoch[094] Batch [2249]/[3760] Speed: 130.316355 samples/sec accuracy=94.837500 loss=0.214762 lr=0.000071 Epoch[094] Batch [2299]/[3760] Speed: 118.951887 samples/sec accuracy=94.841033 loss=0.214727 lr=0.000071 Epoch[094] Batch [2349]/[3760] Speed: 124.789517 samples/sec accuracy=94.833777 loss=0.214749 lr=0.000071 Epoch[094] Batch [2399]/[3760] Speed: 132.007610 samples/sec accuracy=94.814453 loss=0.214946 lr=0.000070 Epoch[094] Batch [2449]/[3760] Speed: 118.713847 samples/sec accuracy=94.823980 loss=0.214658 lr=0.000070 Epoch[094] Batch [2499]/[3760] Speed: 131.025604 samples/sec accuracy=94.828750 loss=0.214580 lr=0.000070 Epoch[094] Batch [2549]/[3760] Speed: 131.343148 samples/sec accuracy=94.835172 loss=0.214526 lr=0.000069 Epoch[094] Batch [2599]/[3760] Speed: 116.638721 samples/sec accuracy=94.839543 loss=0.214352 lr=0.000069 Epoch[094] Batch [2649]/[3760] Speed: 128.610122 samples/sec accuracy=94.837854 loss=0.214198 lr=0.000069 Epoch[094] Batch [2699]/[3760] Speed: 124.840744 samples/sec accuracy=94.828704 loss=0.214119 lr=0.000068 Epoch[094] Batch [2749]/[3760] Speed: 122.111481 samples/sec accuracy=94.813636 loss=0.214337 lr=0.000068 Epoch[094] Batch [2799]/[3760] Speed: 130.983598 samples/sec accuracy=94.812500 loss=0.214383 lr=0.000068 Epoch[094] Batch [2849]/[3760] Speed: 127.571345 samples/sec accuracy=94.809759 loss=0.214414 lr=0.000067 Epoch[094] Batch [2899]/[3760] Speed: 123.602653 samples/sec accuracy=94.808728 loss=0.214415 lr=0.000067 Epoch[094] Batch [2949]/[3760] Speed: 122.221634 samples/sec accuracy=94.793962 loss=0.214835 lr=0.000067 Epoch[094] Batch [2999]/[3760] Speed: 132.138260 samples/sec accuracy=94.791146 loss=0.214708 lr=0.000066 Epoch[094] Batch [3049]/[3760] Speed: 118.713587 samples/sec accuracy=94.792520 loss=0.214804 lr=0.000066 Epoch[094] Batch [3099]/[3760] Speed: 132.888445 samples/sec accuracy=94.794355 loss=0.214766 lr=0.000066 Epoch[094] Batch [3149]/[3760] Speed: 119.371579 samples/sec accuracy=94.795139 loss=0.214722 lr=0.000065 Epoch[094] Batch [3199]/[3760] Speed: 131.278831 samples/sec accuracy=94.783203 loss=0.215016 lr=0.000065 Epoch[094] Batch [3249]/[3760] Speed: 121.887439 samples/sec accuracy=94.782212 loss=0.215176 lr=0.000065 Epoch[094] Batch [3299]/[3760] Speed: 129.571058 samples/sec accuracy=94.779356 loss=0.215156 lr=0.000064 Epoch[094] Batch [3349]/[3760] Speed: 125.386761 samples/sec accuracy=94.770522 loss=0.215415 lr=0.000064 Epoch[094] Batch [3399]/[3760] Speed: 122.855680 samples/sec accuracy=94.761029 loss=0.215584 lr=0.000064 Epoch[094] Batch [3449]/[3760] Speed: 131.207273 samples/sec accuracy=94.766757 loss=0.215376 lr=0.000063 Epoch[094] Batch [3499]/[3760] Speed: 122.490011 samples/sec accuracy=94.766518 loss=0.215421 lr=0.000063 Epoch[094] Batch [3549]/[3760] Speed: 129.366112 samples/sec accuracy=94.763204 loss=0.215569 lr=0.000063 Epoch[094] Batch [3599]/[3760] Speed: 121.257586 samples/sec accuracy=94.765625 loss=0.215418 lr=0.000062 Epoch[094] Batch [3649]/[3760] Speed: 126.117148 samples/sec accuracy=94.766695 loss=0.215287 lr=0.000062 Epoch[094] Batch [3699]/[3760] Speed: 123.906005 samples/sec accuracy=94.763091 loss=0.215528 lr=0.000062 Epoch[094] Batch [3749]/[3760] Speed: 147.782252 samples/sec accuracy=94.757917 loss=0.215590 lr=0.000061 Batch [0049]/[0303]: acc-top1=67.218750 acc-top5=87.312500 Batch [0099]/[0303]: acc-top1=67.625000 acc-top5=86.875000 Batch [0149]/[0303]: acc-top1=67.385417 acc-top5=86.750000 Batch [0199]/[0303]: acc-top1=66.835938 acc-top5=86.460938 Batch [0249]/[0303]: acc-top1=66.931250 acc-top5=86.381250 Batch [0299]/[0303]: acc-top1=66.812500 acc-top5=86.364583 [Epoch 094] training: accuracy=94.761054 loss=0.215486 [Epoch 094] speed: 125 samples/sec time cost: 2103.967832 [Epoch 094] validation: acc-top1=66.795586 acc-top5=86.339728 loss=2.159987 Epoch[095] Batch [0049]/[3760] Speed: 88.347205 samples/sec accuracy=95.937500 loss=0.190795 lr=0.000061 Epoch[095] Batch [0099]/[3760] Speed: 131.762775 samples/sec accuracy=95.234375 loss=0.212677 lr=0.000060 Epoch[095] Batch [0149]/[3760] Speed: 124.679439 samples/sec accuracy=95.000000 loss=0.218028 lr=0.000060 Epoch[095] Batch [0199]/[3760] Speed: 121.540423 samples/sec accuracy=94.929688 loss=0.218666 lr=0.000060 Epoch[095] Batch [0249]/[3760] Speed: 131.128098 samples/sec accuracy=95.037500 loss=0.214966 lr=0.000060 Epoch[095] Batch [0299]/[3760] Speed: 124.456093 samples/sec accuracy=95.093750 loss=0.214091 lr=0.000059 Epoch[095] Batch [0349]/[3760] Speed: 124.126857 samples/sec accuracy=95.022321 loss=0.214423 lr=0.000059 Epoch[095] Batch [0399]/[3760] Speed: 132.380246 samples/sec accuracy=95.035156 loss=0.214089 lr=0.000059 Epoch[095] Batch [0449]/[3760] Speed: 122.671196 samples/sec accuracy=95.027778 loss=0.214307 lr=0.000058 Epoch[095] Batch [0499]/[3760] Speed: 123.906763 samples/sec accuracy=95.006250 loss=0.214787 lr=0.000058 Epoch[095] Batch [0549]/[3760] Speed: 128.873788 samples/sec accuracy=94.994318 loss=0.215061 lr=0.000058 Epoch[095] Batch [0599]/[3760] Speed: 123.622075 samples/sec accuracy=94.942708 loss=0.216000 lr=0.000057 Epoch[095] Batch [0649]/[3760] Speed: 127.370079 samples/sec accuracy=94.884615 loss=0.216183 lr=0.000057 Epoch[095] Batch [0699]/[3760] Speed: 121.710702 samples/sec accuracy=94.875000 loss=0.216335 lr=0.000057 Epoch[095] Batch [0749]/[3760] Speed: 127.205517 samples/sec accuracy=94.872917 loss=0.215853 lr=0.000056 Epoch[095] Batch [0799]/[3760] Speed: 127.471067 samples/sec accuracy=94.871094 loss=0.216083 lr=0.000056 Epoch[095] Batch [0849]/[3760] Speed: 124.005196 samples/sec accuracy=94.906250 loss=0.215049 lr=0.000056 Epoch[095] Batch [0899]/[3760] Speed: 130.997390 samples/sec accuracy=94.894097 loss=0.215274 lr=0.000055 Epoch[095] Batch [0949]/[3760] Speed: 123.810790 samples/sec accuracy=94.891447 loss=0.215127 lr=0.000055 Epoch[095] Batch [0999]/[3760] Speed: 124.631286 samples/sec accuracy=94.892188 loss=0.215352 lr=0.000055 Epoch[095] Batch [1049]/[3760] Speed: 124.857527 samples/sec accuracy=94.934524 loss=0.214683 lr=0.000054 Epoch[095] Batch [1099]/[3760] Speed: 122.482825 samples/sec accuracy=94.936080 loss=0.214715 lr=0.000054 Epoch[095] Batch [1149]/[3760] Speed: 124.011369 samples/sec accuracy=94.957880 loss=0.214232 lr=0.000054 Epoch[095] Batch [1199]/[3760] Speed: 128.328966 samples/sec accuracy=94.950521 loss=0.214494 lr=0.000054 Epoch[095] Batch [1249]/[3760] Speed: 120.143395 samples/sec accuracy=94.958750 loss=0.214423 lr=0.000053 Epoch[095] Batch [1299]/[3760] Speed: 132.206821 samples/sec accuracy=94.969952 loss=0.214017 lr=0.000053 Epoch[095] Batch [1349]/[3760] Speed: 127.847720 samples/sec accuracy=94.982639 loss=0.213190 lr=0.000053 Epoch[095] Batch [1399]/[3760] Speed: 124.135354 samples/sec accuracy=94.950893 loss=0.213507 lr=0.000052 Epoch[095] Batch [1449]/[3760] Speed: 123.644749 samples/sec accuracy=94.983836 loss=0.212608 lr=0.000052 Epoch[095] Batch [1499]/[3760] Speed: 120.393805 samples/sec accuracy=94.989583 loss=0.212459 lr=0.000052 Epoch[095] Batch [1549]/[3760] Speed: 135.806898 samples/sec accuracy=94.960685 loss=0.213001 lr=0.000051 Epoch[095] Batch [1599]/[3760] Speed: 122.321835 samples/sec accuracy=94.962891 loss=0.213091 lr=0.000051 Epoch[095] Batch [1649]/[3760] Speed: 126.032000 samples/sec accuracy=94.946970 loss=0.213086 lr=0.000051 Epoch[095] Batch [1699]/[3760] Speed: 128.450812 samples/sec accuracy=94.956801 loss=0.212802 lr=0.000051 Epoch[095] Batch [1749]/[3760] Speed: 119.642387 samples/sec accuracy=94.939286 loss=0.213079 lr=0.000050 Epoch[095] Batch [1799]/[3760] Speed: 131.004052 samples/sec accuracy=94.940104 loss=0.213038 lr=0.000050 Epoch[095] Batch [1849]/[3760] Speed: 122.743882 samples/sec accuracy=94.928209 loss=0.213362 lr=0.000050 Epoch[095] Batch [1899]/[3760] Speed: 124.492802 samples/sec accuracy=94.917763 loss=0.213411 lr=0.000049 Epoch[095] Batch [1949]/[3760] Speed: 127.594284 samples/sec accuracy=94.927083 loss=0.212981 lr=0.000049 Epoch[095] Batch [1999]/[3760] Speed: 123.549805 samples/sec accuracy=94.935937 loss=0.212882 lr=0.000049 Epoch[095] Batch [2049]/[3760] Speed: 124.951674 samples/sec accuracy=94.934451 loss=0.212960 lr=0.000049 Epoch[095] Batch [2099]/[3760] Speed: 133.145233 samples/sec accuracy=94.941220 loss=0.212810 lr=0.000048 Epoch[095] Batch [2149]/[3760] Speed: 117.253974 samples/sec accuracy=94.938227 loss=0.213135 lr=0.000048 Epoch[095] Batch [2199]/[3760] Speed: 130.601328 samples/sec accuracy=94.936080 loss=0.212984 lr=0.000048 Epoch[095] Batch [2249]/[3760] Speed: 119.995296 samples/sec accuracy=94.929167 loss=0.212852 lr=0.000047 Epoch[095] Batch [2299]/[3760] Speed: 132.268771 samples/sec accuracy=94.932745 loss=0.212771 lr=0.000047 Epoch[095] Batch [2349]/[3760] Speed: 126.802922 samples/sec accuracy=94.942819 loss=0.212492 lr=0.000047 Epoch[095] Batch [2399]/[3760] Speed: 128.476324 samples/sec accuracy=94.943359 loss=0.212597 lr=0.000047 Epoch[095] Batch [2449]/[3760] Speed: 119.443574 samples/sec accuracy=94.941327 loss=0.212617 lr=0.000046 Epoch[095] Batch [2499]/[3760] Speed: 131.831290 samples/sec accuracy=94.940000 loss=0.212568 lr=0.000046 Epoch[095] Batch [2549]/[3760] Speed: 120.591634 samples/sec accuracy=94.941789 loss=0.212463 lr=0.000046 Epoch[095] Batch [2599]/[3760] Speed: 130.057397 samples/sec accuracy=94.933894 loss=0.212593 lr=0.000045 Epoch[095] Batch [2649]/[3760] Speed: 121.649950 samples/sec accuracy=94.928066 loss=0.212780 lr=0.000045 Epoch[095] Batch [2699]/[3760] Speed: 126.005432 samples/sec accuracy=94.927662 loss=0.212833 lr=0.000045 Epoch[095] Batch [2749]/[3760] Speed: 128.956453 samples/sec accuracy=94.915909 loss=0.212862 lr=0.000045 Epoch[095] Batch [2799]/[3760] Speed: 120.685689 samples/sec accuracy=94.922991 loss=0.212849 lr=0.000044 Epoch[095] Batch [2849]/[3760] Speed: 132.061368 samples/sec accuracy=94.923246 loss=0.212800 lr=0.000044 Epoch[095] Batch [2899]/[3760] Speed: 124.439679 samples/sec accuracy=94.922953 loss=0.212956 lr=0.000044 Epoch[095] Batch [2949]/[3760] Speed: 127.747480 samples/sec accuracy=94.912076 loss=0.213146 lr=0.000043 Epoch[095] Batch [2999]/[3760] Speed: 121.717661 samples/sec accuracy=94.908854 loss=0.213180 lr=0.000043 Epoch[095] Batch [3049]/[3760] Speed: 127.233101 samples/sec accuracy=94.910348 loss=0.213263 lr=0.000043 Epoch[095] Batch [3099]/[3760] Speed: 129.161176 samples/sec accuracy=94.913306 loss=0.213090 lr=0.000043 Epoch[095] Batch [3149]/[3760] Speed: 117.892079 samples/sec accuracy=94.917659 loss=0.212916 lr=0.000042 Epoch[095] Batch [3199]/[3760] Speed: 136.480959 samples/sec accuracy=94.913574 loss=0.213093 lr=0.000042 Epoch[095] Batch [3249]/[3760] Speed: 119.243925 samples/sec accuracy=94.901923 loss=0.213342 lr=0.000042 Epoch[095] Batch [3299]/[3760] Speed: 132.625052 samples/sec accuracy=94.907197 loss=0.213126 lr=0.000042 Epoch[095] Batch [3349]/[3760] Speed: 126.593098 samples/sec accuracy=94.910448 loss=0.213082 lr=0.000041 Epoch[095] Batch [3399]/[3760] Speed: 119.659846 samples/sec accuracy=94.902574 loss=0.213201 lr=0.000041 Epoch[095] Batch [3449]/[3760] Speed: 128.045084 samples/sec accuracy=94.903533 loss=0.213230 lr=0.000041 Epoch[095] Batch [3499]/[3760] Speed: 128.186917 samples/sec accuracy=94.895982 loss=0.213380 lr=0.000040 Epoch[095] Batch [3549]/[3760] Speed: 121.198164 samples/sec accuracy=94.895687 loss=0.213395 lr=0.000040 Epoch[095] Batch [3599]/[3760] Speed: 128.844018 samples/sec accuracy=94.895833 loss=0.213410 lr=0.000040 Epoch[095] Batch [3649]/[3760] Speed: 125.477060 samples/sec accuracy=94.898545 loss=0.213344 lr=0.000040 Epoch[095] Batch [3699]/[3760] Speed: 125.590627 samples/sec accuracy=94.896537 loss=0.213360 lr=0.000039 Epoch[095] Batch [3749]/[3760] Speed: 141.226029 samples/sec accuracy=94.900833 loss=0.213288 lr=0.000039 Batch [0049]/[0303]: acc-top1=67.250000 acc-top5=87.531250 Batch [0099]/[0303]: acc-top1=67.843750 acc-top5=86.937500 Batch [0149]/[0303]: acc-top1=67.427083 acc-top5=86.812500 Batch [0199]/[0303]: acc-top1=66.929688 acc-top5=86.523438 Batch [0249]/[0303]: acc-top1=67.106250 acc-top5=86.475000 Batch [0299]/[0303]: acc-top1=66.984375 acc-top5=86.453125 [Epoch 095] training: accuracy=94.900682 loss=0.213243 [Epoch 095] speed: 125 samples/sec time cost: 2105.246688 [Epoch 095] validation: acc-top1=66.950289 acc-top5=86.411922 loss=2.165795 Epoch[096] Batch [0049]/[3759] Speed: 90.355968 samples/sec accuracy=94.531250 loss=0.217187 lr=0.000039 Epoch[096] Batch [0099]/[3759] Speed: 120.962742 samples/sec accuracy=94.671875 loss=0.213601 lr=0.000039 Epoch[096] Batch [0149]/[3759] Speed: 133.402780 samples/sec accuracy=94.718750 loss=0.212330 lr=0.000038 Epoch[096] Batch [0199]/[3759] Speed: 120.004749 samples/sec accuracy=94.906250 loss=0.208844 lr=0.000038 Epoch[096] Batch [0249]/[3759] Speed: 128.503534 samples/sec accuracy=94.900000 loss=0.208912 lr=0.000038 Epoch[096] Batch [0299]/[3759] Speed: 129.010903 samples/sec accuracy=94.932292 loss=0.208763 lr=0.000038 Epoch[096] Batch [0349]/[3759] Speed: 123.465816 samples/sec accuracy=94.870536 loss=0.210804 lr=0.000037 Epoch[096] Batch [0399]/[3759] Speed: 130.795892 samples/sec accuracy=94.800781 loss=0.211908 lr=0.000037 Epoch[096] Batch [0449]/[3759] Speed: 120.562813 samples/sec accuracy=94.822917 loss=0.212181 lr=0.000037 Epoch[096] Batch [0499]/[3759] Speed: 128.958134 samples/sec accuracy=94.812500 loss=0.213818 lr=0.000037 Epoch[096] Batch [0549]/[3759] Speed: 123.679406 samples/sec accuracy=94.784091 loss=0.214560 lr=0.000036 Epoch[096] Batch [0599]/[3759] Speed: 127.281190 samples/sec accuracy=94.778646 loss=0.214841 lr=0.000036 Epoch[096] Batch [0649]/[3759] Speed: 125.192079 samples/sec accuracy=94.730769 loss=0.216091 lr=0.000036 Epoch[096] Batch [0699]/[3759] Speed: 123.548584 samples/sec accuracy=94.736607 loss=0.216184 lr=0.000036 Epoch[096] Batch [0749]/[3759] Speed: 126.103598 samples/sec accuracy=94.750000 loss=0.215341 lr=0.000035 Epoch[096] Batch [0799]/[3759] Speed: 125.430532 samples/sec accuracy=94.716797 loss=0.216302 lr=0.000035 Epoch[096] Batch [0849]/[3759] Speed: 124.582687 samples/sec accuracy=94.762868 loss=0.215490 lr=0.000035 Epoch[096] Batch [0899]/[3759] Speed: 129.573792 samples/sec accuracy=94.789931 loss=0.215287 lr=0.000035 Epoch[096] Batch [0949]/[3759] Speed: 126.485357 samples/sec accuracy=94.812500 loss=0.215031 lr=0.000034 Epoch[096] Batch [0999]/[3759] Speed: 120.102208 samples/sec accuracy=94.814062 loss=0.215174 lr=0.000034 Epoch[096] Batch [1049]/[3759] Speed: 127.089634 samples/sec accuracy=94.842262 loss=0.214785 lr=0.000034 Epoch[096] Batch [1099]/[3759] Speed: 124.164151 samples/sec accuracy=94.884943 loss=0.213170 lr=0.000034 Epoch[096] Batch [1149]/[3759] Speed: 128.239047 samples/sec accuracy=94.858696 loss=0.213759 lr=0.000033 Epoch[096] Batch [1199]/[3759] Speed: 116.650738 samples/sec accuracy=94.864583 loss=0.213455 lr=0.000033 Epoch[096] Batch [1249]/[3759] Speed: 133.670633 samples/sec accuracy=94.893750 loss=0.213170 lr=0.000033 Epoch[096] Batch [1299]/[3759] Speed: 122.045879 samples/sec accuracy=94.906250 loss=0.212854 lr=0.000033 Epoch[096] Batch [1349]/[3759] Speed: 127.858550 samples/sec accuracy=94.922454 loss=0.212762 lr=0.000032 Epoch[096] Batch [1399]/[3759] Speed: 129.598571 samples/sec accuracy=94.922991 loss=0.212821 lr=0.000032 Epoch[096] Batch [1449]/[3759] Speed: 122.780596 samples/sec accuracy=94.948276 loss=0.212210 lr=0.000032 Epoch[096] Batch [1499]/[3759] Speed: 131.785002 samples/sec accuracy=94.951042 loss=0.212122 lr=0.000032 Epoch[096] Batch [1549]/[3759] Speed: 114.963116 samples/sec accuracy=94.955645 loss=0.212337 lr=0.000031 Epoch[096] Batch [1599]/[3759] Speed: 135.550768 samples/sec accuracy=94.984375 loss=0.211424 lr=0.000031 Epoch[096] Batch [1649]/[3759] Speed: 128.194505 samples/sec accuracy=94.974432 loss=0.211930 lr=0.000031 Epoch[096] Batch [1699]/[3759] Speed: 117.820827 samples/sec accuracy=94.973346 loss=0.211911 lr=0.000031 Epoch[096] Batch [1749]/[3759] Speed: 132.174299 samples/sec accuracy=94.981250 loss=0.211499 lr=0.000030 Epoch[096] Batch [1799]/[3759] Speed: 120.332528 samples/sec accuracy=94.982639 loss=0.211213 lr=0.000030 Epoch[096] Batch [1849]/[3759] Speed: 129.519924 samples/sec accuracy=94.970439 loss=0.211268 lr=0.000030 Epoch[096] Batch [1899]/[3759] Speed: 129.181144 samples/sec accuracy=94.955592 loss=0.211602 lr=0.000030 Epoch[096] Batch [1949]/[3759] Speed: 120.941400 samples/sec accuracy=94.959135 loss=0.211467 lr=0.000030 Epoch[096] Batch [1999]/[3759] Speed: 129.958733 samples/sec accuracy=94.952344 loss=0.211348 lr=0.000029 Epoch[096] Batch [2049]/[3759] Speed: 127.500009 samples/sec accuracy=94.951982 loss=0.211467 lr=0.000029 Epoch[096] Batch [2099]/[3759] Speed: 118.744134 samples/sec accuracy=94.946429 loss=0.211590 lr=0.000029 Epoch[096] Batch [2149]/[3759] Speed: 132.454023 samples/sec accuracy=94.930959 loss=0.211816 lr=0.000029 Epoch[096] Batch [2199]/[3759] Speed: 118.316707 samples/sec accuracy=94.933239 loss=0.211785 lr=0.000028 Epoch[096] Batch [2249]/[3759] Speed: 131.502434 samples/sec accuracy=94.943750 loss=0.211709 lr=0.000028 Epoch[096] Batch [2299]/[3759] Speed: 118.139923 samples/sec accuracy=94.937500 loss=0.211906 lr=0.000028 Epoch[096] Batch [2349]/[3759] Speed: 132.677520 samples/sec accuracy=94.936170 loss=0.211919 lr=0.000028 Epoch[096] Batch [2399]/[3759] Speed: 129.265729 samples/sec accuracy=94.929036 loss=0.212088 lr=0.000028 Epoch[096] Batch [2449]/[3759] Speed: 121.400913 samples/sec accuracy=94.938776 loss=0.211926 lr=0.000027 Epoch[096] Batch [2499]/[3759] Speed: 128.688561 samples/sec accuracy=94.946875 loss=0.211659 lr=0.000027 Epoch[096] Batch [2549]/[3759] Speed: 119.413872 samples/sec accuracy=94.953431 loss=0.211628 lr=0.000027 Epoch[096] Batch [2599]/[3759] Speed: 130.681161 samples/sec accuracy=94.947115 loss=0.211766 lr=0.000027 Epoch[096] Batch [2649]/[3759] Speed: 122.862423 samples/sec accuracy=94.943986 loss=0.211611 lr=0.000026 Epoch[096] Batch [2699]/[3759] Speed: 127.474158 samples/sec accuracy=94.947917 loss=0.211580 lr=0.000026 Epoch[096] Batch [2749]/[3759] Speed: 127.448851 samples/sec accuracy=94.944886 loss=0.211791 lr=0.000026 Epoch[096] Batch [2799]/[3759] Speed: 120.747269 samples/sec accuracy=94.933594 loss=0.212055 lr=0.000026 Epoch[096] Batch [2849]/[3759] Speed: 129.129134 samples/sec accuracy=94.932018 loss=0.212065 lr=0.000026 Epoch[096] Batch [2899]/[3759] Speed: 126.354906 samples/sec accuracy=94.930496 loss=0.212264 lr=0.000025 Epoch[096] Batch [2949]/[3759] Speed: 126.630011 samples/sec accuracy=94.925847 loss=0.212297 lr=0.000025 Epoch[096] Batch [2999]/[3759] Speed: 127.073029 samples/sec accuracy=94.919792 loss=0.212337 lr=0.000025 Epoch[096] Batch [3049]/[3759] Speed: 121.494132 samples/sec accuracy=94.907275 loss=0.212497 lr=0.000025 Epoch[096] Batch [3099]/[3759] Speed: 132.142268 samples/sec accuracy=94.903730 loss=0.212660 lr=0.000025 Epoch[096] Batch [3149]/[3759] Speed: 121.239864 samples/sec accuracy=94.896825 loss=0.212766 lr=0.000024 Epoch[096] Batch [3199]/[3759] Speed: 130.511597 samples/sec accuracy=94.887695 loss=0.213053 lr=0.000024 Epoch[096] Batch [3249]/[3759] Speed: 118.199415 samples/sec accuracy=94.885096 loss=0.213257 lr=0.000024 Epoch[096] Batch [3299]/[3759] Speed: 130.677728 samples/sec accuracy=94.879261 loss=0.213402 lr=0.000024 Epoch[096] Batch [3349]/[3759] Speed: 126.785411 samples/sec accuracy=94.877799 loss=0.213360 lr=0.000024 Epoch[096] Batch [3399]/[3759] Speed: 122.584731 samples/sec accuracy=94.875460 loss=0.213434 lr=0.000023 Epoch[096] Batch [3449]/[3759] Speed: 130.524073 samples/sec accuracy=94.883605 loss=0.213090 lr=0.000023 Epoch[096] Batch [3499]/[3759] Speed: 117.667043 samples/sec accuracy=94.877232 loss=0.213157 lr=0.000023 Epoch[096] Batch [3549]/[3759] Speed: 130.803229 samples/sec accuracy=94.883363 loss=0.212998 lr=0.000023 Epoch[096] Batch [3599]/[3759] Speed: 131.099840 samples/sec accuracy=94.880642 loss=0.213097 lr=0.000023 Epoch[096] Batch [3649]/[3759] Speed: 121.018972 samples/sec accuracy=94.886986 loss=0.212977 lr=0.000022 Epoch[096] Batch [3699]/[3759] Speed: 131.600779 samples/sec accuracy=94.888091 loss=0.213048 lr=0.000022 Epoch[096] Batch [3749]/[3759] Speed: 138.622363 samples/sec accuracy=94.879583 loss=0.213109 lr=0.000022 Batch [0049]/[0303]: acc-top1=67.125000 acc-top5=87.343750 Batch [0099]/[0303]: acc-top1=67.609375 acc-top5=86.968750 Batch [0149]/[0303]: acc-top1=67.208333 acc-top5=86.812500 Batch [0199]/[0303]: acc-top1=66.671875 acc-top5=86.484375 Batch [0249]/[0303]: acc-top1=66.862500 acc-top5=86.387500 Batch [0299]/[0303]: acc-top1=66.739583 acc-top5=86.437500 [Epoch 096] training: accuracy=94.883530 loss=0.213024 [Epoch 096] speed: 125 samples/sec time cost: 2105.136512 [Epoch 096] validation: acc-top1=66.723391 acc-top5=86.386139 loss=2.172561 Epoch[097] Batch [0049]/[3760] Speed: 89.890716 samples/sec accuracy=94.656250 loss=0.217246 lr=0.000022 Epoch[097] Batch [0099]/[3760] Speed: 127.296331 samples/sec accuracy=94.812500 loss=0.209498 lr=0.000022 Epoch[097] Batch [0149]/[3760] Speed: 123.649724 samples/sec accuracy=94.958333 loss=0.206501 lr=0.000021 Epoch[097] Batch [0199]/[3760] Speed: 126.814360 samples/sec accuracy=94.984375 loss=0.205998 lr=0.000021 Epoch[097] Batch [0249]/[3760] Speed: 127.889478 samples/sec accuracy=94.981250 loss=0.206457 lr=0.000021 Epoch[097] Batch [0299]/[3760] Speed: 126.173947 samples/sec accuracy=94.854167 loss=0.212366 lr=0.000021 Epoch[097] Batch [0349]/[3760] Speed: 128.370310 samples/sec accuracy=94.906250 loss=0.211129 lr=0.000021 Epoch[097] Batch [0399]/[3760] Speed: 120.619433 samples/sec accuracy=94.925781 loss=0.211310 lr=0.000020 Epoch[097] Batch [0449]/[3760] Speed: 124.519416 samples/sec accuracy=94.982639 loss=0.209840 lr=0.000020 Epoch[097] Batch [0499]/[3760] Speed: 132.086962 samples/sec accuracy=94.990625 loss=0.210085 lr=0.000020 Epoch[097] Batch [0549]/[3760] Speed: 118.086940 samples/sec accuracy=94.997159 loss=0.209494 lr=0.000020 Epoch[097] Batch [0599]/[3760] Speed: 127.797218 samples/sec accuracy=95.020833 loss=0.208522 lr=0.000020 Epoch[097] Batch [0649]/[3760] Speed: 126.817648 samples/sec accuracy=94.983173 loss=0.210400 lr=0.000019 Epoch[097] Batch [0699]/[3760] Speed: 120.962347 samples/sec accuracy=94.948661 loss=0.210867 lr=0.000019 Epoch[097] Batch [0749]/[3760] Speed: 128.251624 samples/sec accuracy=94.914583 loss=0.211143 lr=0.000019 Epoch[097] Batch [0799]/[3760] Speed: 128.968259 samples/sec accuracy=94.900391 loss=0.211593 lr=0.000019 Epoch[097] Batch [0849]/[3760] Speed: 120.878289 samples/sec accuracy=94.939338 loss=0.209969 lr=0.000019 Epoch[097] Batch [0899]/[3760] Speed: 131.551597 samples/sec accuracy=94.954861 loss=0.209768 lr=0.000019 Epoch[097] Batch [0949]/[3760] Speed: 126.233026 samples/sec accuracy=94.967105 loss=0.209396 lr=0.000018 Epoch[097] Batch [0999]/[3760] Speed: 117.615403 samples/sec accuracy=94.978125 loss=0.209162 lr=0.000018 Epoch[097] Batch [1049]/[3760] Speed: 132.150964 samples/sec accuracy=94.965774 loss=0.209911 lr=0.000018 Epoch[097] Batch [1099]/[3760] Speed: 122.832076 samples/sec accuracy=94.937500 loss=0.210692 lr=0.000018 Epoch[097] Batch [1149]/[3760] Speed: 125.695174 samples/sec accuracy=94.945652 loss=0.211210 lr=0.000018 Epoch[097] Batch [1199]/[3760] Speed: 129.634176 samples/sec accuracy=94.962240 loss=0.210800 lr=0.000017 Epoch[097] Batch [1249]/[3760] Speed: 122.546282 samples/sec accuracy=94.976250 loss=0.210928 lr=0.000017 Epoch[097] Batch [1299]/[3760] Speed: 124.552326 samples/sec accuracy=95.001202 loss=0.210196 lr=0.000017 Epoch[097] Batch [1349]/[3760] Speed: 133.668729 samples/sec accuracy=94.995370 loss=0.210328 lr=0.000017 Epoch[097] Batch [1399]/[3760] Speed: 119.767440 samples/sec accuracy=94.987723 loss=0.210519 lr=0.000017 Epoch[097] Batch [1449]/[3760] Speed: 132.208344 samples/sec accuracy=94.994612 loss=0.210353 lr=0.000017 Epoch[097] Batch [1499]/[3760] Speed: 120.957409 samples/sec accuracy=95.003125 loss=0.210481 lr=0.000016 Epoch[097] Batch [1549]/[3760] Speed: 127.744156 samples/sec accuracy=95.012097 loss=0.210104 lr=0.000016 Epoch[097] Batch [1599]/[3760] Speed: 121.939707 samples/sec accuracy=95.014648 loss=0.210196 lr=0.000016 Epoch[097] Batch [1649]/[3760] Speed: 126.274472 samples/sec accuracy=95.003788 loss=0.210152 lr=0.000016 Epoch[097] Batch [1699]/[3760] Speed: 126.206111 samples/sec accuracy=94.985294 loss=0.210191 lr=0.000016 Epoch[097] Batch [1749]/[3760] Speed: 128.462145 samples/sec accuracy=94.980357 loss=0.209966 lr=0.000016 Epoch[097] Batch [1799]/[3760] Speed: 128.008918 samples/sec accuracy=94.965278 loss=0.210597 lr=0.000015 Epoch[097] Batch [1849]/[3760] Speed: 119.019991 samples/sec accuracy=94.968750 loss=0.210685 lr=0.000015 Epoch[097] Batch [1899]/[3760] Speed: 125.250582 samples/sec accuracy=94.980263 loss=0.210607 lr=0.000015 Epoch[097] Batch [1949]/[3760] Speed: 124.025394 samples/sec accuracy=94.967949 loss=0.210570 lr=0.000015 Epoch[097] Batch [1999]/[3760] Speed: 129.038754 samples/sec accuracy=94.962500 loss=0.210604 lr=0.000015 Epoch[097] Batch [2049]/[3760] Speed: 122.664534 samples/sec accuracy=94.964177 loss=0.210850 lr=0.000015 Epoch[097] Batch [2099]/[3760] Speed: 133.895484 samples/sec accuracy=94.968750 loss=0.210564 lr=0.000014 Epoch[097] Batch [2149]/[3760] Speed: 120.770319 samples/sec accuracy=94.976744 loss=0.210148 lr=0.000014 Epoch[097] Batch [2199]/[3760] Speed: 129.074149 samples/sec accuracy=94.977273 loss=0.210400 lr=0.000014 Epoch[097] Batch [2249]/[3760] Speed: 122.553763 samples/sec accuracy=94.981250 loss=0.210291 lr=0.000014 Epoch[097] Batch [2299]/[3760] Speed: 121.857529 samples/sec accuracy=94.963315 loss=0.210537 lr=0.000014 Epoch[097] Batch [2349]/[3760] Speed: 128.370670 samples/sec accuracy=94.946144 loss=0.211215 lr=0.000014 Epoch[097] Batch [2399]/[3760] Speed: 123.151243 samples/sec accuracy=94.940755 loss=0.211339 lr=0.000014 Epoch[097] Batch [2449]/[3760] Speed: 128.583708 samples/sec accuracy=94.949617 loss=0.211143 lr=0.000013 Epoch[097] Batch [2499]/[3760] Speed: 129.143466 samples/sec accuracy=94.926250 loss=0.211827 lr=0.000013 Epoch[097] Batch [2549]/[3760] Speed: 122.835115 samples/sec accuracy=94.933824 loss=0.211711 lr=0.000013 Epoch[097] Batch [2599]/[3760] Speed: 126.987049 samples/sec accuracy=94.939303 loss=0.211534 lr=0.000013 Epoch[097] Batch [2649]/[3760] Speed: 121.546550 samples/sec accuracy=94.935142 loss=0.211682 lr=0.000013 Epoch[097] Batch [2699]/[3760] Speed: 130.091264 samples/sec accuracy=94.934028 loss=0.211671 lr=0.000013 Epoch[097] Batch [2749]/[3760] Speed: 129.130575 samples/sec accuracy=94.937500 loss=0.211490 lr=0.000013 Epoch[097] Batch [2799]/[3760] Speed: 121.066142 samples/sec accuracy=94.930804 loss=0.211672 lr=0.000012 Epoch[097] Batch [2849]/[3760] Speed: 126.781372 samples/sec accuracy=94.927632 loss=0.211799 lr=0.000012 Epoch[097] Batch [2899]/[3760] Speed: 124.149555 samples/sec accuracy=94.934267 loss=0.211822 lr=0.000012 Epoch[097] Batch [2949]/[3760] Speed: 133.238871 samples/sec accuracy=94.939619 loss=0.211585 lr=0.000012 Epoch[097] Batch [2999]/[3760] Speed: 115.734339 samples/sec accuracy=94.941667 loss=0.211651 lr=0.000012 Epoch[097] Batch [3049]/[3760] Speed: 133.307024 samples/sec accuracy=94.943648 loss=0.211767 lr=0.000012 Epoch[097] Batch [3099]/[3760] Speed: 122.088496 samples/sec accuracy=94.942036 loss=0.211722 lr=0.000011 Epoch[097] Batch [3149]/[3760] Speed: 128.760189 samples/sec accuracy=94.944444 loss=0.211568 lr=0.000011 Epoch[097] Batch [3199]/[3760] Speed: 124.445474 samples/sec accuracy=94.943848 loss=0.211636 lr=0.000011 Epoch[097] Batch [3249]/[3760] Speed: 127.630577 samples/sec accuracy=94.935096 loss=0.211815 lr=0.000011 Epoch[097] Batch [3299]/[3760] Speed: 122.560117 samples/sec accuracy=94.933239 loss=0.211832 lr=0.000011 Epoch[097] Batch [3349]/[3760] Speed: 126.801813 samples/sec accuracy=94.946362 loss=0.211571 lr=0.000011 Epoch[097] Batch [3399]/[3760] Speed: 135.590140 samples/sec accuracy=94.956342 loss=0.211308 lr=0.000011 Epoch[097] Batch [3449]/[3760] Speed: 115.172682 samples/sec accuracy=94.957428 loss=0.211447 lr=0.000011 Epoch[097] Batch [3499]/[3760] Speed: 133.510587 samples/sec accuracy=94.950446 loss=0.211621 lr=0.000010 Epoch[097] Batch [3549]/[3760] Speed: 118.108390 samples/sec accuracy=94.948063 loss=0.211799 lr=0.000010 Epoch[097] Batch [3599]/[3760] Speed: 126.346836 samples/sec accuracy=94.954861 loss=0.211697 lr=0.000010 Epoch[097] Batch [3649]/[3760] Speed: 126.525687 samples/sec accuracy=94.951627 loss=0.211717 lr=0.000010 Epoch[097] Batch [3699]/[3760] Speed: 124.161365 samples/sec accuracy=94.949747 loss=0.211766 lr=0.000010 Epoch[097] Batch [3749]/[3760] Speed: 144.075454 samples/sec accuracy=94.951250 loss=0.211718 lr=0.000010 Batch [0049]/[0303]: acc-top1=67.656250 acc-top5=87.062500 Batch [0099]/[0303]: acc-top1=67.968750 acc-top5=86.671875 Batch [0149]/[0303]: acc-top1=67.541667 acc-top5=86.593750 Batch [0199]/[0303]: acc-top1=66.937500 acc-top5=86.414062 Batch [0249]/[0303]: acc-top1=67.031250 acc-top5=86.343750 Batch [0299]/[0303]: acc-top1=66.927083 acc-top5=86.385417 [Epoch 097] training: accuracy=94.949302 loss=0.211820 [Epoch 097] speed: 125 samples/sec time cost: 2106.618590 [Epoch 097] validation: acc-top1=66.898721 acc-top5=86.350041 loss=2.175611 Epoch[098] Batch [0049]/[3759] Speed: 90.885555 samples/sec accuracy=95.187500 loss=0.200276 lr=0.000010 Epoch[098] Batch [0099]/[3759] Speed: 130.218982 samples/sec accuracy=94.859375 loss=0.209867 lr=0.000009 Epoch[098] Batch [0149]/[3759] Speed: 119.306776 samples/sec accuracy=94.885417 loss=0.213819 lr=0.000009 Epoch[098] Batch [0199]/[3759] Speed: 133.028617 samples/sec accuracy=95.015625 loss=0.209191 lr=0.000009 Epoch[098] Batch [0249]/[3759] Speed: 117.053228 samples/sec accuracy=95.118750 loss=0.208194 lr=0.000009 Epoch[098] Batch [0299]/[3759] Speed: 130.016105 samples/sec accuracy=95.114583 loss=0.209777 lr=0.000009 Epoch[098] Batch [0349]/[3759] Speed: 121.112776 samples/sec accuracy=95.049107 loss=0.212103 lr=0.000009 Epoch[098] Batch [0399]/[3759] Speed: 129.304283 samples/sec accuracy=94.976562 loss=0.212897 lr=0.000009 Epoch[098] Batch [0449]/[3759] Speed: 128.994181 samples/sec accuracy=94.993056 loss=0.211736 lr=0.000009 Epoch[098] Batch [0499]/[3759] Speed: 120.933857 samples/sec accuracy=94.968750 loss=0.212505 lr=0.000008 Epoch[098] Batch [0549]/[3759] Speed: 128.091082 samples/sec accuracy=95.025568 loss=0.210181 lr=0.000008 Epoch[098] Batch [0599]/[3759] Speed: 124.071743 samples/sec accuracy=95.007812 loss=0.210012 lr=0.000008 Epoch[098] Batch [0649]/[3759] Speed: 122.562492 samples/sec accuracy=94.985577 loss=0.210964 lr=0.000008 Epoch[098] Batch [0699]/[3759] Speed: 127.626867 samples/sec accuracy=94.968750 loss=0.211005 lr=0.000008 Epoch[098] Batch [0749]/[3759] Speed: 124.880624 samples/sec accuracy=94.945833 loss=0.211922 lr=0.000008 Epoch[098] Batch [0799]/[3759] Speed: 125.544694 samples/sec accuracy=94.917969 loss=0.212408 lr=0.000008 Epoch[098] Batch [0849]/[3759] Speed: 126.364895 samples/sec accuracy=94.915441 loss=0.212144 lr=0.000008 Epoch[098] Batch [0899]/[3759] Speed: 129.613658 samples/sec accuracy=94.904514 loss=0.212399 lr=0.000007 Epoch[098] Batch [0949]/[3759] Speed: 122.501070 samples/sec accuracy=94.888158 loss=0.212378 lr=0.000007 Epoch[098] Batch [0999]/[3759] Speed: 127.697013 samples/sec accuracy=94.887500 loss=0.211674 lr=0.000007 Epoch[098] Batch [1049]/[3759] Speed: 126.178497 samples/sec accuracy=94.875000 loss=0.211914 lr=0.000007 Epoch[098] Batch [1099]/[3759] Speed: 128.244939 samples/sec accuracy=94.892045 loss=0.211432 lr=0.000007 Epoch[098] Batch [1149]/[3759] Speed: 119.396907 samples/sec accuracy=94.879076 loss=0.211712 lr=0.000007 Epoch[098] Batch [1199]/[3759] Speed: 126.950767 samples/sec accuracy=94.869792 loss=0.212328 lr=0.000007 Epoch[098] Batch [1249]/[3759] Speed: 130.600902 samples/sec accuracy=94.898750 loss=0.211577 lr=0.000007 Epoch[098] Batch [1299]/[3759] Speed: 121.169676 samples/sec accuracy=94.890625 loss=0.211899 lr=0.000007 Epoch[098] Batch [1349]/[3759] Speed: 128.883084 samples/sec accuracy=94.870370 loss=0.211711 lr=0.000007 Epoch[098] Batch [1399]/[3759] Speed: 127.257241 samples/sec accuracy=94.885045 loss=0.211326 lr=0.000006 Epoch[098] Batch [1449]/[3759] Speed: 123.236392 samples/sec accuracy=94.870690 loss=0.211523 lr=0.000006 Epoch[098] Batch [1499]/[3759] Speed: 122.775235 samples/sec accuracy=94.863542 loss=0.211349 lr=0.000006 Epoch[098] Batch [1549]/[3759] Speed: 128.065557 samples/sec accuracy=94.883065 loss=0.211078 lr=0.000006 Epoch[098] Batch [1599]/[3759] Speed: 122.392106 samples/sec accuracy=94.872070 loss=0.211665 lr=0.000006 Epoch[098] Batch [1649]/[3759] Speed: 134.864292 samples/sec accuracy=94.888258 loss=0.211644 lr=0.000006 Epoch[098] Batch [1699]/[3759] Speed: 119.866418 samples/sec accuracy=94.888787 loss=0.211735 lr=0.000006 Epoch[098] Batch [1749]/[3759] Speed: 125.204741 samples/sec accuracy=94.887500 loss=0.211868 lr=0.000006 Epoch[098] Batch [1799]/[3759] Speed: 128.001465 samples/sec accuracy=94.906250 loss=0.211284 lr=0.000006 Epoch[098] Batch [1849]/[3759] Speed: 122.516163 samples/sec accuracy=94.890203 loss=0.211903 lr=0.000005 Epoch[098] Batch [1899]/[3759] Speed: 131.948421 samples/sec accuracy=94.888980 loss=0.212104 lr=0.000005 Epoch[098] Batch [1949]/[3759] Speed: 123.143819 samples/sec accuracy=94.879006 loss=0.212234 lr=0.000005 Epoch[098] Batch [1999]/[3759] Speed: 123.691284 samples/sec accuracy=94.875781 loss=0.212283 lr=0.000005 Epoch[098] Batch [2049]/[3759] Speed: 129.792585 samples/sec accuracy=94.871189 loss=0.212584 lr=0.000005 Epoch[098] Batch [2099]/[3759] Speed: 122.091940 samples/sec accuracy=94.878720 loss=0.212363 lr=0.000005 Epoch[098] Batch [2149]/[3759] Speed: 130.160056 samples/sec accuracy=94.877907 loss=0.212338 lr=0.000005 Epoch[098] Batch [2199]/[3759] Speed: 128.241099 samples/sec accuracy=94.887074 loss=0.212172 lr=0.000005 Epoch[098] Batch [2249]/[3759] Speed: 118.900722 samples/sec accuracy=94.883333 loss=0.212577 lr=0.000005 Epoch[098] Batch [2299]/[3759] Speed: 129.079217 samples/sec accuracy=94.887228 loss=0.212539 lr=0.000005 Epoch[098] Batch [2349]/[3759] Speed: 128.311057 samples/sec accuracy=94.893617 loss=0.212469 lr=0.000005 Epoch[098] Batch [2399]/[3759] Speed: 122.066691 samples/sec accuracy=94.891927 loss=0.212486 lr=0.000004 Epoch[098] Batch [2449]/[3759] Speed: 132.992873 samples/sec accuracy=94.889031 loss=0.212438 lr=0.000004 Epoch[098] Batch [2499]/[3759] Speed: 115.434263 samples/sec accuracy=94.898750 loss=0.212196 lr=0.000004 Epoch[098] Batch [2549]/[3759] Speed: 134.466425 samples/sec accuracy=94.903186 loss=0.212066 lr=0.000004 Epoch[098] Batch [2599]/[3759] Speed: 124.997058 samples/sec accuracy=94.899038 loss=0.212065 lr=0.000004 Epoch[098] Batch [2649]/[3759] Speed: 120.954611 samples/sec accuracy=94.895047 loss=0.212113 lr=0.000004 Epoch[098] Batch [2699]/[3759] Speed: 129.461987 samples/sec accuracy=94.899884 loss=0.212178 lr=0.000004 Epoch[098] Batch [2749]/[3759] Speed: 122.411338 samples/sec accuracy=94.893182 loss=0.212350 lr=0.000004 Epoch[098] Batch [2799]/[3759] Speed: 126.650824 samples/sec accuracy=94.885045 loss=0.212506 lr=0.000004 Epoch[098] Batch [2849]/[3759] Speed: 122.647840 samples/sec accuracy=94.881579 loss=0.212517 lr=0.000004 Epoch[098] Batch [2899]/[3759] Speed: 132.594957 samples/sec accuracy=94.881466 loss=0.212347 lr=0.000004 Epoch[098] Batch [2949]/[3759] Speed: 121.615460 samples/sec accuracy=94.883475 loss=0.212374 lr=0.000004 Epoch[098] Batch [2999]/[3759] Speed: 126.956838 samples/sec accuracy=94.881250 loss=0.212481 lr=0.000003 Epoch[098] Batch [3049]/[3759] Speed: 128.833947 samples/sec accuracy=94.887807 loss=0.212408 lr=0.000003 Epoch[098] Batch [3099]/[3759] Speed: 116.990524 samples/sec accuracy=94.886593 loss=0.212325 lr=0.000003 Epoch[098] Batch [3149]/[3759] Speed: 124.624393 samples/sec accuracy=94.893353 loss=0.212223 lr=0.000003 Epoch[098] Batch [3199]/[3759] Speed: 132.089703 samples/sec accuracy=94.900391 loss=0.212019 lr=0.000003 Epoch[098] Batch [3249]/[3759] Speed: 122.990866 samples/sec accuracy=94.888462 loss=0.212303 lr=0.000003 Epoch[098] Batch [3299]/[3759] Speed: 127.529645 samples/sec accuracy=94.891572 loss=0.212159 lr=0.000003 Epoch[098] Batch [3349]/[3759] Speed: 124.649226 samples/sec accuracy=94.893190 loss=0.212270 lr=0.000003 Epoch[098] Batch [3399]/[3759] Speed: 123.030108 samples/sec accuracy=94.895221 loss=0.212281 lr=0.000003 Epoch[098] Batch [3449]/[3759] Speed: 129.131950 samples/sec accuracy=94.894475 loss=0.212362 lr=0.000003 Epoch[098] Batch [3499]/[3759] Speed: 128.237592 samples/sec accuracy=94.893304 loss=0.212450 lr=0.000003 Epoch[098] Batch [3549]/[3759] Speed: 121.649851 samples/sec accuracy=94.897447 loss=0.212506 lr=0.000003 Epoch[098] Batch [3599]/[3759] Speed: 132.979217 samples/sec accuracy=94.903646 loss=0.212446 lr=0.000003 Epoch[098] Batch [3649]/[3759] Speed: 114.681864 samples/sec accuracy=94.898116 loss=0.212593 lr=0.000003 Epoch[098] Batch [3699]/[3759] Speed: 133.821443 samples/sec accuracy=94.896959 loss=0.212646 lr=0.000002 Epoch[098] Batch [3749]/[3759] Speed: 143.257724 samples/sec accuracy=94.892500 loss=0.212804 lr=0.000002 Batch [0049]/[0303]: acc-top1=67.375000 acc-top5=87.187500 Batch [0099]/[0303]: acc-top1=67.531250 acc-top5=86.718750 Batch [0149]/[0303]: acc-top1=67.281250 acc-top5=86.666667 Batch [0199]/[0303]: acc-top1=66.695312 acc-top5=86.437500 Batch [0249]/[0303]: acc-top1=66.781250 acc-top5=86.356250 Batch [0299]/[0303]: acc-top1=66.729167 acc-top5=86.385417 [Epoch 098] training: accuracy=94.896000 loss=0.212691 [Epoch 098] speed: 125 samples/sec time cost: 2106.947426 [Epoch 098] validation: acc-top1=66.707921 acc-top5=86.350041 loss=2.160112 Epoch[099] Batch [0049]/[3760] Speed: 89.991412 samples/sec accuracy=95.187500 loss=0.192628 lr=0.000002 Epoch[099] Batch [0099]/[3760] Speed: 126.705300 samples/sec accuracy=95.359375 loss=0.191268 lr=0.000002 Epoch[099] Batch [0149]/[3760] Speed: 126.706781 samples/sec accuracy=95.312500 loss=0.199057 lr=0.000002 Epoch[099] Batch [0199]/[3760] Speed: 122.156361 samples/sec accuracy=95.125000 loss=0.206056 lr=0.000002 Epoch[099] Batch [0249]/[3760] Speed: 127.166395 samples/sec accuracy=95.043750 loss=0.207670 lr=0.000002 Epoch[099] Batch [0299]/[3760] Speed: 127.607408 samples/sec accuracy=95.098958 loss=0.207781 lr=0.000002 Epoch[099] Batch [0349]/[3760] Speed: 121.582187 samples/sec accuracy=95.089286 loss=0.207645 lr=0.000002 Epoch[099] Batch [0399]/[3760] Speed: 126.709084 samples/sec accuracy=95.062500 loss=0.209314 lr=0.000002 Epoch[099] Batch [0449]/[3760] Speed: 128.440597 samples/sec accuracy=95.010417 loss=0.210033 lr=0.000002 Epoch[099] Batch [0499]/[3760] Speed: 123.239632 samples/sec accuracy=95.031250 loss=0.210129 lr=0.000002 Epoch[099] Batch [0549]/[3760] Speed: 128.242333 samples/sec accuracy=95.093750 loss=0.209016 lr=0.000002 Epoch[099] Batch [0599]/[3760] Speed: 123.045902 samples/sec accuracy=95.106771 loss=0.208615 lr=0.000002 Epoch[099] Batch [0649]/[3760] Speed: 128.275606 samples/sec accuracy=95.096154 loss=0.208124 lr=0.000002 Epoch[099] Batch [0699]/[3760] Speed: 123.944695 samples/sec accuracy=95.131696 loss=0.207251 lr=0.000002 Epoch[099] Batch [0749]/[3760] Speed: 131.726560 samples/sec accuracy=95.104167 loss=0.207763 lr=0.000002 Epoch[099] Batch [0799]/[3760] Speed: 123.614530 samples/sec accuracy=95.074219 loss=0.208254 lr=0.000001 Epoch[099] Batch [0849]/[3760] Speed: 124.009551 samples/sec accuracy=95.051471 loss=0.209204 lr=0.000001 Epoch[099] Batch [0899]/[3760] Speed: 122.784152 samples/sec accuracy=95.017361 loss=0.210593 lr=0.000001 Epoch[099] Batch [0949]/[3760] Speed: 132.343421 samples/sec accuracy=95.024671 loss=0.210221 lr=0.000001 Epoch[099] Batch [0999]/[3760] Speed: 125.074481 samples/sec accuracy=95.012500 loss=0.210315 lr=0.000001 Epoch[099] Batch [1049]/[3760] Speed: 123.111630 samples/sec accuracy=95.013393 loss=0.209799 lr=0.000001 Epoch[099] Batch [1099]/[3760] Speed: 126.529573 samples/sec accuracy=95.001420 loss=0.210142 lr=0.000001 Epoch[099] Batch [1149]/[3760] Speed: 127.291090 samples/sec accuracy=94.995924 loss=0.209761 lr=0.000001 Epoch[099] Batch [1199]/[3760] Speed: 127.743244 samples/sec accuracy=94.977865 loss=0.210463 lr=0.000001 Epoch[099] Batch [1249]/[3760] Speed: 122.033505 samples/sec accuracy=94.977500 loss=0.210081 lr=0.000001 Epoch[099] Batch [1299]/[3760] Speed: 128.767791 samples/sec accuracy=94.991587 loss=0.209888 lr=0.000001 Epoch[099] Batch [1349]/[3760] Speed: 122.840325 samples/sec accuracy=95.000000 loss=0.209640 lr=0.000001 Epoch[099] Batch [1399]/[3760] Speed: 130.138929 samples/sec accuracy=94.993304 loss=0.210258 lr=0.000001 Epoch[099] Batch [1449]/[3760] Speed: 119.548986 samples/sec accuracy=94.969828 loss=0.210898 lr=0.000001 Epoch[099] Batch [1499]/[3760] Speed: 133.779006 samples/sec accuracy=94.964583 loss=0.211072 lr=0.000001 Epoch[099] Batch [1549]/[3760] Speed: 115.386896 samples/sec accuracy=94.972782 loss=0.211068 lr=0.000001 Epoch[099] Batch [1599]/[3760] Speed: 133.210838 samples/sec accuracy=94.958008 loss=0.211897 lr=0.000001 Epoch[099] Batch [1649]/[3760] Speed: 127.793069 samples/sec accuracy=94.965909 loss=0.211253 lr=0.000001 Epoch[099] Batch [1699]/[3760] Speed: 120.379187 samples/sec accuracy=94.967831 loss=0.211268 lr=0.000001 Epoch[099] Batch [1749]/[3760] Speed: 128.143641 samples/sec accuracy=94.981250 loss=0.211252 lr=0.000001 Epoch[099] Batch [1799]/[3760] Speed: 120.480405 samples/sec accuracy=94.992188 loss=0.211156 lr=0.000001 Epoch[099] Batch [1849]/[3760] Speed: 131.225857 samples/sec accuracy=95.005912 loss=0.210762 lr=0.000001 Epoch[099] Batch [1899]/[3760] Speed: 121.639184 samples/sec accuracy=95.018914 loss=0.210499 lr=0.000001 Epoch[099] Batch [1949]/[3760] Speed: 125.817876 samples/sec accuracy=95.022436 loss=0.210295 lr=0.000001 Epoch[099] Batch [1999]/[3760] Speed: 126.393010 samples/sec accuracy=95.021094 loss=0.210231 lr=0.000001 Epoch[099] Batch [2049]/[3760] Speed: 128.454410 samples/sec accuracy=95.025152 loss=0.209866 lr=0.000000 Epoch[099] Batch [2099]/[3760] Speed: 125.848623 samples/sec accuracy=95.049851 loss=0.209429 lr=0.000000 Epoch[099] Batch [2149]/[3760] Speed: 120.598325 samples/sec accuracy=95.021076 loss=0.210065 lr=0.000000 Epoch[099] Batch [2199]/[3760] Speed: 132.337722 samples/sec accuracy=95.024148 loss=0.209809 lr=0.000000 Epoch[099] Batch [2249]/[3760] Speed: 126.215515 samples/sec accuracy=95.015972 loss=0.210078 lr=0.000000 Epoch[099] Batch [2299]/[3760] Speed: 122.699728 samples/sec accuracy=95.008152 loss=0.210475 lr=0.000000 Epoch[099] Batch [2349]/[3760] Speed: 131.292170 samples/sec accuracy=95.015957 loss=0.210515 lr=0.000000 Epoch[099] Batch [2399]/[3760] Speed: 116.635594 samples/sec accuracy=95.009115 loss=0.210640 lr=0.000000 Epoch[099] Batch [2449]/[3760] Speed: 135.546678 samples/sec accuracy=95.005740 loss=0.210781 lr=0.000000 Epoch[099] Batch [2499]/[3760] Speed: 119.231084 samples/sec accuracy=95.013750 loss=0.210476 lr=0.000000 Epoch[099] Batch [2549]/[3760] Speed: 130.916483 samples/sec accuracy=95.016544 loss=0.210179 lr=0.000000 Epoch[099] Batch [2599]/[3760] Speed: 118.369728 samples/sec accuracy=95.015024 loss=0.210183 lr=0.000000 Epoch[099] Batch [2649]/[3760] Speed: 131.448992 samples/sec accuracy=95.010024 loss=0.210257 lr=0.000000 Epoch[099] Batch [2699]/[3760] Speed: 131.288518 samples/sec accuracy=95.002894 loss=0.210526 lr=0.000000 Epoch[099] Batch [2749]/[3760] Speed: 119.401641 samples/sec accuracy=95.011364 loss=0.210439 lr=0.000000 Epoch[099] Batch [2799]/[3760] Speed: 133.153154 samples/sec accuracy=95.012835 loss=0.210413 lr=0.000000 Epoch[099] Batch [2849]/[3760] Speed: 121.643219 samples/sec accuracy=95.008772 loss=0.210575 lr=0.000000 Epoch[099] Batch [2899]/[3760] Speed: 126.240325 samples/sec accuracy=95.019397 loss=0.210462 lr=0.000000 Epoch[099] Batch [2949]/[3760] Speed: 119.053891 samples/sec accuracy=95.023305 loss=0.210307 lr=0.000000 Epoch[099] Batch [2999]/[3760] Speed: 129.565410 samples/sec accuracy=95.015625 loss=0.210696 lr=0.000000 Epoch[099] Batch [3049]/[3760] Speed: 128.829042 samples/sec accuracy=95.019980 loss=0.210601 lr=0.000000 Epoch[099] Batch [3099]/[3760] Speed: 125.724269 samples/sec accuracy=95.017137 loss=0.210715 lr=0.000000 Epoch[099] Batch [3149]/[3760] Speed: 125.719097 samples/sec accuracy=95.019841 loss=0.210600 lr=0.000000 Epoch[099] Batch [3199]/[3760] Speed: 125.092654 samples/sec accuracy=95.013184 loss=0.210564 lr=0.000000 Epoch[099] Batch [3249]/[3760] Speed: 122.180869 samples/sec accuracy=95.011538 loss=0.210641 lr=0.000000 Epoch[099] Batch [3299]/[3760] Speed: 132.123177 samples/sec accuracy=95.014678 loss=0.210685 lr=0.000000 Epoch[099] Batch [3349]/[3760] Speed: 120.165818 samples/sec accuracy=95.018657 loss=0.210635 lr=0.000000 Epoch[099] Batch [3399]/[3760] Speed: 125.923703 samples/sec accuracy=95.014246 loss=0.210770 lr=0.000000 Epoch[099] Batch [3449]/[3760] Speed: 127.271606 samples/sec accuracy=95.015851 loss=0.210685 lr=0.000000 Epoch[099] Batch [3499]/[3760] Speed: 123.861922 samples/sec accuracy=95.017411 loss=0.210576 lr=0.000000 Epoch[099] Batch [3549]/[3760] Speed: 125.228295 samples/sec accuracy=95.018926 loss=0.210704 lr=0.000000 Epoch[099] Batch [3599]/[3760] Speed: 127.932908 samples/sec accuracy=95.029948 loss=0.210513 lr=0.000000 Epoch[099] Batch [3649]/[3760] Speed: 127.698026 samples/sec accuracy=95.030394 loss=0.210513 lr=0.000000 Epoch[099] Batch [3699]/[3760] Speed: 127.306883 samples/sec accuracy=95.030828 loss=0.210571 lr=0.000000 Epoch[099] Batch [3749]/[3760] Speed: 141.505187 samples/sec accuracy=95.038750 loss=0.210435 lr=0.000000 Batch [0049]/[0303]: acc-top1=67.125000 acc-top5=87.093750 Batch [0099]/[0303]: acc-top1=67.734375 acc-top5=86.718750 Batch [0149]/[0303]: acc-top1=67.427083 acc-top5=86.729167 Batch [0199]/[0303]: acc-top1=66.906250 acc-top5=86.437500 Batch [0249]/[0303]: acc-top1=67.068750 acc-top5=86.318750 Batch [0299]/[0303]: acc-top1=67.005208 acc-top5=86.385417 [Epoch 099] training: accuracy=95.038231 loss=0.210470 [Epoch 099] speed: 125 samples/sec time cost: 2104.680703 [Epoch 099] validation: acc-top1=66.970916 acc-top5=86.339728 loss=2.162073