ContraGAN-train-2021_01_01_09_35_08.log

[INFO] 2021-01-01 09:35:08 > Run name : ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 09:35:08 > {'config_path': './src/configs/TINY_ILSVRC2012/ContraGAN.json', 'checkpoint_folder': None, 'load_current': False, 'log_output_path': None, 'seed': -1, 'distributed_data_parallel': False, 'num_workers': 8, 'synchronized_bn': True, 'mixed_precision': False, 'disable_debugging_API': True, 'reduce_train_dataset': 1.0, 'standing_statistics': False, 'standing_step': -1, 'freeze_layers': -1, 'load_all_data_in_memory': True, 'train': True, 'eval': True, 'save_images': False, 'image_visualization': False, 'k_nearest_neighbor': False, 'interpolation': False, 'frequency_analysis': False, 'nrow': 10, 'ncol': 8, 'print_every': 100, 'save_every': 2000, 'eval_type': 'valid'}
[INFO] 2021-01-01 09:35:08 > {'data_processing': {'dataset_name': 'tiny_imagenet', 'data_path': './data/TINY_ILSVRC2012', 'img_size': 64, 'num_classes': 200, 'batch_size4prcsing': 256, 'chunk_size': 500, 'compression': False}, 'train': {'model': {'architecture': 'big_resnet', 'conditional_strategy': 'ContraGAN', 'pos_collected_numerator': True, 'hypersphere_dim': 768, 'nonlinear_embed': False, 'normalize_embed': True, 'g_spectral_norm': True, 'd_spectral_norm': True, 'activation_fn': 'ReLU', 'attention': True, 'attention_after_nth_gen_block': 3, 'attention_after_nth_dis_block': 1, 'z_dim': 100, 'shared_dim': 128, 'g_conv_dim': 80, 'd_conv_dim': 80, 'G_depth': 'N/A', 'D_depth': 'N/A'}, 'optimization': {'optimizer': 'Adam', 'batch_size': 1024, 'accumulation_steps': 1, 'd_lr': 0.0004, 'g_lr': 0.0001, 'momentum': 'N/A', 'nesterov': 'N/A', 'alpha': 'N/A', 'beta1': 0.0, 'beta2': 0.999, 'g_steps_per_iter': 1, 'd_steps_per_iter': 1, 'total_step': 100000}, 'loss_function': {'adv_loss': 'hinge', 'contrastive_lambda': 1.0, 'margin': 0.0, 'tempering_type': 'discrete', 'tempering_step': 1, 'start_temperature': 1.0, 'end_temperature': 1.0, 'weight_clipping_for_dis': False, 'weight_clipping_bound': 'N/A', 'gradient_penalty_for_dis': False, 'gradient_penalty_lambda': 'N/A', 'deep_regret_analysis_for_dis': False, 'regret_penalty_lambda': 'N/A', 'cr': False, 'cr_lambda': 'N/A', 'bcr': False, 'real_lambda': 'N/A', 'fake_lambda': 'N/A', 'zcr': False, 'gen_lambda': 'N/A', 'dis_lambda': 'N/A', 'sigma_noise': 'N/A'}, 'initialization': {'g_init': 'ortho', 'd_init': 'ortho'}, 'training_and_sampling_setting': {'random_flip_preprocessing': True, 'diff_aug': False, 'ada': False, 'ada_target': 'N/A', 'ada_length': 'N/A', 'prior': 'gaussian', 'truncated_factor': 1, 'latent_op': False, 'latent_op_rate': 'N/A', 'latent_op_step': 'N/A', 'latent_op_step4eval': 'N/A', 'latent_op_alpha': 'N/A', 'latent_op_beta': 'N/A', 'latent_norm_reg_weight': 'N/A', 'ema': True, 'ema_decay': 0.9999, 'ema_start': 20000}}}
[INFO] 2021-01-01 09:35:08 > Load train datasets...
[INFO] 2021-01-01 09:35:19 > Train dataset size : 100000
[INFO] 2021-01-01 09:35:19 > Load valid datasets...
[INFO] 2021-01-01 09:35:19 > Eval dataset size : 10000
[INFO] 2021-01-01 09:35:19 > Build model...
[INFO] 2021-01-01 09:35:19 > Modules are located on models.big_resnet.
[INFO] 2021-01-01 09:35:24 > Prepare EMA for G with decay of 0.9999.
[INFO] 2021-01-01 09:35:24 > Number of parameters: 17335204
[INFO] 2021-01-01 09:35:24 > Generator(
  (linear0): Linear(in_features=20, out_features=20480, bias=True)
  (shared): Embedding(200, 128)
  (blocks): ModuleList(
    (0): ModuleList(
      (0): GenBlock(
        (bn1): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(1280, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=1280, bias=False)
          (bias): Linear(in_features=148, out_features=1280, bias=False)
        )
        (bn2): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(640, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=640, bias=False)
          (bias): Linear(in_features=148, out_features=640, bias=False)
        )
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(1280, 640, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(1280, 640, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(640, 640, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
      )
    )
    (1): ModuleList(
      (0): GenBlock(
        (bn1): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(640, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=640, bias=False)
          (bias): Linear(in_features=148, out_features=640, bias=False)
        )
        (bn2): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(320, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=320, bias=False)
          (bias): Linear(in_features=148, out_features=320, bias=False)
        )
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(640, 320, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(640, 320, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(320, 320, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
      )
    )
    (2): ModuleList(
      (0): GenBlock(
        (bn1): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(320, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=320, bias=False)
          (bias): Linear(in_features=148, out_features=320, bias=False)
        )
        (bn2): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(160, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=160, bias=False)
          (bias): Linear(in_features=148, out_features=160, bias=False)
        )
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(320, 160, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(320, 160, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(160, 160, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
      )
    )
    (3): ModuleList(
      (0): Self_Attn(
        (conv1x1_theta): Conv2d(160, 20, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (conv1x1_phi): Conv2d(160, 20, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (conv1x1_g): Conv2d(160, 80, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (conv1x1_attn): Conv2d(80, 160, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (maxpool): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
        (softmax): Softmax(dim=-1)
      )
    )
    (4): ModuleList(
      (0): GenBlock(
        (bn1): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(160, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=160, bias=False)
          (bias): Linear(in_features=148, out_features=160, bias=False)
        )
        (bn2): ConditionalBatchNorm2d_for_skip_and_shared(
          (bn): BatchNorm2d(80, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
          (gain): Linear(in_features=148, out_features=80, bias=False)
          (bias): Linear(in_features=148, out_features=80, bias=False)
        )
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(160, 80, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(160, 80, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(80, 80, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
      )
    )
  )
  (bn4): BatchNorm2d(80, eps=0.0001, momentum=0.1, affine=True, track_running_stats=True)
  (activation): ReLU(inplace=True)
  (conv2d5): Conv2d(80, 3, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
  (tanh): Tanh()
)
[INFO] 2021-01-01 09:35:24 > Number of parameters: 31678130
[INFO] 2021-01-01 09:35:24 > Discriminator(
  (blocks): ModuleList(
    (0): ModuleList(
      (0): DiscOptBlock(
        (conv2d0): Conv2d(3, 80, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(3, 80, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(80, 80, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (activation): ReLU(inplace=True)
        (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
      )
    )
    (1): ModuleList(
      (0): Self_Attn(
        (conv1x1_theta): Conv2d(80, 10, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (conv1x1_phi): Conv2d(80, 10, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (conv1x1_g): Conv2d(80, 40, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (conv1x1_attn): Conv2d(40, 80, kernel_size=(1, 1), stride=(1, 1), bias=False)
        (maxpool): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
        (softmax): Softmax(dim=-1)
      )
    )
    (2): ModuleList(
      (0): DiscBlock(
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(80, 160, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(80, 160, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(160, 160, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
      )
    )
    (3): ModuleList(
      (0): DiscBlock(
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(160, 320, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(160, 320, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(320, 320, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
      )
    )
    (4): ModuleList(
      (0): DiscBlock(
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(320, 640, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(320, 640, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(640, 640, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
      )
    )
    (5): ModuleList(
      (0): DiscBlock(
        (activation): ReLU(inplace=True)
        (conv2d0): Conv2d(640, 1280, kernel_size=(1, 1), stride=(1, 1))
        (conv2d1): Conv2d(640, 1280, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (conv2d2): Conv2d(1280, 1280, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
        (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
      )
    )
  )
  (activation): ReLU(inplace=True)
  (linear1): Linear(in_features=1280, out_features=1, bias=True)
  (linear2): Linear(in_features=1280, out_features=768, bias=True)
  (embedding): Embedding(200, 768)
)
[INFO] 2021-01-01 09:35:27 > Start training....
[INFO] 2021-01-01 09:37:55 > Step:     100 Progress: 0.1% Elapsed: 0:02:28 temperature: 1.0 ada_p: No Discriminator_loss: 7.14415 Generator_loss: 5.15677 
[INFO] 2021-01-01 09:40:09 > Step:     200 Progress: 0.2% Elapsed: 0:04:41 temperature: 1.0 ada_p: No Discriminator_loss: 7.17567 Generator_loss: 5.9498 
[INFO] 2021-01-01 09:42:23 > Step:     300 Progress: 0.3% Elapsed: 0:06:56 temperature: 1.0 ada_p: No Discriminator_loss: 6.90503 Generator_loss: 5.52486 
[INFO] 2021-01-01 09:44:37 > Step:     400 Progress: 0.4% Elapsed: 0:09:09 temperature: 1.0 ada_p: No Discriminator_loss: 7.02485 Generator_loss: 4.47226 
[INFO] 2021-01-01 09:46:51 > Step:     500 Progress: 0.5% Elapsed: 0:11:23 temperature: 1.0 ada_p: No Discriminator_loss: 6.41457 Generator_loss: 3.91195 
[INFO] 2021-01-01 09:49:05 > Step:     600 Progress: 0.6% Elapsed: 0:13:38 temperature: 1.0 ada_p: No Discriminator_loss: 6.95358 Generator_loss: 4.63073 
[INFO] 2021-01-01 09:51:21 > Step:     700 Progress: 0.7% Elapsed: 0:15:53 temperature: 1.0 ada_p: No Discriminator_loss: 6.84959 Generator_loss: 4.85028 
[INFO] 2021-01-01 09:53:36 > Step:     800 Progress: 0.8% Elapsed: 0:18:09 temperature: 1.0 ada_p: No Discriminator_loss: 7.06524 Generator_loss: 5.02222 
[INFO] 2021-01-01 09:55:52 > Step:     900 Progress: 0.9% Elapsed: 0:20:24 temperature: 1.0 ada_p: No Discriminator_loss: 6.88772 Generator_loss: 4.44013 
[INFO] 2021-01-01 09:58:09 > Step:    1000 Progress: 1.0% Elapsed: 0:22:41 temperature: 1.0 ada_p: No Discriminator_loss: 6.75522 Generator_loss: 3.67924 
[INFO] 2021-01-01 10:00:25 > Step:    1100 Progress: 1.1% Elapsed: 0:24:58 temperature: 1.0 ada_p: No Discriminator_loss: 6.65658 Generator_loss: 5.23119 
[INFO] 2021-01-01 10:02:42 > Step:    1200 Progress: 1.2% Elapsed: 0:27:15 temperature: 1.0 ada_p: No Discriminator_loss: 6.81106 Generator_loss: 4.04819 
[INFO] 2021-01-01 10:05:00 > Step:    1300 Progress: 1.3% Elapsed: 0:29:32 temperature: 1.0 ada_p: No Discriminator_loss: 6.9753 Generator_loss: 5.36358 
[INFO] 2021-01-01 10:07:17 > Step:    1400 Progress: 1.4% Elapsed: 0:31:49 temperature: 1.0 ada_p: No Discriminator_loss: 6.9319 Generator_loss: 4.7246 
[INFO] 2021-01-01 10:09:35 > Step:    1500 Progress: 1.5% Elapsed: 0:34:07 temperature: 1.0 ada_p: No Discriminator_loss: 6.81169 Generator_loss: 4.30929 
[INFO] 2021-01-01 10:11:51 > Step:    1600 Progress: 1.6% Elapsed: 0:36:23 temperature: 1.0 ada_p: No Discriminator_loss: 6.71021 Generator_loss: 5.3944 
[INFO] 2021-01-01 10:14:08 > Step:    1700 Progress: 1.7% Elapsed: 0:38:40 temperature: 1.0 ada_p: No Discriminator_loss: 6.75846 Generator_loss: 5.45634 
[INFO] 2021-01-01 10:16:25 > Step:    1800 Progress: 1.8% Elapsed: 0:40:57 temperature: 1.0 ada_p: No Discriminator_loss: 6.69348 Generator_loss: 5.77306 
[INFO] 2021-01-01 10:18:42 > Step:    1900 Progress: 1.9% Elapsed: 0:43:14 temperature: 1.0 ada_p: No Discriminator_loss: 7.02535 Generator_loss: 5.15005 
[INFO] 2021-01-01 10:20:58 > Step:    2000 Progress: 2.0% Elapsed: 0:45:30 temperature: 1.0 ada_p: No Discriminator_loss: 6.65095 Generator_loss: 5.30381 
[INFO] 2021-01-01 10:20:58 > Start Evaluation (2000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 10:20:58 > Calculating FID Score....
[INFO] 2021-01-01 10:21:18 > Calculating Inception Score....
[INFO] 2021-01-01 10:21:24 > Calculate F_beta Score....
[INFO] 2021-01-01 10:21:48 > Calculate Accuracies....
[INFO] 2021-01-01 10:21:51 > Calculate Accuracies....
[INFO] 2021-01-01 10:21:53 > F_8 score (Step: 2000, Using valid images): 0.2496093454626136
[INFO] 2021-01-01 10:21:53 > F_1/8 score (Step: 2000, Using valid images): 0.4422284456462324
[INFO] 2021-01-01 10:21:53 > FID score (Step: 2000, Using valid moments): 121.58491063251944
[INFO] 2021-01-01 10:21:53 > Inception score (Step: 2000, 10000 generated images): 4.733783721923828
[INFO] 2021-01-01 10:21:53 > Best FID score (Step: 2000, Using valid moments): 121.58491063251944
[INFO] 2021-01-01 10:22:06 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 10:24:23 > Step:    2100 Progress: 2.1% Elapsed: 0:48:55 temperature: 1.0 ada_p: No Discriminator_loss: 6.63797 Generator_loss: 4.95302 
[INFO] 2021-01-01 10:26:39 > Step:    2200 Progress: 2.2% Elapsed: 0:51:11 temperature: 1.0 ada_p: No Discriminator_loss: 7.15841 Generator_loss: 4.19899 
[INFO] 2021-01-01 10:28:56 > Step:    2300 Progress: 2.3% Elapsed: 0:53:28 temperature: 1.0 ada_p: No Discriminator_loss: 6.6683 Generator_loss: 4.56495 
[INFO] 2021-01-01 10:31:13 > Step:    2400 Progress: 2.4% Elapsed: 0:55:45 temperature: 1.0 ada_p: No Discriminator_loss: 6.45824 Generator_loss: 3.82421 
[INFO] 2021-01-01 10:33:29 > Step:    2500 Progress: 2.5% Elapsed: 0:58:01 temperature: 1.0 ada_p: No Discriminator_loss: 6.62605 Generator_loss: 5.45443 
[INFO] 2021-01-01 10:35:45 > Step:    2600 Progress: 2.6% Elapsed: 1:00:18 temperature: 1.0 ada_p: No Discriminator_loss: 6.4274 Generator_loss: 4.85703 
[INFO] 2021-01-01 10:38:01 > Step:    2700 Progress: 2.7% Elapsed: 1:02:34 temperature: 1.0 ada_p: No Discriminator_loss: 6.64023 Generator_loss: 4.22427 
[INFO] 2021-01-01 10:40:18 > Step:    2800 Progress: 2.8% Elapsed: 1:04:50 temperature: 1.0 ada_p: No Discriminator_loss: 6.58241 Generator_loss: 3.83383 
[INFO] 2021-01-01 10:42:35 > Step:    2900 Progress: 2.9% Elapsed: 1:07:07 temperature: 1.0 ada_p: No Discriminator_loss: 6.62672 Generator_loss: 5.35179 
[INFO] 2021-01-01 10:44:51 > Step:    3000 Progress: 3.0% Elapsed: 1:09:24 temperature: 1.0 ada_p: No Discriminator_loss: 6.47786 Generator_loss: 3.99502 
[INFO] 2021-01-01 10:47:08 > Step:    3100 Progress: 3.1% Elapsed: 1:11:40 temperature: 1.0 ada_p: No Discriminator_loss: 6.73978 Generator_loss: 3.74886 
[INFO] 2021-01-01 10:49:24 > Step:    3200 Progress: 3.2% Elapsed: 1:13:56 temperature: 1.0 ada_p: No Discriminator_loss: 6.75835 Generator_loss: 5.18551 
[INFO] 2021-01-01 10:51:41 > Step:    3300 Progress: 3.3% Elapsed: 1:16:13 temperature: 1.0 ada_p: No Discriminator_loss: 6.59692 Generator_loss: 5.04412 
[INFO] 2021-01-01 10:53:57 > Step:    3400 Progress: 3.4% Elapsed: 1:18:29 temperature: 1.0 ada_p: No Discriminator_loss: 6.33465 Generator_loss: 3.98533 
[INFO] 2021-01-01 10:56:13 > Step:    3500 Progress: 3.5% Elapsed: 1:20:45 temperature: 1.0 ada_p: No Discriminator_loss: 6.48619 Generator_loss: 5.53686 
[INFO] 2021-01-01 10:58:30 > Step:    3600 Progress: 3.6% Elapsed: 1:23:02 temperature: 1.0 ada_p: No Discriminator_loss: 6.51452 Generator_loss: 5.71876 
[INFO] 2021-01-01 11:00:46 > Step:    3700 Progress: 3.7% Elapsed: 1:25:18 temperature: 1.0 ada_p: No Discriminator_loss: 6.51488 Generator_loss: 4.51335 
[INFO] 2021-01-01 11:03:03 > Step:    3800 Progress: 3.8% Elapsed: 1:27:35 temperature: 1.0 ada_p: No Discriminator_loss: 6.59746 Generator_loss: 4.21529 
[INFO] 2021-01-01 11:05:20 > Step:    3900 Progress: 3.9% Elapsed: 1:29:52 temperature: 1.0 ada_p: No Discriminator_loss: 6.58579 Generator_loss: 5.06898 
[INFO] 2021-01-01 11:07:37 > Step:    4000 Progress: 4.0% Elapsed: 1:32:09 temperature: 1.0 ada_p: No Discriminator_loss: 6.56108 Generator_loss: 5.46277 
[INFO] 2021-01-01 11:07:37 > Start Evaluation (4000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 11:07:37 > Calculating FID Score....
[INFO] 2021-01-01 11:07:53 > Calculating Inception Score....
[INFO] 2021-01-01 11:07:59 > Calculate F_beta Score....
[INFO] 2021-01-01 11:08:20 > Calculate Accuracies....
[INFO] 2021-01-01 11:08:24 > Calculate Accuracies....
[INFO] 2021-01-01 11:08:25 > F_8 score (Step: 4000, Using valid images): 0.51320472379572
[INFO] 2021-01-01 11:08:25 > F_1/8 score (Step: 4000, Using valid images): 0.7576222852058131
[INFO] 2021-01-01 11:08:25 > FID score (Step: 4000, Using valid moments): 73.43976731106966
[INFO] 2021-01-01 11:08:25 > Inception score (Step: 4000, 10000 generated images): 7.085235118865967
[INFO] 2021-01-01 11:08:25 > Best FID score (Step: 4000, Using valid moments): 73.43976731106966
[INFO] 2021-01-01 11:08:39 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 11:10:56 > Step:    4100 Progress: 4.1% Elapsed: 1:35:28 temperature: 1.0 ada_p: No Discriminator_loss: 6.64109 Generator_loss: 5.59561 
[INFO] 2021-01-01 11:13:12 > Step:    4200 Progress: 4.2% Elapsed: 1:37:45 temperature: 1.0 ada_p: No Discriminator_loss: 6.48453 Generator_loss: 4.56393 
[INFO] 2021-01-01 11:15:29 > Step:    4300 Progress: 4.3% Elapsed: 1:40:01 temperature: 1.0 ada_p: No Discriminator_loss: 6.53353 Generator_loss: 5.58297 
[INFO] 2021-01-01 11:17:46 > Step:    4400 Progress: 4.4% Elapsed: 1:42:18 temperature: 1.0 ada_p: No Discriminator_loss: 6.35343 Generator_loss: 3.87091 
[INFO] 2021-01-01 11:20:02 > Step:    4500 Progress: 4.5% Elapsed: 1:44:35 temperature: 1.0 ada_p: No Discriminator_loss: 6.39878 Generator_loss: 4.05373 
[INFO] 2021-01-01 11:22:19 > Step:    4600 Progress: 4.6% Elapsed: 1:46:51 temperature: 1.0 ada_p: No Discriminator_loss: 6.41379 Generator_loss: 4.17262 
[INFO] 2021-01-01 11:24:35 > Step:    4700 Progress: 4.7% Elapsed: 1:49:07 temperature: 1.0 ada_p: No Discriminator_loss: 6.51766 Generator_loss: 4.32238 
[INFO] 2021-01-01 11:26:51 > Step:    4800 Progress: 4.8% Elapsed: 1:51:24 temperature: 1.0 ada_p: No Discriminator_loss: 6.27837 Generator_loss: 3.83737 
[INFO] 2021-01-01 11:29:09 > Step:    4900 Progress: 4.9% Elapsed: 1:53:41 temperature: 1.0 ada_p: No Discriminator_loss: 6.80063 Generator_loss: 5.20208 
[INFO] 2021-01-01 11:31:25 > Step:    5000 Progress: 5.0% Elapsed: 1:55:57 temperature: 1.0 ada_p: No Discriminator_loss: 6.40695 Generator_loss: 5.04247 
[INFO] 2021-01-01 11:33:43 > Step:    5100 Progress: 5.1% Elapsed: 1:58:15 temperature: 1.0 ada_p: No Discriminator_loss: 6.50502 Generator_loss: 4.89756 
[INFO] 2021-01-01 11:35:59 > Step:    5200 Progress: 5.2% Elapsed: 2:00:32 temperature: 1.0 ada_p: No Discriminator_loss: 6.42728 Generator_loss: 4.99439 
[INFO] 2021-01-01 11:38:16 > Step:    5300 Progress: 5.3% Elapsed: 2:02:48 temperature: 1.0 ada_p: No Discriminator_loss: 6.76073 Generator_loss: 4.9632 
[INFO] 2021-01-01 11:40:33 > Step:    5400 Progress: 5.4% Elapsed: 2:05:05 temperature: 1.0 ada_p: No Discriminator_loss: 6.61933 Generator_loss: 4.61746 
[INFO] 2021-01-01 11:42:49 > Step:    5500 Progress: 5.5% Elapsed: 2:07:22 temperature: 1.0 ada_p: No Discriminator_loss: 6.40398 Generator_loss: 4.541 
[INFO] 2021-01-01 11:45:06 > Step:    5600 Progress: 5.6% Elapsed: 2:09:38 temperature: 1.0 ada_p: No Discriminator_loss: 6.69288 Generator_loss: 5.15674 
[INFO] 2021-01-01 11:47:23 > Step:    5700 Progress: 5.7% Elapsed: 2:11:55 temperature: 1.0 ada_p: No Discriminator_loss: 6.25219 Generator_loss: 5.24652 
[INFO] 2021-01-01 11:49:40 > Step:    5800 Progress: 5.8% Elapsed: 2:14:12 temperature: 1.0 ada_p: No Discriminator_loss: 6.60878 Generator_loss: 5.59432 
[INFO] 2021-01-01 11:51:56 > Step:    5900 Progress: 5.9% Elapsed: 2:16:28 temperature: 1.0 ada_p: No Discriminator_loss: 6.70304 Generator_loss: 5.39626 
[INFO] 2021-01-01 11:54:12 > Step:    6000 Progress: 6.0% Elapsed: 2:18:44 temperature: 1.0 ada_p: No Discriminator_loss: 6.42754 Generator_loss: 3.69781 
[INFO] 2021-01-01 11:54:12 > Start Evaluation (6000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 11:54:12 > Calculating FID Score....
[INFO] 2021-01-01 11:54:28 > Calculating Inception Score....
[INFO] 2021-01-01 11:54:34 > Calculate F_beta Score....
[INFO] 2021-01-01 11:54:55 > Calculate Accuracies....
[INFO] 2021-01-01 11:54:58 > Calculate Accuracies....
[INFO] 2021-01-01 11:55:00 > F_8 score (Step: 6000, Using valid images): 0.5833623606374658
[INFO] 2021-01-01 11:55:00 > F_1/8 score (Step: 6000, Using valid images): 0.8483811853560325
[INFO] 2021-01-01 11:55:00 > FID score (Step: 6000, Using valid moments): 60.8470606797805
[INFO] 2021-01-01 11:55:00 > Inception score (Step: 6000, 10000 generated images): 8.025978088378906
[INFO] 2021-01-01 11:55:00 > Best FID score (Step: 6000, Using valid moments): 60.8470606797805
[INFO] 2021-01-01 11:55:14 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 11:57:30 > Step:    6100 Progress: 6.1% Elapsed: 2:22:02 temperature: 1.0 ada_p: No Discriminator_loss: 6.57112 Generator_loss: 3.94788 
[INFO] 2021-01-01 11:59:46 > Step:    6200 Progress: 6.2% Elapsed: 2:24:18 temperature: 1.0 ada_p: No Discriminator_loss: 6.27351 Generator_loss: 5.63885 
[INFO] 2021-01-01 12:02:02 > Step:    6300 Progress: 6.3% Elapsed: 2:26:35 temperature: 1.0 ada_p: No Discriminator_loss: 6.63643 Generator_loss: 4.77079 
[INFO] 2021-01-01 12:04:19 > Step:    6400 Progress: 6.4% Elapsed: 2:28:51 temperature: 1.0 ada_p: No Discriminator_loss: 6.27977 Generator_loss: 5.53622 
[INFO] 2021-01-01 12:06:37 > Step:    6500 Progress: 6.5% Elapsed: 2:31:09 temperature: 1.0 ada_p: No Discriminator_loss: 6.38979 Generator_loss: 3.78355 
[INFO] 2021-01-01 12:08:53 > Step:    6600 Progress: 6.6% Elapsed: 2:33:25 temperature: 1.0 ada_p: No Discriminator_loss: 6.41427 Generator_loss: 4.30248 
[INFO] 2021-01-01 12:11:10 > Step:    6700 Progress: 6.7% Elapsed: 2:35:42 temperature: 1.0 ada_p: No Discriminator_loss: 6.40189 Generator_loss: 5.43417 
[INFO] 2021-01-01 12:13:27 > Step:    6800 Progress: 6.8% Elapsed: 2:37:59 temperature: 1.0 ada_p: No Discriminator_loss: 6.38011 Generator_loss: 5.60368 
[INFO] 2021-01-01 12:15:43 > Step:    6900 Progress: 6.9% Elapsed: 2:40:16 temperature: 1.0 ada_p: No Discriminator_loss: 6.30859 Generator_loss: 4.18083 
[INFO] 2021-01-01 12:17:59 > Step:    7000 Progress: 7.0% Elapsed: 2:42:32 temperature: 1.0 ada_p: No Discriminator_loss: 6.27736 Generator_loss: 5.41653 
[INFO] 2021-01-01 12:20:16 > Step:    7100 Progress: 7.1% Elapsed: 2:44:49 temperature: 1.0 ada_p: No Discriminator_loss: 6.30874 Generator_loss: 4.42936 
[INFO] 2021-01-01 12:22:34 > Step:    7200 Progress: 7.2% Elapsed: 2:47:06 temperature: 1.0 ada_p: No Discriminator_loss: 6.31569 Generator_loss: 4.52828 
[INFO] 2021-01-01 12:24:50 > Step:    7300 Progress: 7.3% Elapsed: 2:49:22 temperature: 1.0 ada_p: No Discriminator_loss: 6.74801 Generator_loss: 4.88963 
[INFO] 2021-01-01 12:27:06 > Step:    7400 Progress: 7.4% Elapsed: 2:51:39 temperature: 1.0 ada_p: No Discriminator_loss: 6.1915 Generator_loss: 4.78569 
[INFO] 2021-01-01 12:29:23 > Step:    7500 Progress: 7.5% Elapsed: 2:53:55 temperature: 1.0 ada_p: No Discriminator_loss: 6.19195 Generator_loss: 5.18383 
[INFO] 2021-01-01 12:31:39 > Step:    7600 Progress: 7.6% Elapsed: 2:56:11 temperature: 1.0 ada_p: No Discriminator_loss: 6.35816 Generator_loss: 4.33287 
[INFO] 2021-01-01 12:33:56 > Step:    7700 Progress: 7.7% Elapsed: 2:58:28 temperature: 1.0 ada_p: No Discriminator_loss: 6.43522 Generator_loss: 4.91609 
[INFO] 2021-01-01 12:36:12 > Step:    7800 Progress: 7.8% Elapsed: 3:00:44 temperature: 1.0 ada_p: No Discriminator_loss: 6.49126 Generator_loss: 5.31759 
[INFO] 2021-01-01 12:38:29 > Step:    7900 Progress: 7.9% Elapsed: 3:03:01 temperature: 1.0 ada_p: No Discriminator_loss: 6.06669 Generator_loss: 5.03698 
[INFO] 2021-01-01 12:40:45 > Step:    8000 Progress: 8.0% Elapsed: 3:05:17 temperature: 1.0 ada_p: No Discriminator_loss: 6.38306 Generator_loss: 5.05105 
[INFO] 2021-01-01 12:40:45 > Start Evaluation (8000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 12:40:45 > Calculating FID Score....
[INFO] 2021-01-01 12:41:02 > Calculating Inception Score....
[INFO] 2021-01-01 12:41:07 > Calculate F_beta Score....
[INFO] 2021-01-01 12:41:29 > Calculate Accuracies....
[INFO] 2021-01-01 12:41:33 > Calculate Accuracies....
[INFO] 2021-01-01 12:41:34 > F_8 score (Step: 8000, Using valid images): 0.6459565811046384
[INFO] 2021-01-01 12:41:34 > F_1/8 score (Step: 8000, Using valid images): 0.9128243888098079
[INFO] 2021-01-01 12:41:34 > FID score (Step: 8000, Using valid moments): 52.63575923277608
[INFO] 2021-01-01 12:41:34 > Inception score (Step: 8000, 10000 generated images): 8.968579292297363
[INFO] 2021-01-01 12:41:34 > Best FID score (Step: 8000, Using valid moments): 52.63575923277608
[INFO] 2021-01-01 12:41:48 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 12:44:05 > Step:    8100 Progress: 8.1% Elapsed: 3:08:37 temperature: 1.0 ada_p: No Discriminator_loss: 6.20081 Generator_loss: 5.87635 
[INFO] 2021-01-01 12:46:22 > Step:    8200 Progress: 8.2% Elapsed: 3:10:55 temperature: 1.0 ada_p: No Discriminator_loss: 6.60857 Generator_loss: 5.13202 
[INFO] 2021-01-01 12:48:39 > Step:    8300 Progress: 8.3% Elapsed: 3:13:11 temperature: 1.0 ada_p: No Discriminator_loss: 6.2106 Generator_loss: 5.39115 
[INFO] 2021-01-01 12:50:55 > Step:    8400 Progress: 8.4% Elapsed: 3:15:27 temperature: 1.0 ada_p: No Discriminator_loss: 6.50728 Generator_loss: 5.15617 
[INFO] 2021-01-01 12:53:12 > Step:    8500 Progress: 8.5% Elapsed: 3:17:45 temperature: 1.0 ada_p: No Discriminator_loss: 6.11819 Generator_loss: 5.22361 
[INFO] 2021-01-01 12:55:29 > Step:    8600 Progress: 8.6% Elapsed: 3:20:01 temperature: 1.0 ada_p: No Discriminator_loss: 6.29546 Generator_loss: 5.71825 
[INFO] 2021-01-01 12:57:44 > Step:    8700 Progress: 8.7% Elapsed: 3:22:16 temperature: 1.0 ada_p: No Discriminator_loss: 6.14748 Generator_loss: 4.92935 
[INFO] 2021-01-01 13:00:00 > Step:    8800 Progress: 8.8% Elapsed: 3:24:33 temperature: 1.0 ada_p: No Discriminator_loss: 6.23931 Generator_loss: 5.237 
[INFO] 2021-01-01 13:02:17 > Step:    8900 Progress: 8.9% Elapsed: 3:26:49 temperature: 1.0 ada_p: No Discriminator_loss: 6.1677 Generator_loss: 5.33762 
[INFO] 2021-01-01 13:04:34 > Step:    9000 Progress: 9.0% Elapsed: 3:29:06 temperature: 1.0 ada_p: No Discriminator_loss: 5.88382 Generator_loss: 4.66716 
[INFO] 2021-01-01 13:06:51 > Step:    9100 Progress: 9.1% Elapsed: 3:31:23 temperature: 1.0 ada_p: No Discriminator_loss: 6.16067 Generator_loss: 4.76934 
[INFO] 2021-01-01 13:09:08 > Step:    9200 Progress: 9.2% Elapsed: 3:33:40 temperature: 1.0 ada_p: No Discriminator_loss: 6.65631 Generator_loss: 5.02823 
[INFO] 2021-01-01 13:11:25 > Step:    9300 Progress: 9.3% Elapsed: 3:35:57 temperature: 1.0 ada_p: No Discriminator_loss: 6.36621 Generator_loss: 4.43252 
[INFO] 2021-01-01 13:13:42 > Step:    9400 Progress: 9.4% Elapsed: 3:38:15 temperature: 1.0 ada_p: No Discriminator_loss: 6.39062 Generator_loss: 4.07682 
[INFO] 2021-01-01 13:16:00 > Step:    9500 Progress: 9.5% Elapsed: 3:40:32 temperature: 1.0 ada_p: No Discriminator_loss: 6.40696 Generator_loss: 3.82748 
[INFO] 2021-01-01 13:18:16 > Step:    9600 Progress: 9.6% Elapsed: 3:42:49 temperature: 1.0 ada_p: No Discriminator_loss: 6.10654 Generator_loss: 4.26565 
[INFO] 2021-01-01 13:20:33 > Step:    9700 Progress: 9.7% Elapsed: 3:45:05 temperature: 1.0 ada_p: No Discriminator_loss: 6.35429 Generator_loss: 3.64499 
[INFO] 2021-01-01 13:22:52 > Step:    9800 Progress: 9.8% Elapsed: 3:47:24 temperature: 1.0 ada_p: No Discriminator_loss: 6.60909 Generator_loss: 4.65066 
[INFO] 2021-01-01 13:25:09 > Step:    9900 Progress: 9.9% Elapsed: 3:49:41 temperature: 1.0 ada_p: No Discriminator_loss: 6.50489 Generator_loss: 4.96008 
[INFO] 2021-01-01 13:27:25 > Step:   10000 Progress: 10.0% Elapsed: 3:51:58 temperature: 1.0 ada_p: No Discriminator_loss: 6.10317 Generator_loss: 5.17858 
[INFO] 2021-01-01 13:27:25 > Start Evaluation (10000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 13:27:25 > Calculating FID Score....
[INFO] 2021-01-01 13:27:41 > Calculating Inception Score....
[INFO] 2021-01-01 13:27:47 > Calculate F_beta Score....
[INFO] 2021-01-01 13:28:08 > Calculate Accuracies....
[INFO] 2021-01-01 13:28:11 > Calculate Accuracies....
[INFO] 2021-01-01 13:28:13 > F_8 score (Step: 10000, Using valid images): 0.6885188439677732
[INFO] 2021-01-01 13:28:13 > F_1/8 score (Step: 10000, Using valid images): 0.9275836434791895
[INFO] 2021-01-01 13:28:13 > FID score (Step: 10000, Using valid moments): 49.10957160770988
[INFO] 2021-01-01 13:28:13 > Inception score (Step: 10000, 10000 generated images): 9.528701782226562
[INFO] 2021-01-01 13:28:13 > Best FID score (Step: 10000, Using valid moments): 49.10957160770988
[INFO] 2021-01-01 13:28:27 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 13:30:43 > Step:   10100 Progress: 10.1% Elapsed: 3:55:15 temperature: 1.0 ada_p: No Discriminator_loss: 6.5958 Generator_loss: 4.4784 
[INFO] 2021-01-01 13:32:59 > Step:   10200 Progress: 10.2% Elapsed: 3:57:31 temperature: 1.0 ada_p: No Discriminator_loss: 6.38317 Generator_loss: 5.20341 
[INFO] 2021-01-01 13:35:16 > Step:   10300 Progress: 10.3% Elapsed: 3:59:49 temperature: 1.0 ada_p: No Discriminator_loss: 6.23695 Generator_loss: 5.65432 
[INFO] 2021-01-01 13:37:34 > Step:   10400 Progress: 10.4% Elapsed: 4:02:06 temperature: 1.0 ada_p: No Discriminator_loss: 5.95111 Generator_loss: 5.09487 
[INFO] 2021-01-01 13:39:51 > Step:   10500 Progress: 10.5% Elapsed: 4:04:24 temperature: 1.0 ada_p: No Discriminator_loss: 6.57968 Generator_loss: 5.11542 
[INFO] 2021-01-01 13:42:08 > Step:   10600 Progress: 10.6% Elapsed: 4:06:40 temperature: 1.0 ada_p: No Discriminator_loss: 6.04091 Generator_loss: 4.85806 
[INFO] 2021-01-01 13:44:25 > Step:   10700 Progress: 10.7% Elapsed: 4:08:57 temperature: 1.0 ada_p: No Discriminator_loss: 6.00738 Generator_loss: 5.03038 
[INFO] 2021-01-01 13:46:42 > Step:   10800 Progress: 10.8% Elapsed: 4:11:14 temperature: 1.0 ada_p: No Discriminator_loss: 6.01304 Generator_loss: 3.9229 
[INFO] 2021-01-01 13:48:59 > Step:   10900 Progress: 10.9% Elapsed: 4:13:31 temperature: 1.0 ada_p: No Discriminator_loss: 6.09314 Generator_loss: 5.59555 
[INFO] 2021-01-01 13:51:17 > Step:   11000 Progress: 11.0% Elapsed: 4:15:49 temperature: 1.0 ada_p: No Discriminator_loss: 5.96831 Generator_loss: 5.39706 
[INFO] 2021-01-01 13:53:33 > Step:   11100 Progress: 11.1% Elapsed: 4:18:06 temperature: 1.0 ada_p: No Discriminator_loss: 5.84013 Generator_loss: 5.27668 
[INFO] 2021-01-01 13:55:50 > Step:   11200 Progress: 11.2% Elapsed: 4:20:22 temperature: 1.0 ada_p: No Discriminator_loss: 6.06021 Generator_loss: 4.9029 
[INFO] 2021-01-01 13:58:05 > Step:   11300 Progress: 11.3% Elapsed: 4:22:37 temperature: 1.0 ada_p: No Discriminator_loss: 6.51446 Generator_loss: 5.05898 
[INFO] 2021-01-01 14:00:21 > Step:   11400 Progress: 11.4% Elapsed: 4:24:53 temperature: 1.0 ada_p: No Discriminator_loss: 6.09215 Generator_loss: 5.17363 
[INFO] 2021-01-01 14:02:39 > Step:   11500 Progress: 11.5% Elapsed: 4:27:11 temperature: 1.0 ada_p: No Discriminator_loss: 6.3478 Generator_loss: 5.42412 
[INFO] 2021-01-01 14:04:56 > Step:   11600 Progress: 11.6% Elapsed: 4:29:28 temperature: 1.0 ada_p: No Discriminator_loss: 6.05152 Generator_loss: 4.55987 
[INFO] 2021-01-01 14:07:13 > Step:   11700 Progress: 11.7% Elapsed: 4:31:45 temperature: 1.0 ada_p: No Discriminator_loss: 6.26308 Generator_loss: 4.62771 
[INFO] 2021-01-01 14:09:30 > Step:   11800 Progress: 11.8% Elapsed: 4:34:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.91338 Generator_loss: 3.85858 
[INFO] 2021-01-01 14:11:46 > Step:   11900 Progress: 11.9% Elapsed: 4:36:19 temperature: 1.0 ada_p: No Discriminator_loss: 6.57071 Generator_loss: 5.00736 
[INFO] 2021-01-01 14:14:03 > Step:   12000 Progress: 12.0% Elapsed: 4:38:35 temperature: 1.0 ada_p: No Discriminator_loss: 5.91862 Generator_loss: 4.02148 
[INFO] 2021-01-01 14:14:03 > Start Evaluation (12000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 14:14:03 > Calculating FID Score....
[INFO] 2021-01-01 14:14:19 > Calculating Inception Score....
[INFO] 2021-01-01 14:14:24 > Calculate F_beta Score....
[INFO] 2021-01-01 14:14:45 > Calculate Accuracies....
[INFO] 2021-01-01 14:14:48 > Calculate Accuracies....
[INFO] 2021-01-01 14:14:50 > F_8 score (Step: 12000, Using valid images): 0.7229076218054045
[INFO] 2021-01-01 14:14:50 > F_1/8 score (Step: 12000, Using valid images): 0.9012564663037455
[INFO] 2021-01-01 14:14:50 > FID score (Step: 12000, Using valid moments): 47.478455175150486
[INFO] 2021-01-01 14:14:50 > Inception score (Step: 12000, 10000 generated images): 9.756738662719727
[INFO] 2021-01-01 14:14:50 > Best FID score (Step: 12000, Using valid moments): 47.478455175150486
[INFO] 2021-01-01 14:15:04 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 14:17:21 > Step:   12100 Progress: 12.1% Elapsed: 4:41:53 temperature: 1.0 ada_p: No Discriminator_loss: 6.2031 Generator_loss: 5.25456 
[INFO] 2021-01-01 14:19:38 > Step:   12200 Progress: 12.2% Elapsed: 4:44:10 temperature: 1.0 ada_p: No Discriminator_loss: 5.97205 Generator_loss: 5.23414 
[INFO] 2021-01-01 14:21:54 > Step:   12300 Progress: 12.3% Elapsed: 4:46:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.84731 Generator_loss: 4.49589 
[INFO] 2021-01-01 14:24:10 > Step:   12400 Progress: 12.4% Elapsed: 4:48:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.79219 Generator_loss: 4.54244 
[INFO] 2021-01-01 14:26:27 > Step:   12500 Progress: 12.5% Elapsed: 4:51:00 temperature: 1.0 ada_p: No Discriminator_loss: 6.05515 Generator_loss: 4.79662 
[INFO] 2021-01-01 14:28:44 > Step:   12600 Progress: 12.6% Elapsed: 4:53:16 temperature: 1.0 ada_p: No Discriminator_loss: 6.10486 Generator_loss: 5.33187 
[INFO] 2021-01-01 14:31:01 > Step:   12700 Progress: 12.7% Elapsed: 4:55:33 temperature: 1.0 ada_p: No Discriminator_loss: 6.23172 Generator_loss: 5.81294 
[INFO] 2021-01-01 14:33:18 > Step:   12800 Progress: 12.8% Elapsed: 4:57:51 temperature: 1.0 ada_p: No Discriminator_loss: 6.32932 Generator_loss: 5.67128 
[INFO] 2021-01-01 14:35:35 > Step:   12900 Progress: 12.9% Elapsed: 5:00:08 temperature: 1.0 ada_p: No Discriminator_loss: 6.30163 Generator_loss: 4.68881 
[INFO] 2021-01-01 14:37:54 > Step:   13000 Progress: 13.0% Elapsed: 5:02:26 temperature: 1.0 ada_p: No Discriminator_loss: 6.4985 Generator_loss: 4.87781 
[INFO] 2021-01-01 14:40:11 > Step:   13100 Progress: 13.1% Elapsed: 5:04:44 temperature: 1.0 ada_p: No Discriminator_loss: 5.86082 Generator_loss: 5.66251 
[INFO] 2021-01-01 14:42:29 > Step:   13200 Progress: 13.2% Elapsed: 5:07:01 temperature: 1.0 ada_p: No Discriminator_loss: 6.21327 Generator_loss: 3.73781 
[INFO] 2021-01-01 14:44:45 > Step:   13300 Progress: 13.3% Elapsed: 5:09:18 temperature: 1.0 ada_p: No Discriminator_loss: 6.34649 Generator_loss: 5.36393 
[INFO] 2021-01-01 14:47:02 > Step:   13400 Progress: 13.4% Elapsed: 5:11:34 temperature: 1.0 ada_p: No Discriminator_loss: 6.26342 Generator_loss: 5.25501 
[INFO] 2021-01-01 14:49:18 > Step:   13500 Progress: 13.5% Elapsed: 5:13:50 temperature: 1.0 ada_p: No Discriminator_loss: 6.07645 Generator_loss: 4.58438 
[INFO] 2021-01-01 14:51:34 > Step:   13600 Progress: 13.6% Elapsed: 5:16:06 temperature: 1.0 ada_p: No Discriminator_loss: 6.00416 Generator_loss: 4.83911 
[INFO] 2021-01-01 14:53:50 > Step:   13700 Progress: 13.7% Elapsed: 5:18:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.90803 Generator_loss: 3.84522 
[INFO] 2021-01-01 14:56:07 > Step:   13800 Progress: 13.8% Elapsed: 5:20:39 temperature: 1.0 ada_p: No Discriminator_loss: 6.01666 Generator_loss: 5.01075 
[INFO] 2021-01-01 14:58:22 > Step:   13900 Progress: 13.9% Elapsed: 5:22:54 temperature: 1.0 ada_p: No Discriminator_loss: 5.93417 Generator_loss: 3.96653 
[INFO] 2021-01-01 15:00:39 > Step:   14000 Progress: 14.0% Elapsed: 5:25:11 temperature: 1.0 ada_p: No Discriminator_loss: 5.99109 Generator_loss: 5.20713 
[INFO] 2021-01-01 15:00:39 > Start Evaluation (14000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 15:00:39 > Calculating FID Score....
[INFO] 2021-01-01 15:00:55 > Calculating Inception Score....
[INFO] 2021-01-01 15:01:00 > Calculate F_beta Score....
[INFO] 2021-01-01 15:01:22 > Calculate Accuracies....
[INFO] 2021-01-01 15:01:26 > Calculate Accuracies....
[INFO] 2021-01-01 15:01:28 > F_8 score (Step: 14000, Using valid images): 0.7450075066060069
[INFO] 2021-01-01 15:01:28 > F_1/8 score (Step: 14000, Using valid images): 0.9407943270188441
[INFO] 2021-01-01 15:01:28 > FID score (Step: 14000, Using valid moments): 42.692024713510875
[INFO] 2021-01-01 15:01:28 > Inception score (Step: 14000, 10000 generated images): 10.545735359191895
[INFO] 2021-01-01 15:01:28 > Best FID score (Step: 14000, Using valid moments): 42.692024713510875
[INFO] 2021-01-01 15:01:41 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 15:03:58 > Step:   14100 Progress: 14.1% Elapsed: 5:28:30 temperature: 1.0 ada_p: No Discriminator_loss: 5.98846 Generator_loss: 5.50755 
[INFO] 2021-01-01 15:06:15 > Step:   14200 Progress: 14.2% Elapsed: 5:30:47 temperature: 1.0 ada_p: No Discriminator_loss: 6.10983 Generator_loss: 4.51974 
[INFO] 2021-01-01 15:08:32 > Step:   14300 Progress: 14.3% Elapsed: 5:33:04 temperature: 1.0 ada_p: No Discriminator_loss: 6.13961 Generator_loss: 4.8083 
[INFO] 2021-01-01 15:10:48 > Step:   14400 Progress: 14.4% Elapsed: 5:35:20 temperature: 1.0 ada_p: No Discriminator_loss: 6.08416 Generator_loss: 4.17935 
[INFO] 2021-01-01 15:13:05 > Step:   14500 Progress: 14.5% Elapsed: 5:37:37 temperature: 1.0 ada_p: No Discriminator_loss: 6.06445 Generator_loss: 5.46053 
[INFO] 2021-01-01 15:15:22 > Step:   14600 Progress: 14.6% Elapsed: 5:39:54 temperature: 1.0 ada_p: No Discriminator_loss: 5.94825 Generator_loss: 5.84131 
[INFO] 2021-01-01 15:17:39 > Step:   14700 Progress: 14.7% Elapsed: 5:42:11 temperature: 1.0 ada_p: No Discriminator_loss: 5.9041 Generator_loss: 5.63333 
[INFO] 2021-01-01 15:19:56 > Step:   14800 Progress: 14.8% Elapsed: 5:44:28 temperature: 1.0 ada_p: No Discriminator_loss: 5.83913 Generator_loss: 4.66377 
[INFO] 2021-01-01 15:22:12 > Step:   14900 Progress: 14.9% Elapsed: 5:46:44 temperature: 1.0 ada_p: No Discriminator_loss: 5.96394 Generator_loss: 5.01838 
[INFO] 2021-01-01 15:24:29 > Step:   15000 Progress: 15.0% Elapsed: 5:49:01 temperature: 1.0 ada_p: No Discriminator_loss: 5.7982 Generator_loss: 5.84709 
[INFO] 2021-01-01 15:26:45 > Step:   15100 Progress: 15.1% Elapsed: 5:51:17 temperature: 1.0 ada_p: No Discriminator_loss: 6.18473 Generator_loss: 5.19601 
[INFO] 2021-01-01 15:29:01 > Step:   15200 Progress: 15.2% Elapsed: 5:53:34 temperature: 1.0 ada_p: No Discriminator_loss: 5.94489 Generator_loss: 4.74132 
[INFO] 2021-01-01 15:31:18 > Step:   15300 Progress: 15.3% Elapsed: 5:55:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.77379 Generator_loss: 5.73603 
[INFO] 2021-01-01 15:33:35 > Step:   15400 Progress: 15.4% Elapsed: 5:58:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.80096 Generator_loss: 4.36747 
[INFO] 2021-01-01 15:35:51 > Step:   15500 Progress: 15.5% Elapsed: 6:00:23 temperature: 1.0 ada_p: No Discriminator_loss: 6.22182 Generator_loss: 3.62431 
[INFO] 2021-01-01 15:38:08 > Step:   15600 Progress: 15.6% Elapsed: 6:02:40 temperature: 1.0 ada_p: No Discriminator_loss: 5.9168 Generator_loss: 3.74533 
[INFO] 2021-01-01 15:40:24 > Step:   15700 Progress: 15.7% Elapsed: 6:04:57 temperature: 1.0 ada_p: No Discriminator_loss: 5.74473 Generator_loss: 4.53042 
[INFO] 2021-01-01 15:42:42 > Step:   15800 Progress: 15.8% Elapsed: 6:07:14 temperature: 1.0 ada_p: No Discriminator_loss: 6.02649 Generator_loss: 5.82689 
[INFO] 2021-01-01 15:44:59 > Step:   15900 Progress: 15.9% Elapsed: 6:09:31 temperature: 1.0 ada_p: No Discriminator_loss: 6.04806 Generator_loss: 5.22253 
[INFO] 2021-01-01 15:47:15 > Step:   16000 Progress: 16.0% Elapsed: 6:11:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.81116 Generator_loss: 5.72261 
[INFO] 2021-01-01 15:47:15 > Start Evaluation (16000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 15:47:15 > Calculating FID Score....
[INFO] 2021-01-01 15:47:32 > Calculating Inception Score....
[INFO] 2021-01-01 15:47:38 > Calculate F_beta Score....
[INFO] 2021-01-01 15:47:59 > Calculate Accuracies....
[INFO] 2021-01-01 15:48:03 > Calculate Accuracies....
[INFO] 2021-01-01 15:48:04 > F_8 score (Step: 16000, Using valid images): 0.7507036100382264
[INFO] 2021-01-01 15:48:04 > F_1/8 score (Step: 16000, Using valid images): 0.9193393149011017
[INFO] 2021-01-01 15:48:04 > FID score (Step: 16000, Using valid moments): 43.16903184885564
[INFO] 2021-01-01 15:48:04 > Inception score (Step: 16000, 10000 generated images): 10.579740524291992
[INFO] 2021-01-01 15:48:04 > Best FID score (Step: 14000, Using valid moments): 42.692024713510875
[INFO] 2021-01-01 15:48:11 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 15:50:28 > Step:   16100 Progress: 16.1% Elapsed: 6:15:01 temperature: 1.0 ada_p: No Discriminator_loss: 6.02492 Generator_loss: 5.99599 
[INFO] 2021-01-01 15:52:46 > Step:   16200 Progress: 16.2% Elapsed: 6:17:18 temperature: 1.0 ada_p: No Discriminator_loss: 5.58036 Generator_loss: 5.07263 
[INFO] 2021-01-01 15:55:03 > Step:   16300 Progress: 16.3% Elapsed: 6:19:36 temperature: 1.0 ada_p: No Discriminator_loss: 6.21553 Generator_loss: 4.28454 
[INFO] 2021-01-01 15:57:21 > Step:   16400 Progress: 16.4% Elapsed: 6:21:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.87051 Generator_loss: 3.99225 
[INFO] 2021-01-01 15:59:37 > Step:   16500 Progress: 16.5% Elapsed: 6:24:09 temperature: 1.0 ada_p: No Discriminator_loss: 6.33164 Generator_loss: 4.11688 
[INFO] 2021-01-01 16:01:54 > Step:   16600 Progress: 16.6% Elapsed: 6:26:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.81623 Generator_loss: 5.49532 
[INFO] 2021-01-01 16:04:10 > Step:   16700 Progress: 16.7% Elapsed: 6:28:42 temperature: 1.0 ada_p: No Discriminator_loss: 6.21676 Generator_loss: 5.14082 
[INFO] 2021-01-01 16:06:28 > Step:   16800 Progress: 16.8% Elapsed: 6:31:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.88153 Generator_loss: 5.14863 
[INFO] 2021-01-01 16:08:44 > Step:   16900 Progress: 16.9% Elapsed: 6:33:17 temperature: 1.0 ada_p: No Discriminator_loss: 5.78844 Generator_loss: 5.75492 
[INFO] 2021-01-01 16:11:01 > Step:   17000 Progress: 17.0% Elapsed: 6:35:34 temperature: 1.0 ada_p: No Discriminator_loss: 6.13582 Generator_loss: 4.10204 
[INFO] 2021-01-01 16:13:19 > Step:   17100 Progress: 17.1% Elapsed: 6:37:51 temperature: 1.0 ada_p: No Discriminator_loss: 5.64742 Generator_loss: 4.4705 
[INFO] 2021-01-01 16:15:37 > Step:   17200 Progress: 17.2% Elapsed: 6:40:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.6417 Generator_loss: 5.32109 
[INFO] 2021-01-01 16:17:53 > Step:   17300 Progress: 17.3% Elapsed: 6:42:25 temperature: 1.0 ada_p: No Discriminator_loss: 5.99919 Generator_loss: 4.12918 
[INFO] 2021-01-01 16:20:09 > Step:   17400 Progress: 17.4% Elapsed: 6:44:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.58983 Generator_loss: 4.38459 
[INFO] 2021-01-01 16:22:26 > Step:   17500 Progress: 17.5% Elapsed: 6:46:58 temperature: 1.0 ada_p: No Discriminator_loss: 5.92854 Generator_loss: 4.34755 
[INFO] 2021-01-01 16:24:42 > Step:   17600 Progress: 17.6% Elapsed: 6:49:14 temperature: 1.0 ada_p: No Discriminator_loss: 5.77425 Generator_loss: 4.25621 
[INFO] 2021-01-01 16:26:59 > Step:   17700 Progress: 17.7% Elapsed: 6:51:31 temperature: 1.0 ada_p: No Discriminator_loss: 5.72314 Generator_loss: 4.57869 
[INFO] 2021-01-01 16:29:15 > Step:   17800 Progress: 17.8% Elapsed: 6:53:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.64266 Generator_loss: 4.49148 
[INFO] 2021-01-01 16:31:31 > Step:   17900 Progress: 17.9% Elapsed: 6:56:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.80815 Generator_loss: 5.64055 
[INFO] 2021-01-01 16:33:48 > Step:   18000 Progress: 18.0% Elapsed: 6:58:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.60507 Generator_loss: 4.38571 
[INFO] 2021-01-01 16:33:48 > Start Evaluation (18000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 16:33:48 > Calculating FID Score....
[INFO] 2021-01-01 16:34:04 > Calculating Inception Score....
[INFO] 2021-01-01 16:34:10 > Calculate F_beta Score....
[INFO] 2021-01-01 16:34:32 > Calculate Accuracies....
[INFO] 2021-01-01 16:34:36 > Calculate Accuracies....
[INFO] 2021-01-01 16:34:41 > F_8 score (Step: 18000, Using valid images): 0.7754174387117335
[INFO] 2021-01-01 16:34:41 > F_1/8 score (Step: 18000, Using valid images): 0.9384471738710944
[INFO] 2021-01-01 16:34:41 > FID score (Step: 18000, Using valid moments): 41.67525722733831
[INFO] 2021-01-01 16:34:41 > Inception score (Step: 18000, 10000 generated images): 10.399096488952637
[INFO] 2021-01-01 16:34:41 > Best FID score (Step: 18000, Using valid moments): 41.67525722733831
[INFO] 2021-01-01 16:34:55 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 16:37:12 > Step:   18100 Progress: 18.1% Elapsed: 7:01:44 temperature: 1.0 ada_p: No Discriminator_loss: 5.86503 Generator_loss: 4.11616 
[INFO] 2021-01-01 16:39:28 > Step:   18200 Progress: 18.2% Elapsed: 7:04:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.89411 Generator_loss: 6.0014 
[INFO] 2021-01-01 16:41:45 > Step:   18300 Progress: 18.3% Elapsed: 7:06:17 temperature: 1.0 ada_p: No Discriminator_loss: 6.05138 Generator_loss: 4.16179 
[INFO] 2021-01-01 16:44:01 > Step:   18400 Progress: 18.4% Elapsed: 7:08:33 temperature: 1.0 ada_p: No Discriminator_loss: 5.56718 Generator_loss: 5.57817 
[INFO] 2021-01-01 16:46:18 > Step:   18500 Progress: 18.5% Elapsed: 7:10:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.55397 Generator_loss: 5.5257 
[INFO] 2021-01-01 16:48:35 > Step:   18600 Progress: 18.6% Elapsed: 7:13:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.57207 Generator_loss: 5.39595 
[INFO] 2021-01-01 16:50:51 > Step:   18700 Progress: 18.7% Elapsed: 7:15:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.71619 Generator_loss: 6.03368 
[INFO] 2021-01-01 16:53:08 > Step:   18800 Progress: 18.8% Elapsed: 7:17:40 temperature: 1.0 ada_p: No Discriminator_loss: 5.72113 Generator_loss: 5.71792 
[INFO] 2021-01-01 16:55:24 > Step:   18900 Progress: 18.9% Elapsed: 7:19:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.9509 Generator_loss: 5.61082 
[INFO] 2021-01-01 16:57:40 > Step:   19000 Progress: 19.0% Elapsed: 7:22:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.94117 Generator_loss: 5.8592 
[INFO] 2021-01-01 16:59:56 > Step:   19100 Progress: 19.1% Elapsed: 7:24:28 temperature: 1.0 ada_p: No Discriminator_loss: 6.01498 Generator_loss: 4.05626 
[INFO] 2021-01-01 17:02:13 > Step:   19200 Progress: 19.2% Elapsed: 7:26:45 temperature: 1.0 ada_p: No Discriminator_loss: 5.6893 Generator_loss: 4.39489 
[INFO] 2021-01-01 17:04:30 > Step:   19300 Progress: 19.3% Elapsed: 7:29:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.88366 Generator_loss: 6.08261 
[INFO] 2021-01-01 17:06:46 > Step:   19400 Progress: 19.4% Elapsed: 7:31:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.83831 Generator_loss: 4.48405 
[INFO] 2021-01-01 17:09:04 > Step:   19500 Progress: 19.5% Elapsed: 7:33:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.70305 Generator_loss: 3.94894 
[INFO] 2021-01-01 17:11:21 > Step:   19600 Progress: 19.6% Elapsed: 7:35:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.71806 Generator_loss: 4.89606 
[INFO] 2021-01-01 17:13:38 > Step:   19700 Progress: 19.7% Elapsed: 7:38:10 temperature: 1.0 ada_p: No Discriminator_loss: 5.59259 Generator_loss: 4.08048 
[INFO] 2021-01-01 17:15:55 > Step:   19800 Progress: 19.8% Elapsed: 7:40:27 temperature: 1.0 ada_p: No Discriminator_loss: 5.84001 Generator_loss: 4.07343 
[INFO] 2021-01-01 17:18:11 > Step:   19900 Progress: 19.9% Elapsed: 7:42:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.4725 Generator_loss: 4.37649 
[INFO] 2021-01-01 17:20:28 > Step:   20000 Progress: 20.0% Elapsed: 7:45:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.72036 Generator_loss: 4.64496 
[INFO] 2021-01-01 17:20:28 > Start Evaluation (20000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 17:20:28 > Calculating FID Score....
[INFO] 2021-01-01 17:20:44 > Calculating Inception Score....
[INFO] 2021-01-01 17:20:49 > Calculate F_beta Score....
[INFO] 2021-01-01 17:21:11 > Calculate Accuracies....
[INFO] 2021-01-01 17:21:14 > Calculate Accuracies....
[INFO] 2021-01-01 17:21:16 > F_8 score (Step: 20000, Using valid images): 0.7593047534102986
[INFO] 2021-01-01 17:21:16 > F_1/8 score (Step: 20000, Using valid images): 0.9332912487310007
[INFO] 2021-01-01 17:21:16 > FID score (Step: 20000, Using valid moments): 41.01450552562369
[INFO] 2021-01-01 17:21:16 > Inception score (Step: 20000, 10000 generated images): 10.56449031829834
[INFO] 2021-01-01 17:21:16 > Best FID score (Step: 20000, Using valid moments): 41.01450552562369
[INFO] 2021-01-01 17:21:30 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 17:23:46 > Step:   20100 Progress: 20.1% Elapsed: 7:48:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.57567 Generator_loss: 4.4222 
[INFO] 2021-01-01 17:26:03 > Step:   20200 Progress: 20.2% Elapsed: 7:50:35 temperature: 1.0 ada_p: No Discriminator_loss: 6.43968 Generator_loss: 5.17839 
[INFO] 2021-01-01 17:28:21 > Step:   20300 Progress: 20.3% Elapsed: 7:52:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.66265 Generator_loss: 5.6042 
[INFO] 2021-01-01 17:30:38 > Step:   20400 Progress: 20.4% Elapsed: 7:55:10 temperature: 1.0 ada_p: No Discriminator_loss: 5.47797 Generator_loss: 5.46196 
[INFO] 2021-01-01 17:32:54 > Step:   20500 Progress: 20.5% Elapsed: 7:57:27 temperature: 1.0 ada_p: No Discriminator_loss: 5.39807 Generator_loss: 4.93759 
[INFO] 2021-01-01 17:35:11 > Step:   20600 Progress: 20.6% Elapsed: 7:59:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.69986 Generator_loss: 4.84524 
[INFO] 2021-01-01 17:37:27 > Step:   20700 Progress: 20.7% Elapsed: 8:02:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.59035 Generator_loss: 4.42528 
[INFO] 2021-01-01 17:39:44 > Step:   20800 Progress: 20.8% Elapsed: 8:04:16 temperature: 1.0 ada_p: No Discriminator_loss: 5.64717 Generator_loss: 4.64292 
[INFO] 2021-01-01 17:42:01 > Step:   20900 Progress: 20.9% Elapsed: 8:06:33 temperature: 1.0 ada_p: No Discriminator_loss: 5.60815 Generator_loss: 5.76206 
[INFO] 2021-01-01 17:44:17 > Step:   21000 Progress: 21.0% Elapsed: 8:08:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.86128 Generator_loss: 5.56382 
[INFO] 2021-01-01 17:46:34 > Step:   21100 Progress: 21.1% Elapsed: 8:11:06 temperature: 1.0 ada_p: No Discriminator_loss: 5.74618 Generator_loss: 6.09171 
[INFO] 2021-01-01 17:48:52 > Step:   21200 Progress: 21.2% Elapsed: 8:13:24 temperature: 1.0 ada_p: No Discriminator_loss: 5.67156 Generator_loss: 5.75512 
[INFO] 2021-01-01 17:51:08 > Step:   21300 Progress: 21.3% Elapsed: 8:15:40 temperature: 1.0 ada_p: No Discriminator_loss: 6.26275 Generator_loss: 5.42005 
[INFO] 2021-01-01 17:53:25 > Step:   21400 Progress: 21.4% Elapsed: 8:17:57 temperature: 1.0 ada_p: No Discriminator_loss: 5.65244 Generator_loss: 4.2752 
[INFO] 2021-01-01 17:55:42 > Step:   21500 Progress: 21.5% Elapsed: 8:20:14 temperature: 1.0 ada_p: No Discriminator_loss: 5.96749 Generator_loss: 5.49642 
[INFO] 2021-01-01 17:57:59 > Step:   21600 Progress: 21.6% Elapsed: 8:22:31 temperature: 1.0 ada_p: No Discriminator_loss: 5.64607 Generator_loss: 6.14027 
[INFO] 2021-01-01 18:00:15 > Step:   21700 Progress: 21.7% Elapsed: 8:24:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.86261 Generator_loss: 5.94467 
[INFO] 2021-01-01 18:02:32 > Step:   21800 Progress: 21.8% Elapsed: 8:27:04 temperature: 1.0 ada_p: No Discriminator_loss: 5.69106 Generator_loss: 6.12884 
[INFO] 2021-01-01 18:04:48 > Step:   21900 Progress: 21.9% Elapsed: 8:29:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.46578 Generator_loss: 5.67239 
[INFO] 2021-01-01 18:07:04 > Step:   22000 Progress: 22.0% Elapsed: 8:31:37 temperature: 1.0 ada_p: No Discriminator_loss: 5.81145 Generator_loss: 4.34823 
[INFO] 2021-01-01 18:07:04 > Start Evaluation (22000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 18:07:04 > Calculating FID Score....
[INFO] 2021-01-01 18:07:20 > Calculating Inception Score....
[INFO] 2021-01-01 18:07:26 > Calculate F_beta Score....
[INFO] 2021-01-01 18:07:48 > Calculate Accuracies....
[INFO] 2021-01-01 18:07:51 > Calculate Accuracies....
[INFO] 2021-01-01 18:07:53 > F_8 score (Step: 22000, Using valid images): 0.7852117043901754
[INFO] 2021-01-01 18:07:53 > F_1/8 score (Step: 22000, Using valid images): 0.9387131340173035
[INFO] 2021-01-01 18:07:53 > FID score (Step: 22000, Using valid moments): 38.35868896143444
[INFO] 2021-01-01 18:07:53 > Inception score (Step: 22000, 10000 generated images): 11.081013679504395
[INFO] 2021-01-01 18:07:53 > Best FID score (Step: 22000, Using valid moments): 38.35868896143444
[INFO] 2021-01-01 18:08:07 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 18:10:24 > Step:   22100 Progress: 22.1% Elapsed: 8:34:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.64317 Generator_loss: 4.06264 
[INFO] 2021-01-01 18:12:40 > Step:   22200 Progress: 22.2% Elapsed: 8:37:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.66626 Generator_loss: 4.47689 
[INFO] 2021-01-01 18:14:57 > Step:   22300 Progress: 22.3% Elapsed: 8:39:29 temperature: 1.0 ada_p: No Discriminator_loss: 5.86534 Generator_loss: 4.18682 
[INFO] 2021-01-01 18:17:13 > Step:   22400 Progress: 22.4% Elapsed: 8:41:45 temperature: 1.0 ada_p: No Discriminator_loss: 5.59367 Generator_loss: 5.17402 
[INFO] 2021-01-01 18:19:30 > Step:   22500 Progress: 22.5% Elapsed: 8:44:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.74561 Generator_loss: 4.31446 
[INFO] 2021-01-01 18:21:47 > Step:   22600 Progress: 22.6% Elapsed: 8:46:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.49466 Generator_loss: 4.82981 
[INFO] 2021-01-01 18:24:05 > Step:   22700 Progress: 22.7% Elapsed: 8:48:37 temperature: 1.0 ada_p: No Discriminator_loss: 5.56048 Generator_loss: 5.01254 
[INFO] 2021-01-01 18:26:22 > Step:   22800 Progress: 22.8% Elapsed: 8:50:54 temperature: 1.0 ada_p: No Discriminator_loss: 5.42989 Generator_loss: 4.31942 
[INFO] 2021-01-01 18:28:39 > Step:   22900 Progress: 22.9% Elapsed: 8:53:11 temperature: 1.0 ada_p: No Discriminator_loss: 5.45027 Generator_loss: 4.76521 
[INFO] 2021-01-01 18:30:56 > Step:   23000 Progress: 23.0% Elapsed: 8:55:28 temperature: 1.0 ada_p: No Discriminator_loss: 5.53793 Generator_loss: 5.00801 
[INFO] 2021-01-01 18:33:13 > Step:   23100 Progress: 23.1% Elapsed: 8:57:45 temperature: 1.0 ada_p: No Discriminator_loss: 5.59487 Generator_loss: 4.56586 
[INFO] 2021-01-01 18:35:30 > Step:   23200 Progress: 23.2% Elapsed: 9:00:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.69287 Generator_loss: 4.52236 
[INFO] 2021-01-01 18:37:47 > Step:   23300 Progress: 23.3% Elapsed: 9:02:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.5488 Generator_loss: 4.9137 
[INFO] 2021-01-01 18:40:04 > Step:   23400 Progress: 23.4% Elapsed: 9:04:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.46623 Generator_loss: 4.45748 
[INFO] 2021-01-01 18:42:20 > Step:   23500 Progress: 23.5% Elapsed: 9:06:52 temperature: 1.0 ada_p: No Discriminator_loss: 5.53045 Generator_loss: 4.46981 
[INFO] 2021-01-01 18:44:37 > Step:   23600 Progress: 23.6% Elapsed: 9:09:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.70383 Generator_loss: 4.62882 
[INFO] 2021-01-01 18:46:54 > Step:   23700 Progress: 23.7% Elapsed: 9:11:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.83447 Generator_loss: 4.02937 
[INFO] 2021-01-01 18:49:11 > Step:   23800 Progress: 23.8% Elapsed: 9:13:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.4132 Generator_loss: 4.57008 
[INFO] 2021-01-01 18:51:28 > Step:   23900 Progress: 23.9% Elapsed: 9:16:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.51518 Generator_loss: 4.84667 
[INFO] 2021-01-01 18:53:44 > Step:   24000 Progress: 24.0% Elapsed: 9:18:16 temperature: 1.0 ada_p: No Discriminator_loss: 5.61755 Generator_loss: 4.40526 
[INFO] 2021-01-01 18:53:44 > Start Evaluation (24000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 18:53:44 > Calculating FID Score....
[INFO] 2021-01-01 18:54:00 > Calculating Inception Score....
[INFO] 2021-01-01 18:54:06 > Calculate F_beta Score....
[INFO] 2021-01-01 18:54:28 > Calculate Accuracies....
[INFO] 2021-01-01 18:54:31 > Calculate Accuracies....
[INFO] 2021-01-01 18:54:33 > F_8 score (Step: 24000, Using valid images): 0.7951012874352272
[INFO] 2021-01-01 18:54:33 > F_1/8 score (Step: 24000, Using valid images): 0.9501091570036855
[INFO] 2021-01-01 18:54:33 > FID score (Step: 24000, Using valid moments): 35.852976329759315
[INFO] 2021-01-01 18:54:33 > Inception score (Step: 24000, 10000 generated images): 11.528078079223633
[INFO] 2021-01-01 18:54:33 > Best FID score (Step: 24000, Using valid moments): 35.852976329759315
[INFO] 2021-01-01 18:54:47 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 18:57:04 > Step:   24100 Progress: 24.1% Elapsed: 9:21:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.41037 Generator_loss: 4.53461 
[INFO] 2021-01-01 18:59:20 > Step:   24200 Progress: 24.2% Elapsed: 9:23:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.54425 Generator_loss: 4.58851 
[INFO] 2021-01-01 19:01:35 > Step:   24300 Progress: 24.3% Elapsed: 9:26:08 temperature: 1.0 ada_p: No Discriminator_loss: 5.65613 Generator_loss: 4.78705 
[INFO] 2021-01-01 19:03:51 > Step:   24400 Progress: 24.4% Elapsed: 9:28:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.39265 Generator_loss: 4.92758 
[INFO] 2021-01-01 19:06:07 > Step:   24500 Progress: 24.5% Elapsed: 9:30:39 temperature: 1.0 ada_p: No Discriminator_loss: 5.41843 Generator_loss: 4.76102 
[INFO] 2021-01-01 19:08:23 > Step:   24600 Progress: 24.6% Elapsed: 9:32:55 temperature: 1.0 ada_p: No Discriminator_loss: 5.49156 Generator_loss: 4.84859 
[INFO] 2021-01-01 19:10:39 > Step:   24700 Progress: 24.7% Elapsed: 9:35:11 temperature: 1.0 ada_p: No Discriminator_loss: 5.55037 Generator_loss: 4.29234 
[INFO] 2021-01-01 19:12:55 > Step:   24800 Progress: 24.8% Elapsed: 9:37:27 temperature: 1.0 ada_p: No Discriminator_loss: 5.64256 Generator_loss: 4.50236 
[INFO] 2021-01-01 19:15:12 > Step:   24900 Progress: 24.9% Elapsed: 9:39:44 temperature: 1.0 ada_p: No Discriminator_loss: 5.64779 Generator_loss: 5.0268 
[INFO] 2021-01-01 19:17:28 > Step:   25000 Progress: 25.0% Elapsed: 9:42:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.56621 Generator_loss: 4.86003 
[INFO] 2021-01-01 19:19:45 > Step:   25100 Progress: 25.1% Elapsed: 9:44:17 temperature: 1.0 ada_p: No Discriminator_loss: 5.47365 Generator_loss: 4.82685 
[INFO] 2021-01-01 19:22:02 > Step:   25200 Progress: 25.2% Elapsed: 9:46:34 temperature: 1.0 ada_p: No Discriminator_loss: 5.56035 Generator_loss: 4.68922 
[INFO] 2021-01-01 19:24:19 > Step:   25300 Progress: 25.3% Elapsed: 9:48:51 temperature: 1.0 ada_p: No Discriminator_loss: 5.3498 Generator_loss: 4.55344 
[INFO] 2021-01-01 19:26:35 > Step:   25400 Progress: 25.4% Elapsed: 9:51:08 temperature: 1.0 ada_p: No Discriminator_loss: 5.62117 Generator_loss: 4.9422 
[INFO] 2021-01-01 19:28:52 > Step:   25500 Progress: 25.5% Elapsed: 9:53:24 temperature: 1.0 ada_p: No Discriminator_loss: 5.49669 Generator_loss: 4.56934 
[INFO] 2021-01-01 19:31:09 > Step:   25600 Progress: 25.6% Elapsed: 9:55:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.51157 Generator_loss: 4.47658 
[INFO] 2021-01-01 19:33:25 > Step:   25700 Progress: 25.7% Elapsed: 9:57:58 temperature: 1.0 ada_p: No Discriminator_loss: 5.64435 Generator_loss: 4.71594 
[INFO] 2021-01-01 19:35:42 > Step:   25800 Progress: 25.8% Elapsed: 10:00:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.45305 Generator_loss: 4.90508 
[INFO] 2021-01-01 19:38:00 > Step:   25900 Progress: 25.9% Elapsed: 10:02:32 temperature: 1.0 ada_p: No Discriminator_loss: 5.60854 Generator_loss: 4.55687 
[INFO] 2021-01-01 19:40:17 > Step:   26000 Progress: 26.0% Elapsed: 10:04:49 temperature: 1.0 ada_p: No Discriminator_loss: 5.61894 Generator_loss: 4.77657 
[INFO] 2021-01-01 19:40:17 > Start Evaluation (26000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 19:40:17 > Calculating FID Score....
[INFO] 2021-01-01 19:40:33 > Calculating Inception Score....
[INFO] 2021-01-01 19:40:39 > Calculate F_beta Score....
[INFO] 2021-01-01 19:41:01 > Calculate Accuracies....
[INFO] 2021-01-01 19:41:04 > Calculate Accuracies....
[INFO] 2021-01-01 19:41:06 > F_8 score (Step: 26000, Using valid images): 0.8168282128877751
[INFO] 2021-01-01 19:41:06 > F_1/8 score (Step: 26000, Using valid images): 0.9560738593424084
[INFO] 2021-01-01 19:41:06 > FID score (Step: 26000, Using valid moments): 32.85704403276702
[INFO] 2021-01-01 19:41:06 > Inception score (Step: 26000, 10000 generated images): 12.080682754516602
[INFO] 2021-01-01 19:41:06 > Best FID score (Step: 26000, Using valid moments): 32.85704403276702
[INFO] 2021-01-01 19:41:20 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 19:43:37 > Step:   26100 Progress: 26.1% Elapsed: 10:08:10 temperature: 1.0 ada_p: No Discriminator_loss: 5.51589 Generator_loss: 4.5406 
[INFO] 2021-01-01 19:45:54 > Step:   26200 Progress: 26.2% Elapsed: 10:10:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.49233 Generator_loss: 4.83096 
[INFO] 2021-01-01 19:48:11 > Step:   26300 Progress: 26.3% Elapsed: 10:12:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.3143 Generator_loss: 4.86279 
[INFO] 2021-01-01 19:50:27 > Step:   26400 Progress: 26.4% Elapsed: 10:15:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.52601 Generator_loss: 4.79946 
[INFO] 2021-01-01 19:52:44 > Step:   26500 Progress: 26.5% Elapsed: 10:17:16 temperature: 1.0 ada_p: No Discriminator_loss: 5.48184 Generator_loss: 4.88454 
[INFO] 2021-01-01 19:55:01 > Step:   26600 Progress: 26.6% Elapsed: 10:19:33 temperature: 1.0 ada_p: No Discriminator_loss: 5.55877 Generator_loss: 4.69133 
[INFO] 2021-01-01 19:57:17 > Step:   26700 Progress: 26.7% Elapsed: 10:21:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.36238 Generator_loss: 4.60218 
[INFO] 2021-01-01 19:59:34 > Step:   26800 Progress: 26.8% Elapsed: 10:24:06 temperature: 1.0 ada_p: No Discriminator_loss: 5.2363 Generator_loss: 4.59188 
[INFO] 2021-01-01 20:01:50 > Step:   26900 Progress: 26.9% Elapsed: 10:26:22 temperature: 1.0 ada_p: No Discriminator_loss: 5.54597 Generator_loss: 4.81301 
[INFO] 2021-01-01 20:04:06 > Step:   27000 Progress: 27.0% Elapsed: 10:28:38 temperature: 1.0 ada_p: No Discriminator_loss: 5.44528 Generator_loss: 4.76369 
[INFO] 2021-01-01 20:06:23 > Step:   27100 Progress: 27.1% Elapsed: 10:30:55 temperature: 1.0 ada_p: No Discriminator_loss: 5.67255 Generator_loss: 5.00507 
[INFO] 2021-01-01 20:08:40 > Step:   27200 Progress: 27.2% Elapsed: 10:33:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.38081 Generator_loss: 4.75925 
[INFO] 2021-01-01 20:10:57 > Step:   27300 Progress: 27.3% Elapsed: 10:35:29 temperature: 1.0 ada_p: No Discriminator_loss: 5.29344 Generator_loss: 4.80877 
[INFO] 2021-01-01 20:13:13 > Step:   27400 Progress: 27.4% Elapsed: 10:37:46 temperature: 1.0 ada_p: No Discriminator_loss: 5.48463 Generator_loss: 4.86319 
[INFO] 2021-01-01 20:15:30 > Step:   27500 Progress: 27.5% Elapsed: 10:40:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.33046 Generator_loss: 4.6677 
[INFO] 2021-01-01 20:17:46 > Step:   27600 Progress: 27.6% Elapsed: 10:42:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.36306 Generator_loss: 4.84447 
[INFO] 2021-01-01 20:20:04 > Step:   27700 Progress: 27.7% Elapsed: 10:44:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.50527 Generator_loss: 5.02011 
[INFO] 2021-01-01 20:22:21 > Step:   27800 Progress: 27.8% Elapsed: 10:46:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.30973 Generator_loss: 4.64515 
[INFO] 2021-01-01 20:24:37 > Step:   27900 Progress: 27.9% Elapsed: 10:49:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.51907 Generator_loss: 4.65085 
[INFO] 2021-01-01 20:26:54 > Step:   28000 Progress: 28.0% Elapsed: 10:51:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.57893 Generator_loss: 4.91823 
[INFO] 2021-01-01 20:26:54 > Start Evaluation (28000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 20:26:54 > Calculating FID Score....
[INFO] 2021-01-01 20:27:10 > Calculating Inception Score....
[INFO] 2021-01-01 20:27:16 > Calculate F_beta Score....
[INFO] 2021-01-01 20:27:37 > Calculate Accuracies....
[INFO] 2021-01-01 20:27:40 > Calculate Accuracies....
[INFO] 2021-01-01 20:27:42 > F_8 score (Step: 28000, Using valid images): 0.8420175748596385
[INFO] 2021-01-01 20:27:42 > F_1/8 score (Step: 28000, Using valid images): 0.9662119078197597
[INFO] 2021-01-01 20:27:42 > FID score (Step: 28000, Using valid moments): 31.409734833494667
[INFO] 2021-01-01 20:27:42 > Inception score (Step: 28000, 10000 generated images): 12.54921817779541
[INFO] 2021-01-01 20:27:42 > Best FID score (Step: 28000, Using valid moments): 31.409734833494667
[INFO] 2021-01-01 20:27:56 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 20:30:13 > Step:   28100 Progress: 28.1% Elapsed: 10:54:45 temperature: 1.0 ada_p: No Discriminator_loss: 5.62866 Generator_loss: 4.7909 
[INFO] 2021-01-01 20:32:31 > Step:   28200 Progress: 28.2% Elapsed: 10:57:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.44895 Generator_loss: 4.69995 
[INFO] 2021-01-01 20:34:47 > Step:   28300 Progress: 28.3% Elapsed: 10:59:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.35759 Generator_loss: 4.6453 
[INFO] 2021-01-01 20:37:04 > Step:   28400 Progress: 28.4% Elapsed: 11:01:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.22521 Generator_loss: 4.57997 
[INFO] 2021-01-01 20:39:21 > Step:   28500 Progress: 28.5% Elapsed: 11:03:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.47883 Generator_loss: 4.77604 
[INFO] 2021-01-01 20:41:38 > Step:   28600 Progress: 28.6% Elapsed: 11:06:10 temperature: 1.0 ada_p: No Discriminator_loss: 5.38776 Generator_loss: 4.73367 
[INFO] 2021-01-01 20:43:54 > Step:   28700 Progress: 28.7% Elapsed: 11:08:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.32145 Generator_loss: 4.96376 
[INFO] 2021-01-01 20:46:11 > Step:   28800 Progress: 28.8% Elapsed: 11:10:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.32123 Generator_loss: 4.87176 
[INFO] 2021-01-01 20:48:28 > Step:   28900 Progress: 28.9% Elapsed: 11:13:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.40615 Generator_loss: 4.63687 
[INFO] 2021-01-01 20:50:44 > Step:   29000 Progress: 29.0% Elapsed: 11:15:16 temperature: 1.0 ada_p: No Discriminator_loss: 5.22582 Generator_loss: 4.76186 
[INFO] 2021-01-01 20:53:01 > Step:   29100 Progress: 29.1% Elapsed: 11:17:33 temperature: 1.0 ada_p: No Discriminator_loss: 5.31609 Generator_loss: 5.13609 
[INFO] 2021-01-01 20:55:17 > Step:   29200 Progress: 29.2% Elapsed: 11:19:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.54961 Generator_loss: 4.88278 
[INFO] 2021-01-01 20:57:34 > Step:   29300 Progress: 29.3% Elapsed: 11:22:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.33285 Generator_loss: 4.73583 
[INFO] 2021-01-01 20:59:51 > Step:   29400 Progress: 29.4% Elapsed: 11:24:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.19422 Generator_loss: 4.78434 
[INFO] 2021-01-01 21:02:07 > Step:   29500 Progress: 29.5% Elapsed: 11:26:39 temperature: 1.0 ada_p: No Discriminator_loss: 5.2803 Generator_loss: 4.57424 
[INFO] 2021-01-01 21:04:24 > Step:   29600 Progress: 29.6% Elapsed: 11:28:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.23255 Generator_loss: 4.93104 
[INFO] 2021-01-01 21:06:40 > Step:   29700 Progress: 29.7% Elapsed: 11:31:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.21464 Generator_loss: 4.7129 
[INFO] 2021-01-01 21:08:57 > Step:   29800 Progress: 29.8% Elapsed: 11:33:29 temperature: 1.0 ada_p: No Discriminator_loss: 5.35333 Generator_loss: 4.80663 
[INFO] 2021-01-01 21:11:14 > Step:   29900 Progress: 29.9% Elapsed: 11:35:46 temperature: 1.0 ada_p: No Discriminator_loss: 5.42339 Generator_loss: 4.73128 
[INFO] 2021-01-01 21:13:30 > Step:   30000 Progress: 30.0% Elapsed: 11:38:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.53429 Generator_loss: 4.94162 
[INFO] 2021-01-01 21:13:30 > Start Evaluation (30000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 21:13:30 > Calculating FID Score....
[INFO] 2021-01-01 21:13:47 > Calculating Inception Score....
[INFO] 2021-01-01 21:13:52 > Calculate F_beta Score....
[INFO] 2021-01-01 21:14:14 > Calculate Accuracies....
[INFO] 2021-01-01 21:14:17 > Calculate Accuracies....
[INFO] 2021-01-01 21:14:19 > F_8 score (Step: 30000, Using valid images): 0.8728672300055427
[INFO] 2021-01-01 21:14:19 > F_1/8 score (Step: 30000, Using valid images): 0.9692475039998991
[INFO] 2021-01-01 21:14:19 > FID score (Step: 30000, Using valid moments): 30.114954382655014
[INFO] 2021-01-01 21:14:19 > Inception score (Step: 30000, 10000 generated images): 12.999106407165527
[INFO] 2021-01-01 21:14:19 > Best FID score (Step: 30000, Using valid moments): 30.114954382655014
[INFO] 2021-01-01 21:14:33 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 21:16:49 > Step:   30100 Progress: 30.1% Elapsed: 11:41:21 temperature: 1.0 ada_p: No Discriminator_loss: 5.2438 Generator_loss: 4.83406 
[INFO] 2021-01-01 21:19:05 > Step:   30200 Progress: 30.2% Elapsed: 11:43:37 temperature: 1.0 ada_p: No Discriminator_loss: 5.20901 Generator_loss: 4.74364 
[INFO] 2021-01-01 21:21:21 > Step:   30300 Progress: 30.3% Elapsed: 11:45:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.41126 Generator_loss: 4.85272 
[INFO] 2021-01-01 21:23:37 > Step:   30400 Progress: 30.4% Elapsed: 11:48:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.36229 Generator_loss: 4.92835 
[INFO] 2021-01-01 21:25:54 > Step:   30500 Progress: 30.5% Elapsed: 11:50:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.38123 Generator_loss: 4.69123 
[INFO] 2021-01-01 21:28:10 > Step:   30600 Progress: 30.6% Elapsed: 11:52:42 temperature: 1.0 ada_p: No Discriminator_loss: 5.34039 Generator_loss: 4.74641 
[INFO] 2021-01-01 21:30:26 > Step:   30700 Progress: 30.7% Elapsed: 11:54:58 temperature: 1.0 ada_p: No Discriminator_loss: 5.25371 Generator_loss: 4.81459 
[INFO] 2021-01-01 21:32:42 > Step:   30800 Progress: 30.8% Elapsed: 11:57:14 temperature: 1.0 ada_p: No Discriminator_loss: 5.35152 Generator_loss: 4.8424 
[INFO] 2021-01-01 21:34:58 > Step:   30900 Progress: 30.9% Elapsed: 11:59:31 temperature: 1.0 ada_p: No Discriminator_loss: 5.21124 Generator_loss: 4.97328 
[INFO] 2021-01-01 21:37:15 > Step:   31000 Progress: 31.0% Elapsed: 12:01:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.33473 Generator_loss: 4.79609 
[INFO] 2021-01-01 21:39:31 > Step:   31100 Progress: 31.1% Elapsed: 12:04:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.35161 Generator_loss: 5.00796 
[INFO] 2021-01-01 21:41:48 > Step:   31200 Progress: 31.2% Elapsed: 12:06:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.30518 Generator_loss: 4.75075 
[INFO] 2021-01-01 21:44:05 > Step:   31300 Progress: 31.3% Elapsed: 12:08:37 temperature: 1.0 ada_p: No Discriminator_loss: 5.26235 Generator_loss: 4.71392 
[INFO] 2021-01-01 21:46:22 > Step:   31400 Progress: 31.4% Elapsed: 12:10:54 temperature: 1.0 ada_p: No Discriminator_loss: 5.3866 Generator_loss: 4.91783 
[INFO] 2021-01-01 21:48:39 > Step:   31500 Progress: 31.5% Elapsed: 12:13:11 temperature: 1.0 ada_p: No Discriminator_loss: 5.2011 Generator_loss: 4.84591 
[INFO] 2021-01-01 21:50:56 > Step:   31600 Progress: 31.6% Elapsed: 12:15:28 temperature: 1.0 ada_p: No Discriminator_loss: 5.2737 Generator_loss: 4.79517 
[INFO] 2021-01-01 21:53:13 > Step:   31700 Progress: 31.7% Elapsed: 12:17:45 temperature: 1.0 ada_p: No Discriminator_loss: 5.25623 Generator_loss: 4.73754 
[INFO] 2021-01-01 21:55:29 > Step:   31800 Progress: 31.8% Elapsed: 12:20:01 temperature: 1.0 ada_p: No Discriminator_loss: 5.35732 Generator_loss: 4.91778 
[INFO] 2021-01-01 21:57:45 > Step:   31900 Progress: 31.9% Elapsed: 12:22:17 temperature: 1.0 ada_p: No Discriminator_loss: 5.29225 Generator_loss: 4.76059 
[INFO] 2021-01-01 22:00:01 > Step:   32000 Progress: 32.0% Elapsed: 12:24:33 temperature: 1.0 ada_p: No Discriminator_loss: 5.37596 Generator_loss: 4.85983 
[INFO] 2021-01-01 22:00:01 > Start Evaluation (32000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 22:00:01 > Calculating FID Score....
[INFO] 2021-01-01 22:00:17 > Calculating Inception Score....
[INFO] 2021-01-01 22:00:23 > Calculate F_beta Score....
[INFO] 2021-01-01 22:00:43 > Calculate Accuracies....
[INFO] 2021-01-01 22:00:47 > Calculate Accuracies....
[INFO] 2021-01-01 22:00:48 > F_8 score (Step: 32000, Using valid images): 0.8481712538300508
[INFO] 2021-01-01 22:00:48 > F_1/8 score (Step: 32000, Using valid images): 0.966042799059852
[INFO] 2021-01-01 22:00:48 > FID score (Step: 32000, Using valid moments): 29.017290401177263
[INFO] 2021-01-01 22:00:48 > Inception score (Step: 32000, 10000 generated images): 13.1800537109375
[INFO] 2021-01-01 22:00:48 > Best FID score (Step: 32000, Using valid moments): 29.017290401177263
[INFO] 2021-01-01 22:01:02 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 22:03:18 > Step:   32100 Progress: 32.1% Elapsed: 12:27:51 temperature: 1.0 ada_p: No Discriminator_loss: 5.40496 Generator_loss: 5.03032 
[INFO] 2021-01-01 22:05:35 > Step:   32200 Progress: 32.2% Elapsed: 12:30:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.39071 Generator_loss: 5.10318 
[INFO] 2021-01-01 22:07:51 > Step:   32300 Progress: 32.3% Elapsed: 12:32:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.52284 Generator_loss: 5.03251 
[INFO] 2021-01-01 22:10:08 > Step:   32400 Progress: 32.4% Elapsed: 12:34:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.21328 Generator_loss: 4.64174 
[INFO] 2021-01-01 22:12:25 > Step:   32500 Progress: 32.5% Elapsed: 12:36:57 temperature: 1.0 ada_p: No Discriminator_loss: 5.34319 Generator_loss: 4.72224 
[INFO] 2021-01-01 22:14:41 > Step:   32600 Progress: 32.6% Elapsed: 12:39:14 temperature: 1.0 ada_p: No Discriminator_loss: 5.21446 Generator_loss: 4.90436 
[INFO] 2021-01-01 22:16:58 > Step:   32700 Progress: 32.7% Elapsed: 12:41:30 temperature: 1.0 ada_p: No Discriminator_loss: 5.5002 Generator_loss: 5.20187 
[INFO] 2021-01-01 22:19:14 > Step:   32800 Progress: 32.8% Elapsed: 12:43:46 temperature: 1.0 ada_p: No Discriminator_loss: 5.28114 Generator_loss: 5.04329 
[INFO] 2021-01-01 22:21:31 > Step:   32900 Progress: 32.9% Elapsed: 12:46:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.22177 Generator_loss: 4.82985 
[INFO] 2021-01-01 22:23:48 > Step:   33000 Progress: 33.0% Elapsed: 12:48:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.27758 Generator_loss: 4.77438 
[INFO] 2021-01-01 22:26:04 > Step:   33100 Progress: 33.1% Elapsed: 12:50:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.37052 Generator_loss: 4.78435 
[INFO] 2021-01-01 22:28:21 > Step:   33200 Progress: 33.2% Elapsed: 12:52:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.37758 Generator_loss: 4.76433 
[INFO] 2021-01-01 22:30:37 > Step:   33300 Progress: 33.3% Elapsed: 12:55:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.19181 Generator_loss: 4.91937 
[INFO] 2021-01-01 22:32:54 > Step:   33400 Progress: 33.4% Elapsed: 12:57:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.15607 Generator_loss: 4.76919 
[INFO] 2021-01-01 22:35:10 > Step:   33500 Progress: 33.5% Elapsed: 12:59:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.27238 Generator_loss: 4.83437 
[INFO] 2021-01-01 22:37:27 > Step:   33600 Progress: 33.6% Elapsed: 13:01:59 temperature: 1.0 ada_p: No Discriminator_loss: 5.17711 Generator_loss: 4.94434 
[INFO] 2021-01-01 22:39:42 > Step:   33700 Progress: 33.7% Elapsed: 13:04:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.30039 Generator_loss: 5.13622 
[INFO] 2021-01-01 22:41:59 > Step:   33800 Progress: 33.8% Elapsed: 13:06:31 temperature: 1.0 ada_p: No Discriminator_loss: 5.40177 Generator_loss: 5.00095 
[INFO] 2021-01-01 22:44:15 > Step:   33900 Progress: 33.9% Elapsed: 13:08:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.19504 Generator_loss: 4.76116 
[INFO] 2021-01-01 22:46:31 > Step:   34000 Progress: 34.0% Elapsed: 13:11:04 temperature: 1.0 ada_p: No Discriminator_loss: 5.26407 Generator_loss: 4.89157 
[INFO] 2021-01-01 22:46:31 > Start Evaluation (34000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 22:46:31 > Calculating FID Score....
[INFO] 2021-01-01 22:46:48 > Calculating Inception Score....
[INFO] 2021-01-01 22:46:54 > Calculate F_beta Score....
[INFO] 2021-01-01 22:47:15 > Calculate Accuracies....
[INFO] 2021-01-01 22:47:19 > Calculate Accuracies....
[INFO] 2021-01-01 22:47:20 > F_8 score (Step: 34000, Using valid images): 0.8617096662457306
[INFO] 2021-01-01 22:47:20 > F_1/8 score (Step: 34000, Using valid images): 0.9730238345873043
[INFO] 2021-01-01 22:47:20 > FID score (Step: 34000, Using valid moments): 28.539594896543406
[INFO] 2021-01-01 22:47:20 > Inception score (Step: 34000, 10000 generated images): 13.261667251586914
[INFO] 2021-01-01 22:47:20 > Best FID score (Step: 34000, Using valid moments): 28.539594896543406
[INFO] 2021-01-01 22:47:34 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 22:49:52 > Step:   34100 Progress: 34.1% Elapsed: 13:14:24 temperature: 1.0 ada_p: No Discriminator_loss: 5.1391 Generator_loss: 4.97163 
[INFO] 2021-01-01 22:52:08 > Step:   34200 Progress: 34.2% Elapsed: 13:16:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.29117 Generator_loss: 4.96942 
[INFO] 2021-01-01 22:54:25 > Step:   34300 Progress: 34.3% Elapsed: 13:18:58 temperature: 1.0 ada_p: No Discriminator_loss: 5.15694 Generator_loss: 4.97751 
[INFO] 2021-01-01 22:56:43 > Step:   34400 Progress: 34.4% Elapsed: 13:21:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.33189 Generator_loss: 5.00488 
[INFO] 2021-01-01 22:59:00 > Step:   34500 Progress: 34.5% Elapsed: 13:23:32 temperature: 1.0 ada_p: No Discriminator_loss: 5.34016 Generator_loss: 4.89314 
[INFO] 2021-01-01 23:01:17 > Step:   34600 Progress: 34.6% Elapsed: 13:25:49 temperature: 1.0 ada_p: No Discriminator_loss: 5.11776 Generator_loss: 4.83504 
[INFO] 2021-01-01 23:03:32 > Step:   34700 Progress: 34.7% Elapsed: 13:28:04 temperature: 1.0 ada_p: No Discriminator_loss: 5.2508 Generator_loss: 4.95426 
[INFO] 2021-01-01 23:05:49 > Step:   34800 Progress: 34.8% Elapsed: 13:30:22 temperature: 1.0 ada_p: No Discriminator_loss: 5.27953 Generator_loss: 5.04876 
[INFO] 2021-01-01 23:08:06 > Step:   34900 Progress: 34.9% Elapsed: 13:32:38 temperature: 1.0 ada_p: No Discriminator_loss: 5.23338 Generator_loss: 4.89186 
[INFO] 2021-01-01 23:10:23 > Step:   35000 Progress: 35.0% Elapsed: 13:34:55 temperature: 1.0 ada_p: No Discriminator_loss: 5.05017 Generator_loss: 4.8202 
[INFO] 2021-01-01 23:12:39 > Step:   35100 Progress: 35.1% Elapsed: 13:37:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.25875 Generator_loss: 4.96677 
[INFO] 2021-01-01 23:14:56 > Step:   35200 Progress: 35.2% Elapsed: 13:39:28 temperature: 1.0 ada_p: No Discriminator_loss: 5.07675 Generator_loss: 5.03945 
[INFO] 2021-01-01 23:17:12 > Step:   35300 Progress: 35.3% Elapsed: 13:41:44 temperature: 1.0 ada_p: No Discriminator_loss: 5.27591 Generator_loss: 4.78065 
[INFO] 2021-01-01 23:19:29 > Step:   35400 Progress: 35.4% Elapsed: 13:44:01 temperature: 1.0 ada_p: No Discriminator_loss: 5.11265 Generator_loss: 5.0104 
[INFO] 2021-01-01 23:21:45 > Step:   35500 Progress: 35.5% Elapsed: 13:46:18 temperature: 1.0 ada_p: No Discriminator_loss: 5.18197 Generator_loss: 4.91049 
[INFO] 2021-01-01 23:24:03 > Step:   35600 Progress: 35.6% Elapsed: 13:48:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.23834 Generator_loss: 5.08727 
[INFO] 2021-01-01 23:26:21 > Step:   35700 Progress: 35.7% Elapsed: 13:50:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.18502 Generator_loss: 5.09446 
[INFO] 2021-01-01 23:28:37 > Step:   35800 Progress: 35.8% Elapsed: 13:53:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.27947 Generator_loss: 4.83519 
[INFO] 2021-01-01 23:30:54 > Step:   35900 Progress: 35.9% Elapsed: 13:55:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.28325 Generator_loss: 5.02897 
[INFO] 2021-01-01 23:33:11 > Step:   36000 Progress: 36.0% Elapsed: 13:57:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.07235 Generator_loss: 4.93042 
[INFO] 2021-01-01 23:33:11 > Start Evaluation (36000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 23:33:11 > Calculating FID Score....
[INFO] 2021-01-01 23:33:28 > Calculating Inception Score....
[INFO] 2021-01-01 23:33:33 > Calculate F_beta Score....
[INFO] 2021-01-01 23:33:55 > Calculate Accuracies....
[INFO] 2021-01-01 23:33:58 > Calculate Accuracies....
[INFO] 2021-01-01 23:34:00 > F_8 score (Step: 36000, Using valid images): 0.8789437452722679
[INFO] 2021-01-01 23:34:00 > F_1/8 score (Step: 36000, Using valid images): 0.9733812251203815
[INFO] 2021-01-01 23:34:00 > FID score (Step: 36000, Using valid moments): 28.41816184714355
[INFO] 2021-01-01 23:34:00 > Inception score (Step: 36000, 10000 generated images): 13.272552490234375
[INFO] 2021-01-01 23:34:00 > Best FID score (Step: 36000, Using valid moments): 28.41816184714355
[INFO] 2021-01-01 23:34:14 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-01 23:36:30 > Step:   36100 Progress: 36.1% Elapsed: 14:01:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.30425 Generator_loss: 5.08266 
[INFO] 2021-01-01 23:38:46 > Step:   36200 Progress: 36.2% Elapsed: 14:03:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.16546 Generator_loss: 5.05479 
[INFO] 2021-01-01 23:41:02 > Step:   36300 Progress: 36.3% Elapsed: 14:05:35 temperature: 1.0 ada_p: No Discriminator_loss: 5.18155 Generator_loss: 4.93224 
[INFO] 2021-01-01 23:43:18 > Step:   36400 Progress: 36.4% Elapsed: 14:07:51 temperature: 1.0 ada_p: No Discriminator_loss: 5.22957 Generator_loss: 4.9676 
[INFO] 2021-01-01 23:45:35 > Step:   36500 Progress: 36.5% Elapsed: 14:10:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.22035 Generator_loss: 4.97281 
[INFO] 2021-01-01 23:47:52 > Step:   36600 Progress: 36.6% Elapsed: 14:12:24 temperature: 1.0 ada_p: No Discriminator_loss: 5.11351 Generator_loss: 5.02054 
[INFO] 2021-01-01 23:50:08 > Step:   36700 Progress: 36.7% Elapsed: 14:14:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.10539 Generator_loss: 4.9596 
[INFO] 2021-01-01 23:52:25 > Step:   36800 Progress: 36.8% Elapsed: 14:16:57 temperature: 1.0 ada_p: No Discriminator_loss: 5.08065 Generator_loss: 4.97312 
[INFO] 2021-01-01 23:54:42 > Step:   36900 Progress: 36.9% Elapsed: 14:19:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.16383 Generator_loss: 5.10734 
[INFO] 2021-01-01 23:56:59 > Step:   37000 Progress: 37.0% Elapsed: 14:21:31 temperature: 1.0 ada_p: No Discriminator_loss: 5.16216 Generator_loss: 5.07456 
[INFO] 2021-01-01 23:59:15 > Step:   37100 Progress: 37.1% Elapsed: 14:23:48 temperature: 1.0 ada_p: No Discriminator_loss: 5.26681 Generator_loss: 5.06122 
[INFO] 2021-01-02 00:01:32 > Step:   37200 Progress: 37.2% Elapsed: 14:26:04 temperature: 1.0 ada_p: No Discriminator_loss: 5.30126 Generator_loss: 5.10964 
[INFO] 2021-01-02 00:03:48 > Step:   37300 Progress: 37.3% Elapsed: 14:28:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.25478 Generator_loss: 4.99761 
[INFO] 2021-01-02 00:06:04 > Step:   37400 Progress: 37.4% Elapsed: 14:30:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.15323 Generator_loss: 4.93023 
[INFO] 2021-01-02 00:08:20 > Step:   37500 Progress: 37.5% Elapsed: 14:32:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.10118 Generator_loss: 5.05557 
[INFO] 2021-01-02 00:10:37 > Step:   37600 Progress: 37.6% Elapsed: 14:35:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.16109 Generator_loss: 4.92863 
[INFO] 2021-01-02 00:12:53 > Step:   37700 Progress: 37.7% Elapsed: 14:37:25 temperature: 1.0 ada_p: No Discriminator_loss: 5.13525 Generator_loss: 5.14002 
[INFO] 2021-01-02 00:15:09 > Step:   37800 Progress: 37.8% Elapsed: 14:39:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.22417 Generator_loss: 4.95989 
[INFO] 2021-01-02 00:17:26 > Step:   37900 Progress: 37.9% Elapsed: 14:41:58 temperature: 1.0 ada_p: No Discriminator_loss: 5.14823 Generator_loss: 5.0907 
[INFO] 2021-01-02 00:19:42 > Step:   38000 Progress: 38.0% Elapsed: 14:44:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.0507 Generator_loss: 5.02106 
[INFO] 2021-01-02 00:19:42 > Start Evaluation (38000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 00:19:42 > Calculating FID Score....
[INFO] 2021-01-02 00:19:58 > Calculating Inception Score....
[INFO] 2021-01-02 00:20:04 > Calculate F_beta Score....
[INFO] 2021-01-02 00:20:26 > Calculate Accuracies....
[INFO] 2021-01-02 00:20:29 > Calculate Accuracies....
[INFO] 2021-01-02 00:20:31 > F_8 score (Step: 38000, Using valid images): 0.885373173410038
[INFO] 2021-01-02 00:20:31 > F_1/8 score (Step: 38000, Using valid images): 0.9759885452720158
[INFO] 2021-01-02 00:20:31 > FID score (Step: 38000, Using valid moments): 27.653074937530107
[INFO] 2021-01-02 00:20:31 > Inception score (Step: 38000, 10000 generated images): 13.334328651428223
[INFO] 2021-01-02 00:20:31 > Best FID score (Step: 38000, Using valid moments): 27.653074937530107
[INFO] 2021-01-02 00:20:45 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 00:23:01 > Step:   38100 Progress: 38.1% Elapsed: 14:47:34 temperature: 1.0 ada_p: No Discriminator_loss: 5.15584 Generator_loss: 4.85941 
[INFO] 2021-01-02 00:25:18 > Step:   38200 Progress: 38.2% Elapsed: 14:49:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.05103 Generator_loss: 5.13903 
[INFO] 2021-01-02 00:27:34 > Step:   38300 Progress: 38.3% Elapsed: 14:52:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.14193 Generator_loss: 4.98535 
[INFO] 2021-01-02 00:29:51 > Step:   38400 Progress: 38.4% Elapsed: 14:54:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.03851 Generator_loss: 5.02086 
[INFO] 2021-01-02 00:32:08 > Step:   38500 Progress: 38.5% Elapsed: 14:56:40 temperature: 1.0 ada_p: No Discriminator_loss: 5.14887 Generator_loss: 5.00114 
[INFO] 2021-01-02 00:34:24 > Step:   38600 Progress: 38.6% Elapsed: 14:58:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.12775 Generator_loss: 5.07104 
[INFO] 2021-01-02 00:36:39 > Step:   38700 Progress: 38.7% Elapsed: 15:01:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.11445 Generator_loss: 4.87473 
[INFO] 2021-01-02 00:38:56 > Step:   38800 Progress: 38.8% Elapsed: 15:03:28 temperature: 1.0 ada_p: No Discriminator_loss: 5.18663 Generator_loss: 4.93941 
[INFO] 2021-01-02 00:41:14 > Step:   38900 Progress: 38.9% Elapsed: 15:05:46 temperature: 1.0 ada_p: No Discriminator_loss: 5.30489 Generator_loss: 5.07884 
[INFO] 2021-01-02 00:43:30 > Step:   39000 Progress: 39.0% Elapsed: 15:08:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.06404 Generator_loss: 5.04868 
[INFO] 2021-01-02 00:45:47 > Step:   39100 Progress: 39.1% Elapsed: 15:10:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.14161 Generator_loss: 5.13637 
[INFO] 2021-01-02 00:48:04 > Step:   39200 Progress: 39.2% Elapsed: 15:12:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.06177 Generator_loss: 4.89486 
[INFO] 2021-01-02 00:50:20 > Step:   39300 Progress: 39.3% Elapsed: 15:14:52 temperature: 1.0 ada_p: No Discriminator_loss: 5.18133 Generator_loss: 5.03468 
[INFO] 2021-01-02 00:52:37 > Step:   39400 Progress: 39.4% Elapsed: 15:17:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.31821 Generator_loss: 4.96777 
[INFO] 2021-01-02 00:54:53 > Step:   39500 Progress: 39.5% Elapsed: 15:19:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.22231 Generator_loss: 5.07461 
[INFO] 2021-01-02 00:57:10 > Step:   39600 Progress: 39.6% Elapsed: 15:21:42 temperature: 1.0 ada_p: No Discriminator_loss: 5.04099 Generator_loss: 5.08505 
[INFO] 2021-01-02 00:59:26 > Step:   39700 Progress: 39.7% Elapsed: 15:23:58 temperature: 1.0 ada_p: No Discriminator_loss: 5.07906 Generator_loss: 5.06936 
[INFO] 2021-01-02 01:01:43 > Step:   39800 Progress: 39.8% Elapsed: 15:26:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.21368 Generator_loss: 5.20148 
[INFO] 2021-01-02 01:03:59 > Step:   39900 Progress: 39.9% Elapsed: 15:28:31 temperature: 1.0 ada_p: No Discriminator_loss: 5.05775 Generator_loss: 5.08266 
[INFO] 2021-01-02 01:06:15 > Step:   40000 Progress: 40.0% Elapsed: 15:30:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.16641 Generator_loss: 5.1439 
[INFO] 2021-01-02 01:06:15 > Start Evaluation (40000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 01:06:15 > Calculating FID Score....
[INFO] 2021-01-02 01:06:31 > Calculating Inception Score....
[INFO] 2021-01-02 01:06:37 > Calculate F_beta Score....
[INFO] 2021-01-02 01:06:58 > Calculate Accuracies....
[INFO] 2021-01-02 01:07:02 > Calculate Accuracies....
[INFO] 2021-01-02 01:07:04 > F_8 score (Step: 40000, Using valid images): 0.8783723904724609
[INFO] 2021-01-02 01:07:04 > F_1/8 score (Step: 40000, Using valid images): 0.9724154101391616
[INFO] 2021-01-02 01:07:04 > FID score (Step: 40000, Using valid moments): 27.360779346029858
[INFO] 2021-01-02 01:07:04 > Inception score (Step: 40000, 10000 generated images): 13.421764373779297
[INFO] 2021-01-02 01:07:04 > Best FID score (Step: 40000, Using valid moments): 27.360779346029858
[INFO] 2021-01-02 01:07:18 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 01:09:34 > Step:   40100 Progress: 40.1% Elapsed: 15:34:07 temperature: 1.0 ada_p: No Discriminator_loss: 5.16678 Generator_loss: 5.12919 
[INFO] 2021-01-02 01:11:51 > Step:   40200 Progress: 40.2% Elapsed: 15:36:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.13795 Generator_loss: 5.16213 
[INFO] 2021-01-02 01:14:07 > Step:   40300 Progress: 40.3% Elapsed: 15:38:40 temperature: 1.0 ada_p: No Discriminator_loss: 5.12198 Generator_loss: 5.00857 
[INFO] 2021-01-02 01:16:24 > Step:   40400 Progress: 40.4% Elapsed: 15:40:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.0399 Generator_loss: 5.00547 
[INFO] 2021-01-02 01:18:40 > Step:   40500 Progress: 40.5% Elapsed: 15:43:13 temperature: 1.0 ada_p: No Discriminator_loss: 5.28701 Generator_loss: 5.09659 
[INFO] 2021-01-02 01:20:57 > Step:   40600 Progress: 40.6% Elapsed: 15:45:29 temperature: 1.0 ada_p: No Discriminator_loss: 5.1313 Generator_loss: 4.99492 
[INFO] 2021-01-02 01:23:14 > Step:   40700 Progress: 40.7% Elapsed: 15:47:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.13503 Generator_loss: 5.00532 
[INFO] 2021-01-02 01:25:31 > Step:   40800 Progress: 40.8% Elapsed: 15:50:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.12549 Generator_loss: 5.101 
[INFO] 2021-01-02 01:27:48 > Step:   40900 Progress: 40.9% Elapsed: 15:52:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.0758 Generator_loss: 4.93434 
[INFO] 2021-01-02 01:30:05 > Step:   41000 Progress: 41.0% Elapsed: 15:54:37 temperature: 1.0 ada_p: No Discriminator_loss: 5.17746 Generator_loss: 5.14396 
[INFO] 2021-01-02 01:32:22 > Step:   41100 Progress: 41.1% Elapsed: 15:56:54 temperature: 1.0 ada_p: No Discriminator_loss: 5.00914 Generator_loss: 5.19132 
[INFO] 2021-01-02 01:34:39 > Step:   41200 Progress: 41.2% Elapsed: 15:59:11 temperature: 1.0 ada_p: No Discriminator_loss: 5.00296 Generator_loss: 5.13191 
[INFO] 2021-01-02 01:36:55 > Step:   41300 Progress: 41.3% Elapsed: 16:01:28 temperature: 1.0 ada_p: No Discriminator_loss: 5.21261 Generator_loss: 5.02525 
[INFO] 2021-01-02 01:39:11 > Step:   41400 Progress: 41.4% Elapsed: 16:03:44 temperature: 1.0 ada_p: No Discriminator_loss: 5.12841 Generator_loss: 4.96539 
[INFO] 2021-01-02 01:41:28 > Step:   41500 Progress: 41.5% Elapsed: 16:06:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.02409 Generator_loss: 5.03771 
[INFO] 2021-01-02 01:43:45 > Step:   41600 Progress: 41.6% Elapsed: 16:08:17 temperature: 1.0 ada_p: No Discriminator_loss: 5.12216 Generator_loss: 5.06815 
[INFO] 2021-01-02 01:46:02 > Step:   41700 Progress: 41.7% Elapsed: 16:10:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.94123 Generator_loss: 5.04531 
[INFO] 2021-01-02 01:48:18 > Step:   41800 Progress: 41.8% Elapsed: 16:12:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.99757 Generator_loss: 5.05955 
[INFO] 2021-01-02 01:50:35 > Step:   41900 Progress: 41.9% Elapsed: 16:15:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.99339 Generator_loss: 4.97199 
[INFO] 2021-01-02 01:52:52 > Step:   42000 Progress: 42.0% Elapsed: 16:17:24 temperature: 1.0 ada_p: No Discriminator_loss: 5.05824 Generator_loss: 5.12138 
[INFO] 2021-01-02 01:52:52 > Start Evaluation (42000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 01:52:52 > Calculating FID Score....
[INFO] 2021-01-02 01:53:08 > Calculating Inception Score....
[INFO] 2021-01-02 01:53:14 > Calculate F_beta Score....
[INFO] 2021-01-02 01:53:34 > Calculate Accuracies....
[INFO] 2021-01-02 01:53:38 > Calculate Accuracies....
[INFO] 2021-01-02 01:53:40 > F_8 score (Step: 42000, Using valid images): 0.8894485602177055
[INFO] 2021-01-02 01:53:40 > F_1/8 score (Step: 42000, Using valid images): 0.9713333243634021
[INFO] 2021-01-02 01:53:40 > FID score (Step: 42000, Using valid moments): 27.645208759849595
[INFO] 2021-01-02 01:53:40 > Inception score (Step: 42000, 10000 generated images): 13.648024559020996
[INFO] 2021-01-02 01:53:40 > Best FID score (Step: 40000, Using valid moments): 27.360779346029858
[INFO] 2021-01-02 01:53:46 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 01:56:05 > Step:   42100 Progress: 42.1% Elapsed: 16:20:37 temperature: 1.0 ada_p: No Discriminator_loss: 5.03435 Generator_loss: 5.24788 
[INFO] 2021-01-02 01:58:21 > Step:   42200 Progress: 42.2% Elapsed: 16:22:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.94361 Generator_loss: 4.98176 
[INFO] 2021-01-02 02:00:37 > Step:   42300 Progress: 42.3% Elapsed: 16:25:09 temperature: 1.0 ada_p: No Discriminator_loss: 5.08716 Generator_loss: 5.1801 
[INFO] 2021-01-02 02:02:54 > Step:   42400 Progress: 42.4% Elapsed: 16:27:26 temperature: 1.0 ada_p: No Discriminator_loss: 5.04579 Generator_loss: 5.05857 
[INFO] 2021-01-02 02:05:09 > Step:   42500 Progress: 42.5% Elapsed: 16:29:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.89212 Generator_loss: 5.12871 
[INFO] 2021-01-02 02:07:25 > Step:   42600 Progress: 42.6% Elapsed: 16:31:57 temperature: 1.0 ada_p: No Discriminator_loss: 5.01846 Generator_loss: 5.08063 
[INFO] 2021-01-02 02:09:41 > Step:   42700 Progress: 42.7% Elapsed: 16:34:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.94376 Generator_loss: 5.11764 
[INFO] 2021-01-02 02:11:57 > Step:   42800 Progress: 42.8% Elapsed: 16:36:29 temperature: 1.0 ada_p: No Discriminator_loss: 5.07265 Generator_loss: 5.1847 
[INFO] 2021-01-02 02:14:13 > Step:   42900 Progress: 42.9% Elapsed: 16:38:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.96437 Generator_loss: 5.1743 
[INFO] 2021-01-02 02:16:29 > Step:   43000 Progress: 43.0% Elapsed: 16:41:01 temperature: 1.0 ada_p: No Discriminator_loss: 5.0592 Generator_loss: 5.33593 
[INFO] 2021-01-02 02:18:45 > Step:   43100 Progress: 43.1% Elapsed: 16:43:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.96409 Generator_loss: 5.06545 
[INFO] 2021-01-02 02:21:02 > Step:   43200 Progress: 43.2% Elapsed: 16:45:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.91719 Generator_loss: 5.14092 
[INFO] 2021-01-02 02:23:18 > Step:   43300 Progress: 43.3% Elapsed: 16:47:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.06704 Generator_loss: 5.06165 
[INFO] 2021-01-02 02:25:34 > Step:   43400 Progress: 43.4% Elapsed: 16:50:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.90957 Generator_loss: 5.24959 
[INFO] 2021-01-02 02:27:50 > Step:   43500 Progress: 43.5% Elapsed: 16:52:22 temperature: 1.0 ada_p: No Discriminator_loss: 5.03422 Generator_loss: 5.07072 
[INFO] 2021-01-02 02:30:07 > Step:   43600 Progress: 43.6% Elapsed: 16:54:40 temperature: 1.0 ada_p: No Discriminator_loss: 4.92327 Generator_loss: 5.13338 
[INFO] 2021-01-02 02:32:24 > Step:   43700 Progress: 43.7% Elapsed: 16:56:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.04468 Generator_loss: 4.88532 
[INFO] 2021-01-02 02:34:41 > Step:   43800 Progress: 43.8% Elapsed: 16:59:13 temperature: 1.0 ada_p: No Discriminator_loss: 5.08912 Generator_loss: 5.02597 
[INFO] 2021-01-02 02:36:58 > Step:   43900 Progress: 43.9% Elapsed: 17:01:30 temperature: 1.0 ada_p: No Discriminator_loss: 5.08713 Generator_loss: 5.08025 
[INFO] 2021-01-02 02:39:14 > Step:   44000 Progress: 44.0% Elapsed: 17:03:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.01699 Generator_loss: 5.28861 
[INFO] 2021-01-02 02:39:14 > Start Evaluation (44000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 02:39:14 > Calculating FID Score....
[INFO] 2021-01-02 02:39:31 > Calculating Inception Score....
[INFO] 2021-01-02 02:39:37 > Calculate F_beta Score....
[INFO] 2021-01-02 02:39:58 > Calculate Accuracies....
[INFO] 2021-01-02 02:40:01 > Calculate Accuracies....
[INFO] 2021-01-02 02:40:03 > F_8 score (Step: 44000, Using valid images): 0.8847791452921556
[INFO] 2021-01-02 02:40:03 > F_1/8 score (Step: 44000, Using valid images): 0.9767887666514222
[INFO] 2021-01-02 02:40:03 > FID score (Step: 44000, Using valid moments): 27.090717568816444
[INFO] 2021-01-02 02:40:03 > Inception score (Step: 44000, 10000 generated images): 13.57205581665039
[INFO] 2021-01-02 02:40:03 > Best FID score (Step: 44000, Using valid moments): 27.090717568816444
[INFO] 2021-01-02 02:40:17 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 02:42:34 > Step:   44100 Progress: 44.1% Elapsed: 17:07:06 temperature: 1.0 ada_p: No Discriminator_loss: 5.08823 Generator_loss: 5.19598 
[INFO] 2021-01-02 02:44:51 > Step:   44200 Progress: 44.2% Elapsed: 17:09:23 temperature: 1.0 ada_p: No Discriminator_loss: 5.06234 Generator_loss: 5.13351 
[INFO] 2021-01-02 02:47:07 > Step:   44300 Progress: 44.3% Elapsed: 17:11:39 temperature: 1.0 ada_p: No Discriminator_loss: 5.05392 Generator_loss: 5.47606 
[INFO] 2021-01-02 02:49:24 > Step:   44400 Progress: 44.4% Elapsed: 17:13:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.1226 Generator_loss: 5.16494 
[INFO] 2021-01-02 02:51:41 > Step:   44500 Progress: 44.5% Elapsed: 17:16:13 temperature: 1.0 ada_p: No Discriminator_loss: 5.07725 Generator_loss: 5.12497 
[INFO] 2021-01-02 02:53:58 > Step:   44600 Progress: 44.6% Elapsed: 17:18:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.8749 Generator_loss: 5.22078 
[INFO] 2021-01-02 02:56:14 > Step:   44700 Progress: 44.7% Elapsed: 17:20:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.94132 Generator_loss: 5.16633 
[INFO] 2021-01-02 02:58:31 > Step:   44800 Progress: 44.8% Elapsed: 17:23:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.11916 Generator_loss: 5.31189 
[INFO] 2021-01-02 03:00:48 > Step:   44900 Progress: 44.9% Elapsed: 17:25:20 temperature: 1.0 ada_p: No Discriminator_loss: 5.0587 Generator_loss: 5.18826 
[INFO] 2021-01-02 03:03:04 > Step:   45000 Progress: 45.0% Elapsed: 17:27:36 temperature: 1.0 ada_p: No Discriminator_loss: 5.052 Generator_loss: 5.0559 
[INFO] 2021-01-02 03:05:21 > Step:   45100 Progress: 45.1% Elapsed: 17:29:53 temperature: 1.0 ada_p: No Discriminator_loss: 5.03601 Generator_loss: 5.09269 
[INFO] 2021-01-02 03:07:37 > Step:   45200 Progress: 45.2% Elapsed: 17:32:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.92027 Generator_loss: 5.15422 
[INFO] 2021-01-02 03:09:55 > Step:   45300 Progress: 45.3% Elapsed: 17:34:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.79923 Generator_loss: 5.3128 
[INFO] 2021-01-02 03:12:11 > Step:   45400 Progress: 45.4% Elapsed: 17:36:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.9565 Generator_loss: 5.23359 
[INFO] 2021-01-02 03:14:28 > Step:   45500 Progress: 45.5% Elapsed: 17:39:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.85683 Generator_loss: 5.20382 
[INFO] 2021-01-02 03:16:45 > Step:   45600 Progress: 45.6% Elapsed: 17:41:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.90106 Generator_loss: 5.11568 
[INFO] 2021-01-02 03:19:01 > Step:   45700 Progress: 45.7% Elapsed: 17:43:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.93204 Generator_loss: 5.14181 
[INFO] 2021-01-02 03:21:17 > Step:   45800 Progress: 45.8% Elapsed: 17:45:50 temperature: 1.0 ada_p: No Discriminator_loss: 5.00967 Generator_loss: 5.24184 
[INFO] 2021-01-02 03:23:33 > Step:   45900 Progress: 45.9% Elapsed: 17:48:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.91991 Generator_loss: 5.08335 
[INFO] 2021-01-02 03:25:50 > Step:   46000 Progress: 46.0% Elapsed: 17:50:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.97967 Generator_loss: 5.13695 
[INFO] 2021-01-02 03:25:50 > Start Evaluation (46000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 03:25:50 > Calculating FID Score....
[INFO] 2021-01-02 03:26:06 > Calculating Inception Score....
[INFO] 2021-01-02 03:26:12 > Calculate F_beta Score....
[INFO] 2021-01-02 03:26:35 > Calculate Accuracies....
[INFO] 2021-01-02 03:26:38 > Calculate Accuracies....
[INFO] 2021-01-02 03:26:40 > F_8 score (Step: 46000, Using valid images): 0.8862736289973115
[INFO] 2021-01-02 03:26:40 > F_1/8 score (Step: 46000, Using valid images): 0.9753674503055157
[INFO] 2021-01-02 03:26:40 > FID score (Step: 46000, Using valid moments): 27.045015748419303
[INFO] 2021-01-02 03:26:40 > Inception score (Step: 46000, 10000 generated images): 13.704564094543457
[INFO] 2021-01-02 03:26:40 > Best FID score (Step: 46000, Using valid moments): 27.045015748419303
[INFO] 2021-01-02 03:26:53 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 03:29:09 > Step:   46100 Progress: 46.1% Elapsed: 17:53:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.04016 Generator_loss: 5.22417 
[INFO] 2021-01-02 03:31:25 > Step:   46200 Progress: 46.2% Elapsed: 17:55:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.98043 Generator_loss: 5.23445 
[INFO] 2021-01-02 03:33:41 > Step:   46300 Progress: 46.3% Elapsed: 17:58:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.95173 Generator_loss: 5.22641 
[INFO] 2021-01-02 03:35:57 > Step:   46400 Progress: 46.4% Elapsed: 18:00:30 temperature: 1.0 ada_p: No Discriminator_loss: 5.02773 Generator_loss: 5.16954 
[INFO] 2021-01-02 03:38:13 > Step:   46500 Progress: 46.5% Elapsed: 18:02:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.93645 Generator_loss: 5.17306 
[INFO] 2021-01-02 03:40:30 > Step:   46600 Progress: 46.6% Elapsed: 18:05:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.03878 Generator_loss: 5.08849 
[INFO] 2021-01-02 03:42:46 > Step:   46700 Progress: 46.7% Elapsed: 18:07:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.06877 Generator_loss: 5.60475 
[INFO] 2021-01-02 03:45:02 > Step:   46800 Progress: 46.8% Elapsed: 18:09:35 temperature: 1.0 ada_p: No Discriminator_loss: 5.05985 Generator_loss: 5.16198 
[INFO] 2021-01-02 03:47:19 > Step:   46900 Progress: 46.9% Elapsed: 18:11:52 temperature: 1.0 ada_p: No Discriminator_loss: 5.10588 Generator_loss: 5.218 
[INFO] 2021-01-02 03:49:36 > Step:   47000 Progress: 47.0% Elapsed: 18:14:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.97409 Generator_loss: 5.11913 
[INFO] 2021-01-02 03:51:53 > Step:   47100 Progress: 47.1% Elapsed: 18:16:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.83441 Generator_loss: 5.33981 
[INFO] 2021-01-02 03:54:09 > Step:   47200 Progress: 47.2% Elapsed: 18:18:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.95065 Generator_loss: 5.2346 
[INFO] 2021-01-02 03:56:25 > Step:   47300 Progress: 47.3% Elapsed: 18:20:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.98141 Generator_loss: 5.355 
[INFO] 2021-01-02 03:58:42 > Step:   47400 Progress: 47.4% Elapsed: 18:23:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.85406 Generator_loss: 5.27884 
[INFO] 2021-01-02 04:00:59 > Step:   47500 Progress: 47.5% Elapsed: 18:25:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.89047 Generator_loss: 5.26626 
[INFO] 2021-01-02 04:03:16 > Step:   47600 Progress: 47.6% Elapsed: 18:27:48 temperature: 1.0 ada_p: No Discriminator_loss: 5.03441 Generator_loss: 5.0518 
[INFO] 2021-01-02 04:05:33 > Step:   47700 Progress: 47.7% Elapsed: 18:30:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.85186 Generator_loss: 5.21646 
[INFO] 2021-01-02 04:07:50 > Step:   47800 Progress: 47.8% Elapsed: 18:32:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.90493 Generator_loss: 5.16881 
[INFO] 2021-01-02 04:10:07 > Step:   47900 Progress: 47.9% Elapsed: 18:34:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.94975 Generator_loss: 5.09632 
[INFO] 2021-01-02 04:12:23 > Step:   48000 Progress: 48.0% Elapsed: 18:36:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.88125 Generator_loss: 5.40235 
[INFO] 2021-01-02 04:12:23 > Start Evaluation (48000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 04:12:23 > Calculating FID Score....
[INFO] 2021-01-02 04:12:40 > Calculating Inception Score....
[INFO] 2021-01-02 04:12:46 > Calculate F_beta Score....
[INFO] 2021-01-02 04:13:07 > Calculate Accuracies....
[INFO] 2021-01-02 04:13:11 > Calculate Accuracies....
[INFO] 2021-01-02 04:13:13 > F_8 score (Step: 48000, Using valid images): 0.896090569049458
[INFO] 2021-01-02 04:13:13 > F_1/8 score (Step: 48000, Using valid images): 0.9747331056382594
[INFO] 2021-01-02 04:13:13 > FID score (Step: 48000, Using valid moments): 27.046051298114662
[INFO] 2021-01-02 04:13:13 > Inception score (Step: 48000, 10000 generated images): 13.535608291625977
[INFO] 2021-01-02 04:13:13 > Best FID score (Step: 46000, Using valid moments): 27.045015748419303
[INFO] 2021-01-02 04:13:20 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 04:15:37 > Step:   48100 Progress: 48.1% Elapsed: 18:40:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.8904 Generator_loss: 5.29452 
[INFO] 2021-01-02 04:17:54 > Step:   48200 Progress: 48.2% Elapsed: 18:42:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.91322 Generator_loss: 5.28061 
[INFO] 2021-01-02 04:20:11 > Step:   48300 Progress: 48.3% Elapsed: 18:44:43 temperature: 1.0 ada_p: No Discriminator_loss: 5.02663 Generator_loss: 5.21429 
[INFO] 2021-01-02 04:22:27 > Step:   48400 Progress: 48.4% Elapsed: 18:47:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.97124 Generator_loss: 5.1273 
[INFO] 2021-01-02 04:24:44 > Step:   48500 Progress: 48.5% Elapsed: 18:49:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.93901 Generator_loss: 5.27891 
[INFO] 2021-01-02 04:27:01 > Step:   48600 Progress: 48.6% Elapsed: 18:51:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.8478 Generator_loss: 5.25541 
[INFO] 2021-01-02 04:29:19 > Step:   48700 Progress: 48.7% Elapsed: 18:53:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.91113 Generator_loss: 5.24838 
[INFO] 2021-01-02 04:31:35 > Step:   48800 Progress: 48.8% Elapsed: 18:56:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.89676 Generator_loss: 5.26891 
[INFO] 2021-01-02 04:33:53 > Step:   48900 Progress: 48.9% Elapsed: 18:58:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.84687 Generator_loss: 5.27281 
[INFO] 2021-01-02 04:36:10 > Step:   49000 Progress: 49.0% Elapsed: 19:00:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.91759 Generator_loss: 5.28154 
[INFO] 2021-01-02 04:38:27 > Step:   49100 Progress: 49.1% Elapsed: 19:02:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.91799 Generator_loss: 5.4191 
[INFO] 2021-01-02 04:40:44 > Step:   49200 Progress: 49.2% Elapsed: 19:05:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.87475 Generator_loss: 5.27427 
[INFO] 2021-01-02 04:43:01 > Step:   49300 Progress: 49.3% Elapsed: 19:07:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.86665 Generator_loss: 5.29108 
[INFO] 2021-01-02 04:45:18 > Step:   49400 Progress: 49.4% Elapsed: 19:09:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.84363 Generator_loss: 5.28389 
[INFO] 2021-01-02 04:47:35 > Step:   49500 Progress: 49.5% Elapsed: 19:12:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.83253 Generator_loss: 5.41498 
[INFO] 2021-01-02 04:49:51 > Step:   49600 Progress: 49.6% Elapsed: 19:14:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.87376 Generator_loss: 5.25825 
[INFO] 2021-01-02 04:52:08 > Step:   49700 Progress: 49.7% Elapsed: 19:16:40 temperature: 1.0 ada_p: No Discriminator_loss: 4.79715 Generator_loss: 5.26716 
[INFO] 2021-01-02 04:54:24 > Step:   49800 Progress: 49.8% Elapsed: 19:18:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.86821 Generator_loss: 5.17411 
[INFO] 2021-01-02 04:56:42 > Step:   49900 Progress: 49.9% Elapsed: 19:21:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.93503 Generator_loss: 5.25119 
[INFO] 2021-01-02 04:58:58 > Step:   50000 Progress: 50.0% Elapsed: 19:23:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.91542 Generator_loss: 5.38971 
[INFO] 2021-01-02 04:58:58 > Start Evaluation (50000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 04:58:58 > Calculating FID Score....
[INFO] 2021-01-02 04:59:14 > Calculating Inception Score....
[INFO] 2021-01-02 04:59:20 > Calculate F_beta Score....
[INFO] 2021-01-02 04:59:40 > Calculate Accuracies....
[INFO] 2021-01-02 04:59:44 > Calculate Accuracies....
[INFO] 2021-01-02 04:59:45 > F_8 score (Step: 50000, Using valid images): 0.8994706310123065
[INFO] 2021-01-02 04:59:45 > F_1/8 score (Step: 50000, Using valid images): 0.9712813296211461
[INFO] 2021-01-02 04:59:45 > FID score (Step: 50000, Using valid moments): 27.437485173601033
[INFO] 2021-01-02 04:59:45 > Inception score (Step: 50000, 10000 generated images): 13.577929496765137
[INFO] 2021-01-02 04:59:45 > Best FID score (Step: 46000, Using valid moments): 27.045015748419303
[INFO] 2021-01-02 04:59:52 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 05:02:09 > Step:   50100 Progress: 50.1% Elapsed: 19:26:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.86907 Generator_loss: 5.50327 
[INFO] 2021-01-02 05:04:26 > Step:   50200 Progress: 50.2% Elapsed: 19:28:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.84665 Generator_loss: 5.30442 
[INFO] 2021-01-02 05:06:42 > Step:   50300 Progress: 50.3% Elapsed: 19:31:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.93347 Generator_loss: 5.19397 
[INFO] 2021-01-02 05:08:58 > Step:   50400 Progress: 50.4% Elapsed: 19:33:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.90554 Generator_loss: 5.25827 
[INFO] 2021-01-02 05:11:14 > Step:   50500 Progress: 50.5% Elapsed: 19:35:47 temperature: 1.0 ada_p: No Discriminator_loss: 5.10245 Generator_loss: 5.22598 
[INFO] 2021-01-02 05:13:31 > Step:   50600 Progress: 50.6% Elapsed: 19:38:04 temperature: 1.0 ada_p: No Discriminator_loss: 4.9665 Generator_loss: 5.27854 
[INFO] 2021-01-02 05:15:49 > Step:   50700 Progress: 50.7% Elapsed: 19:40:21 temperature: 1.0 ada_p: No Discriminator_loss: 4.82241 Generator_loss: 5.4244 
[INFO] 2021-01-02 05:18:05 > Step:   50800 Progress: 50.8% Elapsed: 19:42:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.99083 Generator_loss: 5.31655 
[INFO] 2021-01-02 05:20:22 > Step:   50900 Progress: 50.9% Elapsed: 19:44:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.81174 Generator_loss: 5.27688 
[INFO] 2021-01-02 05:22:38 > Step:   51000 Progress: 51.0% Elapsed: 19:47:11 temperature: 1.0 ada_p: No Discriminator_loss: 4.86979 Generator_loss: 5.22701 
[INFO] 2021-01-02 05:24:55 > Step:   51100 Progress: 51.1% Elapsed: 19:49:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.76905 Generator_loss: 5.30348 
[INFO] 2021-01-02 05:27:11 > Step:   51200 Progress: 51.2% Elapsed: 19:51:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.8348 Generator_loss: 5.29382 
[INFO] 2021-01-02 05:29:28 > Step:   51300 Progress: 51.3% Elapsed: 19:54:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.85924 Generator_loss: 5.46214 
[INFO] 2021-01-02 05:31:44 > Step:   51400 Progress: 51.4% Elapsed: 19:56:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.90094 Generator_loss: 5.2904 
[INFO] 2021-01-02 05:34:00 > Step:   51500 Progress: 51.5% Elapsed: 19:58:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.88643 Generator_loss: 5.35689 
[INFO] 2021-01-02 05:36:16 > Step:   51600 Progress: 51.6% Elapsed: 20:00:49 temperature: 1.0 ada_p: No Discriminator_loss: 4.89178 Generator_loss: 5.37784 
[INFO] 2021-01-02 05:38:33 > Step:   51700 Progress: 51.7% Elapsed: 20:03:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.87073 Generator_loss: 5.53926 
[INFO] 2021-01-02 05:40:51 > Step:   51800 Progress: 51.8% Elapsed: 20:05:23 temperature: 1.0 ada_p: No Discriminator_loss: 4.69531 Generator_loss: 5.41656 
[INFO] 2021-01-02 05:43:07 > Step:   51900 Progress: 51.9% Elapsed: 20:07:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.86588 Generator_loss: 5.28966 
[INFO] 2021-01-02 05:45:23 > Step:   52000 Progress: 52.0% Elapsed: 20:09:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.78934 Generator_loss: 5.33711 
[INFO] 2021-01-02 05:45:23 > Start Evaluation (52000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 05:45:23 > Calculating FID Score....
[INFO] 2021-01-02 05:45:39 > Calculating Inception Score....
[INFO] 2021-01-02 05:45:45 > Calculate F_beta Score....
[INFO] 2021-01-02 05:46:07 > Calculate Accuracies....
[INFO] 2021-01-02 05:46:11 > Calculate Accuracies....
[INFO] 2021-01-02 05:46:12 > F_8 score (Step: 52000, Using valid images): 0.8933644278769561
[INFO] 2021-01-02 05:46:12 > F_1/8 score (Step: 52000, Using valid images): 0.9752828268808481
[INFO] 2021-01-02 05:46:12 > FID score (Step: 52000, Using valid moments): 27.087163953119727
[INFO] 2021-01-02 05:46:12 > Inception score (Step: 52000, 10000 generated images): 13.689278602600098
[INFO] 2021-01-02 05:46:12 > Best FID score (Step: 46000, Using valid moments): 27.045015748419303
[INFO] 2021-01-02 05:46:19 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 05:48:36 > Step:   52100 Progress: 52.1% Elapsed: 20:13:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.97562 Generator_loss: 5.22625 
[INFO] 2021-01-02 05:50:53 > Step:   52200 Progress: 52.2% Elapsed: 20:15:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.87703 Generator_loss: 5.24102 
[INFO] 2021-01-02 05:53:10 > Step:   52300 Progress: 52.3% Elapsed: 20:17:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.79853 Generator_loss: 5.35321 
[INFO] 2021-01-02 05:55:27 > Step:   52400 Progress: 52.4% Elapsed: 20:19:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.97218 Generator_loss: 5.34016 
[INFO] 2021-01-02 05:57:44 > Step:   52500 Progress: 52.5% Elapsed: 20:22:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.87774 Generator_loss: 5.43521 
[INFO] 2021-01-02 06:00:01 > Step:   52600 Progress: 52.6% Elapsed: 20:24:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.83142 Generator_loss: 5.44558 
[INFO] 2021-01-02 06:02:18 > Step:   52700 Progress: 52.7% Elapsed: 20:26:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.77613 Generator_loss: 5.35143 
[INFO] 2021-01-02 06:04:35 > Step:   52800 Progress: 52.8% Elapsed: 20:29:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.96455 Generator_loss: 5.2761 
[INFO] 2021-01-02 06:06:51 > Step:   52900 Progress: 52.9% Elapsed: 20:31:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.84109 Generator_loss: 5.21952 
[INFO] 2021-01-02 06:09:08 > Step:   53000 Progress: 53.0% Elapsed: 20:33:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.25225 Generator_loss: 5.64156 
[INFO] 2021-01-02 06:11:25 > Step:   53100 Progress: 53.1% Elapsed: 20:35:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.98614 Generator_loss: 5.54609 
[INFO] 2021-01-02 06:13:43 > Step:   53200 Progress: 53.2% Elapsed: 20:38:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.93786 Generator_loss: 5.49474 
[INFO] 2021-01-02 06:15:59 > Step:   53300 Progress: 53.3% Elapsed: 20:40:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.82854 Generator_loss: 5.45609 
[INFO] 2021-01-02 06:18:16 > Step:   53400 Progress: 53.4% Elapsed: 20:42:49 temperature: 1.0 ada_p: No Discriminator_loss: 4.76099 Generator_loss: 5.48388 
[INFO] 2021-01-02 06:20:33 > Step:   53500 Progress: 53.5% Elapsed: 20:45:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.71931 Generator_loss: 5.4244 
[INFO] 2021-01-02 06:22:50 > Step:   53600 Progress: 53.6% Elapsed: 20:47:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.76767 Generator_loss: 5.39238 
[INFO] 2021-01-02 06:25:06 > Step:   53700 Progress: 53.7% Elapsed: 20:49:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.79814 Generator_loss: 5.2557 
[INFO] 2021-01-02 06:27:23 > Step:   53800 Progress: 53.8% Elapsed: 20:51:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.90234 Generator_loss: 5.45522 
[INFO] 2021-01-02 06:29:39 > Step:   53900 Progress: 53.9% Elapsed: 20:54:12 temperature: 1.0 ada_p: No Discriminator_loss: 5.16668 Generator_loss: 5.45526 
[INFO] 2021-01-02 06:31:55 > Step:   54000 Progress: 54.0% Elapsed: 20:56:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.8904 Generator_loss: 5.27387 
[INFO] 2021-01-02 06:31:55 > Start Evaluation (54000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 06:31:55 > Calculating FID Score....
[INFO] 2021-01-02 06:32:11 > Calculating Inception Score....
[INFO] 2021-01-02 06:32:17 > Calculate F_beta Score....
[INFO] 2021-01-02 06:32:39 > Calculate Accuracies....
[INFO] 2021-01-02 06:32:43 > Calculate Accuracies....
[INFO] 2021-01-02 06:32:44 > F_8 score (Step: 54000, Using valid images): 0.9023922519513939
[INFO] 2021-01-02 06:32:44 > F_1/8 score (Step: 54000, Using valid images): 0.9749229284095045
[INFO] 2021-01-02 06:32:44 > FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 06:32:44 > Inception score (Step: 54000, 10000 generated images): 13.494095802307129
[INFO] 2021-01-02 06:32:44 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 06:32:58 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 06:35:14 > Step:   54100 Progress: 54.1% Elapsed: 20:59:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.97255 Generator_loss: 5.36585 
[INFO] 2021-01-02 06:37:29 > Step:   54200 Progress: 54.2% Elapsed: 21:02:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.92666 Generator_loss: 5.35693 
[INFO] 2021-01-02 06:39:45 > Step:   54300 Progress: 54.3% Elapsed: 21:04:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.89732 Generator_loss: 5.32929 
[INFO] 2021-01-02 06:42:01 > Step:   54400 Progress: 54.4% Elapsed: 21:06:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.74257 Generator_loss: 5.46388 
[INFO] 2021-01-02 06:44:17 > Step:   54500 Progress: 54.5% Elapsed: 21:08:49 temperature: 1.0 ada_p: No Discriminator_loss: 5.0281 Generator_loss: 5.35853 
[INFO] 2021-01-02 06:46:33 > Step:   54600 Progress: 54.6% Elapsed: 21:11:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.89343 Generator_loss: 5.19887 
[INFO] 2021-01-02 06:48:49 > Step:   54700 Progress: 54.7% Elapsed: 21:13:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.81742 Generator_loss: 5.38916 
[INFO] 2021-01-02 06:51:06 > Step:   54800 Progress: 54.8% Elapsed: 21:15:38 temperature: 1.0 ada_p: No Discriminator_loss: 4.87944 Generator_loss: 5.51772 
[INFO] 2021-01-02 06:53:23 > Step:   54900 Progress: 54.9% Elapsed: 21:17:56 temperature: 1.0 ada_p: No Discriminator_loss: 5.04221 Generator_loss: 5.71172 
[INFO] 2021-01-02 06:55:41 > Step:   55000 Progress: 55.0% Elapsed: 21:20:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.73861 Generator_loss: 5.45964 
[INFO] 2021-01-02 06:57:58 > Step:   55100 Progress: 55.1% Elapsed: 21:22:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.81064 Generator_loss: 5.36583 
[INFO] 2021-01-02 07:00:15 > Step:   55200 Progress: 55.2% Elapsed: 21:24:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.70395 Generator_loss: 5.4068 
[INFO] 2021-01-02 07:02:32 > Step:   55300 Progress: 55.3% Elapsed: 21:27:04 temperature: 1.0 ada_p: No Discriminator_loss: 4.90192 Generator_loss: 5.17063 
[INFO] 2021-01-02 07:04:49 > Step:   55400 Progress: 55.4% Elapsed: 21:29:21 temperature: 1.0 ada_p: No Discriminator_loss: 4.89494 Generator_loss: 5.25157 
[INFO] 2021-01-02 07:07:05 > Step:   55500 Progress: 55.5% Elapsed: 21:31:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.84233 Generator_loss: 5.34175 
[INFO] 2021-01-02 07:09:21 > Step:   55600 Progress: 55.6% Elapsed: 21:33:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.86876 Generator_loss: 5.33489 
[INFO] 2021-01-02 07:11:38 > Step:   55700 Progress: 55.7% Elapsed: 21:36:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.76032 Generator_loss: 5.37667 
[INFO] 2021-01-02 07:13:55 > Step:   55800 Progress: 55.8% Elapsed: 21:38:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.80948 Generator_loss: 5.383 
[INFO] 2021-01-02 07:16:11 > Step:   55900 Progress: 55.9% Elapsed: 21:40:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.76215 Generator_loss: 5.49906 
[INFO] 2021-01-02 07:18:28 > Step:   56000 Progress: 56.0% Elapsed: 21:43:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.79907 Generator_loss: 5.47797 
[INFO] 2021-01-02 07:18:28 > Start Evaluation (56000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 07:18:28 > Calculating FID Score....
[INFO] 2021-01-02 07:18:44 > Calculating Inception Score....
[INFO] 2021-01-02 07:18:50 > Calculate F_beta Score....
[INFO] 2021-01-02 07:19:11 > Calculate Accuracies....
[INFO] 2021-01-02 07:19:15 > Calculate Accuracies....
[INFO] 2021-01-02 07:19:17 > F_8 score (Step: 56000, Using valid images): 0.8978404782932927
[INFO] 2021-01-02 07:19:17 > F_1/8 score (Step: 56000, Using valid images): 0.9746522020288187
[INFO] 2021-01-02 07:19:17 > FID score (Step: 56000, Using valid moments): 27.310884739048277
[INFO] 2021-01-02 07:19:17 > Inception score (Step: 56000, 10000 generated images): 13.446577072143555
[INFO] 2021-01-02 07:19:17 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 07:19:24 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 07:21:41 > Step:   56100 Progress: 56.1% Elapsed: 21:46:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.77707 Generator_loss: 5.34021 
[INFO] 2021-01-02 07:23:58 > Step:   56200 Progress: 56.2% Elapsed: 21:48:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.73477 Generator_loss: 5.54874 
[INFO] 2021-01-02 07:26:15 > Step:   56300 Progress: 56.3% Elapsed: 21:50:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.73129 Generator_loss: 5.37762 
[INFO] 2021-01-02 07:28:33 > Step:   56400 Progress: 56.4% Elapsed: 21:53:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.78576 Generator_loss: 5.4583 
[INFO] 2021-01-02 07:30:50 > Step:   56500 Progress: 56.5% Elapsed: 21:55:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.71378 Generator_loss: 5.57157 
[INFO] 2021-01-02 07:33:06 > Step:   56600 Progress: 56.6% Elapsed: 21:57:39 temperature: 1.0 ada_p: No Discriminator_loss: 5.03368 Generator_loss: 5.27985 
[INFO] 2021-01-02 07:35:24 > Step:   56700 Progress: 56.7% Elapsed: 21:59:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.85941 Generator_loss: 5.52056 
[INFO] 2021-01-02 07:37:41 > Step:   56800 Progress: 56.8% Elapsed: 22:02:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.82069 Generator_loss: 5.37852 
[INFO] 2021-01-02 07:39:58 > Step:   56900 Progress: 56.9% Elapsed: 22:04:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.91183 Generator_loss: 5.45748 
[INFO] 2021-01-02 07:42:15 > Step:   57000 Progress: 57.0% Elapsed: 22:06:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.71147 Generator_loss: 5.44781 
[INFO] 2021-01-02 07:44:32 > Step:   57100 Progress: 57.1% Elapsed: 22:09:04 temperature: 1.0 ada_p: No Discriminator_loss: 4.80807 Generator_loss: 5.40686 
[INFO] 2021-01-02 07:46:49 > Step:   57200 Progress: 57.2% Elapsed: 22:11:21 temperature: 1.0 ada_p: No Discriminator_loss: 4.79587 Generator_loss: 5.38406 
[INFO] 2021-01-02 07:49:05 > Step:   57300 Progress: 57.3% Elapsed: 22:13:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.86747 Generator_loss: 5.38304 
[INFO] 2021-01-02 07:51:22 > Step:   57400 Progress: 57.4% Elapsed: 22:15:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.70495 Generator_loss: 5.56465 
[INFO] 2021-01-02 07:53:39 > Step:   57500 Progress: 57.5% Elapsed: 22:18:11 temperature: 1.0 ada_p: No Discriminator_loss: 4.91706 Generator_loss: 5.47862 
[INFO] 2021-01-02 07:55:55 > Step:   57600 Progress: 57.6% Elapsed: 22:20:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.74145 Generator_loss: 5.29309 
[INFO] 2021-01-02 07:58:12 > Step:   57700 Progress: 57.7% Elapsed: 22:22:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.79888 Generator_loss: 5.46431 
[INFO] 2021-01-02 08:00:29 > Step:   57800 Progress: 57.8% Elapsed: 22:25:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.85346 Generator_loss: 5.2152 
[INFO] 2021-01-02 08:02:45 > Step:   57900 Progress: 57.9% Elapsed: 22:27:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.89647 Generator_loss: 5.32893 
[INFO] 2021-01-02 08:05:02 > Step:   58000 Progress: 58.0% Elapsed: 22:29:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.86528 Generator_loss: 5.40621 
[INFO] 2021-01-02 08:05:02 > Start Evaluation (58000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 08:05:02 > Calculating FID Score....
[INFO] 2021-01-02 08:05:18 > Calculating Inception Score....
[INFO] 2021-01-02 08:05:24 > Calculate F_beta Score....
[INFO] 2021-01-02 08:05:46 > Calculate Accuracies....
[INFO] 2021-01-02 08:05:49 > Calculate Accuracies....
[INFO] 2021-01-02 08:05:51 > F_8 score (Step: 58000, Using valid images): 0.8818441332362417
[INFO] 2021-01-02 08:05:51 > F_1/8 score (Step: 58000, Using valid images): 0.975515582393757
[INFO] 2021-01-02 08:05:51 > FID score (Step: 58000, Using valid moments): 27.393167354309412
[INFO] 2021-01-02 08:05:51 > Inception score (Step: 58000, 10000 generated images): 13.537040710449219
[INFO] 2021-01-02 08:05:51 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 08:05:58 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 08:08:14 > Step:   58100 Progress: 58.1% Elapsed: 22:32:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.78621 Generator_loss: 5.78527 
[INFO] 2021-01-02 08:10:30 > Step:   58200 Progress: 58.2% Elapsed: 22:35:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.82033 Generator_loss: 5.40408 
[INFO] 2021-01-02 08:12:47 > Step:   58300 Progress: 58.3% Elapsed: 22:37:19 temperature: 1.0 ada_p: No Discriminator_loss: 4.64792 Generator_loss: 5.5642 
[INFO] 2021-01-02 08:15:03 > Step:   58400 Progress: 58.4% Elapsed: 22:39:36 temperature: 1.0 ada_p: No Discriminator_loss: 4.79727 Generator_loss: 5.50625 
[INFO] 2021-01-02 08:17:19 > Step:   58500 Progress: 58.5% Elapsed: 22:41:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.69274 Generator_loss: 5.47948 
[INFO] 2021-01-02 08:19:37 > Step:   58600 Progress: 58.6% Elapsed: 22:44:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.74807 Generator_loss: 5.48857 
[INFO] 2021-01-02 08:21:54 > Step:   58700 Progress: 58.7% Elapsed: 22:46:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.8293 Generator_loss: 5.48814 
[INFO] 2021-01-02 08:24:10 > Step:   58800 Progress: 58.8% Elapsed: 22:48:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.97217 Generator_loss: 5.57336 
[INFO] 2021-01-02 08:26:26 > Step:   58900 Progress: 58.9% Elapsed: 22:50:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.90219 Generator_loss: 5.4438 
[INFO] 2021-01-02 08:28:43 > Step:   59000 Progress: 59.0% Elapsed: 22:53:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.76428 Generator_loss: 5.44387 
[INFO] 2021-01-02 08:31:00 > Step:   59100 Progress: 59.1% Elapsed: 22:55:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.82401 Generator_loss: 5.56307 
[INFO] 2021-01-02 08:33:16 > Step:   59200 Progress: 59.2% Elapsed: 22:57:48 temperature: 1.0 ada_p: No Discriminator_loss: 4.73296 Generator_loss: 5.57545 
[INFO] 2021-01-02 08:35:33 > Step:   59300 Progress: 59.3% Elapsed: 23:00:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.65252 Generator_loss: 5.59478 
[INFO] 2021-01-02 08:37:49 > Step:   59400 Progress: 59.4% Elapsed: 23:02:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.76345 Generator_loss: 5.5821 
[INFO] 2021-01-02 08:40:06 > Step:   59500 Progress: 59.5% Elapsed: 23:04:39 temperature: 1.0 ada_p: No Discriminator_loss: 5.00558 Generator_loss: 5.25358 
[INFO] 2021-01-02 08:42:23 > Step:   59600 Progress: 59.6% Elapsed: 23:06:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.71641 Generator_loss: 5.50733 
[INFO] 2021-01-02 08:44:39 > Step:   59700 Progress: 59.7% Elapsed: 23:09:12 temperature: 1.0 ada_p: No Discriminator_loss: 4.72061 Generator_loss: 5.62681 
[INFO] 2021-01-02 08:46:56 > Step:   59800 Progress: 59.8% Elapsed: 23:11:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.70599 Generator_loss: 5.65434 
[INFO] 2021-01-02 08:49:13 > Step:   59900 Progress: 59.9% Elapsed: 23:13:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.70818 Generator_loss: 5.64426 
[INFO] 2021-01-02 08:51:29 > Step:   60000 Progress: 60.0% Elapsed: 23:16:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.71085 Generator_loss: 5.48015 
[INFO] 2021-01-02 08:51:29 > Start Evaluation (60000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 08:51:29 > Calculating FID Score....
[INFO] 2021-01-02 08:51:45 > Calculating Inception Score....
[INFO] 2021-01-02 08:51:51 > Calculate F_beta Score....
[INFO] 2021-01-02 08:52:12 > Calculate Accuracies....
[INFO] 2021-01-02 08:52:15 > Calculate Accuracies....
[INFO] 2021-01-02 08:52:17 > F_8 score (Step: 60000, Using valid images): 0.8868519184400631
[INFO] 2021-01-02 08:52:17 > F_1/8 score (Step: 60000, Using valid images): 0.9716800828709757
[INFO] 2021-01-02 08:52:17 > FID score (Step: 60000, Using valid moments): 27.426603341709438
[INFO] 2021-01-02 08:52:17 > Inception score (Step: 60000, 10000 generated images): 13.87148666381836
[INFO] 2021-01-02 08:52:17 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 08:52:24 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 08:54:41 > Step:   60100 Progress: 60.1% Elapsed: 23:19:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.7471 Generator_loss: 5.42599 
[INFO] 2021-01-02 08:56:57 > Step:   60200 Progress: 60.2% Elapsed: 23:21:29 temperature: 1.0 ada_p: No Discriminator_loss: 4.73876 Generator_loss: 5.49734 
[INFO] 2021-01-02 08:59:14 > Step:   60300 Progress: 60.3% Elapsed: 23:23:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.61247 Generator_loss: 5.5049 
[INFO] 2021-01-02 09:01:30 > Step:   60400 Progress: 60.4% Elapsed: 23:26:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.78585 Generator_loss: 5.47163 
[INFO] 2021-01-02 09:03:46 > Step:   60500 Progress: 60.5% Elapsed: 23:28:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.74268 Generator_loss: 5.43048 
[INFO] 2021-01-02 09:06:02 > Step:   60600 Progress: 60.6% Elapsed: 23:30:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.72241 Generator_loss: 5.52511 
[INFO] 2021-01-02 09:08:18 > Step:   60700 Progress: 60.7% Elapsed: 23:32:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.63852 Generator_loss: 5.67735 
[INFO] 2021-01-02 09:10:33 > Step:   60800 Progress: 60.8% Elapsed: 23:35:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.76115 Generator_loss: 5.4713 
[INFO] 2021-01-02 09:12:50 > Step:   60900 Progress: 60.9% Elapsed: 23:37:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.57436 Generator_loss: 5.97913 
[INFO] 2021-01-02 09:15:07 > Step:   61000 Progress: 61.0% Elapsed: 23:39:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.65809 Generator_loss: 5.74955 
[INFO] 2021-01-02 09:17:23 > Step:   61100 Progress: 61.1% Elapsed: 23:41:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.72576 Generator_loss: 5.48822 
[INFO] 2021-01-02 09:19:40 > Step:   61200 Progress: 61.2% Elapsed: 23:44:12 temperature: 1.0 ada_p: No Discriminator_loss: 4.61684 Generator_loss: 5.7127 
[INFO] 2021-01-02 09:21:56 > Step:   61300 Progress: 61.3% Elapsed: 23:46:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.83469 Generator_loss: 5.39808 
[INFO] 2021-01-02 09:24:12 > Step:   61400 Progress: 61.4% Elapsed: 23:48:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.72311 Generator_loss: 5.46669 
[INFO] 2021-01-02 09:26:30 > Step:   61500 Progress: 61.5% Elapsed: 23:51:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.77423 Generator_loss: 5.41096 
[INFO] 2021-01-02 09:28:47 > Step:   61600 Progress: 61.6% Elapsed: 23:53:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.69075 Generator_loss: 5.71519 
[INFO] 2021-01-02 09:31:04 > Step:   61700 Progress: 61.7% Elapsed: 23:55:36 temperature: 1.0 ada_p: No Discriminator_loss: 4.75025 Generator_loss: 5.57504 
[INFO] 2021-01-02 09:33:21 > Step:   61800 Progress: 61.8% Elapsed: 23:57:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.67695 Generator_loss: 5.63132 
[INFO] 2021-01-02 09:35:37 > Step:   61900 Progress: 61.9% Elapsed: 1 day, 0:00:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.70513 Generator_loss: 5.55502 
[INFO] 2021-01-02 09:37:54 > Step:   62000 Progress: 62.0% Elapsed: 1 day, 0:02:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.64515 Generator_loss: 5.52801 
[INFO] 2021-01-02 09:37:54 > Start Evaluation (62000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 09:37:54 > Calculating FID Score....
[INFO] 2021-01-02 09:38:11 > Calculating Inception Score....
[INFO] 2021-01-02 09:38:16 > Calculate F_beta Score....
[INFO] 2021-01-02 09:38:38 > Calculate Accuracies....
[INFO] 2021-01-02 09:38:41 > Calculate Accuracies....
[INFO] 2021-01-02 09:38:43 > F_8 score (Step: 62000, Using valid images): 0.8851878750714806
[INFO] 2021-01-02 09:38:43 > F_1/8 score (Step: 62000, Using valid images): 0.9726483203316977
[INFO] 2021-01-02 09:38:43 > FID score (Step: 62000, Using valid moments): 27.546237190302236
[INFO] 2021-01-02 09:38:43 > Inception score (Step: 62000, 10000 generated images): 13.640633583068848
[INFO] 2021-01-02 09:38:43 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 09:38:50 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 09:41:07 > Step:   62100 Progress: 62.1% Elapsed: 1 day, 0:05:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.69235 Generator_loss: 5.47592 
[INFO] 2021-01-02 09:43:24 > Step:   62200 Progress: 62.2% Elapsed: 1 day, 0:07:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.65459 Generator_loss: 5.71676 
[INFO] 2021-01-02 09:45:40 > Step:   62300 Progress: 62.3% Elapsed: 1 day, 0:10:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.705 Generator_loss: 5.56949 
[INFO] 2021-01-02 09:47:58 > Step:   62400 Progress: 62.4% Elapsed: 1 day, 0:12:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.76895 Generator_loss: 5.49211 
[INFO] 2021-01-02 09:50:14 > Step:   62500 Progress: 62.5% Elapsed: 1 day, 0:14:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.6679 Generator_loss: 5.59101 
[INFO] 2021-01-02 09:52:30 > Step:   62600 Progress: 62.6% Elapsed: 1 day, 0:17:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.99204 Generator_loss: 5.2572 
[INFO] 2021-01-02 09:54:46 > Step:   62700 Progress: 62.7% Elapsed: 1 day, 0:19:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.66324 Generator_loss: 5.52073 
[INFO] 2021-01-02 09:57:03 > Step:   62800 Progress: 62.8% Elapsed: 1 day, 0:21:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.59959 Generator_loss: 5.71981 
[INFO] 2021-01-02 09:59:19 > Step:   62900 Progress: 62.9% Elapsed: 1 day, 0:23:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.66641 Generator_loss: 5.5875 
[INFO] 2021-01-02 10:01:36 > Step:   63000 Progress: 63.0% Elapsed: 1 day, 0:26:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.74184 Generator_loss: 5.44454 
[INFO] 2021-01-02 10:03:53 > Step:   63100 Progress: 63.1% Elapsed: 1 day, 0:28:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.61443 Generator_loss: 5.59005 
[INFO] 2021-01-02 10:06:10 > Step:   63200 Progress: 63.2% Elapsed: 1 day, 0:30:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.62846 Generator_loss: 5.66526 
[INFO] 2021-01-02 10:08:27 > Step:   63300 Progress: 63.3% Elapsed: 1 day, 0:32:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.65282 Generator_loss: 5.51241 
[INFO] 2021-01-02 10:10:42 > Step:   63400 Progress: 63.4% Elapsed: 1 day, 0:35:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.70792 Generator_loss: 5.5357 
[INFO] 2021-01-02 10:12:59 > Step:   63500 Progress: 63.5% Elapsed: 1 day, 0:37:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.77551 Generator_loss: 5.6181 
[INFO] 2021-01-02 10:15:16 > Step:   63600 Progress: 63.6% Elapsed: 1 day, 0:39:48 temperature: 1.0 ada_p: No Discriminator_loss: 4.65542 Generator_loss: 5.63191 
[INFO] 2021-01-02 10:17:32 > Step:   63700 Progress: 63.7% Elapsed: 1 day, 0:42:04 temperature: 1.0 ada_p: No Discriminator_loss: 4.86834 Generator_loss: 5.67908 
[INFO] 2021-01-02 10:19:48 > Step:   63800 Progress: 63.8% Elapsed: 1 day, 0:44:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.59013 Generator_loss: 5.70392 
[INFO] 2021-01-02 10:22:05 > Step:   63900 Progress: 63.9% Elapsed: 1 day, 0:46:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.7814 Generator_loss: 5.4921 
[INFO] 2021-01-02 10:24:22 > Step:   64000 Progress: 64.0% Elapsed: 1 day, 0:48:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.69304 Generator_loss: 5.58281 
[INFO] 2021-01-02 10:24:22 > Start Evaluation (64000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 10:24:22 > Calculating FID Score....
[INFO] 2021-01-02 10:24:38 > Calculating Inception Score....
[INFO] 2021-01-02 10:24:44 > Calculate F_beta Score....
[INFO] 2021-01-02 10:25:06 > Calculate Accuracies....
[INFO] 2021-01-02 10:25:10 > Calculate Accuracies....
[INFO] 2021-01-02 10:25:12 > F_8 score (Step: 64000, Using valid images): 0.8821118687319083
[INFO] 2021-01-02 10:25:12 > F_1/8 score (Step: 64000, Using valid images): 0.9731865328332272
[INFO] 2021-01-02 10:25:12 > FID score (Step: 64000, Using valid moments): 27.442693584898507
[INFO] 2021-01-02 10:25:12 > Inception score (Step: 64000, 10000 generated images): 13.570592880249023
[INFO] 2021-01-02 10:25:12 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 10:25:18 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 10:27:35 > Step:   64100 Progress: 64.1% Elapsed: 1 day, 0:52:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.80172 Generator_loss: 5.43343 
[INFO] 2021-01-02 10:29:51 > Step:   64200 Progress: 64.2% Elapsed: 1 day, 0:54:23 temperature: 1.0 ada_p: No Discriminator_loss: 4.68443 Generator_loss: 5.50164 
[INFO] 2021-01-02 10:32:08 > Step:   64300 Progress: 64.3% Elapsed: 1 day, 0:56:40 temperature: 1.0 ada_p: No Discriminator_loss: 4.71159 Generator_loss: 5.54308 
[INFO] 2021-01-02 10:34:24 > Step:   64400 Progress: 64.4% Elapsed: 1 day, 0:58:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.76255 Generator_loss: 5.57327 
[INFO] 2021-01-02 10:36:40 > Step:   64500 Progress: 64.5% Elapsed: 1 day, 1:01:12 temperature: 1.0 ada_p: No Discriminator_loss: 4.69353 Generator_loss: 5.57305 
[INFO] 2021-01-02 10:38:56 > Step:   64600 Progress: 64.6% Elapsed: 1 day, 1:03:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.75136 Generator_loss: 5.55929 
[INFO] 2021-01-02 10:41:13 > Step:   64700 Progress: 64.7% Elapsed: 1 day, 1:05:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.51711 Generator_loss: 6.11966 
[INFO] 2021-01-02 10:43:30 > Step:   64800 Progress: 64.8% Elapsed: 1 day, 1:08:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.78735 Generator_loss: 5.58987 
[INFO] 2021-01-02 10:45:48 > Step:   64900 Progress: 64.9% Elapsed: 1 day, 1:10:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.68279 Generator_loss: 5.69413 
[INFO] 2021-01-02 10:48:05 > Step:   65000 Progress: 65.0% Elapsed: 1 day, 1:12:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.74932 Generator_loss: 5.4749 
[INFO] 2021-01-02 10:50:21 > Step:   65100 Progress: 65.1% Elapsed: 1 day, 1:14:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.76746 Generator_loss: 5.52948 
[INFO] 2021-01-02 10:52:38 > Step:   65200 Progress: 65.2% Elapsed: 1 day, 1:17:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.50759 Generator_loss: 5.76748 
[INFO] 2021-01-02 10:54:55 > Step:   65300 Progress: 65.3% Elapsed: 1 day, 1:19:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.54488 Generator_loss: 5.77224 
[INFO] 2021-01-02 10:57:12 > Step:   65400 Progress: 65.4% Elapsed: 1 day, 1:21:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.64099 Generator_loss: 5.54332 
[INFO] 2021-01-02 10:59:29 > Step:   65500 Progress: 65.5% Elapsed: 1 day, 1:24:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.8545 Generator_loss: 5.45803 
[INFO] 2021-01-02 11:01:46 > Step:   65600 Progress: 65.6% Elapsed: 1 day, 1:26:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.83045 Generator_loss: 5.56152 
[INFO] 2021-01-02 11:04:02 > Step:   65700 Progress: 65.7% Elapsed: 1 day, 1:28:34 temperature: 1.0 ada_p: No Discriminator_loss: 5.03501 Generator_loss: 5.27278 
[INFO] 2021-01-02 11:06:18 > Step:   65800 Progress: 65.8% Elapsed: 1 day, 1:30:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.56398 Generator_loss: 5.80106 
[INFO] 2021-01-02 11:08:34 > Step:   65900 Progress: 65.9% Elapsed: 1 day, 1:33:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.68528 Generator_loss: 5.62142 
[INFO] 2021-01-02 11:10:50 > Step:   66000 Progress: 66.0% Elapsed: 1 day, 1:35:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.66492 Generator_loss: 5.67578 
[INFO] 2021-01-02 11:10:50 > Start Evaluation (66000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 11:10:50 > Calculating FID Score....
[INFO] 2021-01-02 11:11:06 > Calculating Inception Score....
[INFO] 2021-01-02 11:11:12 > Calculate F_beta Score....
[INFO] 2021-01-02 11:11:33 > Calculate Accuracies....
[INFO] 2021-01-02 11:11:37 > Calculate Accuracies....
[INFO] 2021-01-02 11:11:38 > F_8 score (Step: 66000, Using valid images): 0.8943981116680635
[INFO] 2021-01-02 11:11:39 > F_1/8 score (Step: 66000, Using valid images): 0.9730189604302589
[INFO] 2021-01-02 11:11:39 > FID score (Step: 66000, Using valid moments): 27.49573700337214
[INFO] 2021-01-02 11:11:39 > Inception score (Step: 66000, 10000 generated images): 13.370409965515137
[INFO] 2021-01-02 11:11:39 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 11:11:45 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 11:14:03 > Step:   66100 Progress: 66.1% Elapsed: 1 day, 1:38:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.57329 Generator_loss: 5.78527 
[INFO] 2021-01-02 11:16:19 > Step:   66200 Progress: 66.2% Elapsed: 1 day, 1:40:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.63935 Generator_loss: 5.66617 
[INFO] 2021-01-02 11:18:35 > Step:   66300 Progress: 66.3% Elapsed: 1 day, 1:43:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.64144 Generator_loss: 5.63398 
[INFO] 2021-01-02 11:20:52 > Step:   66400 Progress: 66.4% Elapsed: 1 day, 1:45:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.71211 Generator_loss: 5.6594 
[INFO] 2021-01-02 11:23:09 > Step:   66500 Progress: 66.5% Elapsed: 1 day, 1:47:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.56601 Generator_loss: 5.84411 
[INFO] 2021-01-02 11:25:25 > Step:   66600 Progress: 66.6% Elapsed: 1 day, 1:49:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.66856 Generator_loss: 5.75761 
[INFO] 2021-01-02 11:27:41 > Step:   66700 Progress: 66.7% Elapsed: 1 day, 1:52:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.75646 Generator_loss: 5.48255 
[INFO] 2021-01-02 11:29:57 > Step:   66800 Progress: 66.8% Elapsed: 1 day, 1:54:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.51533 Generator_loss: 5.91077 
[INFO] 2021-01-02 11:32:14 > Step:   66900 Progress: 66.9% Elapsed: 1 day, 1:56:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.76216 Generator_loss: 5.50677 
[INFO] 2021-01-02 11:34:31 > Step:   67000 Progress: 67.0% Elapsed: 1 day, 1:59:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.62858 Generator_loss: 5.57354 
[INFO] 2021-01-02 11:36:48 > Step:   67100 Progress: 67.1% Elapsed: 1 day, 2:01:21 temperature: 1.0 ada_p: No Discriminator_loss: 5.00128 Generator_loss: 5.34417 
[INFO] 2021-01-02 11:39:05 > Step:   67200 Progress: 67.2% Elapsed: 1 day, 2:03:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.85869 Generator_loss: 5.38585 
[INFO] 2021-01-02 11:41:21 > Step:   67300 Progress: 67.3% Elapsed: 1 day, 2:05:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.65349 Generator_loss: 5.75873 
[INFO] 2021-01-02 11:43:37 > Step:   67400 Progress: 67.4% Elapsed: 1 day, 2:08:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.61556 Generator_loss: 5.78854 
[INFO] 2021-01-02 11:45:54 > Step:   67500 Progress: 67.5% Elapsed: 1 day, 2:10:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.58291 Generator_loss: 5.57692 
[INFO] 2021-01-02 11:48:10 > Step:   67600 Progress: 67.6% Elapsed: 1 day, 2:12:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.59535 Generator_loss: 5.62387 
[INFO] 2021-01-02 11:50:26 > Step:   67700 Progress: 67.7% Elapsed: 1 day, 2:14:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.63737 Generator_loss: 5.56581 
[INFO] 2021-01-02 11:52:43 > Step:   67800 Progress: 67.8% Elapsed: 1 day, 2:17:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.8293 Generator_loss: 5.52861 
[INFO] 2021-01-02 11:54:59 > Step:   67900 Progress: 67.9% Elapsed: 1 day, 2:19:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.62314 Generator_loss: 5.769 
[INFO] 2021-01-02 11:57:17 > Step:   68000 Progress: 68.0% Elapsed: 1 day, 2:21:49 temperature: 1.0 ada_p: No Discriminator_loss: 4.55453 Generator_loss: 5.65727 
[INFO] 2021-01-02 11:57:17 > Start Evaluation (68000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 11:57:17 > Calculating FID Score....
[INFO] 2021-01-02 11:57:33 > Calculating Inception Score....
[INFO] 2021-01-02 11:57:39 > Calculate F_beta Score....
[INFO] 2021-01-02 11:58:01 > Calculate Accuracies....
[INFO] 2021-01-02 11:58:04 > Calculate Accuracies....
[INFO] 2021-01-02 11:58:06 > F_8 score (Step: 68000, Using valid images): 0.8891220939525016
[INFO] 2021-01-02 11:58:06 > F_1/8 score (Step: 68000, Using valid images): 0.9726427909391079
[INFO] 2021-01-02 11:58:06 > FID score (Step: 68000, Using valid moments): 28.0174321128477
[INFO] 2021-01-02 11:58:06 > Inception score (Step: 68000, 10000 generated images): 13.64184284210205
[INFO] 2021-01-02 11:58:06 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 11:58:13 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 12:00:29 > Step:   68100 Progress: 68.1% Elapsed: 1 day, 2:25:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.70182 Generator_loss: 5.47197 
[INFO] 2021-01-02 12:02:46 > Step:   68200 Progress: 68.2% Elapsed: 1 day, 2:27:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.98331 Generator_loss: 5.51166 
[INFO] 2021-01-02 12:05:02 > Step:   68300 Progress: 68.3% Elapsed: 1 day, 2:29:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.70022 Generator_loss: 5.52067 
[INFO] 2021-01-02 12:07:18 > Step:   68400 Progress: 68.4% Elapsed: 1 day, 2:31:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.58721 Generator_loss: 5.73491 
[INFO] 2021-01-02 12:09:34 > Step:   68500 Progress: 68.5% Elapsed: 1 day, 2:34:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.50901 Generator_loss: 5.90608 
[INFO] 2021-01-02 12:11:50 > Step:   68600 Progress: 68.6% Elapsed: 1 day, 2:36:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.61961 Generator_loss: 5.84652 
[INFO] 2021-01-02 12:14:06 > Step:   68700 Progress: 68.7% Elapsed: 1 day, 2:38:38 temperature: 1.0 ada_p: No Discriminator_loss: 4.48197 Generator_loss: 5.99779 
[INFO] 2021-01-02 12:16:22 > Step:   68800 Progress: 68.8% Elapsed: 1 day, 2:40:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.5307 Generator_loss: 5.72031 
[INFO] 2021-01-02 12:18:38 > Step:   68900 Progress: 68.9% Elapsed: 1 day, 2:43:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.48566 Generator_loss: 5.90139 
[INFO] 2021-01-02 12:20:54 > Step:   69000 Progress: 69.0% Elapsed: 1 day, 2:45:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.9938 Generator_loss: 5.58645 
[INFO] 2021-01-02 12:23:10 > Step:   69100 Progress: 69.1% Elapsed: 1 day, 2:47:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.7698 Generator_loss: 5.50562 
[INFO] 2021-01-02 12:25:28 > Step:   69200 Progress: 69.2% Elapsed: 1 day, 2:50:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.12546 Generator_loss: 5.26736 
[INFO] 2021-01-02 12:27:45 > Step:   69300 Progress: 69.3% Elapsed: 1 day, 2:52:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.71961 Generator_loss: 5.55707 
[INFO] 2021-01-02 12:30:03 > Step:   69400 Progress: 69.4% Elapsed: 1 day, 2:54:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.52172 Generator_loss: 5.87347 
[INFO] 2021-01-02 12:32:19 > Step:   69500 Progress: 69.5% Elapsed: 1 day, 2:56:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.53708 Generator_loss: 5.69614 
[INFO] 2021-01-02 12:34:36 > Step:   69600 Progress: 69.6% Elapsed: 1 day, 2:59:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.49587 Generator_loss: 5.97941 
[INFO] 2021-01-02 12:36:52 > Step:   69700 Progress: 69.7% Elapsed: 1 day, 3:01:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.57628 Generator_loss: 5.85747 
[INFO] 2021-01-02 12:39:09 > Step:   69800 Progress: 69.8% Elapsed: 1 day, 3:03:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.52424 Generator_loss: 5.79908 
[INFO] 2021-01-02 12:41:25 > Step:   69900 Progress: 69.9% Elapsed: 1 day, 3:05:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.48317 Generator_loss: 5.89785 
[INFO] 2021-01-02 12:43:42 > Step:   70000 Progress: 70.0% Elapsed: 1 day, 3:08:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.56298 Generator_loss: 5.78724 
[INFO] 2021-01-02 12:43:42 > Start Evaluation (70000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 12:43:42 > Calculating FID Score....
[INFO] 2021-01-02 12:43:58 > Calculating Inception Score....
[INFO] 2021-01-02 12:44:03 > Calculate F_beta Score....
[INFO] 2021-01-02 12:44:25 > Calculate Accuracies....
[INFO] 2021-01-02 12:44:28 > Calculate Accuracies....
[INFO] 2021-01-02 12:44:30 > F_8 score (Step: 70000, Using valid images): 0.8913920976781681
[INFO] 2021-01-02 12:44:30 > F_1/8 score (Step: 70000, Using valid images): 0.97389520386988
[INFO] 2021-01-02 12:44:30 > FID score (Step: 70000, Using valid moments): 27.826889760100812
[INFO] 2021-01-02 12:44:30 > Inception score (Step: 70000, 10000 generated images): 13.625587463378906
[INFO] 2021-01-02 12:44:30 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 12:44:37 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 12:46:54 > Step:   70100 Progress: 70.1% Elapsed: 1 day, 3:11:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.48739 Generator_loss: 5.92619 
[INFO] 2021-01-02 12:49:10 > Step:   70200 Progress: 70.2% Elapsed: 1 day, 3:13:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.58036 Generator_loss: 5.75354 
[INFO] 2021-01-02 12:51:26 > Step:   70300 Progress: 70.3% Elapsed: 1 day, 3:15:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.57771 Generator_loss: 5.82559 
[INFO] 2021-01-02 12:53:42 > Step:   70400 Progress: 70.4% Elapsed: 1 day, 3:18:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.59677 Generator_loss: 5.90736 
[INFO] 2021-01-02 12:55:58 > Step:   70500 Progress: 70.5% Elapsed: 1 day, 3:20:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.63074 Generator_loss: 6.02888 
[INFO] 2021-01-02 12:58:14 > Step:   70600 Progress: 70.6% Elapsed: 1 day, 3:22:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.75547 Generator_loss: 5.79174 
[INFO] 2021-01-02 13:00:29 > Step:   70700 Progress: 70.7% Elapsed: 1 day, 3:25:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.51236 Generator_loss: 5.99187 
[INFO] 2021-01-02 13:02:46 > Step:   70800 Progress: 70.8% Elapsed: 1 day, 3:27:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.5639 Generator_loss: 5.87083 
[INFO] 2021-01-02 13:05:02 > Step:   70900 Progress: 70.9% Elapsed: 1 day, 3:29:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.77285 Generator_loss: 5.64329 
[INFO] 2021-01-02 13:07:18 > Step:   71000 Progress: 71.0% Elapsed: 1 day, 3:31:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.57679 Generator_loss: 5.67865 
[INFO] 2021-01-02 13:09:34 > Step:   71100 Progress: 71.1% Elapsed: 1 day, 3:34:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.55994 Generator_loss: 5.74202 
[INFO] 2021-01-02 13:11:52 > Step:   71200 Progress: 71.2% Elapsed: 1 day, 3:36:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.57092 Generator_loss: 5.80692 
[INFO] 2021-01-02 13:14:08 > Step:   71300 Progress: 71.3% Elapsed: 1 day, 3:38:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.57446 Generator_loss: 5.673 
[INFO] 2021-01-02 13:16:25 > Step:   71400 Progress: 71.4% Elapsed: 1 day, 3:40:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.55402 Generator_loss: 5.78049 
[INFO] 2021-01-02 13:18:41 > Step:   71500 Progress: 71.5% Elapsed: 1 day, 3:43:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.58871 Generator_loss: 5.71517 
[INFO] 2021-01-02 13:20:58 > Step:   71600 Progress: 71.6% Elapsed: 1 day, 3:45:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.5764 Generator_loss: 5.78932 
[INFO] 2021-01-02 13:23:14 > Step:   71700 Progress: 71.7% Elapsed: 1 day, 3:47:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.55577 Generator_loss: 5.83843 
[INFO] 2021-01-02 13:25:31 > Step:   71800 Progress: 71.8% Elapsed: 1 day, 3:50:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.48929 Generator_loss: 5.90998 
[INFO] 2021-01-02 13:27:47 > Step:   71900 Progress: 71.9% Elapsed: 1 day, 3:52:19 temperature: 1.0 ada_p: No Discriminator_loss: 4.54061 Generator_loss: 5.79001 
[INFO] 2021-01-02 13:30:03 > Step:   72000 Progress: 72.0% Elapsed: 1 day, 3:54:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.61208 Generator_loss: 5.77134 
[INFO] 2021-01-02 13:30:03 > Start Evaluation (72000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 13:30:03 > Calculating FID Score....
[INFO] 2021-01-02 13:30:19 > Calculating Inception Score....
[INFO] 2021-01-02 13:30:25 > Calculate F_beta Score....
[INFO] 2021-01-02 13:30:46 > Calculate Accuracies....
[INFO] 2021-01-02 13:30:49 > Calculate Accuracies....
[INFO] 2021-01-02 13:31:00 > F_8 score (Step: 72000, Using valid images): 0.8949599216855517
[INFO] 2021-01-02 13:31:00 > F_1/8 score (Step: 72000, Using valid images): 0.9712332953713874
[INFO] 2021-01-02 13:31:00 > FID score (Step: 72000, Using valid moments): 27.91005519917485
[INFO] 2021-01-02 13:31:00 > Inception score (Step: 72000, 10000 generated images): 13.543028831481934
[INFO] 2021-01-02 13:31:00 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 13:31:07 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 13:33:23 > Step:   72100 Progress: 72.1% Elapsed: 1 day, 3:57:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.63325 Generator_loss: 5.89152 
[INFO] 2021-01-02 13:35:40 > Step:   72200 Progress: 72.2% Elapsed: 1 day, 4:00:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.67191 Generator_loss: 5.74064 
[INFO] 2021-01-02 13:37:56 > Step:   72300 Progress: 72.3% Elapsed: 1 day, 4:02:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.79136 Generator_loss: 5.73161 
[INFO] 2021-01-02 13:40:12 > Step:   72400 Progress: 72.4% Elapsed: 1 day, 4:04:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.47959 Generator_loss: 5.93609 
[INFO] 2021-01-02 13:42:28 > Step:   72500 Progress: 72.5% Elapsed: 1 day, 4:07:00 temperature: 1.0 ada_p: No Discriminator_loss: 5.03423 Generator_loss: 5.47023 
[INFO] 2021-01-02 13:44:44 > Step:   72600 Progress: 72.6% Elapsed: 1 day, 4:09:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.5427 Generator_loss: 5.80717 
[INFO] 2021-01-02 13:46:59 > Step:   72700 Progress: 72.7% Elapsed: 1 day, 4:11:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.58397 Generator_loss: 5.94044 
[INFO] 2021-01-02 13:49:15 > Step:   72800 Progress: 72.8% Elapsed: 1 day, 4:13:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.58296 Generator_loss: 5.68991 
[INFO] 2021-01-02 13:51:31 > Step:   72900 Progress: 72.9% Elapsed: 1 day, 4:16:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.61797 Generator_loss: 5.62607 
[INFO] 2021-01-02 13:53:47 > Step:   73000 Progress: 73.0% Elapsed: 1 day, 4:18:19 temperature: 1.0 ada_p: No Discriminator_loss: 4.57882 Generator_loss: 5.81572 
[INFO] 2021-01-02 13:56:03 > Step:   73100 Progress: 73.1% Elapsed: 1 day, 4:20:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.64347 Generator_loss: 5.61527 
[INFO] 2021-01-02 13:58:20 > Step:   73200 Progress: 73.2% Elapsed: 1 day, 4:22:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.85454 Generator_loss: 5.60303 
[INFO] 2021-01-02 14:00:36 > Step:   73300 Progress: 73.3% Elapsed: 1 day, 4:25:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.55329 Generator_loss: 6.88492 
[INFO] 2021-01-02 14:02:52 > Step:   73400 Progress: 73.4% Elapsed: 1 day, 4:27:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.64759 Generator_loss: 6.88984 
[INFO] 2021-01-02 14:05:09 > Step:   73500 Progress: 73.5% Elapsed: 1 day, 4:29:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.5031 Generator_loss: 7.09573 
[INFO] 2021-01-02 14:07:26 > Step:   73600 Progress: 73.6% Elapsed: 1 day, 4:31:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.57528 Generator_loss: 6.9824 
[INFO] 2021-01-02 14:09:43 > Step:   73700 Progress: 73.7% Elapsed: 1 day, 4:34:15 temperature: 1.0 ada_p: No Discriminator_loss: 5.00084 Generator_loss: 6.87912 
[INFO] 2021-01-02 14:11:58 > Step:   73800 Progress: 73.8% Elapsed: 1 day, 4:36:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.75136 Generator_loss: 7.03906 
[INFO] 2021-01-02 14:14:15 > Step:   73900 Progress: 73.9% Elapsed: 1 day, 4:38:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.55783 Generator_loss: 6.78564 
[INFO] 2021-01-02 14:16:32 > Step:   74000 Progress: 74.0% Elapsed: 1 day, 4:41:04 temperature: 1.0 ada_p: No Discriminator_loss: 4.58997 Generator_loss: 5.66282 
[INFO] 2021-01-02 14:16:32 > Start Evaluation (74000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 14:16:32 > Calculating FID Score....
[INFO] 2021-01-02 14:16:48 > Calculating Inception Score....
[INFO] 2021-01-02 14:16:54 > Calculate F_beta Score....
[INFO] 2021-01-02 14:17:15 > Calculate Accuracies....
[INFO] 2021-01-02 14:17:19 > Calculate Accuracies....
[INFO] 2021-01-02 14:17:20 > F_8 score (Step: 74000, Using valid images): 0.8785133987435799
[INFO] 2021-01-02 14:17:20 > F_1/8 score (Step: 74000, Using valid images): 0.9670377872299043
[INFO] 2021-01-02 14:17:20 > FID score (Step: 74000, Using valid moments): 28.00131600580761
[INFO] 2021-01-02 14:17:20 > Inception score (Step: 74000, 10000 generated images): 13.458572387695312
[INFO] 2021-01-02 14:17:20 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 14:17:27 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 14:19:44 > Step:   74100 Progress: 74.1% Elapsed: 1 day, 4:44:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.56101 Generator_loss: 5.80169 
[INFO] 2021-01-02 14:22:00 > Step:   74200 Progress: 74.2% Elapsed: 1 day, 4:46:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.66538 Generator_loss: 5.50478 
[INFO] 2021-01-02 14:24:17 > Step:   74300 Progress: 74.3% Elapsed: 1 day, 4:48:49 temperature: 1.0 ada_p: No Discriminator_loss: 4.58894 Generator_loss: 5.75996 
[INFO] 2021-01-02 14:26:34 > Step:   74400 Progress: 74.4% Elapsed: 1 day, 4:51:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.4553 Generator_loss: 5.91805 
[INFO] 2021-01-02 14:28:51 > Step:   74500 Progress: 74.5% Elapsed: 1 day, 4:53:23 temperature: 1.0 ada_p: No Discriminator_loss: 4.46855 Generator_loss: 5.95619 
[INFO] 2021-01-02 14:31:07 > Step:   74600 Progress: 74.6% Elapsed: 1 day, 4:55:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.49557 Generator_loss: 6.00705 
[INFO] 2021-01-02 14:33:24 > Step:   74700 Progress: 74.7% Elapsed: 1 day, 4:57:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.65523 Generator_loss: 5.72458 
[INFO] 2021-01-02 14:35:40 > Step:   74800 Progress: 74.8% Elapsed: 1 day, 5:00:12 temperature: 1.0 ada_p: No Discriminator_loss: 4.50938 Generator_loss: 5.85779 
[INFO] 2021-01-02 14:37:56 > Step:   74900 Progress: 74.9% Elapsed: 1 day, 5:02:29 temperature: 1.0 ada_p: No Discriminator_loss: 4.46248 Generator_loss: 6.04807 
[INFO] 2021-01-02 14:40:13 > Step:   75000 Progress: 75.0% Elapsed: 1 day, 5:04:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.65836 Generator_loss: 5.71979 
[INFO] 2021-01-02 14:42:30 > Step:   75100 Progress: 75.1% Elapsed: 1 day, 5:07:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.56534 Generator_loss: 5.83101 
[INFO] 2021-01-02 14:44:46 > Step:   75200 Progress: 75.2% Elapsed: 1 day, 5:09:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.63116 Generator_loss: 5.86561 
[INFO] 2021-01-02 14:47:02 > Step:   75300 Progress: 75.3% Elapsed: 1 day, 5:11:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.62564 Generator_loss: 5.67923 
[INFO] 2021-01-02 14:49:18 > Step:   75400 Progress: 75.4% Elapsed: 1 day, 5:13:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.52261 Generator_loss: 5.78485 
[INFO] 2021-01-02 14:51:35 > Step:   75500 Progress: 75.5% Elapsed: 1 day, 5:16:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.49986 Generator_loss: 5.79316 
[INFO] 2021-01-02 14:53:52 > Step:   75600 Progress: 75.6% Elapsed: 1 day, 5:18:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.6338 Generator_loss: 5.65661 
[INFO] 2021-01-02 14:56:09 > Step:   75700 Progress: 75.7% Elapsed: 1 day, 5:20:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.80772 Generator_loss: 5.39113 
[INFO] 2021-01-02 14:58:26 > Step:   75800 Progress: 75.8% Elapsed: 1 day, 5:22:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.50998 Generator_loss: 6.02843 
[INFO] 2021-01-02 15:00:42 > Step:   75900 Progress: 75.9% Elapsed: 1 day, 5:25:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.53126 Generator_loss: 5.93682 
[INFO] 2021-01-02 15:02:59 > Step:   76000 Progress: 76.0% Elapsed: 1 day, 5:27:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.65814 Generator_loss: 5.60627 
[INFO] 2021-01-02 15:02:59 > Start Evaluation (76000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 15:02:59 > Calculating FID Score....
[INFO] 2021-01-02 15:03:16 > Calculating Inception Score....
[INFO] 2021-01-02 15:03:21 > Calculate F_beta Score....
[INFO] 2021-01-02 15:03:43 > Calculate Accuracies....
[INFO] 2021-01-02 15:03:46 > Calculate Accuracies....
[INFO] 2021-01-02 15:03:48 > F_8 score (Step: 76000, Using valid images): 0.8900817730896515
[INFO] 2021-01-02 15:03:48 > F_1/8 score (Step: 76000, Using valid images): 0.970336192890026
[INFO] 2021-01-02 15:03:48 > FID score (Step: 76000, Using valid moments): 28.10727142990538
[INFO] 2021-01-02 15:03:48 > Inception score (Step: 76000, 10000 generated images): 13.541350364685059
[INFO] 2021-01-02 15:03:48 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 15:03:55 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 15:06:11 > Step:   76100 Progress: 76.1% Elapsed: 1 day, 5:30:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.58457 Generator_loss: 5.80467 
[INFO] 2021-01-02 15:08:28 > Step:   76200 Progress: 76.2% Elapsed: 1 day, 5:33:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.80472 Generator_loss: 5.76056 
[INFO] 2021-01-02 15:10:45 > Step:   76300 Progress: 76.3% Elapsed: 1 day, 5:35:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.53897 Generator_loss: 5.84707 
[INFO] 2021-01-02 15:13:00 > Step:   76400 Progress: 76.4% Elapsed: 1 day, 5:37:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.48463 Generator_loss: 6.08262 
[INFO] 2021-01-02 15:15:16 > Step:   76500 Progress: 76.5% Elapsed: 1 day, 5:39:48 temperature: 1.0 ada_p: No Discriminator_loss: 4.48164 Generator_loss: 6.03092 
[INFO] 2021-01-02 15:17:33 > Step:   76600 Progress: 76.6% Elapsed: 1 day, 5:42:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.6521 Generator_loss: 5.51996 
[INFO] 2021-01-02 15:19:49 > Step:   76700 Progress: 76.7% Elapsed: 1 day, 5:44:21 temperature: 1.0 ada_p: No Discriminator_loss: 4.49455 Generator_loss: 5.91353 
[INFO] 2021-01-02 15:22:06 > Step:   76800 Progress: 76.8% Elapsed: 1 day, 5:46:38 temperature: 1.0 ada_p: No Discriminator_loss: 4.60516 Generator_loss: 5.50921 
[INFO] 2021-01-02 15:24:22 > Step:   76900 Progress: 76.9% Elapsed: 1 day, 5:48:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.57143 Generator_loss: 5.81064 
[INFO] 2021-01-02 15:26:39 > Step:   77000 Progress: 77.0% Elapsed: 1 day, 5:51:11 temperature: 1.0 ada_p: No Discriminator_loss: 4.46009 Generator_loss: 6.08834 
[INFO] 2021-01-02 15:28:56 > Step:   77100 Progress: 77.1% Elapsed: 1 day, 5:53:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.78904 Generator_loss: 5.63404 
[INFO] 2021-01-02 15:31:12 > Step:   77200 Progress: 77.2% Elapsed: 1 day, 5:55:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.44616 Generator_loss: 6.11615 
[INFO] 2021-01-02 15:33:29 > Step:   77300 Progress: 77.3% Elapsed: 1 day, 5:58:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.51869 Generator_loss: 5.87884 
[INFO] 2021-01-02 15:35:46 > Step:   77400 Progress: 77.4% Elapsed: 1 day, 6:00:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.51037 Generator_loss: 5.80696 
[INFO] 2021-01-02 15:38:02 > Step:   77500 Progress: 77.5% Elapsed: 1 day, 6:02:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.69023 Generator_loss: 5.73183 
[INFO] 2021-01-02 15:40:19 > Step:   77600 Progress: 77.6% Elapsed: 1 day, 6:04:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.58984 Generator_loss: 5.83055 
[INFO] 2021-01-02 15:42:37 > Step:   77700 Progress: 77.7% Elapsed: 1 day, 6:07:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.42408 Generator_loss: 6.20174 
[INFO] 2021-01-02 15:44:54 > Step:   77800 Progress: 77.8% Elapsed: 1 day, 6:09:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.64768 Generator_loss: 5.78465 
[INFO] 2021-01-02 15:47:11 > Step:   77900 Progress: 77.9% Elapsed: 1 day, 6:11:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.43484 Generator_loss: 6.03154 
[INFO] 2021-01-02 15:49:27 > Step:   78000 Progress: 78.0% Elapsed: 1 day, 6:14:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.58784 Generator_loss: 6.974 
[INFO] 2021-01-02 15:49:27 > Start Evaluation (78000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 15:49:27 > Calculating FID Score....
[INFO] 2021-01-02 15:49:44 > Calculating Inception Score....
[INFO] 2021-01-02 15:49:50 > Calculate F_beta Score....
[INFO] 2021-01-02 15:50:11 > Calculate Accuracies....
[INFO] 2021-01-02 15:50:14 > Calculate Accuracies....
[INFO] 2021-01-02 15:50:16 > F_8 score (Step: 78000, Using valid images): 0.8969624498187291
[INFO] 2021-01-02 15:50:16 > F_1/8 score (Step: 78000, Using valid images): 0.9726381325510368
[INFO] 2021-01-02 15:50:16 > FID score (Step: 78000, Using valid moments): 27.88326486942549
[INFO] 2021-01-02 15:50:16 > Inception score (Step: 78000, 10000 generated images): 13.40685749053955
[INFO] 2021-01-02 15:50:16 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 15:50:23 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 15:52:40 > Step:   78100 Progress: 78.1% Elapsed: 1 day, 6:17:12 temperature: 1.0 ada_p: No Discriminator_loss: 4.48237 Generator_loss: 6.98858 
[INFO] 2021-01-02 15:54:57 > Step:   78200 Progress: 78.2% Elapsed: 1 day, 6:19:29 temperature: 1.0 ada_p: No Discriminator_loss: 4.53981 Generator_loss: 7.04588 
[INFO] 2021-01-02 15:57:13 > Step:   78300 Progress: 78.3% Elapsed: 1 day, 6:21:45 temperature: 1.0 ada_p: No Discriminator_loss: 4.82059 Generator_loss: 7.32128 
[INFO] 2021-01-02 15:59:29 > Step:   78400 Progress: 78.4% Elapsed: 1 day, 6:24:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.54716 Generator_loss: 7.17274 
[INFO] 2021-01-02 16:01:46 > Step:   78500 Progress: 78.5% Elapsed: 1 day, 6:26:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.50853 Generator_loss: 6.83532 
[INFO] 2021-01-02 16:04:02 > Step:   78600 Progress: 78.6% Elapsed: 1 day, 6:28:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.56813 Generator_loss: 6.9531 
[INFO] 2021-01-02 16:06:20 > Step:   78700 Progress: 78.7% Elapsed: 1 day, 6:30:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.51277 Generator_loss: 6.97135 
[INFO] 2021-01-02 16:08:36 > Step:   78800 Progress: 78.8% Elapsed: 1 day, 6:33:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.54225 Generator_loss: 7.03964 
[INFO] 2021-01-02 16:10:53 > Step:   78900 Progress: 78.9% Elapsed: 1 day, 6:35:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.78181 Generator_loss: 6.90154 
[INFO] 2021-01-02 16:13:09 > Step:   79000 Progress: 79.0% Elapsed: 1 day, 6:37:41 temperature: 1.0 ada_p: No Discriminator_loss: 5.03438 Generator_loss: 6.80911 
[INFO] 2021-01-02 16:15:25 > Step:   79100 Progress: 79.1% Elapsed: 1 day, 6:39:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.4946 Generator_loss: 7.01355 
[INFO] 2021-01-02 16:17:43 > Step:   79200 Progress: 79.2% Elapsed: 1 day, 6:42:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.68372 Generator_loss: 6.97908 
[INFO] 2021-01-02 16:20:01 > Step:   79300 Progress: 79.3% Elapsed: 1 day, 6:44:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.5111 Generator_loss: 6.9972 
[INFO] 2021-01-02 16:22:18 > Step:   79400 Progress: 79.4% Elapsed: 1 day, 6:46:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.5041 Generator_loss: 7.02084 
[INFO] 2021-01-02 16:24:34 > Step:   79500 Progress: 79.5% Elapsed: 1 day, 6:49:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.54207 Generator_loss: 6.83913 
[INFO] 2021-01-02 16:26:50 > Step:   79600 Progress: 79.6% Elapsed: 1 day, 6:51:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.51825 Generator_loss: 6.9029 
[INFO] 2021-01-02 16:29:06 > Step:   79700 Progress: 79.7% Elapsed: 1 day, 6:53:38 temperature: 1.0 ada_p: No Discriminator_loss: 4.57377 Generator_loss: 7.33261 
[INFO] 2021-01-02 16:31:22 > Step:   79800 Progress: 79.8% Elapsed: 1 day, 6:55:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.56475 Generator_loss: 7.06279 
[INFO] 2021-01-02 16:33:38 > Step:   79900 Progress: 79.9% Elapsed: 1 day, 6:58:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.53308 Generator_loss: 6.91705 
[INFO] 2021-01-02 16:35:55 > Step:   80000 Progress: 80.0% Elapsed: 1 day, 7:00:27 temperature: 1.0 ada_p: No Discriminator_loss: 6.10002 Generator_loss: 6.49502 
[INFO] 2021-01-02 16:35:55 > Start Evaluation (80000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 16:35:55 > Calculating FID Score....
[INFO] 2021-01-02 16:36:11 > Calculating Inception Score....
[INFO] 2021-01-02 16:36:17 > Calculate F_beta Score....
[INFO] 2021-01-02 16:36:38 > Calculate Accuracies....
[INFO] 2021-01-02 16:36:42 > Calculate Accuracies....
[INFO] 2021-01-02 16:36:43 > F_8 score (Step: 80000, Using valid images): 0.8858252439280805
[INFO] 2021-01-02 16:36:43 > F_1/8 score (Step: 80000, Using valid images): 0.9712021859559266
[INFO] 2021-01-02 16:36:43 > FID score (Step: 80000, Using valid moments): 28.01451219446261
[INFO] 2021-01-02 16:36:43 > Inception score (Step: 80000, 10000 generated images): 13.36043930053711
[INFO] 2021-01-02 16:36:43 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 16:36:50 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 16:39:07 > Step:   80100 Progress: 80.1% Elapsed: 1 day, 7:03:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.57911 Generator_loss: 6.92219 
[INFO] 2021-01-02 16:41:24 > Step:   80200 Progress: 80.2% Elapsed: 1 day, 7:05:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.51211 Generator_loss: 6.79181 
[INFO] 2021-01-02 16:43:41 > Step:   80300 Progress: 80.3% Elapsed: 1 day, 7:08:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.59531 Generator_loss: 6.97015 
[INFO] 2021-01-02 16:45:57 > Step:   80400 Progress: 80.4% Elapsed: 1 day, 7:10:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.49987 Generator_loss: 7.08489 
[INFO] 2021-01-02 16:48:14 > Step:   80500 Progress: 80.5% Elapsed: 1 day, 7:12:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.53089 Generator_loss: 7.06971 
[INFO] 2021-01-02 16:50:29 > Step:   80600 Progress: 80.6% Elapsed: 1 day, 7:15:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.59604 Generator_loss: 7.01387 
[INFO] 2021-01-02 16:52:46 > Step:   80700 Progress: 80.7% Elapsed: 1 day, 7:17:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.48248 Generator_loss: 6.89322 
[INFO] 2021-01-02 16:55:02 > Step:   80800 Progress: 80.8% Elapsed: 1 day, 7:19:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.49633 Generator_loss: 6.97876 
[INFO] 2021-01-02 16:57:21 > Step:   80900 Progress: 80.9% Elapsed: 1 day, 7:21:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.51418 Generator_loss: 6.90416 
[INFO] 2021-01-02 16:59:37 > Step:   81000 Progress: 81.0% Elapsed: 1 day, 7:24:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.46557 Generator_loss: 6.8957 
[INFO] 2021-01-02 17:01:54 > Step:   81100 Progress: 81.1% Elapsed: 1 day, 7:26:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.48869 Generator_loss: 7.03854 
[INFO] 2021-01-02 17:04:11 > Step:   81200 Progress: 81.2% Elapsed: 1 day, 7:28:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.49005 Generator_loss: 6.98788 
[INFO] 2021-01-02 17:06:27 > Step:   81300 Progress: 81.3% Elapsed: 1 day, 7:30:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.42185 Generator_loss: 7.03657 
[INFO] 2021-01-02 17:08:43 > Step:   81400 Progress: 81.4% Elapsed: 1 day, 7:33:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.56803 Generator_loss: 6.99542 
[INFO] 2021-01-02 17:10:59 > Step:   81500 Progress: 81.5% Elapsed: 1 day, 7:35:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.5098 Generator_loss: 6.00905 
[INFO] 2021-01-02 17:13:14 > Step:   81600 Progress: 81.6% Elapsed: 1 day, 7:37:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.53437 Generator_loss: 5.92586 
[INFO] 2021-01-02 17:15:30 > Step:   81700 Progress: 81.7% Elapsed: 1 day, 7:40:02 temperature: 1.0 ada_p: No Discriminator_loss: 4.48066 Generator_loss: 6.09895 
[INFO] 2021-01-02 17:17:46 > Step:   81800 Progress: 81.8% Elapsed: 1 day, 7:42:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.56831 Generator_loss: 5.73592 
[INFO] 2021-01-02 17:20:02 > Step:   81900 Progress: 81.9% Elapsed: 1 day, 7:44:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.59764 Generator_loss: 5.76153 
[INFO] 2021-01-02 17:22:19 > Step:   82000 Progress: 82.0% Elapsed: 1 day, 7:46:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.81847 Generator_loss: 5.66224 
[INFO] 2021-01-02 17:22:19 > Start Evaluation (82000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 17:22:19 > Calculating FID Score....
[INFO] 2021-01-02 17:22:36 > Calculating Inception Score....
[INFO] 2021-01-02 17:22:41 > Calculate F_beta Score....
[INFO] 2021-01-02 17:23:03 > Calculate Accuracies....
[INFO] 2021-01-02 17:23:06 > Calculate Accuracies....
[INFO] 2021-01-02 17:23:08 > F_8 score (Step: 82000, Using valid images): 0.9067409743922129
[INFO] 2021-01-02 17:23:08 > F_1/8 score (Step: 82000, Using valid images): 0.9732051983197975
[INFO] 2021-01-02 17:23:08 > FID score (Step: 82000, Using valid moments): 28.257848253191753
[INFO] 2021-01-02 17:23:08 > Inception score (Step: 82000, 10000 generated images): 13.389626502990723
[INFO] 2021-01-02 17:23:08 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 17:23:15 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 17:25:31 > Step:   82100 Progress: 82.1% Elapsed: 1 day, 7:50:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.48574 Generator_loss: 6.0343 
[INFO] 2021-01-02 17:27:48 > Step:   82200 Progress: 82.2% Elapsed: 1 day, 7:52:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.70612 Generator_loss: 5.7777 
[INFO] 2021-01-02 17:30:05 > Step:   82300 Progress: 82.3% Elapsed: 1 day, 7:54:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.79934 Generator_loss: 5.80412 
[INFO] 2021-01-02 17:32:22 > Step:   82400 Progress: 82.4% Elapsed: 1 day, 7:56:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.42058 Generator_loss: 6.05463 
[INFO] 2021-01-02 17:34:40 > Step:   82500 Progress: 82.5% Elapsed: 1 day, 7:59:12 temperature: 1.0 ada_p: No Discriminator_loss: 4.48786 Generator_loss: 5.92911 
[INFO] 2021-01-02 17:36:57 > Step:   82600 Progress: 82.6% Elapsed: 1 day, 8:01:29 temperature: 1.0 ada_p: No Discriminator_loss: 4.61401 Generator_loss: 5.72637 
[INFO] 2021-01-02 17:39:13 > Step:   82700 Progress: 82.7% Elapsed: 1 day, 8:03:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.51608 Generator_loss: 5.83992 
[INFO] 2021-01-02 17:41:30 > Step:   82800 Progress: 82.8% Elapsed: 1 day, 8:06:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.45567 Generator_loss: 6.1563 
[INFO] 2021-01-02 17:43:48 > Step:   82900 Progress: 82.9% Elapsed: 1 day, 8:08:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.45998 Generator_loss: 6.08825 
[INFO] 2021-01-02 17:46:04 > Step:   83000 Progress: 83.0% Elapsed: 1 day, 8:10:36 temperature: 1.0 ada_p: No Discriminator_loss: 4.52355 Generator_loss: 5.86022 
[INFO] 2021-01-02 17:48:21 > Step:   83100 Progress: 83.1% Elapsed: 1 day, 8:12:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.47994 Generator_loss: 6.08164 
[INFO] 2021-01-02 17:50:38 > Step:   83200 Progress: 83.2% Elapsed: 1 day, 8:15:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.85635 Generator_loss: 5.62606 
[INFO] 2021-01-02 17:52:55 > Step:   83300 Progress: 83.3% Elapsed: 1 day, 8:17:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.55062 Generator_loss: 5.95114 
[INFO] 2021-01-02 17:55:12 > Step:   83400 Progress: 83.4% Elapsed: 1 day, 8:19:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.43089 Generator_loss: 6.09261 
[INFO] 2021-01-02 17:57:29 > Step:   83500 Progress: 83.5% Elapsed: 1 day, 8:22:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.51284 Generator_loss: 5.96953 
[INFO] 2021-01-02 17:59:45 > Step:   83600 Progress: 83.6% Elapsed: 1 day, 8:24:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.47728 Generator_loss: 5.90783 
[INFO] 2021-01-02 18:02:02 > Step:   83700 Progress: 83.7% Elapsed: 1 day, 8:26:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.48474 Generator_loss: 6.04122 
[INFO] 2021-01-02 18:04:20 > Step:   83800 Progress: 83.8% Elapsed: 1 day, 8:28:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.47837 Generator_loss: 6.06321 
[INFO] 2021-01-02 18:06:37 > Step:   83900 Progress: 83.9% Elapsed: 1 day, 8:31:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.68666 Generator_loss: 5.64675 
[INFO] 2021-01-02 18:08:54 > Step:   84000 Progress: 84.0% Elapsed: 1 day, 8:33:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.48454 Generator_loss: 5.9894 
[INFO] 2021-01-02 18:08:54 > Start Evaluation (84000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 18:08:54 > Calculating FID Score....
[INFO] 2021-01-02 18:09:11 > Calculating Inception Score....
[INFO] 2021-01-02 18:09:16 > Calculate F_beta Score....
[INFO] 2021-01-02 18:09:37 > Calculate Accuracies....
[INFO] 2021-01-02 18:09:41 > Calculate Accuracies....
[INFO] 2021-01-02 18:09:43 > F_8 score (Step: 84000, Using valid images): 0.8877567797150826
[INFO] 2021-01-02 18:09:43 > F_1/8 score (Step: 84000, Using valid images): 0.971640445831371
[INFO] 2021-01-02 18:09:43 > FID score (Step: 84000, Using valid moments): 28.538098380645465
[INFO] 2021-01-02 18:09:43 > Inception score (Step: 84000, 10000 generated images): 13.140265464782715
[INFO] 2021-01-02 18:09:43 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 18:09:50 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 18:12:08 > Step:   84100 Progress: 84.1% Elapsed: 1 day, 8:36:40 temperature: 1.0 ada_p: No Discriminator_loss: 4.44418 Generator_loss: 6.15392 
[INFO] 2021-01-02 18:14:24 > Step:   84200 Progress: 84.2% Elapsed: 1 day, 8:38:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.41672 Generator_loss: 6.20387 
[INFO] 2021-01-02 18:16:41 > Step:   84300 Progress: 84.3% Elapsed: 1 day, 8:41:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.40503 Generator_loss: 6.30312 
[INFO] 2021-01-02 18:18:58 > Step:   84400 Progress: 84.4% Elapsed: 1 day, 8:43:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.55715 Generator_loss: 5.94136 
[INFO] 2021-01-02 18:21:16 > Step:   84500 Progress: 84.5% Elapsed: 1 day, 8:45:48 temperature: 1.0 ada_p: No Discriminator_loss: 4.46479 Generator_loss: 6.09685 
[INFO] 2021-01-02 18:23:33 > Step:   84600 Progress: 84.6% Elapsed: 1 day, 8:48:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.38259 Generator_loss: 6.31017 
[INFO] 2021-01-02 18:25:50 > Step:   84700 Progress: 84.7% Elapsed: 1 day, 8:50:23 temperature: 1.0 ada_p: No Discriminator_loss: 4.47328 Generator_loss: 6.05706 
[INFO] 2021-01-02 18:28:07 > Step:   84800 Progress: 84.8% Elapsed: 1 day, 8:52:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.53502 Generator_loss: 5.93937 
[INFO] 2021-01-02 18:30:24 > Step:   84900 Progress: 84.9% Elapsed: 1 day, 8:54:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.47061 Generator_loss: 6.0198 
[INFO] 2021-01-02 18:32:41 > Step:   85000 Progress: 85.0% Elapsed: 1 day, 8:57:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.43838 Generator_loss: 6.07601 
[INFO] 2021-01-02 18:34:57 > Step:   85100 Progress: 85.1% Elapsed: 1 day, 8:59:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.73407 Generator_loss: 5.60005 
[INFO] 2021-01-02 18:37:14 > Step:   85200 Progress: 85.2% Elapsed: 1 day, 9:01:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.48101 Generator_loss: 5.95097 
[INFO] 2021-01-02 18:39:30 > Step:   85300 Progress: 85.3% Elapsed: 1 day, 9:04:03 temperature: 1.0 ada_p: No Discriminator_loss: 5.17838 Generator_loss: 5.65206 
[INFO] 2021-01-02 18:41:47 > Step:   85400 Progress: 85.4% Elapsed: 1 day, 9:06:19 temperature: 1.0 ada_p: No Discriminator_loss: 4.53745 Generator_loss: 5.95668 
[INFO] 2021-01-02 18:44:04 > Step:   85500 Progress: 85.5% Elapsed: 1 day, 9:08:36 temperature: 1.0 ada_p: No Discriminator_loss: 4.46834 Generator_loss: 6.00576 
[INFO] 2021-01-02 18:46:20 > Step:   85600 Progress: 85.6% Elapsed: 1 day, 9:10:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.52574 Generator_loss: 6.04852 
[INFO] 2021-01-02 18:48:37 > Step:   85700 Progress: 85.7% Elapsed: 1 day, 9:13:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.68594 Generator_loss: 5.59941 
[INFO] 2021-01-02 18:50:54 > Step:   85800 Progress: 85.8% Elapsed: 1 day, 9:15:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.42205 Generator_loss: 6.28479 
[INFO] 2021-01-02 18:53:11 > Step:   85900 Progress: 85.9% Elapsed: 1 day, 9:17:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.42013 Generator_loss: 6.33932 
[INFO] 2021-01-02 18:55:27 > Step:   86000 Progress: 86.0% Elapsed: 1 day, 9:19:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.45703 Generator_loss: 6.18517 
[INFO] 2021-01-02 18:55:27 > Start Evaluation (86000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 18:55:27 > Calculating FID Score....
[INFO] 2021-01-02 18:55:43 > Calculating Inception Score....
[INFO] 2021-01-02 18:55:48 > Calculate F_beta Score....
[INFO] 2021-01-02 18:56:09 > Calculate Accuracies....
[INFO] 2021-01-02 18:56:13 > Calculate Accuracies....
[INFO] 2021-01-02 18:56:14 > F_8 score (Step: 86000, Using valid images): 0.8905344043540566
[INFO] 2021-01-02 18:56:14 > F_1/8 score (Step: 86000, Using valid images): 0.967494467389505
[INFO] 2021-01-02 18:56:14 > FID score (Step: 86000, Using valid moments): 28.704458220977813
[INFO] 2021-01-02 18:56:14 > Inception score (Step: 86000, 10000 generated images): 13.093596458435059
[INFO] 2021-01-02 18:56:14 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 18:56:21 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 18:58:37 > Step:   86100 Progress: 86.1% Elapsed: 1 day, 9:23:10 temperature: 1.0 ada_p: No Discriminator_loss: 4.44827 Generator_loss: 6.01077 
[INFO] 2021-01-02 19:00:55 > Step:   86200 Progress: 86.2% Elapsed: 1 day, 9:25:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.77839 Generator_loss: 5.60277 
[INFO] 2021-01-02 19:03:12 > Step:   86300 Progress: 86.3% Elapsed: 1 day, 9:27:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.4382 Generator_loss: 6.09645 
[INFO] 2021-01-02 19:05:29 > Step:   86400 Progress: 86.4% Elapsed: 1 day, 9:30:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.56101 Generator_loss: 5.78737 
[INFO] 2021-01-02 19:07:46 > Step:   86500 Progress: 86.5% Elapsed: 1 day, 9:32:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.47335 Generator_loss: 5.94048 
[INFO] 2021-01-02 19:10:03 > Step:   86600 Progress: 86.6% Elapsed: 1 day, 9:34:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.49265 Generator_loss: 5.99868 
[INFO] 2021-01-02 19:12:20 > Step:   86700 Progress: 86.7% Elapsed: 1 day, 9:36:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.5719 Generator_loss: 5.7282 
[INFO] 2021-01-02 19:14:36 > Step:   86800 Progress: 86.8% Elapsed: 1 day, 9:39:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.50246 Generator_loss: 6.14872 
[INFO] 2021-01-02 19:16:53 > Step:   86900 Progress: 86.9% Elapsed: 1 day, 9:41:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.52503 Generator_loss: 5.90284 
[INFO] 2021-01-02 19:19:10 > Step:   87000 Progress: 87.0% Elapsed: 1 day, 9:43:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.49009 Generator_loss: 6.16982 
[INFO] 2021-01-02 19:21:27 > Step:   87100 Progress: 87.1% Elapsed: 1 day, 9:45:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.65617 Generator_loss: 5.67843 
[INFO] 2021-01-02 19:23:43 > Step:   87200 Progress: 87.2% Elapsed: 1 day, 9:48:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.45591 Generator_loss: 6.04553 
[INFO] 2021-01-02 19:26:01 > Step:   87300 Progress: 87.3% Elapsed: 1 day, 9:50:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.71269 Generator_loss: 5.71969 
[INFO] 2021-01-02 19:28:19 > Step:   87400 Progress: 87.4% Elapsed: 1 day, 9:52:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.50515 Generator_loss: 5.95113 
[INFO] 2021-01-02 19:30:36 > Step:   87500 Progress: 87.5% Elapsed: 1 day, 9:55:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.71928 Generator_loss: 5.64029 
[INFO] 2021-01-02 19:32:53 > Step:   87600 Progress: 87.6% Elapsed: 1 day, 9:57:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.39137 Generator_loss: 6.49239 
[INFO] 2021-01-02 19:35:08 > Step:   87700 Progress: 87.7% Elapsed: 1 day, 9:59:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.38025 Generator_loss: 6.46685 
[INFO] 2021-01-02 19:37:25 > Step:   87800 Progress: 87.8% Elapsed: 1 day, 10:01:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.41719 Generator_loss: 6.09708 
[INFO] 2021-01-02 19:39:41 > Step:   87900 Progress: 87.9% Elapsed: 1 day, 10:04:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.35472 Generator_loss: 6.50558 
[INFO] 2021-01-02 19:41:58 > Step:   88000 Progress: 88.0% Elapsed: 1 day, 10:06:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.38395 Generator_loss: 6.47034 
[INFO] 2021-01-02 19:41:58 > Start Evaluation (88000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 19:41:58 > Calculating FID Score....
[INFO] 2021-01-02 19:42:14 > Calculating Inception Score....
[INFO] 2021-01-02 19:42:19 > Calculate F_beta Score....
[INFO] 2021-01-02 19:42:41 > Calculate Accuracies....
[INFO] 2021-01-02 19:42:44 > Calculate Accuracies....
[INFO] 2021-01-02 19:42:46 > F_8 score (Step: 88000, Using valid images): 0.8889545354227736
[INFO] 2021-01-02 19:42:46 > F_1/8 score (Step: 88000, Using valid images): 0.96588644216758
[INFO] 2021-01-02 19:42:46 > FID score (Step: 88000, Using valid moments): 28.769170922196963
[INFO] 2021-01-02 19:42:46 > Inception score (Step: 88000, 10000 generated images): 13.238401412963867
[INFO] 2021-01-02 19:42:46 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 19:42:53 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 19:45:09 > Step:   88100 Progress: 88.1% Elapsed: 1 day, 10:09:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.42129 Generator_loss: 6.19243 
[INFO] 2021-01-02 19:47:25 > Step:   88200 Progress: 88.2% Elapsed: 1 day, 10:11:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.42069 Generator_loss: 6.18342 
[INFO] 2021-01-02 19:49:41 > Step:   88300 Progress: 88.3% Elapsed: 1 day, 10:14:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.50116 Generator_loss: 5.94292 
[INFO] 2021-01-02 19:51:58 > Step:   88400 Progress: 88.4% Elapsed: 1 day, 10:16:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.52305 Generator_loss: 6.01546 
[INFO] 2021-01-02 19:54:14 > Step:   88500 Progress: 88.5% Elapsed: 1 day, 10:18:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.61687 Generator_loss: 5.97064 
[INFO] 2021-01-02 19:56:31 > Step:   88600 Progress: 88.6% Elapsed: 1 day, 10:21:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.73683 Generator_loss: 5.65383 
[INFO] 2021-01-02 19:58:48 > Step:   88700 Progress: 88.7% Elapsed: 1 day, 10:23:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.53667 Generator_loss: 6.07394 
[INFO] 2021-01-02 20:01:05 > Step:   88800 Progress: 88.8% Elapsed: 1 day, 10:25:38 temperature: 1.0 ada_p: No Discriminator_loss: 4.48076 Generator_loss: 6.08834 
[INFO] 2021-01-02 20:03:22 > Step:   88900 Progress: 88.9% Elapsed: 1 day, 10:27:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.74959 Generator_loss: 5.59007 
[INFO] 2021-01-02 20:05:39 > Step:   89000 Progress: 89.0% Elapsed: 1 day, 10:30:11 temperature: 1.0 ada_p: No Discriminator_loss: 4.77661 Generator_loss: 5.62822 
[INFO] 2021-01-02 20:07:55 > Step:   89100 Progress: 89.1% Elapsed: 1 day, 10:32:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.43148 Generator_loss: 6.07873 
[INFO] 2021-01-02 20:10:12 > Step:   89200 Progress: 89.2% Elapsed: 1 day, 10:34:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.53498 Generator_loss: 5.96609 
[INFO] 2021-01-02 20:12:28 > Step:   89300 Progress: 89.3% Elapsed: 1 day, 10:37:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.43387 Generator_loss: 6.20237 
[INFO] 2021-01-02 20:14:45 > Step:   89400 Progress: 89.4% Elapsed: 1 day, 10:39:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.83329 Generator_loss: 5.48439 
[INFO] 2021-01-02 20:17:01 > Step:   89500 Progress: 89.5% Elapsed: 1 day, 10:41:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.4725 Generator_loss: 6.13789 
[INFO] 2021-01-02 20:19:17 > Step:   89600 Progress: 89.6% Elapsed: 1 day, 10:43:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.39409 Generator_loss: 6.45104 
[INFO] 2021-01-02 20:21:34 > Step:   89700 Progress: 89.7% Elapsed: 1 day, 10:46:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.42345 Generator_loss: 6.12801 
[INFO] 2021-01-02 20:23:51 > Step:   89800 Progress: 89.8% Elapsed: 1 day, 10:48:23 temperature: 1.0 ada_p: No Discriminator_loss: 4.44443 Generator_loss: 6.06523 
[INFO] 2021-01-02 20:26:07 > Step:   89900 Progress: 89.9% Elapsed: 1 day, 10:50:39 temperature: 1.0 ada_p: No Discriminator_loss: 4.76628 Generator_loss: 5.64245 
[INFO] 2021-01-02 20:28:23 > Step:   90000 Progress: 90.0% Elapsed: 1 day, 10:52:56 temperature: 1.0 ada_p: No Discriminator_loss: 4.47049 Generator_loss: 5.85244 
[INFO] 2021-01-02 20:28:23 > Start Evaluation (90000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 20:28:23 > Calculating FID Score....
[INFO] 2021-01-02 20:28:39 > Calculating Inception Score....
[INFO] 2021-01-02 20:28:45 > Calculate F_beta Score....
[INFO] 2021-01-02 20:29:07 > Calculate Accuracies....
[INFO] 2021-01-02 20:29:11 > Calculate Accuracies....
[INFO] 2021-01-02 20:29:12 > F_8 score (Step: 90000, Using valid images): 0.8834847495891094
[INFO] 2021-01-02 20:29:12 > F_1/8 score (Step: 90000, Using valid images): 0.9686230416374974
[INFO] 2021-01-02 20:29:12 > FID score (Step: 90000, Using valid moments): 29.107027034553255
[INFO] 2021-01-02 20:29:12 > Inception score (Step: 90000, 10000 generated images): 13.227495193481445
[INFO] 2021-01-02 20:29:12 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 20:29:20 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 20:31:37 > Step:   90100 Progress: 90.1% Elapsed: 1 day, 10:56:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.65286 Generator_loss: 5.76661 
[INFO] 2021-01-02 20:33:53 > Step:   90200 Progress: 90.2% Elapsed: 1 day, 10:58:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.75121 Generator_loss: 6.08139 
[INFO] 2021-01-02 20:36:08 > Step:   90300 Progress: 90.3% Elapsed: 1 day, 11:00:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.51279 Generator_loss: 5.93158 
[INFO] 2021-01-02 20:38:25 > Step:   90400 Progress: 90.4% Elapsed: 1 day, 11:02:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.44752 Generator_loss: 6.22885 
[INFO] 2021-01-02 20:40:41 > Step:   90500 Progress: 90.5% Elapsed: 1 day, 11:05:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.49364 Generator_loss: 6.02519 
[INFO] 2021-01-02 20:42:58 > Step:   90600 Progress: 90.6% Elapsed: 1 day, 11:07:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.44334 Generator_loss: 6.14566 
[INFO] 2021-01-02 20:45:15 > Step:   90700 Progress: 90.7% Elapsed: 1 day, 11:09:47 temperature: 1.0 ada_p: No Discriminator_loss: 4.56996 Generator_loss: 5.81789 
[INFO] 2021-01-02 20:47:32 > Step:   90800 Progress: 90.8% Elapsed: 1 day, 11:12:04 temperature: 1.0 ada_p: No Discriminator_loss: 4.45388 Generator_loss: 6.21294 
[INFO] 2021-01-02 20:49:49 > Step:   90900 Progress: 90.9% Elapsed: 1 day, 11:14:21 temperature: 1.0 ada_p: No Discriminator_loss: 4.38511 Generator_loss: 6.27084 
[INFO] 2021-01-02 20:52:05 > Step:   91000 Progress: 91.0% Elapsed: 1 day, 11:16:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.52977 Generator_loss: 7.31137 
[INFO] 2021-01-02 20:54:21 > Step:   91100 Progress: 91.1% Elapsed: 1 day, 11:18:53 temperature: 1.0 ada_p: No Discriminator_loss: 4.39913 Generator_loss: 6.99875 
[INFO] 2021-01-02 20:56:37 > Step:   91200 Progress: 91.2% Elapsed: 1 day, 11:21:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.39961 Generator_loss: 6.88954 
[INFO] 2021-01-02 20:58:53 > Step:   91300 Progress: 91.3% Elapsed: 1 day, 11:23:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.52644 Generator_loss: 7.37276 
[INFO] 2021-01-02 21:01:09 > Step:   91400 Progress: 91.4% Elapsed: 1 day, 11:25:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.56616 Generator_loss: 7.35903 
[INFO] 2021-01-02 21:03:25 > Step:   91500 Progress: 91.5% Elapsed: 1 day, 11:27:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.80828 Generator_loss: 5.65695 
[INFO] 2021-01-02 21:05:42 > Step:   91600 Progress: 91.6% Elapsed: 1 day, 11:30:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.51807 Generator_loss: 5.94129 
[INFO] 2021-01-02 21:07:59 > Step:   91700 Progress: 91.7% Elapsed: 1 day, 11:32:31 temperature: 1.0 ada_p: No Discriminator_loss: 4.5541 Generator_loss: 5.91713 
[INFO] 2021-01-02 21:10:16 > Step:   91800 Progress: 91.8% Elapsed: 1 day, 11:34:49 temperature: 1.0 ada_p: No Discriminator_loss: 4.37909 Generator_loss: 6.52741 
[INFO] 2021-01-02 21:12:33 > Step:   91900 Progress: 91.9% Elapsed: 1 day, 11:37:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.41699 Generator_loss: 6.28513 
[INFO] 2021-01-02 21:14:50 > Step:   92000 Progress: 92.0% Elapsed: 1 day, 11:39:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.55702 Generator_loss: 5.94786 
[INFO] 2021-01-02 21:14:50 > Start Evaluation (92000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 21:14:50 > Calculating FID Score....
[INFO] 2021-01-02 21:15:06 > Calculating Inception Score....
[INFO] 2021-01-02 21:15:11 > Calculate F_beta Score....
[INFO] 2021-01-02 21:15:33 > Calculate Accuracies....
[INFO] 2021-01-02 21:15:36 > Calculate Accuracies....
[INFO] 2021-01-02 21:15:38 > F_8 score (Step: 92000, Using valid images): 0.8850132657098103
[INFO] 2021-01-02 21:15:38 > F_1/8 score (Step: 92000, Using valid images): 0.9710798909720211
[INFO] 2021-01-02 21:15:38 > FID score (Step: 92000, Using valid moments): 29.33190900376502
[INFO] 2021-01-02 21:15:38 > Inception score (Step: 92000, 10000 generated images): 13.06138801574707
[INFO] 2021-01-02 21:15:38 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 21:15:45 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 21:18:01 > Step:   92100 Progress: 92.1% Elapsed: 1 day, 11:42:33 temperature: 1.0 ada_p: No Discriminator_loss: 4.48975 Generator_loss: 6.17756 
[INFO] 2021-01-02 21:20:17 > Step:   92200 Progress: 92.2% Elapsed: 1 day, 11:44:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.74885 Generator_loss: 5.69103 
[INFO] 2021-01-02 21:22:34 > Step:   92300 Progress: 92.3% Elapsed: 1 day, 11:47:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.99313 Generator_loss: 6.01149 
[INFO] 2021-01-02 21:24:50 > Step:   92400 Progress: 92.4% Elapsed: 1 day, 11:49:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.44331 Generator_loss: 6.13065 
[INFO] 2021-01-02 21:27:06 > Step:   92500 Progress: 92.5% Elapsed: 1 day, 11:51:38 temperature: 1.0 ada_p: No Discriminator_loss: 4.3616 Generator_loss: 6.41475 
[INFO] 2021-01-02 21:29:22 > Step:   92600 Progress: 92.6% Elapsed: 1 day, 11:53:55 temperature: 1.0 ada_p: No Discriminator_loss: 4.5724 Generator_loss: 5.62246 
[INFO] 2021-01-02 21:31:38 > Step:   92700 Progress: 92.7% Elapsed: 1 day, 11:56:11 temperature: 1.0 ada_p: No Discriminator_loss: 4.79997 Generator_loss: 5.89409 
[INFO] 2021-01-02 21:33:56 > Step:   92800 Progress: 92.8% Elapsed: 1 day, 11:58:28 temperature: 1.0 ada_p: No Discriminator_loss: 4.41041 Generator_loss: 6.22777 
[INFO] 2021-01-02 21:36:12 > Step:   92900 Progress: 92.9% Elapsed: 1 day, 12:00:44 temperature: 1.0 ada_p: No Discriminator_loss: 4.45197 Generator_loss: 6.00655 
[INFO] 2021-01-02 21:38:28 > Step:   93000 Progress: 93.0% Elapsed: 1 day, 12:03:00 temperature: 1.0 ada_p: No Discriminator_loss: 4.52239 Generator_loss: 5.99476 
[INFO] 2021-01-02 21:40:44 > Step:   93100 Progress: 93.1% Elapsed: 1 day, 12:05:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.4216 Generator_loss: 6.1989 
[INFO] 2021-01-02 21:43:01 > Step:   93200 Progress: 93.2% Elapsed: 1 day, 12:07:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.58412 Generator_loss: 6.05715 
[INFO] 2021-01-02 21:45:19 > Step:   93300 Progress: 93.3% Elapsed: 1 day, 12:09:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.3786 Generator_loss: 6.4241 
[INFO] 2021-01-02 21:47:37 > Step:   93400 Progress: 93.4% Elapsed: 1 day, 12:12:09 temperature: 1.0 ada_p: No Discriminator_loss: 4.48939 Generator_loss: 6.17161 
[INFO] 2021-01-02 21:49:54 > Step:   93500 Progress: 93.5% Elapsed: 1 day, 12:14:26 temperature: 1.0 ada_p: No Discriminator_loss: 4.4551 Generator_loss: 6.13597 
[INFO] 2021-01-02 21:52:11 > Step:   93600 Progress: 93.6% Elapsed: 1 day, 12:16:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.562 Generator_loss: 5.99494 
[INFO] 2021-01-02 21:54:27 > Step:   93700 Progress: 93.7% Elapsed: 1 day, 12:18:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.96287 Generator_loss: 5.80405 
[INFO] 2021-01-02 21:56:45 > Step:   93800 Progress: 93.8% Elapsed: 1 day, 12:21:17 temperature: 1.0 ada_p: No Discriminator_loss: 4.77478 Generator_loss: 5.62022 
[INFO] 2021-01-02 21:59:02 > Step:   93900 Progress: 93.9% Elapsed: 1 day, 12:23:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.47463 Generator_loss: 6.0759 
[INFO] 2021-01-02 22:01:19 > Step:   94000 Progress: 94.0% Elapsed: 1 day, 12:25:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.41048 Generator_loss: 6.41792 
[INFO] 2021-01-02 22:01:19 > Start Evaluation (94000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 22:01:19 > Calculating FID Score....
[INFO] 2021-01-02 22:01:35 > Calculating Inception Score....
[INFO] 2021-01-02 22:01:41 > Calculate F_beta Score....
[INFO] 2021-01-02 22:02:02 > Calculate Accuracies....
[INFO] 2021-01-02 22:02:05 > Calculate Accuracies....
[INFO] 2021-01-02 22:02:07 > F_8 score (Step: 94000, Using valid images): 0.8969264377180035
[INFO] 2021-01-02 22:02:07 > F_1/8 score (Step: 94000, Using valid images): 0.9675730771003631
[INFO] 2021-01-02 22:02:07 > FID score (Step: 94000, Using valid moments): 29.083327181701236
[INFO] 2021-01-02 22:02:07 > Inception score (Step: 94000, 10000 generated images): 13.04305362701416
[INFO] 2021-01-02 22:02:07 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 22:02:14 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 22:04:31 > Step:   94100 Progress: 94.1% Elapsed: 1 day, 12:29:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.34804 Generator_loss: 6.53447 
[INFO] 2021-01-02 22:06:47 > Step:   94200 Progress: 94.2% Elapsed: 1 day, 12:31:20 temperature: 1.0 ada_p: No Discriminator_loss: 4.45853 Generator_loss: 6.22588 
[INFO] 2021-01-02 22:09:05 > Step:   94300 Progress: 94.3% Elapsed: 1 day, 12:33:37 temperature: 1.0 ada_p: No Discriminator_loss: 4.42057 Generator_loss: 6.26477 
[INFO] 2021-01-02 22:11:22 > Step:   94400 Progress: 94.4% Elapsed: 1 day, 12:35:54 temperature: 1.0 ada_p: No Discriminator_loss: 4.40632 Generator_loss: 6.33783 
[INFO] 2021-01-02 22:13:39 > Step:   94500 Progress: 94.5% Elapsed: 1 day, 12:38:11 temperature: 1.0 ada_p: No Discriminator_loss: 4.49909 Generator_loss: 6.0181 
[INFO] 2021-01-02 22:15:55 > Step:   94600 Progress: 94.6% Elapsed: 1 day, 12:40:27 temperature: 1.0 ada_p: No Discriminator_loss: 4.42106 Generator_loss: 6.39762 
[INFO] 2021-01-02 22:18:11 > Step:   94700 Progress: 94.7% Elapsed: 1 day, 12:42:43 temperature: 1.0 ada_p: No Discriminator_loss: 4.46638 Generator_loss: 6.15326 
[INFO] 2021-01-02 22:20:28 > Step:   94800 Progress: 94.8% Elapsed: 1 day, 12:45:01 temperature: 1.0 ada_p: No Discriminator_loss: 4.58912 Generator_loss: 5.90752 
[INFO] 2021-01-02 22:22:45 > Step:   94900 Progress: 94.9% Elapsed: 1 day, 12:47:18 temperature: 1.0 ada_p: No Discriminator_loss: 4.45815 Generator_loss: 6.10085 
[INFO] 2021-01-02 22:25:02 > Step:   95000 Progress: 95.0% Elapsed: 1 day, 12:49:34 temperature: 1.0 ada_p: No Discriminator_loss: 4.40515 Generator_loss: 6.57508 
[INFO] 2021-01-02 22:27:19 > Step:   95100 Progress: 95.1% Elapsed: 1 day, 12:51:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.3955 Generator_loss: 6.25682 
[INFO] 2021-01-02 22:29:36 > Step:   95200 Progress: 95.2% Elapsed: 1 day, 12:54:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.45327 Generator_loss: 6.26664 
[INFO] 2021-01-02 22:31:53 > Step:   95300 Progress: 95.3% Elapsed: 1 day, 12:56:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.37847 Generator_loss: 6.59428 
[INFO] 2021-01-02 22:34:10 > Step:   95400 Progress: 95.4% Elapsed: 1 day, 12:58:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.7989 Generator_loss: 5.57039 
[INFO] 2021-01-02 22:36:26 > Step:   95500 Progress: 95.5% Elapsed: 1 day, 13:00:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.45555 Generator_loss: 6.25056 
[INFO] 2021-01-02 22:38:43 > Step:   95600 Progress: 95.6% Elapsed: 1 day, 13:03:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.56437 Generator_loss: 6.08524 
[INFO] 2021-01-02 22:40:59 > Step:   95700 Progress: 95.7% Elapsed: 1 day, 13:05:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.59057 Generator_loss: 5.77446 
[INFO] 2021-01-02 22:43:16 > Step:   95800 Progress: 95.8% Elapsed: 1 day, 13:07:49 temperature: 1.0 ada_p: No Discriminator_loss: 4.47916 Generator_loss: 6.1254 
[INFO] 2021-01-02 22:45:33 > Step:   95900 Progress: 95.9% Elapsed: 1 day, 13:10:05 temperature: 1.0 ada_p: No Discriminator_loss: 4.57719 Generator_loss: 5.88868 
[INFO] 2021-01-02 22:47:50 > Step:   96000 Progress: 96.0% Elapsed: 1 day, 13:12:22 temperature: 1.0 ada_p: No Discriminator_loss: 4.40311 Generator_loss: 6.95615 
[INFO] 2021-01-02 22:47:50 > Start Evaluation (96000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 22:47:50 > Calculating FID Score....
[INFO] 2021-01-02 22:48:06 > Calculating Inception Score....
[INFO] 2021-01-02 22:48:12 > Calculate F_beta Score....
[INFO] 2021-01-02 22:48:33 > Calculate Accuracies....
[INFO] 2021-01-02 22:48:37 > Calculate Accuracies....
[INFO] 2021-01-02 22:48:39 > F_8 score (Step: 96000, Using valid images): 0.8766672772454076
[INFO] 2021-01-02 22:48:39 > F_1/8 score (Step: 96000, Using valid images): 0.9717635391383711
[INFO] 2021-01-02 22:48:39 > FID score (Step: 96000, Using valid moments): 29.699346988258867
[INFO] 2021-01-02 22:48:39 > Inception score (Step: 96000, 10000 generated images): 12.950165748596191
[INFO] 2021-01-02 22:48:39 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 22:48:45 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 22:51:02 > Step:   96100 Progress: 96.1% Elapsed: 1 day, 13:15:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.51724 Generator_loss: 7.16758 
[INFO] 2021-01-02 22:53:19 > Step:   96200 Progress: 96.2% Elapsed: 1 day, 13:17:51 temperature: 1.0 ada_p: No Discriminator_loss: 4.43274 Generator_loss: 7.2385 
[INFO] 2021-01-02 22:55:36 > Step:   96300 Progress: 96.3% Elapsed: 1 day, 13:20:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.4177 Generator_loss: 6.93385 
[INFO] 2021-01-02 22:57:53 > Step:   96400 Progress: 96.4% Elapsed: 1 day, 13:22:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.57224 Generator_loss: 7.3035 
[INFO] 2021-01-02 23:00:10 > Step:   96500 Progress: 96.5% Elapsed: 1 day, 13:24:42 temperature: 1.0 ada_p: No Discriminator_loss: 4.42489 Generator_loss: 7.0315 
[INFO] 2021-01-02 23:02:27 > Step:   96600 Progress: 96.6% Elapsed: 1 day, 13:26:59 temperature: 1.0 ada_p: No Discriminator_loss: 4.4839 Generator_loss: 7.124 
[INFO] 2021-01-02 23:04:43 > Step:   96700 Progress: 96.7% Elapsed: 1 day, 13:29:16 temperature: 1.0 ada_p: No Discriminator_loss: 4.44178 Generator_loss: 7.31434 
[INFO] 2021-01-02 23:07:00 > Step:   96800 Progress: 96.8% Elapsed: 1 day, 13:31:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.45587 Generator_loss: 7.13442 
[INFO] 2021-01-02 23:09:18 > Step:   96900 Progress: 96.9% Elapsed: 1 day, 13:33:50 temperature: 1.0 ada_p: No Discriminator_loss: 4.49484 Generator_loss: 7.23887 
[INFO] 2021-01-02 23:11:34 > Step:   97000 Progress: 97.0% Elapsed: 1 day, 13:36:07 temperature: 1.0 ada_p: No Discriminator_loss: 4.50547 Generator_loss: 7.00935 
[INFO] 2021-01-02 23:13:52 > Step:   97100 Progress: 97.1% Elapsed: 1 day, 13:38:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.66173 Generator_loss: 7.05363 
[INFO] 2021-01-02 23:16:09 > Step:   97200 Progress: 97.2% Elapsed: 1 day, 13:40:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.3887 Generator_loss: 7.14435 
[INFO] 2021-01-02 23:18:25 > Step:   97300 Progress: 97.3% Elapsed: 1 day, 13:42:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.35162 Generator_loss: 6.88598 
[INFO] 2021-01-02 23:20:43 > Step:   97400 Progress: 97.4% Elapsed: 1 day, 13:45:15 temperature: 1.0 ada_p: No Discriminator_loss: 4.44847 Generator_loss: 7.27563 
[INFO] 2021-01-02 23:23:00 > Step:   97500 Progress: 97.5% Elapsed: 1 day, 13:47:32 temperature: 1.0 ada_p: No Discriminator_loss: 4.62732 Generator_loss: 7.41611 
[INFO] 2021-01-02 23:25:16 > Step:   97600 Progress: 97.6% Elapsed: 1 day, 13:49:49 temperature: 1.0 ada_p: No Discriminator_loss: 5.70895 Generator_loss: 6.57331 
[INFO] 2021-01-02 23:27:33 > Step:   97700 Progress: 97.7% Elapsed: 1 day, 13:52:06 temperature: 1.0 ada_p: No Discriminator_loss: 4.44567 Generator_loss: 7.19003 
[INFO] 2021-01-02 23:29:51 > Step:   97800 Progress: 97.8% Elapsed: 1 day, 13:54:23 temperature: 1.0 ada_p: No Discriminator_loss: 4.39383 Generator_loss: 7.06311 
[INFO] 2021-01-02 23:32:08 > Step:   97900 Progress: 97.9% Elapsed: 1 day, 13:56:40 temperature: 1.0 ada_p: No Discriminator_loss: 4.48239 Generator_loss: 7.10509 
[INFO] 2021-01-02 23:34:24 > Step:   98000 Progress: 98.0% Elapsed: 1 day, 13:58:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.44719 Generator_loss: 7.16384 
[INFO] 2021-01-02 23:34:24 > Start Evaluation (98000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 23:34:24 > Calculating FID Score....
[INFO] 2021-01-02 23:34:41 > Calculating Inception Score....
[INFO] 2021-01-02 23:34:46 > Calculate F_beta Score....
[INFO] 2021-01-02 23:35:07 > Calculate Accuracies....
[INFO] 2021-01-02 23:35:11 > Calculate Accuracies....
[INFO] 2021-01-02 23:35:12 > F_8 score (Step: 98000, Using valid images): 0.8713631152024054
[INFO] 2021-01-02 23:35:12 > F_1/8 score (Step: 98000, Using valid images): 0.9613259253874993
[INFO] 2021-01-02 23:35:12 > FID score (Step: 98000, Using valid moments): 30.477428973464953
[INFO] 2021-01-02 23:35:12 > Inception score (Step: 98000, 10000 generated images): 12.621363639831543
[INFO] 2021-01-02 23:35:12 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-02 23:35:19 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-02 23:37:36 > Step:   98100 Progress: 98.1% Elapsed: 1 day, 14:02:08 temperature: 1.0 ada_p: No Discriminator_loss: 5.06091 Generator_loss: 5.74321 
[INFO] 2021-01-02 23:39:53 > Step:   98200 Progress: 98.2% Elapsed: 1 day, 14:04:25 temperature: 1.0 ada_p: No Discriminator_loss: 4.71545 Generator_loss: 7.70019 
[INFO] 2021-01-02 23:42:09 > Step:   98300 Progress: 98.3% Elapsed: 1 day, 14:06:41 temperature: 1.0 ada_p: No Discriminator_loss: 4.51982 Generator_loss: 7.18594 
[INFO] 2021-01-02 23:44:25 > Step:   98400 Progress: 98.4% Elapsed: 1 day, 14:08:58 temperature: 1.0 ada_p: No Discriminator_loss: 4.51668 Generator_loss: 7.4092 
[INFO] 2021-01-02 23:46:41 > Step:   98500 Progress: 98.5% Elapsed: 1 day, 14:11:14 temperature: 1.0 ada_p: No Discriminator_loss: 4.4669 Generator_loss: 6.41156 
[INFO] 2021-01-02 23:48:58 > Step:   98600 Progress: 98.6% Elapsed: 1 day, 14:13:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.45706 Generator_loss: 6.14645 
[INFO] 2021-01-02 23:51:14 > Step:   98700 Progress: 98.7% Elapsed: 1 day, 14:15:46 temperature: 1.0 ada_p: No Discriminator_loss: 4.87211 Generator_loss: 6.16428 
[INFO] 2021-01-02 23:53:30 > Step:   98800 Progress: 98.8% Elapsed: 1 day, 14:18:03 temperature: 1.0 ada_p: No Discriminator_loss: 4.47356 Generator_loss: 6.30313 
[INFO] 2021-01-02 23:55:46 > Step:   98900 Progress: 98.9% Elapsed: 1 day, 14:20:19 temperature: 1.0 ada_p: No Discriminator_loss: 4.49491 Generator_loss: 6.40715 
[INFO] 2021-01-02 23:58:03 > Step:   99000 Progress: 99.0% Elapsed: 1 day, 14:22:35 temperature: 1.0 ada_p: No Discriminator_loss: 4.8773 Generator_loss: 7.57967 
[INFO] 2021-01-03 00:00:20 > Step:   99100 Progress: 99.1% Elapsed: 1 day, 14:24:52 temperature: 1.0 ada_p: No Discriminator_loss: 4.62609 Generator_loss: 7.81606 
[INFO] 2021-01-03 00:02:36 > Step:   99200 Progress: 99.2% Elapsed: 1 day, 14:27:08 temperature: 1.0 ada_p: No Discriminator_loss: 4.74963 Generator_loss: 7.88399 
[INFO] 2021-01-03 00:04:52 > Step:   99300 Progress: 99.3% Elapsed: 1 day, 14:29:24 temperature: 1.0 ada_p: No Discriminator_loss: 4.88786 Generator_loss: 7.19128 
[INFO] 2021-01-03 00:07:08 > Step:   99400 Progress: 99.4% Elapsed: 1 day, 14:31:40 temperature: 1.0 ada_p: No Discriminator_loss: 5.00241 Generator_loss: 7.24418 
[INFO] 2021-01-03 00:09:24 > Step:   99500 Progress: 99.5% Elapsed: 1 day, 14:33:57 temperature: 1.0 ada_p: No Discriminator_loss: 4.99278 Generator_loss: 7.81371 
[INFO] 2021-01-03 00:11:41 > Step:   99600 Progress: 99.6% Elapsed: 1 day, 14:36:13 temperature: 1.0 ada_p: No Discriminator_loss: 4.85376 Generator_loss: 6.98804 
[INFO] 2021-01-03 00:13:58 > Step:   99700 Progress: 99.7% Elapsed: 1 day, 14:38:30 temperature: 1.0 ada_p: No Discriminator_loss: 4.79247 Generator_loss: 6.79166 
[INFO] 2021-01-03 00:16:14 > Step:   99800 Progress: 99.8% Elapsed: 1 day, 14:40:46 temperature: 1.0 ada_p: No Discriminator_loss: 5.07749 Generator_loss: 6.90197 
[INFO] 2021-01-03 00:18:30 > Step:   99900 Progress: 99.9% Elapsed: 1 day, 14:43:02 temperature: 1.0 ada_p: No Discriminator_loss: 5.05677 Generator_loss: 6.87567 
[INFO] 2021-01-03 00:20:47 > Step:  100000 Progress: 100.0% Elapsed: 1 day, 14:45:19 temperature: 1.0 ada_p: No Discriminator_loss: 5.14793 Generator_loss: 5.71324 
[INFO] 2021-01-03 00:20:47 > Start Evaluation (100000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-03 00:20:47 > Calculating FID Score....
[INFO] 2021-01-03 00:21:03 > Calculating Inception Score....
[INFO] 2021-01-03 00:21:08 > Calculate F_beta Score....
[INFO] 2021-01-03 00:21:31 > Calculate Accuracies....
[INFO] 2021-01-03 00:21:34 > Calculate Accuracies....
[INFO] 2021-01-03 00:21:36 > F_8 score (Step: 100000, Using valid images): 0.8622378318030955
[INFO] 2021-01-03 00:21:36 > F_1/8 score (Step: 100000, Using valid images): 0.9599794521180187
[INFO] 2021-01-03 00:21:36 > FID score (Step: 100000, Using valid moments): 35.08052745416222
[INFO] 2021-01-03 00:21:36 > Inception score (Step: 100000, 10000 generated images): 12.382637023925781
[INFO] 2021-01-03 00:21:36 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305
[INFO] 2021-01-03 00:21:43 > Save model to checkpoints/ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-03 00:21:44 > Start Evaluation (100000 Step): ContraGAN-train-2021_01_01_09_35_08
[INFO] 2021-01-03 00:21:44 > Calculating FID Score....
[INFO] 2021-01-03 00:22:01 > Calculating Inception Score....
[INFO] 2021-01-03 00:22:06 > Calculate F_beta Score....
[INFO] 2021-01-03 00:22:28 > Calculate Accuracies....
[INFO] 2021-01-03 00:22:32 > Calculate Accuracies....
[INFO] 2021-01-03 00:22:34 > F_8 score (Step: 100000, Using valid images): 0.886200026516982
[INFO] 2021-01-03 00:22:34 > F_1/8 score (Step: 100000, Using valid images): 0.9481626457682509
[INFO] 2021-01-03 00:22:34 > FID score (Step: 100000, Using valid moments): 35.112744540298365
[INFO] 2021-01-03 00:22:34 > Inception score (Step: 100000, 10000 generated images): 12.412008285522461
[INFO] 2021-01-03 00:22:34 > Best FID score (Step: 54000, Using valid moments): 27.027068632410305