Pasted

$ python lstm_regression.py 
10 0
tensorboard/lstm_demo/hidden=10_noise=0.00_20-Nov-01-21-57
2018-11-20 01:21:57.722399: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-11-20 01:21:57.922638: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1405] Found device 0 with properties: 
name: Tesla P100-PCIE-12GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285
pciBusID: 0000:04:00.0
totalMemory: 11.91GiB freeMemory: 11.63GiB
2018-11-20 01:21:57.922673: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:21:58.227974: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:21:58.228010: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:21:58.228016: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:21:58.228263: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
2018-11-20 01:21:58.446737: I tensorflow/core/common_runtime/process_util.cc:69] Creating new thread pool with default inter op setting: 28. Tune using inter_op_parallelism_threads for best performance.
epoch 0, loss=10.6297, w_err=8.52124, u_err=12.0531
epoch 1, loss=8.79685, w_err=7.20968, u_err=12.5967
epoch 2, loss=7.90487, w_err=6.70351, u_err=12.6544
epoch 3, loss=7.1857, w_err=6.52558, u_err=13.2888
epoch 4, loss=6.92823, w_err=6.3015, u_err=13.6526
epoch 5, loss=7.15056, w_err=6.29295, u_err=14.5715
epoch 6, loss=6.16476, w_err=6.37632, u_err=13.7486
epoch 7, loss=6.39313, w_err=6.60102, u_err=14.0458
epoch 8, loss=6.36399, w_err=6.95487, u_err=14.6413
epoch 9, loss=7.00933, w_err=7.71778, u_err=14.9222
10 0.1
tensorboard/lstm_demo/hidden=10_noise=0.10_20-Nov-01-22-43
2018-11-20 01:22:43.742743: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:22:43.742775: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:22:43.742781: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:22:43.742786: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:22:43.742902: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=9.32713, w_err=8.41621, u_err=13.1874
epoch 1, loss=7.34026, w_err=7.49302, u_err=13.5206
epoch 2, loss=6.91166, w_err=7.12653, u_err=13.8453
epoch 3, loss=7.30914, w_err=6.79248, u_err=14.3225
epoch 4, loss=5.53828, w_err=7.01217, u_err=14.7204
epoch 5, loss=5.75306, w_err=7.44633, u_err=15.7084
epoch 6, loss=5.86762, w_err=7.90376, u_err=15.6017
epoch 7, loss=5.84096, w_err=8.283, u_err=16.369
epoch 8, loss=4.69968, w_err=8.87179, u_err=16.1823
epoch 9, loss=4.819, w_err=9.15344, u_err=17.488
10 0.5
tensorboard/lstm_demo/hidden=10_noise=0.50_20-Nov-01-23-33
2018-11-20 01:23:33.702018: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:23:33.702049: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:23:33.702055: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:23:33.702060: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:23:33.702175: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=10.6797, w_err=8.50962, u_err=11.8157
epoch 1, loss=8.29039, w_err=7.89843, u_err=12.4444
epoch 2, loss=7.33286, w_err=7.87325, u_err=12.8858
epoch 3, loss=7.5223, w_err=7.97818, u_err=13.1749
epoch 4, loss=6.05339, w_err=7.65371, u_err=14.169
epoch 5, loss=8.67924, w_err=8.28814, u_err=14.4403
epoch 6, loss=6.81281, w_err=8.80682, u_err=14.4918
epoch 7, loss=6.33745, w_err=8.86114, u_err=15.2632
epoch 8, loss=7.24502, w_err=9.96045, u_err=15.6272
epoch 9, loss=7.7095, w_err=10.3481, u_err=15.9653
100 0
tensorboard/lstm_demo/hidden=100_noise=0.00_20-Nov-01-24-22
2018-11-20 01:24:22.933212: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:24:22.933247: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:24:22.933253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:24:22.933258: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:24:22.933392: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=138.507, w_err=37.5161, u_err=114.413
epoch 1, loss=137.491, w_err=38.4343, u_err=117.304
epoch 2, loss=135.289, w_err=39.8321, u_err=119.539
epoch 3, loss=137.373, w_err=41.7879, u_err=122.446
epoch 4, loss=134.821, w_err=43.884, u_err=123.529
epoch 5, loss=134.989, w_err=45.8154, u_err=124.386
epoch 6, loss=137.851, w_err=52.5569, u_err=130.334
epoch 7, loss=138.026, w_err=57.8802, u_err=134.753
epoch 8, loss=138.927, w_err=63.1109, u_err=137.537
epoch 9, loss=145.229, w_err=70.8715, u_err=143.302
100 0.1
tensorboard/lstm_demo/hidden=100_noise=0.10_20-Nov-01-25-12
2018-11-20 01:25:12.025332: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:25:12.025367: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:25:12.025373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:25:12.025378: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:25:12.025508: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=546.266, w_err=39.6811, u_err=115.702
epoch 1, loss=467.039, w_err=41.292, u_err=119.815
epoch 2, loss=425.5, w_err=41.5123, u_err=120.508
epoch 3, loss=409.249, w_err=41.7531, u_err=121.187
epoch 4, loss=417.128, w_err=41.875, u_err=121.394
epoch 5, loss=408.437, w_err=41.9662, u_err=121.371
epoch 6, loss=402.372, w_err=41.9935, u_err=121.333
epoch 7, loss=401.382, w_err=41.9914, u_err=121.323
epoch 8, loss=401.318, w_err=41.9347, u_err=121.324
epoch 9, loss=401.005, w_err=41.9658, u_err=121.326
100 0.5
tensorboard/lstm_demo/hidden=100_noise=0.50_20-Nov-01-26-01
2018-11-20 01:26:01.360326: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:26:01.360358: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:26:01.360364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:26:01.360369: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:26:01.360486: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=165.629, w_err=37.8015, u_err=116.477
epoch 1, loss=159.905, w_err=38.9053, u_err=119.305
epoch 2, loss=160.393, w_err=38.9982, u_err=119.537
epoch 3, loss=157.616, w_err=39.1445, u_err=119.57
epoch 4, loss=157.814, w_err=39.8623, u_err=119.636
epoch 5, loss=158.496, w_err=40.2721, u_err=119.787
epoch 6, loss=156.315, w_err=40.8518, u_err=119.876
epoch 7, loss=155.521, w_err=41.8879, u_err=119.999
epoch 8, loss=154.967, w_err=42.7591, u_err=120.211
epoch 9, loss=154.88, w_err=43.4281, u_err=120.681
1000 0
tensorboard/lstm_demo/hidden=1000_noise=0.00_20-Nov-01-29-57
2018-11-20 01:29:57.800896: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:29:57.800934: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:29:57.800940: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:29:57.800945: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:29:57.801075: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=4666.15, w_err=137.623, u_err=1131.12
epoch 1, loss=4597.19, w_err=139.623, u_err=1147.54
epoch 2, loss=4571.77, w_err=139.746, u_err=1148.59
epoch 3, loss=4562.35, w_err=139.752, u_err=1148.66
epoch 4, loss=4546.95, w_err=139.752, u_err=1148.67
epoch 5, loss=4540.92, w_err=139.75, u_err=1148.68
epoch 6, loss=4540.02, w_err=139.751, u_err=1148.67
epoch 7, loss=4535.51, w_err=139.75, u_err=1148.67
epoch 8, loss=4529.78, w_err=139.752, u_err=1148.68
epoch 9, loss=4526.54, w_err=139.753, u_err=1148.69
1000 0.1
tensorboard/lstm_demo/hidden=1000_noise=0.10_20-Nov-01-33-46
2018-11-20 01:33:46.410142: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:33:46.410184: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:33:46.410191: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:33:46.410196: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:33:46.410352: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=4838.62, w_err=137.753, u_err=1131.5
epoch 1, loss=4629.37, w_err=139.796, u_err=1148.01
epoch 2, loss=4421.3, w_err=139.928, u_err=1149.09
epoch 3, loss=4338.86, w_err=139.935, u_err=1149.15
epoch 4, loss=4313.18, w_err=139.935, u_err=1149.16
epoch 5, loss=4295.86, w_err=139.935, u_err=1149.16
epoch 6, loss=4280.65, w_err=139.934, u_err=1149.15
epoch 7, loss=4261.16, w_err=139.934, u_err=1149.16
epoch 8, loss=4245.1, w_err=139.933, u_err=1149.15
epoch 9, loss=4236.08, w_err=139.931, u_err=1149.15
1000 0.5
tensorboard/lstm_demo/hidden=1000_noise=0.50_20-Nov-01-37-34
2018-11-20 01:37:34.965331: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:37:34.965373: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:37:34.965379: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:37:34.965385: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:37:34.965524: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=3159.73, w_err=138.3, u_err=1137.79
epoch 1, loss=3083.82, w_err=140.441, u_err=1155.39
epoch 2, loss=3050.47, w_err=140.58, u_err=1156.54
epoch 3, loss=3030, w_err=140.588, u_err=1156.61
epoch 4, loss=3022.77, w_err=140.597, u_err=1156.66
epoch 5, loss=3017.02, w_err=140.599, u_err=1156.67
epoch 6, loss=2996.53, w_err=140.63, u_err=1156.73
epoch 7, loss=2996.52, w_err=140.647, u_err=1156.78
epoch 8, loss=2996.53, w_err=140.648, u_err=1156.78
epoch 9, loss=2992.59, w_err=140.648, u_err=1156.78
[jalal@scc-c12 pset4_GAN_RNN]$