Pasted

$ python rnn_regression.py 
variable name, shape, min, max: 
h0 (10,) -1.390209763872885 1.1620041588906302
w (10, 10) -3.086319961890296 2.635003581923411
x (100, 10) -3.1468819303195654 3.3738213996699704
10 0
tensorboard/hidden=10_noise=0.00_20-Nov-01-15-59
2018-11-20 01:15:59.781025: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2018-11-20 01:15:59.966330: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1405] Found device 0 with properties: 
name: Tesla P100-PCIE-12GB major: 6 minor: 0 memoryClockRate(GHz): 1.3285
pciBusID: 0000:04:00.0
totalMemory: 11.91GiB freeMemory: 11.63GiB
2018-11-20 01:15:59.966364: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:16:00.286811: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:16:00.286846: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:16:00.286852: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:16:00.287099: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
2018-11-20 01:16:00.506090: I tensorflow/core/common_runtime/process_util.cc:69] Creating new thread pool with default inter op setting: 28. Tune using inter_op_parallelism_threads for best performance.
epoch 0, loss=34.8908, w_err=2.8535
epoch 1, loss=4.50327, w_err=1.01455
epoch 2, loss=0.500314, w_err=0.332205
epoch 3, loss=0.0415393, w_err=0.11066
epoch 4, loss=0.00943122, w_err=0.0442696
epoch 5, loss=0.00235489, w_err=0.0201223
epoch 6, loss=0.00173596, w_err=0.0145736
epoch 7, loss=0.000324855, w_err=0.0101238
10 0.1
tensorboard/hidden=10_noise=0.10_20-Nov-01-16-11
2018-11-20 01:16:11.481235: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:16:11.481268: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:16:11.481274: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:16:11.481278: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:16:11.481386: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=35.8704, w_err=2.57949
epoch 1, loss=4.30314, w_err=0.792733
epoch 2, loss=2.47278, w_err=0.50997
epoch 3, loss=2.67791, w_err=0.487974
epoch 4, loss=2.968, w_err=0.510342
epoch 5, loss=3.44888, w_err=0.548782
epoch 6, loss=3.84741, w_err=0.592027
epoch 7, loss=3.9957, w_err=0.637743
10 0.5
tensorboard/hidden=10_noise=0.50_20-Nov-01-16-21
2018-11-20 01:16:21.560301: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:16:21.560337: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:16:21.560344: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:16:21.560349: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:16:21.560477: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=273.183, w_err=4.51849
epoch 1, loss=112.515, w_err=2.65115
epoch 2, loss=95.3863, w_err=2.90635
epoch 3, loss=97.596, w_err=2.97501
epoch 4, loss=94.4694, w_err=2.97785
epoch 5, loss=100.099, w_err=3.03458
epoch 6, loss=99.7086, w_err=3.00082
epoch 7, loss=100.405, w_err=3.01057
100 0
tensorboard/hidden=100_noise=0.00_20-Nov-01-16-31
2018-11-20 01:16:31.746398: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:16:31.746440: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:16:31.746447: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:16:31.746452: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:16:31.746596: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=340.279, w_err=8.09758
epoch 1, loss=41.764, w_err=2.5643
epoch 2, loss=4.44422, w_err=0.885786
epoch 3, loss=0.7234, w_err=0.346504
epoch 4, loss=0.236728, w_err=0.192394
epoch 5, loss=0.134625, w_err=0.137381
epoch 6, loss=0.0800614, w_err=0.103989
epoch 7, loss=0.0442909, w_err=0.0873866
100 0.1
tensorboard/hidden=100_noise=0.10_20-Nov-01-16-43
2018-11-20 01:16:43.808674: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:16:43.808724: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:16:43.808742: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:16:43.808747: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:16:43.808905: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=476.111, w_err=8.47401
epoch 1, loss=63.7397, w_err=3.1087
epoch 2, loss=27.3675, w_err=1.63134
epoch 3, loss=25.2724, w_err=1.39828
epoch 4, loss=27.4067, w_err=1.46412
epoch 5, loss=30.2282, w_err=1.56414
epoch 6, loss=32.8158, w_err=1.68247
epoch 7, loss=35.6787, w_err=1.81894
100 0.5
tensorboard/hidden=100_noise=0.50_20-Nov-01-16-56
2018-11-20 01:16:56.790735: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:16:56.790777: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:16:56.790784: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:16:56.790788: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:16:56.790932: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=1017.49, w_err=10.2579
epoch 1, loss=497.671, w_err=6.05086
epoch 2, loss=464.225, w_err=6.03642
epoch 3, loss=481.253, w_err=6.02639
epoch 4, loss=481.581, w_err=6.1542
epoch 5, loss=491.485, w_err=6.25742
epoch 6, loss=498.195, w_err=6.33522
epoch 7, loss=510.623, w_err=6.41027
1000 0
tensorboard/hidden=1000_noise=0.00_20-Nov-01-17-07
2018-11-20 01:17:07.754516: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:17:07.754557: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:17:07.754564: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:17:07.754570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:17:07.754745: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=5363.86, w_err=33.2644
epoch 1, loss=461.152, w_err=9.65045
epoch 2, loss=52.9528, w_err=3.24025
epoch 3, loss=7.74203, w_err=1.20071
epoch 4, loss=2.02319, w_err=0.576863
epoch 5, loss=1.3099, w_err=0.4226
epoch 6, loss=1.70097, w_err=0.424354
epoch 7, loss=1.78509, w_err=0.477206
1000 0.1
tensorboard/hidden=1000_noise=0.10_20-Nov-01-17-18
2018-11-20 01:17:18.858381: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:17:18.858423: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:17:18.858430: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:17:18.858435: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:17:18.858570: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=4985.82, w_err=33.0791
epoch 1, loss=600.889, w_err=9.61866
epoch 2, loss=237.083, w_err=5.24793
epoch 3, loss=209.068, w_err=4.33949
epoch 4, loss=218.66, w_err=4.49108
epoch 5, loss=237.289, w_err=4.75369
epoch 6, loss=258.529, w_err=5.07065
epoch 7, loss=284.367, w_err=5.40532
1000 0.5
tensorboard/hidden=1000_noise=0.50_20-Nov-01-17-30
2018-11-20 01:17:30.125217: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1484] Adding visible gpu devices: 0
2018-11-20 01:17:30.125253: I tensorflow/core/common_runtime/gpu/gpu_device.cc:965] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-11-20 01:17:30.125259: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971]      0 
2018-11-20 01:17:30.125264: I tensorflow/core/common_runtime/gpu/gpu_device.cc:984] 0:   N 
2018-11-20 01:17:30.125384: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1097] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11251 MB memory) -> physical GPU (device: 0, name: Tesla P100-PCIE-12GB, pci bus id: 0000:04:00.0, compute capability: 6.0)
epoch 0, loss=8829.65, w_err=36.9524
epoch 1, loss=3865.05, w_err=18.9384
epoch 2, loss=3600.48, w_err=18.6118
epoch 3, loss=3687.89, w_err=18.4969
epoch 4, loss=3784.69, w_err=18.7588
epoch 5, loss=3874.89, w_err=18.9512
epoch 6, loss=3971.74, w_err=19.1494
epoch 7, loss=4024.54, w_err=19.2887
[jalal@scc-c12 pset4_GAN_RNN]$