Running for size 12 and layers 3
Best for : 3
Best: [-9.721170] Layer Size [3] and Neuron Size [12]  using {'batch_size': 32, 'epochs': 2000, 'lr': 0.01}
-17.177758 (11.280439) with: {'batch_size': 32, 'epochs': 500, 'lr': 0.01}
-34.657374 (29.231691) with: {'batch_size': 32, 'epochs': 500, 'lr': 0.001}
-12.939048 (4.862494) with: {'batch_size': 32, 'epochs': 1000, 'lr': 0.01}
-20.883207 (11.201940) with: {'batch_size': 32, 'epochs': 1000, 'lr': 0.001}
-23.858539 (20.174187) with: {'batch_size': 32, 'epochs': 1500, 'lr': 0.01}
-15.131664 (9.455129) with: {'batch_size': 32, 'epochs': 1500, 'lr': 0.001}
-9.721170 (5.685409) with: {'batch_size': 32, 'epochs': 2000, 'lr': 0.01}
-9.844963 (5.558540) with: {'batch_size': 32, 'epochs': 2000, 'lr': 0.001}
-15.811816 (7.844408) with: {'batch_size': 64, 'epochs': 500, 'lr': 0.01}
-25.247967 (13.611378) with: {'batch_size': 64, 'epochs': 500, 'lr': 0.001}
-14.171917 (7.061513) with: {'batch_size': 64, 'epochs': 1000, 'lr': 0.01}
-19.624116 (10.836725) with: {'batch_size': 64, 'epochs': 1000, 'lr': 0.001}
-15.642507 (7.385852) with: {'batch_size': 64, 'epochs': 1500, 'lr': 0.01}
-16.694742 (7.781271) with: {'batch_size': 64, 'epochs': 1500, 'lr': 0.001}
-27.758607 (28.744004) with: {'batch_size': 64, 'epochs': 2000, 'lr': 0.01}
-13.396538 (7.863840) with: {'batch_size': 64, 'epochs': 2000, 'lr': 0.001}
-30.244009 (21.520802) with: {'batch_size': 128, 'epochs': 500, 'lr': 0.01}
-84.941585 (65.964288) with: {'batch_size': 128, 'epochs': 500, 'lr': 0.001}
-31.154784 (19.543359) with: {'batch_size': 128, 'epochs': 1000, 'lr': 0.01}
-30.216202 (17.513435) with: {'batch_size': 128, 'epochs': 1000, 'lr': 0.001}
-19.415991 (7.198474) with: {'batch_size': 128, 'epochs': 1500, 'lr': 0.01}
-42.003892 (53.015305) with: {'batch_size': 128, 'epochs': 1500, 'lr': 0.001}
-24.366136 (19.445536) with: {'batch_size': 128, 'epochs': 2000, 'lr': 0.01}
-28.297303 (19.735947) with: {'batch_size': 128, 'epochs': 2000, 'lr': 0.001}
