GRU attempt Bidirectional - 150 epochs
Increases to 90% train 85% test acc around 92 epochs, and then increases to 94% test acc 95.5% test acc and stagnates until finishing
- Batch = 2048
- LR = 3e-5
- Hidden = 256
- Layers = 2
- Bidirectional = True
- Dropout = 0.5
torch running with cuda
torch running with cuda
torch running with cuda
************ Start ************
dataset: Movie Reviews and Ratings , method: RNN , setting: train and test , result: saver , evaluation: accuracy
method running...
--start training...
23973 unknown words out of a 97266 vocab
0
evaluating performance...
Epoch: 0 Accuracy in batch of size 2048 : 0.4990234375 Loss: 0.6939529776573181
evaluating performance...
Test Accuracy: 0.49924
1
evaluating performance...
Epoch: 1 Accuracy in batch of size 2048 : 0.501953125 Loss: 0.6931964755058289
2
evaluating performance...
Epoch: 2 Accuracy in batch of size 2048 : 0.50048828125 Loss: 0.6931698322296143
evaluating performance...
Test Accuracy: 0.50012
3
evaluating performance...
Epoch: 3 Accuracy in batch of size 2048 : 0.5048828125 Loss: 0.6928601264953613
4
evaluating performance...
Epoch: 4 Accuracy in batch of size 2048 : 0.51318359375 Loss: 0.6925387978553772
evaluating performance...
Test Accuracy: 0.5066
5
evaluating performance...
Epoch: 5 Accuracy in batch of size 2048 : 0.50390625 Loss: 0.6930156946182251
6
evaluating performance...
Epoch: 6 Accuracy in batch of size 2048 : 0.52587890625 Loss: 0.6908199787139893
evaluating performance...
Test Accuracy: 0.507
7
evaluating performance...
Epoch: 7 Accuracy in batch of size 2048 : 0.515625 Loss: 0.6911492943763733
8
evaluating performance...
Epoch: 8 Accuracy in batch of size 2048 : 0.541015625 Loss: 0.6896810531616211
evaluating performance...
Test Accuracy: 0.50748
9
evaluating performance...
Epoch: 9 Accuracy in batch of size 2048 : 0.51611328125 Loss: 0.6908626556396484
10
evaluating performance...
Epoch: 10 Accuracy in batch of size 2048 : 0.509765625 Loss: 0.692299485206604
evaluating performance...
Test Accuracy: 0.50852
11
evaluating performance...
Epoch: 11 Accuracy in batch of size 2048 : 0.51171875 Loss: 0.6920781135559082
12
evaluating performance...
Epoch: 12 Accuracy in batch of size 2048 : 0.51953125 Loss: 0.6907010078430176
evaluating performance...
Test Accuracy: 0.5118
13
evaluating performance...
Epoch: 13 Accuracy in batch of size 2048 : 0.50537109375 Loss: 0.6922585964202881
14
evaluating performance...
Epoch: 14 Accuracy in batch of size 2048 : 0.541015625 Loss: 0.6905924677848816
evaluating performance...
Test Accuracy: 0.51256
15
evaluating performance...
Epoch: 15 Accuracy in batch of size 2048 : 0.52880859375 Loss: 0.6887694597244263
16
evaluating performance...
Epoch: 16 Accuracy in batch of size 2048 : 0.53662109375 Loss: 0.6878471970558167
evaluating performance...
Test Accuracy: 0.51584
17
evaluating performance...
Epoch: 17 Accuracy in batch of size 2048 : 0.55712890625 Loss: 0.6863015294075012
18
evaluating performance...
Epoch: 18 Accuracy in batch of size 2048 : 0.521484375 Loss: 0.6880057454109192
evaluating performance...
Test Accuracy: 0.51784
19
evaluating performance...
Epoch: 19 Accuracy in batch of size 2048 : 0.5234375 Loss: 0.685091495513916
20
evaluating performance...
Epoch: 20 Accuracy in batch of size 2048 : 0.517578125 Loss: 0.6861599683761597
evaluating performance...
Test Accuracy: 0.52084
21
evaluating performance...
Epoch: 21 Accuracy in batch of size 2048 : 0.52099609375 Loss: 0.6868613958358765
22
evaluating performance...
Epoch: 22 Accuracy in batch of size 2048 : 0.52587890625 Loss: 0.6849170923233032
evaluating performance...
Test Accuracy: 0.5242
23
evaluating performance...
Epoch: 23 Accuracy in batch of size 2048 : 0.5361328125 Loss: 0.6783689856529236
24
evaluating performance...
Epoch: 24 Accuracy in batch of size 2048 : 0.5263671875 Loss: 0.6766904592514038
evaluating performance...
Test Accuracy: 0.53212
25
evaluating performance...
Epoch: 25 Accuracy in batch of size 2048 : 0.546875 Loss: 0.688940167427063
26
evaluating performance...
Epoch: 26 Accuracy in batch of size 2048 : 0.56494140625 Loss: 0.6708534955978394
evaluating performance...
Test Accuracy: 0.54132
27
evaluating performance...
Epoch: 27 Accuracy in batch of size 2048 : 0.5751953125 Loss: 0.6652529239654541
28
evaluating performance...
Epoch: 28 Accuracy in batch of size 2048 : 0.72412109375 Loss: 0.5899749994277954
evaluating performance...
Test Accuracy: 0.71112
29
evaluating performance...
Epoch: 29 Accuracy in batch of size 2048 : 0.7548828125 Loss: 0.5432003736495972
30
evaluating performance...
Epoch: 30 Accuracy in batch of size 2048 : 0.7587890625 Loss: 0.5377334356307983
evaluating performance...
Test Accuracy: 0.7496
31
evaluating performance...
Epoch: 31 Accuracy in batch of size 2048 : 0.76953125 Loss: 0.53520667552948
32
evaluating performance...
Epoch: 32 Accuracy in batch of size 2048 : 0.7841796875 Loss: 0.5096602439880371
evaluating performance...
Test Accuracy: 0.76588
33
evaluating performance...
Epoch: 33 Accuracy in batch of size 2048 : 0.77587890625 Loss: 0.5232027173042297
34
evaluating performance...
Epoch: 34 Accuracy in batch of size 2048 : 0.79248046875 Loss: 0.49451857805252075
evaluating performance...
Test Accuracy: 0.7752
35
evaluating performance...
Epoch: 35 Accuracy in batch of size 2048 : 0.7646484375 Loss: 0.5242080688476562
36
evaluating performance...
Epoch: 36 Accuracy in batch of size 2048 : 0.8037109375 Loss: 0.480241596698761
evaluating performance...
Test Accuracy: 0.78256
37
evaluating performance...
Epoch: 37 Accuracy in batch of size 2048 : 0.80908203125 Loss: 0.4659687876701355
38
evaluating performance...
Epoch: 38 Accuracy in batch of size 2048 : 0.80615234375 Loss: 0.4686414301395416
evaluating performance...
Test Accuracy: 0.78832
39
evaluating performance...
Epoch: 39 Accuracy in batch of size 2048 : 0.8154296875 Loss: 0.4517536163330078
40
evaluating performance...
Epoch: 40 Accuracy in batch of size 2048 : 0.8115234375 Loss: 0.4506691098213196
evaluating performance...
Test Accuracy: 0.79316
41
evaluating performance...
Epoch: 41 Accuracy in batch of size 2048 : 0.81298828125 Loss: 0.4534149765968323
42
evaluating performance...
Epoch: 42 Accuracy in batch of size 2048 : 0.80615234375 Loss: 0.46272531151771545
evaluating performance...
Test Accuracy: 0.79872
43
evaluating performance...
Epoch: 43 Accuracy in batch of size 2048 : 0.826171875 Loss: 0.4250515401363373
44
evaluating performance...
Epoch: 44 Accuracy in batch of size 2048 : 0.83642578125 Loss: 0.4195757806301117
evaluating performance...
Test Accuracy: 0.80372
45
evaluating performance...
Epoch: 45 Accuracy in batch of size 2048 : 0.8212890625 Loss: 0.4309166967868805
46
evaluating performance...
Epoch: 46 Accuracy in batch of size 2048 : 0.83349609375 Loss: 0.4018644094467163
evaluating performance...
Test Accuracy: 0.80716
47
evaluating performance...
Epoch: 47 Accuracy in batch of size 2048 : 0.83935546875 Loss: 0.4027245044708252
48
evaluating performance...
Epoch: 48 Accuracy in batch of size 2048 : 0.8369140625 Loss: 0.39465758204460144
evaluating performance...
Test Accuracy: 0.81056
49
evaluating performance...
Epoch: 49 Accuracy in batch of size 2048 : 0.833984375 Loss: 0.38840538263320923
50
evaluating performance...
Epoch: 50 Accuracy in batch of size 2048 : 0.853515625 Loss: 0.3694618046283722
evaluating performance...
Test Accuracy: 0.8152
51
evaluating performance...
Epoch: 51 Accuracy in batch of size 2048 : 0.84326171875 Loss: 0.38363271951675415
52
evaluating performance...
Epoch: 52 Accuracy in batch of size 2048 : 0.8427734375 Loss: 0.37426841259002686
evaluating performance...
Test Accuracy: 0.81544
53
evaluating performance...
Epoch: 53 Accuracy in batch of size 2048 : 0.84130859375 Loss: 0.3908984661102295
54
evaluating performance...
Epoch: 54 Accuracy in batch of size 2048 : 0.8388671875 Loss: 0.3862907290458679
evaluating performance...
Test Accuracy: 0.82112
55
evaluating performance...
Epoch: 55 Accuracy in batch of size 2048 : 0.83447265625 Loss: 0.38212066888809204
56
evaluating performance...
Epoch: 56 Accuracy in batch of size 2048 : 0.837890625 Loss: 0.39203721284866333
evaluating performance...
Test Accuracy: 0.82352
57
evaluating performance...
Epoch: 57 Accuracy in batch of size 2048 : 0.84521484375 Loss: 0.3765963912010193
58
evaluating performance...
Epoch: 58 Accuracy in batch of size 2048 : 0.85400390625 Loss: 0.36212846636772156
evaluating performance...
Test Accuracy: 0.82668
59
evaluating performance...
Epoch: 59 Accuracy in batch of size 2048 : 0.8681640625 Loss: 0.3429407775402069
60
evaluating performance...
Epoch: 60 Accuracy in batch of size 2048 : 0.84521484375 Loss: 0.36173972487449646
evaluating performance...
Test Accuracy: 0.82332
61
evaluating performance...
Epoch: 61 Accuracy in batch of size 2048 : 0.8544921875 Loss: 0.3626459240913391
62
evaluating performance...
Epoch: 62 Accuracy in batch of size 2048 : 0.859375 Loss: 0.3573419451713562
evaluating performance...
Test Accuracy: 0.83164
63
evaluating performance...
Epoch: 63 Accuracy in batch of size 2048 : 0.85986328125 Loss: 0.34724557399749756
64
evaluating performance...
Epoch: 64 Accuracy in batch of size 2048 : 0.85986328125 Loss: 0.34541985392570496
evaluating performance...
Test Accuracy: 0.83288
65
evaluating performance...
Epoch: 65 Accuracy in batch of size 2048 : 0.86083984375 Loss: 0.3304675221443176
66
evaluating performance...
Epoch: 66 Accuracy in batch of size 2048 : 0.86669921875 Loss: 0.330737829208374
evaluating performance...
Test Accuracy: 0.83408
67
evaluating performance...
Epoch: 67 Accuracy in batch of size 2048 : 0.86572265625 Loss: 0.3274387717247009
68
evaluating performance...
Epoch: 68 Accuracy in batch of size 2048 : 0.8642578125 Loss: 0.3394179046154022
evaluating performance...
Test Accuracy: 0.83552
69
evaluating performance...
Epoch: 69 Accuracy in batch of size 2048 : 0.85791015625 Loss: 0.33722904324531555
70
evaluating performance...
Epoch: 70 Accuracy in batch of size 2048 : 0.86669921875 Loss: 0.3273610472679138
evaluating performance...
Test Accuracy: 0.8378
71
evaluating performance...
Epoch: 71 Accuracy in batch of size 2048 : 0.87890625 Loss: 0.3197472393512726
72
evaluating performance...
Epoch: 72 Accuracy in batch of size 2048 : 0.87158203125 Loss: 0.3090480864048004
evaluating performance...
Test Accuracy: 0.83948
73
evaluating performance...
Epoch: 73 Accuracy in batch of size 2048 : 0.859375 Loss: 0.32109469175338745
74
evaluating performance...
Epoch: 74 Accuracy in batch of size 2048 : 0.861328125 Loss: 0.3328176736831665
evaluating performance...
Test Accuracy: 0.84064
75
evaluating performance...
Epoch: 75 Accuracy in batch of size 2048 : 0.87841796875 Loss: 0.28832101821899414
76
evaluating performance...
Epoch: 76 Accuracy in batch of size 2048 : 0.87548828125 Loss: 0.3125503659248352
evaluating performance...
Test Accuracy: 0.84184
77
evaluating performance...
Epoch: 77 Accuracy in batch of size 2048 : 0.8857421875 Loss: 0.29328444600105286
78
evaluating performance...
Epoch: 78 Accuracy in batch of size 2048 : 0.86962890625 Loss: 0.3153340816497803
evaluating performance...
Test Accuracy: 0.83808
79
evaluating performance...
Epoch: 79 Accuracy in batch of size 2048 : 0.873046875 Loss: 0.29929590225219727
80
evaluating performance...
Epoch: 80 Accuracy in batch of size 2048 : 0.875 Loss: 0.3076992630958557
evaluating performance...
Test Accuracy: 0.84596
81
evaluating performance...
Epoch: 81 Accuracy in batch of size 2048 : 0.8896484375 Loss: 0.29102468490600586
82
evaluating performance...
Epoch: 82 Accuracy in batch of size 2048 : 0.88623046875 Loss: 0.2878625690937042
evaluating performance...
Test Accuracy: 0.8396
83
evaluating performance...
Epoch: 83 Accuracy in batch of size 2048 : 0.88134765625 Loss: 0.3079909086227417
84
evaluating performance...
Epoch: 84 Accuracy in batch of size 2048 : 0.892578125 Loss: 0.27593252062797546
evaluating performance...
Test Accuracy: 0.84756
85
evaluating performance...
Epoch: 85 Accuracy in batch of size 2048 : 0.88916015625 Loss: 0.2938375473022461
86
evaluating performance...
Epoch: 86 Accuracy in batch of size 2048 : 0.89794921875 Loss: 0.2671705484390259
evaluating performance...
Test Accuracy: 0.84848
87
evaluating performance...
Epoch: 87 Accuracy in batch of size 2048 : 0.88720703125 Loss: 0.2743932604789734
88
evaluating performance...
Epoch: 88 Accuracy in batch of size 2048 : 0.884765625 Loss: 0.29249387979507446
evaluating performance...
Test Accuracy: 0.8462
89
evaluating performance...
Epoch: 89 Accuracy in batch of size 2048 : 0.8984375 Loss: 0.2613788843154907
90
evaluating performance...
Epoch: 90 Accuracy in batch of size 2048 : 0.904296875 Loss: 0.26017335057258606
evaluating performance...
Test Accuracy: 0.84924
91
evaluating performance...
Epoch: 91 Accuracy in batch of size 2048 : 0.9033203125 Loss: 0.25605297088623047
92
evaluating performance...
Epoch: 92 Accuracy in batch of size 2048 : 0.8955078125 Loss: 0.2692186236381531
evaluating performance...
Test Accuracy: 0.85084
93
evaluating performance...
Epoch: 93 Accuracy in batch of size 2048 : 0.89892578125 Loss: 0.26482442021369934
94
evaluating performance...
Epoch: 94 Accuracy in batch of size 2048 : 0.89501953125 Loss: 0.2688380181789398
evaluating performance...
Test Accuracy: 0.85144
95
evaluating performance...
Epoch: 95 Accuracy in batch of size 2048 : 0.90185546875 Loss: 0.2514793872833252
96
evaluating performance...
Epoch: 96 Accuracy in batch of size 2048 : 0.8896484375 Loss: 0.2637173533439636
evaluating performance...
Test Accuracy: 0.84948
97
evaluating performance...
Epoch: 97 Accuracy in batch of size 2048 : 0.89892578125 Loss: 0.25787755846977234
98
evaluating performance...
Epoch: 98 Accuracy in batch of size 2048 : 0.90087890625 Loss: 0.25657379627227783
evaluating performance...
Test Accuracy: 0.85248
99
evaluating performance...
Epoch: 99 Accuracy in batch of size 2048 : 0.89892578125 Loss: 0.26041874289512634
100
evaluating performance...
Epoch: 100 Accuracy in batch of size 2048 : 0.90380859375 Loss: 0.23706339299678802
evaluating performance...
Test Accuracy: 0.8488
101
evaluating performance...
Epoch: 101 Accuracy in batch of size 2048 : 0.90087890625 Loss: 0.2521545886993408
102
evaluating performance...
Epoch: 102 Accuracy in batch of size 2048 : 0.90576171875 Loss: 0.25072231888771057
evaluating performance...
Test Accuracy: 0.8524
103
evaluating performance...
Epoch: 103 Accuracy in batch of size 2048 : 0.9072265625 Loss: 0.2441931962966919
104
evaluating performance...
Epoch: 104 Accuracy in batch of size 2048 : 0.9111328125 Loss: 0.2399788200855255
evaluating performance...
Test Accuracy: 0.84976
105
evaluating performance...
Epoch: 105 Accuracy in batch of size 2048 : 0.89697265625 Loss: 0.2634699046611786
106
evaluating performance...
Epoch: 106 Accuracy in batch of size 2048 : 0.89599609375 Loss: 0.262763649225235
evaluating performance...
Test Accuracy: 0.85408
107
evaluating performance...
Epoch: 107 Accuracy in batch of size 2048 : 0.90869140625 Loss: 0.24230772256851196
108
evaluating performance...
Epoch: 108 Accuracy in batch of size 2048 : 0.9228515625 Loss: 0.2180844098329544
evaluating performance...
Test Accuracy: 0.85608
109
evaluating performance...
Epoch: 109 Accuracy in batch of size 2048 : 0.90478515625 Loss: 0.24391791224479675
110
evaluating performance...
Epoch: 110 Accuracy in batch of size 2048 : 0.90185546875 Loss: 0.26075243949890137
evaluating performance...
Test Accuracy: 0.85648
111
evaluating performance...
Epoch: 111 Accuracy in batch of size 2048 : 0.8994140625 Loss: 0.25296980142593384
112
evaluating performance...
Epoch: 112 Accuracy in batch of size 2048 : 0.90625 Loss: 0.24314583837985992
evaluating performance...
Test Accuracy: 0.8574
113
evaluating performance...
Epoch: 113 Accuracy in batch of size 2048 : 0.92138671875 Loss: 0.22129574418067932
114
evaluating performance...
Epoch: 114 Accuracy in batch of size 2048 : 0.90673828125 Loss: 0.22898223996162415
evaluating performance...
Test Accuracy: 0.85536
115
evaluating performance...
Epoch: 115 Accuracy in batch of size 2048 : 0.91455078125 Loss: 0.21572813391685486
116
evaluating performance...
Epoch: 116 Accuracy in batch of size 2048 : 0.91552734375 Loss: 0.22586947679519653
evaluating performance...
Test Accuracy: 0.85148
117
evaluating performance...
Epoch: 117 Accuracy in batch of size 2048 : 0.9228515625 Loss: 0.20735806226730347
118
evaluating performance...
Epoch: 118 Accuracy in batch of size 2048 : 0.90869140625 Loss: 0.2274911105632782
evaluating performance...
Test Accuracy: 0.85748
119
evaluating performance...
Epoch: 119 Accuracy in batch of size 2048 : 0.92431640625 Loss: 0.21279489994049072
120
evaluating performance...
Epoch: 120 Accuracy in batch of size 2048 : 0.91357421875 Loss: 0.2248018980026245
evaluating performance...
Test Accuracy: 0.85696
121
evaluating performance...
Epoch: 121 Accuracy in batch of size 2048 : 0.93212890625 Loss: 0.19037404656410217
122
evaluating performance...
Epoch: 122 Accuracy in batch of size 2048 : 0.91552734375 Loss: 0.21907564997673035
evaluating performance...
Test Accuracy: 0.85648
123
evaluating performance...
Epoch: 123 Accuracy in batch of size 2048 : 0.916015625 Loss: 0.2133624106645584
124
evaluating performance...
Epoch: 124 Accuracy in batch of size 2048 : 0.92578125 Loss: 0.1998652219772339
evaluating performance...
Test Accuracy: 0.85848
125
evaluating performance...
Epoch: 125 Accuracy in batch of size 2048 : 0.9287109375 Loss: 0.19991430640220642
126
evaluating performance...
Epoch: 126 Accuracy in batch of size 2048 : 0.92822265625 Loss: 0.20785008370876312
evaluating performance...
Test Accuracy: 0.85796
127
evaluating performance...
Epoch: 127 Accuracy in batch of size 2048 : 0.92724609375 Loss: 0.19726327061653137
128
evaluating performance...
Epoch: 128 Accuracy in batch of size 2048 : 0.92333984375 Loss: 0.1914391964673996
evaluating performance...
Test Accuracy: 0.85868
129
evaluating performance...
Epoch: 129 Accuracy in batch of size 2048 : 0.9169921875 Loss: 0.22364330291748047
130
evaluating performance...
Epoch: 130 Accuracy in batch of size 2048 : 0.93408203125 Loss: 0.19692589342594147
evaluating performance...
Test Accuracy: 0.85844
131
evaluating performance...
Epoch: 131 Accuracy in batch of size 2048 : 0.93408203125 Loss: 0.18834950029850006
132
evaluating performance...
Epoch: 132 Accuracy in batch of size 2048 : 0.93603515625 Loss: 0.18185395002365112
evaluating performance...
Test Accuracy: 0.85908
133
evaluating performance...
Epoch: 133 Accuracy in batch of size 2048 : 0.93310546875 Loss: 0.18849125504493713
134
evaluating performance...
Epoch: 134 Accuracy in batch of size 2048 : 0.93994140625 Loss: 0.18150359392166138
evaluating performance...
Test Accuracy: 0.85928
135
evaluating performance...
Epoch: 135 Accuracy in batch of size 2048 : 0.93798828125 Loss: 0.18632705509662628
136
evaluating performance...
Epoch: 136 Accuracy in batch of size 2048 : 0.93212890625 Loss: 0.1856095790863037
evaluating performance...
Test Accuracy: 0.85792
137
evaluating performance...
Epoch: 137 Accuracy in batch of size 2048 : 0.93994140625 Loss: 0.1740923970937729
138
evaluating performance...
Epoch: 138 Accuracy in batch of size 2048 : 0.94189453125 Loss: 0.17192459106445312
evaluating performance...
Test Accuracy: 0.85968
139
evaluating performance...
Epoch: 139 Accuracy in batch of size 2048 : 0.93701171875 Loss: 0.1782170981168747
140
evaluating performance...
Epoch: 140 Accuracy in batch of size 2048 : 0.93359375 Loss: 0.1781800091266632
evaluating performance...
Test Accuracy: 0.85856
141
evaluating performance...
Epoch: 141 Accuracy in batch of size 2048 : 0.939453125 Loss: 0.16450515389442444
142
evaluating performance...
Epoch: 142 Accuracy in batch of size 2048 : 0.9423828125 Loss: 0.15378984808921814
evaluating performance...
Test Accuracy: 0.8584
143
evaluating performance...
Epoch: 143 Accuracy in batch of size 2048 : 0.9287109375 Loss: 0.18852195143699646
144
evaluating performance...
Epoch: 144 Accuracy in batch of size 2048 : 0.9375 Loss: 0.1684921681880951
evaluating performance...
Test Accuracy: 0.85012
145
evaluating performance...
Epoch: 145 Accuracy in batch of size 2048 : 0.9443359375 Loss: 0.15472307801246643
146
evaluating performance...
Epoch: 146 Accuracy in batch of size 2048 : 0.94091796875 Loss: 0.17508701980113983
evaluating performance...
Test Accuracy: 0.85832
147
evaluating performance...
Epoch: 147 Accuracy in batch of size 2048 : 0.94140625 Loss: 0.16512134671211243
148
evaluating performance...
Epoch: 148 Accuracy in batch of size 2048 : 0.9423828125 Loss: 0.17372626066207886
evaluating performance...
Test Accuracy: 0.85804
gets cut off after this