GRU attempt bigger batches - 150 epochs
Does welllish, trends upward but stagnates at 77-78% test acc 80% train and then starts doing unsteady updates
- Batch = 1024
- LR = 5e-5
- Hidden = 128
- Layers =2
- Bidirectional = False
- Dropout = 0.3
torch running with cuda
torch running with cuda
torch running with cuda
************ Start ************
dataset: Movie Reviews and Ratings , method: RNN , setting: train and test , result: saver , evaluation: accuracy
method running...
--start training...
23973 unknown words out of a 97266 vocab
0
evaluating performance...
Epoch: 0 Accuracy in batch of size 1024 : 0.501953125 Loss: 0.6940431594848633
evaluating performance...
Test Accuracy: 0.49872
1
evaluating performance...
Epoch: 1 Accuracy in batch of size 1024 : 0.5029296875 Loss: 0.6923726797103882
2
evaluating performance...
Epoch: 2 Accuracy in batch of size 1024 : 0.51953125 Loss: 0.6920552253723145
evaluating performance...
Test Accuracy: 0.50652
3
evaluating performance...
Epoch: 3 Accuracy in batch of size 1024 : 0.505859375 Loss: 0.6935811042785645
4
evaluating performance...
Epoch: 4 Accuracy in batch of size 1024 : 0.5087890625 Loss: 0.692743182182312
evaluating performance...
Test Accuracy: 0.5068
5
evaluating performance...
Epoch: 5 Accuracy in batch of size 1024 : 0.525390625 Loss: 0.6921892166137695
6
evaluating performance...
Epoch: 6 Accuracy in batch of size 1024 : 0.5068359375 Loss: 0.6918751001358032
evaluating performance...
Test Accuracy: 0.5078
7
evaluating performance...
Epoch: 7 Accuracy in batch of size 1024 : 0.5 Loss: 0.6905884742736816
8
evaluating performance...
Epoch: 8 Accuracy in batch of size 1024 : 0.5263671875 Loss: 0.6875319480895996
evaluating performance...
Test Accuracy: 0.51196
9
evaluating performance...
Epoch: 9 Accuracy in batch of size 1024 : 0.5126953125 Loss: 0.6894941926002502
10
evaluating performance...
Epoch: 10 Accuracy in batch of size 1024 : 0.53515625 Loss: 0.6886029243469238
evaluating performance...
Test Accuracy: 0.51808
11
evaluating performance...
Epoch: 11 Accuracy in batch of size 1024 : 0.53125 Loss: 0.6852179765701294
12
evaluating performance...
Epoch: 12 Accuracy in batch of size 1024 : 0.5205078125 Loss: 0.6817074418067932
evaluating performance...
Test Accuracy: 0.52208
13
evaluating performance...
Epoch: 13 Accuracy in batch of size 1024 : 0.5537109375 Loss: 0.6715033054351807
14
evaluating performance...
Epoch: 14 Accuracy in batch of size 1024 : 0.5322265625 Loss: 0.6778558492660522
evaluating performance...
Test Accuracy: 0.532
15
evaluating performance...
Epoch: 15 Accuracy in batch of size 1024 : 0.548828125 Loss: 0.6631714105606079
16
evaluating performance...
Epoch: 16 Accuracy in batch of size 1024 : 0.6396484375 Loss: 0.6244802474975586
evaluating performance...
Test Accuracy: 0.6252
17
evaluating performance...
Epoch: 17 Accuracy in batch of size 1024 : 0.69921875 Loss: 0.5926613211631775
18
evaluating performance...
Epoch: 18 Accuracy in batch of size 1024 : 0.671875 Loss: 0.6238150596618652
evaluating performance...
Test Accuracy: 0.67928
19
evaluating performance...
Epoch: 19 Accuracy in batch of size 1024 : 0.7197265625 Loss: 0.5651038885116577
20
evaluating performance...
Epoch: 20 Accuracy in batch of size 1024 : 0.7578125 Loss: 0.5596306324005127
evaluating performance...
Test Accuracy: 0.736
21
evaluating performance...
Epoch: 21 Accuracy in batch of size 1024 : 0.7353515625 Loss: 0.5745446085929871
22
evaluating performance...
Epoch: 22 Accuracy in batch of size 1024 : 0.7587890625 Loss: 0.5489673018455505
evaluating performance...
Test Accuracy: 0.7384
23
evaluating performance...
Epoch: 23 Accuracy in batch of size 1024 : 0.767578125 Loss: 0.5446909666061401
24
evaluating performance...
Epoch: 24 Accuracy in batch of size 1024 : 0.771484375 Loss: 0.5363156795501709
evaluating performance...
Test Accuracy: 0.7484
25
evaluating performance...
Epoch: 25 Accuracy in batch of size 1024 : 0.755859375 Loss: 0.5428258180618286
26
evaluating performance...
Epoch: 26 Accuracy in batch of size 1024 : 0.7646484375 Loss: 0.5397188067436218
evaluating performance...
Test Accuracy: 0.74836
27
evaluating performance...
Epoch: 27 Accuracy in batch of size 1024 : 0.763671875 Loss: 0.5438668727874756
28
evaluating performance...
Epoch: 28 Accuracy in batch of size 1024 : 0.748046875 Loss: 0.5578970313072205
evaluating performance...
Test Accuracy: 0.74972
29
evaluating performance...
Epoch: 29 Accuracy in batch of size 1024 : 0.7734375 Loss: 0.5279921293258667
30
evaluating performance...
Epoch: 30 Accuracy in batch of size 1024 : 0.7119140625 Loss: 0.662531316280365
evaluating performance...
Test Accuracy: 0.71516
31
evaluating performance...
Epoch: 31 Accuracy in batch of size 1024 : 0.775390625 Loss: 0.5292829275131226
32
evaluating performance...
Epoch: 32 Accuracy in batch of size 1024 : 0.7509765625 Loss: 0.5543023347854614
evaluating performance...
Test Accuracy: 0.73328
33
evaluating performance...
Epoch: 33 Accuracy in batch of size 1024 : 0.7890625 Loss: 0.5152958035469055
34
evaluating performance...
Epoch: 34 Accuracy in batch of size 1024 : 0.77734375 Loss: 0.5189822912216187
evaluating performance...
Test Accuracy: 0.74976
35
evaluating performance...
Epoch: 35 Accuracy in batch of size 1024 : 0.78125 Loss: 0.5206955671310425
36
evaluating performance...
Epoch: 36 Accuracy in batch of size 1024 : 0.76171875 Loss: 0.5435869693756104
evaluating performance...
Test Accuracy: 0.75908
37
evaluating performance...
Epoch: 37 Accuracy in batch of size 1024 : 0.77734375 Loss: 0.5295751094818115
38
evaluating performance...
Epoch: 38 Accuracy in batch of size 1024 : 0.7607421875 Loss: 0.5350786447525024
evaluating performance...
Test Accuracy: 0.7618
39
evaluating performance...
Epoch: 39 Accuracy in batch of size 1024 : 0.80859375 Loss: 0.4850778579711914
40
evaluating performance...
Epoch: 40 Accuracy in batch of size 1024 : 0.806640625 Loss: 0.48877444863319397
evaluating performance...
Test Accuracy: 0.7734
41
evaluating performance...
Epoch: 41 Accuracy in batch of size 1024 : 0.7861328125 Loss: 0.5123956799507141
42
evaluating performance...
Epoch: 42 Accuracy in batch of size 1024 : 0.767578125 Loss: 0.5275555849075317
evaluating performance...
Test Accuracy: 0.74676
43
evaluating performance...
Epoch: 43 Accuracy in batch of size 1024 : 0.73046875 Loss: 0.6433165669441223
44
evaluating performance...
Epoch: 44 Accuracy in batch of size 1024 : 0.7685546875 Loss: 0.5360813140869141
evaluating performance...
Test Accuracy: 0.7552
45
evaluating performance...
Epoch: 45 Accuracy in batch of size 1024 : 0.7861328125 Loss: 0.5127281546592712
46
evaluating performance...
Epoch: 46 Accuracy in batch of size 1024 : 0.6650390625 Loss: 0.6614273190498352
evaluating performance...
Test Accuracy: 0.68328
47
evaluating performance...
Epoch: 47 Accuracy in batch of size 1024 : 0.7978515625 Loss: 0.5104919075965881
48
evaluating performance...
Epoch: 48 Accuracy in batch of size 1024 : 0.8125 Loss: 0.48772132396698
evaluating performance...
Test Accuracy: 0.77104
49
evaluating performance...
Epoch: 49 Accuracy in batch of size 1024 : 0.7783203125 Loss: 0.5216633081436157
50
evaluating performance...
Epoch: 50 Accuracy in batch of size 1024 : 0.796875 Loss: 0.5030423402786255
evaluating performance...
Test Accuracy: 0.7702
51
evaluating performance...
Epoch: 51 Accuracy in batch of size 1024 : 0.771484375 Loss: 0.5314528942108154
52
evaluating performance...
Epoch: 52 Accuracy in batch of size 1024 : 0.798828125 Loss: 0.4913509488105774
evaluating performance...
Test Accuracy: 0.77296
53
evaluating performance...
Epoch: 53 Accuracy in batch of size 1024 : 0.6923828125 Loss: 0.679347574710846
54
evaluating performance...
Epoch: 54 Accuracy in batch of size 1024 : 0.646484375 Loss: 0.6644469499588013
evaluating performance...
Test Accuracy: 0.6702
55
evaluating performance...
Epoch: 55 Accuracy in batch of size 1024 : 0.7802734375 Loss: 0.5241488218307495
56
evaluating performance...
Epoch: 56 Accuracy in batch of size 1024 : 0.7978515625 Loss: 0.512059211730957
evaluating performance...
Test Accuracy: 0.77424
57
evaluating performance...
Epoch: 57 Accuracy in batch of size 1024 : 0.7939453125 Loss: 0.4981265068054199
58
evaluating performance...
Epoch: 58 Accuracy in batch of size 1024 : 0.7880859375 Loss: 0.5124600529670715
evaluating performance...
Test Accuracy: 0.76608
59
evaluating performance...
Epoch: 59 Accuracy in batch of size 1024 : 0.6669921875 Loss: 0.6949056386947632
60
evaluating performance...
Epoch: 60 Accuracy in batch of size 1024 : 0.693359375 Loss: 0.6110672354698181
evaluating performance...
Test Accuracy: 0.67848
61
evaluating performance...
Epoch: 61 Accuracy in batch of size 1024 : 0.7421875 Loss: 0.5572164058685303
62
evaluating performance...
Epoch: 62 Accuracy in batch of size 1024 : 0.787109375 Loss: 0.5204206705093384
evaluating performance...
Test Accuracy: 0.77124
63
evaluating performance...
Epoch: 63 Accuracy in batch of size 1024 : 0.7978515625 Loss: 0.5150694251060486
64
evaluating performance...
Epoch: 64 Accuracy in batch of size 1024 : 0.7373046875 Loss: 0.605894148349762
evaluating performance...
Test Accuracy: 0.73336
65
evaluating performance...
Epoch: 65 Accuracy in batch of size 1024 : 0.7822265625 Loss: 0.5096127986907959
66
evaluating performance...
Epoch: 66 Accuracy in batch of size 1024 : 0.7998046875 Loss: 0.49920323491096497
evaluating performance...
Test Accuracy: 0.77096
67
evaluating performance...
Epoch: 67 Accuracy in batch of size 1024 : 0.7822265625 Loss: 0.514406144618988
68
evaluating performance...
Epoch: 68 Accuracy in batch of size 1024 : 0.7861328125 Loss: 0.5163235664367676
evaluating performance...
Test Accuracy: 0.76716
69
evaluating performance...
Epoch: 69 Accuracy in batch of size 1024 : 0.783203125 Loss: 0.5185871124267578
70
evaluating performance...
Epoch: 70 Accuracy in batch of size 1024 : 0.7734375 Loss: 0.5281158685684204
evaluating performance...
Test Accuracy: 0.75236
71
evaluating performance...
Epoch: 71 Accuracy in batch of size 1024 : 0.759765625 Loss: 0.5544365048408508
72
evaluating performance...
Epoch: 72 Accuracy in batch of size 1024 : 0.7685546875 Loss: 0.5361729860305786
evaluating performance...
Test Accuracy: 0.76952
73
evaluating performance...
Epoch: 73 Accuracy in batch of size 1024 : 0.74609375 Loss: 0.5660117864608765
74
evaluating performance...
Epoch: 74 Accuracy in batch of size 1024 : 0.78515625 Loss: 0.5158674716949463
evaluating performance...
Test Accuracy: 0.75648
75
evaluating performance...
Epoch: 75 Accuracy in batch of size 1024 : 0.7744140625 Loss: 0.5258389711380005
76
evaluating performance...
Epoch: 76 Accuracy in batch of size 1024 : 0.7900390625 Loss: 0.5113565921783447
evaluating performance...
Test Accuracy: 0.76476
77
evaluating performance...
Epoch: 77 Accuracy in batch of size 1024 : 0.822265625 Loss: 0.46959978342056274
78
evaluating performance...
Epoch: 78 Accuracy in batch of size 1024 : 0.7470703125 Loss: 0.5618340969085693
evaluating performance...
Test Accuracy: 0.74848
79
evaluating performance...
Epoch: 79 Accuracy in batch of size 1024 : 0.7861328125 Loss: 0.5177254676818848
80
evaluating performance...
Epoch: 80 Accuracy in batch of size 1024 : 0.7998046875 Loss: 0.49582523107528687
evaluating performance...
Test Accuracy: 0.75712
81
evaluating performance...
Epoch: 81 Accuracy in batch of size 1024 : 0.7021484375 Loss: 0.6274174451828003
82
evaluating performance...
Epoch: 82 Accuracy in batch of size 1024 : 0.822265625 Loss: 0.48193666338920593
evaluating performance...
Test Accuracy: 0.77392
83
evaluating performance...
Epoch: 83 Accuracy in batch of size 1024 : 0.787109375 Loss: 0.5166073441505432
84
evaluating performance...
Epoch: 84 Accuracy in batch of size 1024 : 0.7705078125 Loss: 0.5321219563484192
evaluating performance...
Test Accuracy: 0.7744
85
evaluating performance...
Epoch: 85 Accuracy in batch of size 1024 : 0.8056640625 Loss: 0.48908212780952454
86
evaluating performance...
Epoch: 86 Accuracy in batch of size 1024 : 0.7685546875 Loss: 0.5388604402542114
evaluating performance...
Test Accuracy: 0.73256
87
evaluating performance...
Epoch: 87 Accuracy in batch of size 1024 : 0.771484375 Loss: 0.5311620235443115
88
evaluating performance...
Epoch: 88 Accuracy in batch of size 1024 : 0.7998046875 Loss: 0.48823022842407227
evaluating performance...
Test Accuracy: 0.76812
89
evaluating performance...
Epoch: 89 Accuracy in batch of size 1024 : 0.8134765625 Loss: 0.4751335382461548
90
evaluating performance...
Epoch: 90 Accuracy in batch of size 1024 : 0.8232421875 Loss: 0.46142417192459106
evaluating performance...
Test Accuracy: 0.7716
91
evaluating performance...
Epoch: 91 Accuracy in batch of size 1024 : 0.7939453125 Loss: 0.5036571025848389
92
evaluating performance...
Epoch: 92 Accuracy in batch of size 1024 : 0.748046875 Loss: 0.5536938905715942
evaluating performance...
Test Accuracy: 0.71336
93
evaluating performance...
Epoch: 93 Accuracy in batch of size 1024 : 0.734375 Loss: 0.5638858675956726
94
evaluating performance...
Epoch: 94 Accuracy in batch of size 1024 : 0.7958984375 Loss: 0.5133391618728638
evaluating performance...
Test Accuracy: 0.775
95
evaluating performance...
Epoch: 95 Accuracy in batch of size 1024 : 0.8193359375 Loss: 0.4748103618621826
96
evaluating performance...
Epoch: 96 Accuracy in batch of size 1024 : 0.7978515625 Loss: 0.4952871799468994
evaluating performance...
Test Accuracy: 0.77676
97
evaluating performance...
Epoch: 97 Accuracy in batch of size 1024 : 0.8154296875 Loss: 0.4927816390991211
98
evaluating performance...
Epoch: 98 Accuracy in batch of size 1024 : 0.7998046875 Loss: 0.5048658847808838
evaluating performance...
Test Accuracy: 0.7764
99
evaluating performance...
Epoch: 99 Accuracy in batch of size 1024 : 0.77734375 Loss: 0.526347815990448
100
evaluating performance...
Epoch: 100 Accuracy in batch of size 1024 : 0.7353515625 Loss: 0.6026602983474731
evaluating performance...
Test Accuracy: 0.73224
101
evaluating performance...
Epoch: 101 Accuracy in batch of size 1024 : 0.7431640625 Loss: 0.5719155073165894
102
evaluating performance...
Epoch: 102 Accuracy in batch of size 1024 : 0.7841796875 Loss: 0.521117627620697
evaluating performance...
Test Accuracy: 0.77764
103
evaluating performance...
Epoch: 103 Accuracy in batch of size 1024 : 0.787109375 Loss: 0.516403317451477
104
evaluating performance...
Epoch: 104 Accuracy in batch of size 1024 : 0.7958984375 Loss: 0.5054775476455688
evaluating performance...
Test Accuracy: 0.764
105
evaluating performance...
Epoch: 105 Accuracy in batch of size 1024 : 0.8271484375 Loss: 0.4519379138946533
106
evaluating performance...
Epoch: 106 Accuracy in batch of size 1024 : 0.6357421875 Loss: 0.7361250519752502
evaluating performance...
Test Accuracy: 0.63548
107
evaluating performance...
Epoch: 107 Accuracy in batch of size 1024 : 0.751953125 Loss: 0.5439838767051697
108
evaluating performance...
Epoch: 108 Accuracy in batch of size 1024 : 0.7880859375 Loss: 0.5138150453567505
evaluating performance...
Test Accuracy: 0.76996
109
evaluating performance...
Epoch: 109 Accuracy in batch of size 1024 : 0.767578125 Loss: 0.5283371806144714
110
evaluating performance...
Epoch: 110 Accuracy in batch of size 1024 : 0.79296875 Loss: 0.506895899772644
evaluating performance...
Test Accuracy: 0.77964
111
evaluating performance...
Epoch: 111 Accuracy in batch of size 1024 : 0.8076171875 Loss: 0.4917670488357544
112
evaluating performance...
Epoch: 112 Accuracy in batch of size 1024 : 0.7880859375 Loss: 0.5117126703262329
evaluating performance...
Test Accuracy: 0.77328
113
evaluating performance...
Epoch: 113 Accuracy in batch of size 1024 : 0.7841796875 Loss: 0.5127863883972168
114
evaluating performance...
Epoch: 114 Accuracy in batch of size 1024 : 0.7978515625 Loss: 0.49536094069480896
evaluating performance...
Test Accuracy: 0.78064
115
evaluating performance...
Epoch: 115 Accuracy in batch of size 1024 : 0.802734375 Loss: 0.49696385860443115
116
evaluating performance...
Epoch: 116 Accuracy in batch of size 1024 : 0.79296875 Loss: 0.5023642182350159
evaluating performance...
Test Accuracy: 0.78012
117
evaluating performance...
Epoch: 117 Accuracy in batch of size 1024 : 0.7333984375 Loss: 0.598241925239563
118
evaluating performance...
Epoch: 118 Accuracy in batch of size 1024 : 0.7822265625 Loss: 0.5152772665023804
evaluating performance...
Test Accuracy: 0.73152
119
evaluating performance...
Epoch: 119 Accuracy in batch of size 1024 : 0.7890625 Loss: 0.5051515102386475
120
evaluating performance...
Epoch: 120 Accuracy in batch of size 1024 : 0.8056640625 Loss: 0.4882957935333252
evaluating performance...
Test Accuracy: 0.77956
121
evaluating performance...
Epoch: 121 Accuracy in batch of size 1024 : 0.8037109375 Loss: 0.4869704842567444
122
evaluating performance...
Epoch: 122 Accuracy in batch of size 1024 : 0.75390625 Loss: 0.5686031579971313
evaluating performance...
Test Accuracy: 0.73768
123
evaluating performance...
Epoch: 123 Accuracy in batch of size 1024 : 0.779296875 Loss: 0.5243512392044067
124
evaluating performance...
Epoch: 124 Accuracy in batch of size 1024 : 0.802734375 Loss: 0.4910377860069275
evaluating performance...
Test Accuracy: 0.77924
125
evaluating performance...
Epoch: 125 Accuracy in batch of size 1024 : 0.8076171875 Loss: 0.48160940408706665
126
evaluating performance...
Epoch: 126 Accuracy in batch of size 1024 : 0.8056640625 Loss: 0.4848352074623108
evaluating performance...
Test Accuracy: 0.78332
127
evaluating performance...
Epoch: 127 Accuracy in batch of size 1024 : 0.814453125 Loss: 0.47536325454711914
128
evaluating performance...
Epoch: 128 Accuracy in batch of size 1024 : 0.8193359375 Loss: 0.4647400677204132
evaluating performance...
Test Accuracy: 0.7828
129
evaluating performance...
Epoch: 129 Accuracy in batch of size 1024 : 0.8310546875 Loss: 0.44631218910217285
130
evaluating performance...
Epoch: 130 Accuracy in batch of size 1024 : 0.8095703125 Loss: 0.48091965913772583
evaluating performance...
Test Accuracy: 0.78584
131
evaluating performance...
Epoch: 131 Accuracy in batch of size 1024 : 0.80078125 Loss: 0.4957481920719147
132
evaluating performance...
Epoch: 132 Accuracy in batch of size 1024 : 0.6552734375 Loss: 0.7140471935272217
evaluating performance...
Test Accuracy: 0.6412
133
evaluating performance...
Epoch: 133 Accuracy in batch of size 1024 : 0.7392578125 Loss: 0.563233494758606
134
evaluating performance...
Epoch: 134 Accuracy in batch of size 1024 : 0.779296875 Loss: 0.5020233392715454
evaluating performance...
Test Accuracy: 0.75812
135
evaluating performance...
Epoch: 135 Accuracy in batch of size 1024 : 0.8017578125 Loss: 0.49197936058044434
136
evaluating performance...
Epoch: 136 Accuracy in batch of size 1024 : 0.8017578125 Loss: 0.4869118332862854
evaluating performance...
Test Accuracy: 0.76908
137
evaluating performance...
Epoch: 137 Accuracy in batch of size 1024 : 0.5478515625 Loss: 0.7950639128684998
138
evaluating performance...
Epoch: 138 Accuracy in batch of size 1024 : 0.5556640625 Loss: 0.7458526492118835
evaluating performance...
Test Accuracy: 0.55588
139
evaluating performance...
Epoch: 139 Accuracy in batch of size 1024 : 0.5830078125 Loss: 0.6876258850097656
140
evaluating performance...
Epoch: 140 Accuracy in batch of size 1024 : 0.61328125 Loss: 0.6620199680328369
evaluating performance...
Test Accuracy: 0.59032
141
evaluating performance...
Epoch: 141 Accuracy in batch of size 1024 : 0.619140625 Loss: 0.6409255862236023
142
evaluating performance...
Epoch: 142 Accuracy in batch of size 1024 : 0.6748046875 Loss: 0.6176267862319946
evaluating performance...
Test Accuracy: 0.64844
143
evaluating performance...
Epoch: 143 Accuracy in batch of size 1024 : 0.6904296875 Loss: 0.6054403185844421
144
evaluating performance...
Epoch: 144 Accuracy in batch of size 1024 : 0.69921875 Loss: 0.590031623840332
evaluating performance...
Test Accuracy: 0.69356
145
evaluating performance...
Epoch: 145 Accuracy in batch of size 1024 : 0.7080078125 Loss: 0.5787575244903564
146
evaluating performance...
Epoch: 146 Accuracy in batch of size 1024 : 0.7607421875 Loss: 0.5441990494728088
evaluating performance...
Test Accuracy: 0.72708
147
evaluating performance...
Epoch: 147 Accuracy in batch of size 1024 : 0.7509765625 Loss: 0.5501682758331299
148
evaluating performance...
Epoch: 148 Accuracy in batch of size 1024 : 0.76953125 Loss: 0.5217851996421814
evaluating performance...
Test Accuracy: 0.76296
149
evaluating performance...
Epoch: 149 Accuracy in batch of size 1024 : 0.7939453125 Loss: 0.4957711398601532
Figure(640x480)
--start testing...
saving results...
evaluating performance...
************ Overall Performance ************
MLP Test Accuracy: 0.7609
************ Finish ************