Python 3.6.8 (tags/v3.6.8:3c6b436a57, Dec 24 2018, 00:16:47) [MSC v.1916 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license()" for more information.
>>> 
device: cpu
-------- Vocabulary Loaded! --------
-------- Process Done! --------
-------- Process Done! --------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [03:25<15:13:27, 205.27s/it]
  1%|          | 2/268 [06:15<13:37:26, 184.39s/it]
  1%|          | 3/268 [09:11<13:18:37, 180.82s/it]
  1%|           | 4/268 [09:52<9:12:33, 125.58s/it] 
  2%|           | 5/268 [10:27<6:47:24, 92.94s/it] 
  2%|           | 6/268 [12:35<7:37:19, 104.73s/it]
  3%|           | 7/268 [13:07<5:52:28, 81.03s/it] 
  3%|           | 8/268 [13:30<4:30:39, 62.46s/it]
  3%|           | 9/268 [14:41<4:41:52, 65.30s/it]
  4%|           | 10/268 [15:24<4:10:38, 58.29s/it]
  4%|           | 11/268 [16:05<3:47:02, 53.01s/it]
  4%|           | 12/268 [16:51<3:37:50, 51.06s/it]
  5%|           | 13/268 [19:02<5:19:40, 75.22s/it]
  5%|           | 14/268 [20:15<5:15:33, 74.54s/it]
  6%|           | 15/268 [22:34<6:35:39, 93.83s/it]
  6%|           | 16/268 [23:06<5:16:37, 75.39s/it]
  6%|           | 17/268 [23:52<4:38:03, 66.47s/it]
  7%|           | 18/268 [25:43<5:32:59, 79.92s/it]
  7%|           | 19/268 [26:49<5:14:30, 75.79s/it]
  7%|           | 20/268 [27:48<4:52:06, 70.67s/it]
  8%|           | 21/268 [28:35<4:21:43, 63.58s/it]
  8%|           | 22/268 [29:12<3:47:54, 55.59s/it]
  9%|           | 23/268 [29:59<3:35:41, 52.82s/it]
  9%|           | 24/268 [30:30<3:08:56, 46.46s/it]
  9%|           | 25/268 [31:08<2:58:02, 43.96s/it]
 10%|           | 26/268 [31:53<2:57:47, 44.08s/it]
 10%|           | 27/268 [32:33<2:52:34, 42.97s/it]
 10%|           | 28/268 [33:40<3:20:55, 50.23s/it]
 11%|           | 29/268 [34:39<3:29:54, 52.70s/it]
 11%|           | 30/268 [35:35<3:33:10, 53.74s/it]
 12%|            | 31/268 [36:18<3:19:32, 50.52s/it]
 12%|            | 32/268 [36:55<3:03:26, 46.64s/it]
 12%|            | 33/268 [38:32<4:00:49, 61.49s/it]
 13%|            | 34/268 [39:22<3:47:22, 58.30s/it]
 13%|            | 35/268 [40:00<3:22:39, 52.19s/it]
 13%|            | 36/268 [40:28<2:52:58, 44.74s/it]
 14%|            | 37/268 [40:53<2:29:24, 38.81s/it]
 14%|            | 38/268 [41:30<2:27:12, 38.40s/it]
 15%|            | 39/268 [42:28<2:49:02, 44.29s/it]
 15%|            | 40/268 [43:30<3:08:06, 49.50s/it]
 15%|            | 41/268 [44:04<2:49:32, 44.81s/it]
 16%|            | 42/268 [44:42<2:41:21, 42.84s/it]
 16%|            | 43/268 [45:34<2:51:31, 45.74s/it]
 16%|            | 44/268 [46:10<2:39:51, 42.82s/it]
 17%|            | 45/268 [47:23<3:12:05, 51.68s/it]
 17%|            | 46/268 [48:13<3:09:57, 51.34s/it]
 18%|            | 47/268 [49:18<3:23:56, 55.37s/it]
 18%|            | 48/268 [50:12<3:21:43, 55.02s/it]
 18%|            | 49/268 [51:42<3:58:46, 65.42s/it]
 19%|            | 50/268 [52:27<3:35:22, 59.28s/it]
 19%|            | 51/268 [53:19<3:26:17, 57.04s/it]
 19%|            | 52/268 [53:50<2:57:53, 49.41s/it]
 20%|            | 53/268 [54:37<2:54:20, 48.65s/it]
 20%|            | 54/268 [55:27<2:54:17, 48.87s/it]
 21%|            | 55/268 [56:19<2:57:12, 49.92s/it]
 21%|            | 56/268 [56:51<2:37:12, 44.49s/it]
 21%|             | 57/268 [58:07<3:09:28, 53.88s/it]
 22%|             | 58/268 [59:52<4:03:09, 69.47s/it]
 22%|             | 59/268 [1:00:38<3:36:52, 62.26s/it]
 22%|             | 60/268 [1:01:13<3:07:43, 54.15s/it]
 23%|             | 61/268 [1:02:01<2:59:55, 52.15s/it]
 23%|             | 62/268 [1:02:57<3:03:43, 53.51s/it]
 24%|             | 63/268 [1:03:43<2:54:55, 51.20s/it]
 24%|             | 64/268 [1:05:12<3:32:29, 62.50s/it]
 24%|             | 65/268 [1:06:49<4:06:27, 72.85s/it]
 25%|             | 66/268 [1:07:19<3:21:46, 59.93s/it]
 25%|             | 67/268 [1:08:20<3:21:57, 60.28s/it]
 25%|             | 68/268 [1:09:49<3:49:34, 68.87s/it]
 26%|             | 69/268 [1:12:12<5:02:26, 91.19s/it]
 26%|             | 70/268 [1:13:12<4:29:51, 81.77s/it]
 26%|             | 71/268 [1:14:12<4:07:36, 75.41s/it]
 27%|             | 72/268 [1:14:55<3:34:34, 65.68s/it]
 27%|             | 73/268 [1:15:53<3:25:53, 63.35s/it]
 28%|             | 74/268 [1:16:34<3:03:07, 56.64s/it]
 28%|             | 75/268 [1:17:40<3:11:19, 59.48s/it]
 28%|             | 76/268 [1:19:07<3:36:52, 67.77s/it]
 29%|             | 77/268 [1:20:11<3:31:39, 66.49s/it]
 29%|             | 78/268 [1:21:20<3:32:51, 67.22s/it]
 29%|             | 79/268 [1:22:15<3:20:29, 63.65s/it]
 30%|             | 80/268 [1:22:59<3:00:49, 57.71s/it]
 30%|             | 81/268 [1:24:23<3:24:20, 65.56s/it]
 31%|             | 82/268 [1:24:57<2:54:17, 56.22s/it]
 31%|             | 83/268 [1:25:29<2:30:25, 48.79s/it]
 31%|              | 84/268 [1:26:40<2:50:22, 55.56s/it]
 32%|              | 85/268 [1:27:28<2:42:08, 53.16s/it]
 32%|              | 86/268 [1:28:57<3:14:03, 63.98s/it]
 32%|              | 87/268 [1:30:56<4:02:26, 80.37s/it]
 33%|              | 88/268 [1:31:35<3:24:31, 68.18s/it]
 33%|              | 89/268 [1:32:42<3:22:05, 67.74s/it]
 34%|              | 90/268 [1:33:17<2:51:57, 57.96s/it]
 34%|              | 91/268 [1:34:28<3:02:49, 61.98s/it]
 34%|              | 92/268 [1:35:37<3:07:11, 63.82s/it]
 35%|              | 93/268 [1:36:33<2:59:59, 61.71s/it]
 35%|              | 94/268 [1:37:27<2:51:38, 59.19s/it]
 35%|              | 95/268 [1:38:11<2:37:38, 54.68s/it]
 36%|              | 96/268 [1:39:18<2:47:30, 58.43s/it]
 36%|              | 97/268 [1:40:01<2:33:29, 53.86s/it]
 37%|              | 98/268 [1:40:44<2:23:20, 50.59s/it]
 37%|              | 99/268 [1:41:36<2:23:37, 50.99s/it]
 37%|              | 100/268 [1:42:24<2:19:56, 49.98s/it]
 38%|              | 101/268 [1:43:34<2:35:38, 55.92s/it]
 38%|              | 102/268 [1:44:15<2:22:52, 51.64s/it]
 38%|              | 103/268 [1:45:06<2:21:17, 51.38s/it]
 39%|              | 104/268 [1:46:05<2:26:31, 53.60s/it]
 39%|              | 105/268 [1:47:47<3:05:02, 68.12s/it]
 40%|              | 106/268 [1:48:32<2:45:03, 61.13s/it]
 40%|              | 107/268 [1:49:34<2:45:10, 61.56s/it]
 40%|              | 108/268 [1:50:40<2:47:41, 62.88s/it]
 41%|              | 109/268 [1:51:27<2:34:08, 58.17s/it]
 41%|              | 110/268 [1:52:24<2:32:13, 57.80s/it]
 41%|               | 111/268 [1:53:04<2:17:19, 52.48s/it]
 42%|               | 112/268 [1:53:57<2:16:27, 52.48s/it]
 42%|               | 113/268 [1:54:31<2:01:36, 47.07s/it]
 43%|               | 114/268 [1:55:27<2:07:22, 49.63s/it]
 43%|               | 115/268 [1:56:19<2:08:31, 50.40s/it]
 43%|               | 116/268 [1:56:58<1:59:22, 47.12s/it]
 44%|               | 117/268 [1:57:34<1:50:12, 43.79s/it]
 44%|               | 118/268 [1:58:36<2:02:50, 49.14s/it]
 44%|               | 119/268 [1:59:36<2:09:58, 52.34s/it]
 45%|               | 120/268 [2:00:50<2:25:14, 58.88s/it]
 45%|               | 121/268 [2:01:48<2:23:54, 58.74s/it]
 46%|               | 122/268 [2:02:54<2:27:42, 60.70s/it]
 46%|               | 123/268 [2:03:36<2:13:15, 55.14s/it]
 46%|               | 124/268 [2:04:39<2:18:16, 57.61s/it]
 47%|               | 125/268 [2:05:37<2:17:13, 57.58s/it]
 47%|               | 126/268 [2:06:24<2:09:09, 54.57s/it]
 47%|               | 127/268 [2:07:28<2:14:20, 57.16s/it]
 48%|               | 128/268 [2:08:25<2:13:51, 57.37s/it]
 48%|               | 129/268 [2:09:40<2:24:44, 62.48s/it]
 49%|               | 130/268 [2:10:47<2:26:44, 63.80s/it]
 49%|               | 131/268 [2:11:36<2:16:02, 59.58s/it]
 49%|               | 132/268 [2:13:05<2:34:54, 68.34s/it]
 50%|               | 133/268 [2:14:12<2:32:25, 67.74s/it]
 50%|               | 134/268 [2:15:20<2:32:03, 68.08s/it]
 50%|               | 135/268 [2:16:07<2:16:51, 61.74s/it]
 51%|               | 136/268 [2:17:02<2:11:24, 59.73s/it]
 51%|               | 137/268 [2:18:00<2:08:50, 59.01s/it]
 51%|                | 138/268 [2:18:45<1:58:39, 54.76s/it]
 52%|                | 139/268 [2:21:24<3:05:20, 86.20s/it]
 52%|                | 140/268 [2:22:28<2:49:38, 79.52s/it]
 53%|                | 141/268 [2:23:17<2:28:36, 70.21s/it]
 53%|                | 142/268 [2:24:03<2:12:11, 62.95s/it]
 53%|                | 143/268 [2:24:59<2:07:00, 60.96s/it]
 54%|                | 144/268 [2:25:40<1:53:52, 55.10s/it]
 54%|                | 145/268 [2:26:29<1:49:02, 53.19s/it]
 54%|                | 146/268 [2:27:33<1:54:58, 56.55s/it]
 55%|                | 147/268 [2:28:17<1:46:19, 52.72s/it]
 55%|                | 148/268 [2:29:15<1:48:35, 54.30s/it]
 56%|                | 149/268 [2:29:51<1:36:38, 48.73s/it]
 56%|                | 150/268 [2:31:41<2:12:09, 67.20s/it]
 56%|                | 151/268 [2:32:26<1:58:07, 60.57s/it]
 57%|                | 152/268 [2:33:27<1:57:06, 60.58s/it]
 57%|                | 153/268 [2:34:43<2:05:01, 65.23s/it]
 57%|                | 154/268 [2:36:06<2:14:14, 70.66s/it]
 58%|                | 155/268 [2:36:52<1:58:55, 63.15s/it]
 58%|                | 156/268 [2:38:15<2:09:14, 69.24s/it]
 59%|                | 157/268 [2:39:21<2:06:16, 68.26s/it]
 59%|                | 158/268 [2:40:12<1:55:37, 63.07s/it]
 59%|                | 159/268 [2:41:42<2:08:59, 71.01s/it]
 60%|                | 160/268 [2:42:38<1:59:54, 66.62s/it]
 60%|                | 161/268 [2:43:29<1:50:11, 61.79s/it]
 60%|                | 162/268 [2:44:23<1:45:14, 59.57s/it]
 61%|                | 163/268 [2:45:25<1:45:13, 60.13s/it]
 61%|                | 164/268 [2:46:04<1:33:29, 53.93s/it]
 62%|                 | 165/268 [2:47:14<1:40:55, 58.79s/it]
 62%|                 | 166/268 [2:48:09<1:37:52, 57.57s/it]
 62%|                 | 167/268 [2:49:15<1:41:02, 60.03s/it]
 63%|                 | 168/268 [2:49:55<1:30:16, 54.16s/it]
 63%|                 | 169/268 [2:51:07<1:38:15, 59.55s/it]
 63%|                 | 170/268 [2:52:46<1:56:16, 71.19s/it]
 64%|                 | 171/268 [2:54:02<1:57:45, 72.84s/it]
 64%|                 | 172/268 [2:55:01<1:49:45, 68.59s/it]
 65%|                 | 173/268 [2:56:18<1:52:22, 70.97s/it]
 65%|                 | 174/268 [2:57:12<1:43:22, 65.98s/it]
 65%|                 | 175/268 [2:58:01<1:34:21, 60.87s/it]
 66%|                 | 176/268 [2:59:52<1:56:20, 75.88s/it]
 66%|                 | 177/268 [3:00:53<1:48:32, 71.57s/it]
 66%|                 | 178/268 [3:02:23<1:55:28, 76.99s/it]
 67%|                 | 179/268 [3:03:28<1:48:58, 73.46s/it]
 67%|                 | 180/268 [3:04:52<1:52:30, 76.71s/it]
 68%|                 | 181/268 [3:05:46<1:41:18, 69.87s/it]
 68%|                 | 182/268 [3:06:44<1:35:06, 66.36s/it]
 68%|                 | 183/268 [3:08:21<1:46:50, 75.41s/it]
 69%|                 | 184/268 [3:09:26<1:41:07, 72.23s/it]
 69%|                 | 185/268 [3:10:55<1:47:07, 77.43s/it]
 69%|                 | 186/268 [3:11:59<1:40:18, 73.40s/it]
 70%|                 | 187/268 [3:12:51<1:30:10, 66.79s/it]
 70%|                 | 188/268 [3:13:33<1:19:16, 59.45s/it]
 71%|                 | 189/268 [3:14:50<1:24:59, 64.56s/it]
 71%|                 | 190/268 [3:16:11<1:30:30, 69.63s/it]
 71%|                  | 191/268 [3:16:59<1:21:07, 63.22s/it]
 72%|                  | 192/268 [3:17:39<1:11:10, 56.19s/it]
 72%|                  | 193/268 [3:18:21<1:04:43, 51.78s/it]
 72%|                  | 194/268 [3:19:57<1:20:26, 65.22s/it]
 73%|                  | 195/268 [3:21:36<1:31:36, 75.29s/it]
 73%|                  | 196/268 [3:23:16<1:39:18, 82.76s/it]
 74%|                  | 197/268 [3:25:06<1:47:37, 90.96s/it]
 74%|                  | 198/268 [3:27:20<2:01:01, 103.73s/it]
 74%|                  | 199/268 [3:28:13<1:42:01, 88.72s/it] 
 75%|                  | 200/268 [3:29:03<1:27:09, 76.91s/it]
 75%|                  | 201/268 [3:30:20<1:26:00, 77.02s/it]
 75%|                  | 202/268 [3:31:17<1:18:00, 70.91s/it]
 76%|                  | 203/268 [3:32:00<1:07:50, 62.62s/it]
 76%|                  | 204/268 [3:33:34<1:16:47, 72.00s/it]
 76%|                  | 205/268 [3:34:40<1:13:46, 70.26s/it]
 77%|                  | 206/268 [3:36:53<1:32:09, 89.19s/it]
 77%|                  | 207/268 [3:37:45<1:19:06, 77.81s/it]
 78%|                  | 208/268 [3:38:48<1:13:27, 73.46s/it]
 78%|                  | 209/268 [3:40:03<1:12:49, 74.07s/it]
 78%|                  | 210/268 [3:40:49<1:03:15, 65.44s/it]
 79%|                  | 211/268 [3:41:36<56:59, 59.99s/it]  
 79%|                  | 212/268 [3:43:25<1:09:34, 74.54s/it]
 79%|                  | 213/268 [3:44:27<1:04:57, 70.86s/it]
 80%|                  | 214/268 [3:45:42<1:05:02, 72.27s/it]
 80%|                  | 215/268 [3:46:40<59:58, 67.89s/it]  
 81%|                  | 216/268 [3:48:39<1:12:05, 83.19s/it]
 81%|                  | 217/268 [3:49:30<1:02:35, 73.63s/it]
 81%|                   | 218/268 [3:50:17<54:33, 65.47s/it]  
 82%|                   | 219/268 [3:51:54<1:01:21, 75.13s/it]
 82%|                   | 220/268 [3:52:44<53:53, 67.36s/it]  
 82%|                   | 221/268 [3:54:02<55:26, 70.78s/it]
 83%|                   | 222/268 [3:55:10<53:36, 69.93s/it]
 83%|                   | 223/268 [3:56:19<52:04, 69.43s/it]
 84%|                   | 224/268 [3:57:03<45:23, 61.89s/it]
 84%|                   | 225/268 [3:58:13<46:07, 64.36s/it]
 84%|                   | 226/268 [3:59:04<42:18, 60.43s/it]
 85%|                   | 227/268 [4:00:00<40:22, 59.09s/it]
 85%|                   | 228/268 [4:00:54<38:14, 57.36s/it]
 85%|                   | 229/268 [4:02:18<42:39, 65.62s/it]
 86%|                   | 230/268 [4:03:55<47:27, 74.93s/it]
 86%|                   | 231/268 [4:04:50<42:36, 69.08s/it]
 87%|                   | 232/268 [4:06:24<45:45, 76.26s/it]
 87%|                   | 233/268 [4:07:29<42:33, 72.95s/it]
 87%|                   | 234/268 [4:09:01<44:34, 78.67s/it]
 88%|                   | 235/268 [4:10:50<48:14, 87.72s/it]
 88%|                   | 236/268 [4:11:51<42:39, 79.97s/it]
 88%|                   | 237/268 [4:14:43<55:32, 107.50s/it]
 89%|                   | 238/268 [4:16:24<52:45, 105.51s/it]
 89%|                   | 239/268 [4:17:22<44:05, 91.22s/it] 
 90%|                   | 240/268 [4:19:39<49:00, 105.02s/it]
 90%|                   | 241/268 [4:20:47<42:12, 93.81s/it] 
 90%|                   | 242/268 [4:21:32<34:16, 79.11s/it]
 91%|                   | 243/268 [4:22:32<30:37, 73.50s/it]
 91%|                   | 244/268 [4:23:39<28:38, 71.61s/it]
 91%|                    | 245/268 [4:24:34<25:30, 66.54s/it]
 92%|                    | 246/268 [4:25:23<22:30, 61.38s/it]
 92%|                    | 247/268 [4:27:18<27:02, 77.27s/it]
 93%|                    | 248/268 [4:28:14<23:38, 70.95s/it]
 93%|                    | 249/268 [4:29:15<21:29, 67.88s/it]
 93%|                    | 250/268 [4:30:11<19:18, 64.33s/it]
 94%|                    | 251/268 [4:30:57<16:40, 58.85s/it]
 94%|                    | 252/268 [4:32:07<16:38, 62.40s/it]
 94%|                    | 253/268 [4:33:57<19:09, 76.63s/it]
 95%|                    | 254/268 [4:35:25<18:41, 80.10s/it]
 95%|                    | 255/268 [4:36:21<15:46, 72.81s/it]
 96%|                    | 256/268 [4:37:06<12:51, 64.33s/it]
 96%|                    | 257/268 [4:38:12<11:54, 64.99s/it]
 96%|                    | 258/268 [4:38:55<09:42, 58.25s/it]
 97%|                    | 259/268 [4:39:45<08:23, 55.92s/it]
 97%|                    | 260/268 [4:40:32<07:04, 53.07s/it]
 97%|                    | 261/268 [4:42:10<07:47, 66.72s/it]
 98%|                    | 262/268 [4:43:12<06:32, 65.35s/it]
 98%|                    | 263/268 [4:44:13<05:19, 63.93s/it]
 99%|                    | 264/268 [4:45:10<04:07, 61.76s/it]
 99%|                    | 265/268 [4:46:15<03:08, 62.68s/it]
 99%|                    | 266/268 [4:47:45<02:21, 70.88s/it]
100%|                    | 267/268 [4:48:29<01:02, 62.90s/it]
100%|                    | 268/268 [4:49:21<00:00, 59.77s/it]
100%|                    | 268/268 [4:49:46<00:00, 64.87s/it]
epoch: 1, train loss: 2012.4923801706798

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:28<13:51, 28.66s/it]
  7%|           | 2/30 [01:05<15:42, 33.67s/it]
 10%|           | 3/30 [9:42:21<119:34:31, 15943.38s/it]
 13%|            | 4/30 [9:43:17<69:50:44, 9670.94s/it]  
 17%|            | 5/30 [9:44:12<43:04:49, 6203.56s/it]
 20%|            | 6/30 [9:44:52<27:23:08, 4107.84s/it]
 23%|             | 7/30 [9:45:34<17:45:06, 2778.56s/it]
 27%|             | 8/30 [9:45:51<11:36:32, 1899.65s/it]
 30%|             | 9/30 [9:46:34<7:41:41, 1319.12s/it] 
 33%|              | 10/30 [9:47:20<5:08:43, 926.15s/it]
 37%|              | 11/30 [9:47:41<3:25:34, 649.17s/it]
 40%|              | 12/30 [9:49:02<2:22:50, 476.11s/it]
 43%|               | 13/30 [9:49:58<1:38:50, 348.86s/it]
 47%|               | 14/30 [9:50:35<1:07:54, 254.67s/it]
 50%|               | 15/30 [9:50:53<45:51, 183.42s/it]  
 53%|                | 16/30 [9:52:07<35:04, 150.33s/it]
 57%|                | 17/30 [9:53:10<26:54, 124.19s/it]
 60%|                | 18/30 [9:53:37<18:59, 94.92s/it] 
 63%|                 | 19/30 [9:54:12<14:05, 76.88s/it]
 67%|                 | 20/30 [9:54:57<11:15, 67.51s/it]
 70%|                 | 21/30 [9:55:16<07:55, 52.79s/it]
 73%|                  | 22/30 [9:55:50<06:18, 47.34s/it]
 77%|                  | 23/30 [9:56:33<05:22, 46.05s/it]
 80%|                  | 24/30 [9:56:59<03:59, 39.92s/it]
 83%|                   | 25/30 [9:57:25<02:58, 35.62s/it]
 87%|                   | 26/30 [9:58:21<02:47, 41.81s/it]
 90%|                   | 27/30 [9:59:07<02:08, 42.98s/it]
 93%|                    | 28/30 [9:59:44<01:22, 41.46s/it]
 97%|                    | 29/30 [10:00:25<00:41, 41.25s/it]
100%|                    | 30/30 [10:00:56<00:00, 37.98s/it]
100%|                    | 30/30 [10:00:56<00:00, 1201.88s/it]
epoch: 1, f1 score: 0.9211978418113707, dev loss: 942.209375
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [01:04<4:46:52, 64.47s/it]
  1%|          | 2/268 [01:43<3:38:56, 49.39s/it]
  1%|          | 3/268 [03:26<5:26:06, 73.84s/it]
  1%|           | 4/268 [04:44<5:33:13, 75.73s/it]
  2%|           | 5/268 [05:57<5:27:49, 74.79s/it]
  2%|           | 6/268 [07:53<6:27:10, 88.66s/it]
  3%|           | 7/268 [09:28<6:34:14, 90.63s/it]
  3%|           | 8/268 [10:29<5:51:55, 81.21s/it]
  3%|           | 9/268 [11:02<4:46:19, 66.33s/it]
  4%|           | 10/268 [12:28<5:11:19, 72.40s/it]
  4%|           | 11/268 [13:47<5:17:35, 74.15s/it]
  4%|           | 12/268 [14:51<5:04:18, 71.32s/it]
  5%|           | 13/268 [16:08<5:10:05, 72.96s/it]
  5%|           | 14/268 [17:01<4:42:49, 66.81s/it]
  6%|           | 15/268 [17:43<4:10:47, 59.48s/it]
  6%|           | 16/268 [19:47<5:30:38, 78.73s/it]
  6%|           | 17/268 [20:58<5:20:03, 76.51s/it]
  7%|           | 18/268 [22:01<5:02:30, 72.60s/it]
  7%|           | 19/268 [22:53<4:35:21, 66.35s/it]
  7%|           | 20/268 [23:28<3:54:25, 56.72s/it]
  8%|           | 21/268 [24:05<3:29:38, 50.92s/it]
  8%|           | 22/268 [25:10<3:46:34, 55.26s/it]
  9%|           | 23/268 [26:44<4:32:06, 66.64s/it]
  9%|           | 24/268 [28:03<4:46:28, 70.44s/it]
  9%|           | 25/268 [29:10<4:41:50, 69.59s/it]
 10%|           | 26/268 [32:13<6:57:54, 103.61s/it]
 10%|           | 27/268 [33:13<6:02:41, 90.30s/it] 
 10%|           | 28/268 [34:51<6:11:01, 92.76s/it]
 11%|           | 29/268 [36:08<5:50:49, 88.07s/it]
 11%|           | 30/268 [37:52<6:08:09, 92.81s/it]
 12%|            | 31/268 [38:42<5:15:35, 79.90s/it]
 12%|            | 32/268 [39:36<4:44:13, 72.26s/it]
 12%|            | 33/268 [40:33<4:24:44, 67.60s/it]
 13%|            | 34/268 [41:26<4:06:26, 63.19s/it]
 13%|            | 35/268 [42:21<3:56:15, 60.84s/it]
 13%|            | 36/268 [43:30<4:03:47, 63.05s/it]
 14%|            | 37/268 [44:18<3:45:49, 58.66s/it]
 14%|            | 38/268 [45:26<3:55:53, 61.54s/it]
 15%|            | 39/268 [46:10<3:34:18, 56.15s/it]
 15%|            | 40/268 [46:51<3:16:06, 51.61s/it]
 15%|            | 41/268 [48:05<3:40:51, 58.38s/it]
 16%|            | 42/268 [49:08<3:45:20, 59.83s/it]
 16%|            | 43/268 [50:03<3:38:53, 58.37s/it]
 16%|            | 44/268 [50:50<3:24:47, 54.86s/it]
 17%|            | 45/268 [52:04<3:45:42, 60.73s/it]
 17%|            | 46/268 [53:12<3:52:25, 62.82s/it]
 18%|            | 47/268 [54:14<3:50:52, 62.68s/it]
 18%|            | 48/268 [55:14<3:46:02, 61.65s/it]
 18%|            | 49/268 [56:23<3:53:25, 63.95s/it]
 19%|            | 50/268 [57:23<3:47:56, 62.74s/it]
 19%|            | 51/268 [59:10<4:34:53, 76.01s/it]
 19%|            | 52/268 [59:53<3:57:52, 66.08s/it]
 20%|            | 53/268 [1:00:38<3:34:48, 59.95s/it]
 20%|            | 54/268 [1:02:37<4:36:45, 77.59s/it]
 21%|            | 55/268 [1:03:21<3:59:36, 67.49s/it]
 21%|            | 56/268 [1:04:12<3:41:06, 62.58s/it]
 21%|             | 57/268 [1:05:25<3:50:34, 65.57s/it]
 22%|             | 58/268 [1:06:16<3:34:42, 61.35s/it]
 22%|             | 59/268 [1:07:07<3:22:51, 58.24s/it]
 22%|             | 60/268 [1:08:06<3:22:48, 58.50s/it]
 23%|             | 61/268 [1:09:09<3:26:30, 59.86s/it]
 23%|             | 62/268 [1:10:34<3:50:53, 67.25s/it]
 24%|             | 63/268 [1:11:46<3:54:25, 68.61s/it]
 24%|             | 64/268 [1:12:57<3:56:39, 69.60s/it]
 24%|             | 65/268 [1:13:54<3:41:56, 65.60s/it]
 25%|             | 66/268 [1:15:06<3:47:28, 67.57s/it]
 25%|             | 67/268 [1:15:42<3:15:15, 58.29s/it]
 25%|             | 68/268 [1:17:35<4:08:57, 74.69s/it]
 26%|             | 69/268 [1:18:20<3:37:43, 65.64s/it]
 26%|             | 70/268 [1:19:04<3:15:07, 59.13s/it]
 26%|             | 71/268 [1:20:38<3:48:55, 69.72s/it]
 27%|             | 72/268 [1:21:52<3:51:30, 70.87s/it]
 27%|             | 73/268 [1:22:57<3:44:45, 69.16s/it]
 28%|             | 74/268 [1:24:24<4:00:37, 74.42s/it]
 28%|             | 75/268 [1:26:15<4:35:04, 85.52s/it]
 28%|             | 76/268 [1:28:29<5:19:52, 99.96s/it]
 29%|             | 77/268 [1:29:58<5:07:28, 96.59s/it]
 29%|             | 78/268 [1:31:33<5:04:35, 96.19s/it]
 29%|             | 79/268 [1:32:45<4:39:51, 88.84s/it]
 30%|             | 80/268 [1:35:18<5:38:59, 108.19s/it]
 30%|             | 81/268 [1:38:31<6:56:16, 133.56s/it]
 31%|             | 82/268 [1:39:21<5:36:26, 108.53s/it]
 31%|             | 83/268 [1:40:22<4:51:18, 94.48s/it] 
 31%|              | 84/268 [1:41:11<4:07:45, 80.79s/it]
 32%|              | 85/268 [1:42:13<3:48:33, 74.94s/it]
 32%|              | 86/268 [1:43:01<3:23:14, 67.00s/it]
 32%|              | 87/268 [1:45:22<4:29:17, 89.27s/it]
 33%|              | 88/268 [1:46:16<3:56:07, 78.71s/it]
 33%|              | 89/268 [1:47:32<3:52:25, 77.91s/it]
 34%|              | 90/268 [1:48:44<3:45:18, 75.94s/it]
 34%|              | 91/268 [1:49:45<3:31:19, 71.63s/it]
 34%|              | 92/268 [1:50:53<3:26:19, 70.34s/it]
 35%|              | 93/268 [1:51:38<3:03:20, 62.86s/it]
 35%|              | 94/268 [1:52:27<2:50:12, 58.70s/it]
 35%|              | 95/268 [1:53:18<2:42:51, 56.48s/it]
 36%|              | 96/268 [1:54:02<2:30:35, 52.53s/it]
 36%|              | 97/268 [1:54:42<2:19:02, 48.79s/it]
 37%|              | 98/268 [1:55:30<2:17:50, 48.65s/it]
 37%|              | 99/268 [1:56:18<2:16:40, 48.52s/it]
 37%|              | 100/268 [1:57:33<2:37:32, 56.26s/it]
 38%|              | 101/268 [1:59:21<3:20:19, 71.97s/it]
 38%|              | 102/268 [2:00:20<3:08:27, 68.11s/it]
 38%|              | 103/268 [2:01:32<3:10:06, 69.13s/it]
 39%|              | 104/268 [2:02:51<3:17:24, 72.22s/it]
 39%|              | 105/268 [2:04:03<3:15:52, 72.10s/it]
 40%|              | 106/268 [2:04:59<3:01:15, 67.13s/it]
 40%|              | 107/268 [2:06:18<3:09:47, 70.73s/it]
 40%|              | 108/268 [2:07:02<2:47:15, 62.72s/it]
 41%|              | 109/268 [2:08:13<2:53:16, 65.39s/it]
 41%|              | 110/268 [2:09:07<2:43:02, 61.91s/it]
 41%|               | 111/268 [2:09:42<2:20:34, 53.73s/it]
 42%|               | 112/268 [2:10:35<2:19:32, 53.67s/it]
 42%|               | 113/268 [2:11:52<2:36:32, 60.60s/it]
 43%|               | 114/268 [2:12:35<2:21:31, 55.14s/it]
 43%|               | 115/268 [2:13:53<2:38:19, 62.09s/it]
 43%|               | 116/268 [2:15:29<3:02:55, 72.21s/it]
 44%|               | 117/268 [2:16:25<2:49:44, 67.44s/it]
 44%|               | 118/268 [2:18:05<3:13:00, 77.21s/it]
 44%|               | 119/268 [2:19:02<2:56:54, 71.24s/it]
 45%|               | 120/268 [2:19:45<2:34:30, 62.64s/it]
 45%|               | 121/268 [2:20:35<2:24:17, 58.89s/it]
 46%|               | 122/268 [2:22:03<2:44:25, 67.58s/it]
 46%|               | 123/268 [2:23:01<2:36:20, 64.69s/it]
 46%|               | 124/268 [2:24:14<2:41:17, 67.21s/it]
 47%|               | 125/268 [2:24:57<2:22:38, 59.85s/it]
 47%|               | 126/268 [2:26:21<2:39:12, 67.27s/it]
 47%|               | 127/268 [2:27:21<2:32:45, 65.01s/it]
 48%|               | 128/268 [2:28:18<2:26:00, 62.57s/it]
 48%|               | 129/268 [2:29:15<2:21:09, 60.93s/it]
 49%|               | 130/268 [2:29:45<1:59:02, 51.76s/it]
 49%|               | 131/268 [2:30:59<2:13:03, 58.27s/it]
 49%|               | 132/268 [2:32:06<2:18:02, 60.90s/it]
 50%|               | 133/268 [2:33:21<2:26:36, 65.16s/it]
 50%|               | 134/268 [2:35:28<3:07:22, 83.90s/it]
 50%|               | 135/268 [2:36:32<2:52:24, 77.78s/it]
 51%|               | 136/268 [2:37:49<2:50:19, 77.42s/it]
 51%|               | 137/268 [2:39:51<3:18:46, 91.04s/it]
 51%|                | 138/268 [2:41:16<3:12:54, 89.03s/it]
 52%|                | 139/268 [2:42:36<3:05:38, 86.35s/it]
 52%|                | 140/268 [2:44:20<3:15:33, 91.67s/it]
 53%|                | 141/268 [2:45:53<3:15:02, 92.15s/it]
 53%|                | 142/268 [2:47:34<3:19:11, 94.85s/it]
 53%|                | 143/268 [2:48:19<2:46:12, 79.78s/it]
 54%|                | 144/268 [2:49:15<2:30:16, 72.71s/it]
 54%|                | 145/268 [2:50:32<2:31:36, 73.96s/it]
 54%|                | 146/268 [2:52:08<2:44:01, 80.67s/it]
 55%|                | 147/268 [2:53:06<2:28:57, 73.86s/it]
 55%|                | 148/268 [2:54:51<2:46:30, 83.25s/it]
 56%|                | 149/268 [2:56:53<3:07:52, 94.73s/it]
 56%|                | 150/268 [2:58:53<3:21:00, 102.21s/it]
 56%|                | 151/268 [3:01:01<3:34:20, 109.92s/it]
 57%|                | 152/268 [3:02:06<3:06:27, 96.45s/it] 
 57%|                | 153/268 [3:02:46<2:32:31, 79.58s/it]
 57%|                | 154/268 [3:03:44<2:19:00, 73.16s/it]
 58%|                | 155/268 [3:04:48<2:12:35, 70.40s/it]
 58%|                | 156/268 [3:06:08<2:16:54, 73.34s/it]
 59%|                | 157/268 [3:09:43<3:34:06, 115.74s/it]
 59%|                | 158/268 [3:11:44<3:35:24, 117.50s/it]
 59%|                | 159/268 [3:13:02<3:11:34, 105.45s/it]
 60%|                | 160/268 [3:13:46<2:36:45, 87.09s/it] 
 60%|                | 161/268 [3:15:47<2:53:25, 97.25s/it]
 60%|                | 162/268 [3:16:42<2:29:13, 84.46s/it]
 61%|                | 163/268 [3:17:57<2:22:54, 81.67s/it]
 61%|                | 164/268 [3:19:49<2:37:34, 90.91s/it]
 62%|                 | 165/268 [3:20:44<2:17:13, 79.94s/it]
 62%|                 | 166/268 [3:21:59<2:13:37, 78.60s/it]
 62%|                 | 167/268 [3:24:16<2:41:37, 96.01s/it]
 63%|                 | 168/268 [3:25:24<2:26:17, 87.78s/it]
 63%|                 | 169/268 [3:26:20<2:09:06, 78.25s/it]
 63%|                 | 170/268 [3:28:26<2:31:08, 92.54s/it]
 64%|                 | 171/268 [3:30:33<2:46:29, 102.98s/it]
 64%|                 | 172/268 [3:32:27<2:49:47, 106.12s/it]
 65%|                 | 173/268 [3:33:38<2:31:26, 95.65s/it] 
 65%|                 | 174/268 [3:35:43<2:43:35, 104.42s/it]
 65%|                 | 175/268 [3:37:19<2:37:50, 101.83s/it]
 66%|                 | 176/268 [3:38:45<2:28:56, 97.14s/it] 
 66%|                 | 177/268 [3:40:05<2:19:40, 92.10s/it]
 66%|                 | 178/268 [3:41:25<2:12:41, 88.46s/it]
 67%|                 | 179/268 [3:42:25<1:58:30, 79.89s/it]
 67%|                 | 180/268 [3:43:45<1:57:18, 79.98s/it]
 68%|                 | 181/268 [3:45:25<2:04:24, 85.80s/it]
 68%|                 | 182/268 [3:48:20<2:41:21, 112.57s/it]
 68%|                 | 183/268 [3:49:50<2:29:50, 105.77s/it]
 69%|                 | 184/268 [3:51:14<2:18:53, 99.21s/it] 
 69%|                 | 185/268 [3:52:22<2:04:15, 89.83s/it]
 69%|                 | 186/268 [3:53:34<1:55:43, 84.68s/it]
 70%|                 | 187/268 [3:54:27<1:41:25, 75.12s/it]
 70%|                 | 188/268 [3:55:29<1:34:47, 71.09s/it]
 71%|                 | 189/268 [3:56:51<1:37:57, 74.40s/it]
 71%|                 | 190/268 [3:57:40<1:26:58, 66.91s/it]
 71%|                  | 191/268 [3:58:54<1:28:21, 68.85s/it]
 72%|                  | 192/268 [4:00:00<1:26:16, 68.11s/it]
 72%|                  | 193/268 [4:02:01<1:44:56, 83.96s/it]
 72%|                  | 194/268 [4:04:03<1:57:28, 95.25s/it]
 73%|                  | 195/268 [4:05:27<1:52:04, 92.12s/it]
 73%|                  | 196/268 [4:07:02<1:51:31, 92.94s/it]
 74%|                  | 197/268 [4:08:24<1:45:58, 89.55s/it]
 74%|                  | 198/268 [4:10:40<2:00:50, 103.57s/it]
 74%|                  | 199/268 [4:11:44<1:45:18, 91.58s/it] 
 75%|                  | 200/268 [4:12:51<1:35:30, 84.28s/it]
 75%|                  | 201/268 [4:14:00<1:29:02, 79.74s/it]
 75%|                  | 202/268 [4:16:29<1:50:29, 100.44s/it]
 76%|                  | 203/268 [4:19:00<2:05:09, 115.53s/it]
 76%|                  | 204/268 [4:20:53<2:02:38, 114.98s/it]
 76%|                  | 205/268 [4:22:31<1:55:19, 109.84s/it]
 77%|                  | 206/268 [4:24:02<1:47:28, 104.01s/it]
 77%|                  | 207/268 [4:25:09<1:34:34, 93.03s/it] 
 78%|                  | 208/268 [4:26:05<1:21:52, 81.87s/it]
 78%|                  | 209/268 [4:27:45<1:25:48, 87.27s/it]
 78%|                  | 210/268 [4:29:26<1:28:29, 91.54s/it]
 79%|                  | 211/268 [4:30:43<1:22:44, 87.10s/it]
 79%|                  | 212/268 [4:32:04<1:19:33, 85.24s/it]
 79%|                  | 213/268 [4:36:00<1:59:46, 130.67s/it]
 80%|                  | 214/268 [4:37:08<1:40:37, 111.81s/it]
 80%|                  | 215/268 [4:38:41<1:33:44, 106.13s/it]
 81%|                  | 216/268 [4:40:24<1:31:01, 105.03s/it]
 81%|                  | 217/268 [4:42:12<1:30:03, 105.94s/it]
 81%|                   | 218/268 [4:44:37<1:38:10, 117.80s/it]
 82%|                   | 219/268 [4:46:04<1:28:35, 108.49s/it]
 82%|                   | 220/268 [4:47:05<1:15:26, 94.30s/it] 
 82%|                   | 221/268 [4:48:03<1:05:19, 83.40s/it]
 83%|                   | 222/268 [4:49:40<1:06:58, 87.36s/it]
 83%|                   | 223/268 [4:50:31<57:30, 76.68s/it]  
 84%|                   | 224/268 [4:52:13<1:01:43, 84.18s/it]
 84%|                   | 225/268 [4:54:38<1:13:25, 102.46s/it]
 84%|                   | 226/268 [4:56:38<1:15:19, 107.61s/it]
 85%|                   | 227/268 [4:58:12<1:10:47, 103.59s/it]
 85%|                   | 228/268 [5:00:14<1:12:44, 109.12s/it]
 85%|                   | 229/268 [5:01:32<1:04:50, 99.76s/it] 
 86%|                   | 230/268 [5:02:54<59:48, 94.44s/it]  
 86%|                   | 231/268 [5:04:47<1:01:38, 99.95s/it]
 87%|                   | 232/268 [5:06:11<57:03, 95.09s/it]  
 87%|                   | 233/268 [5:07:27<52:10, 89.43s/it]
 87%|                   | 234/268 [5:08:53<50:06, 88.44s/it]
 88%|                   | 235/268 [5:10:23<48:53, 88.89s/it]
 88%|                   | 236/268 [5:12:18<51:31, 96.62s/it]
 88%|                   | 237/268 [5:14:27<54:57, 106.38s/it]
 89%|                   | 238/268 [5:16:01<51:27, 102.91s/it]
 89%|                   | 239/268 [5:18:03<52:25, 108.48s/it]
 90%|                   | 240/268 [5:20:16<54:02, 115.81s/it]
 90%|                   | 241/268 [5:21:59<50:20, 111.85s/it]
 90%|                   | 242/268 [5:23:31<45:57, 106.06s/it]
 91%|                   | 243/268 [5:25:51<48:28, 116.34s/it]
 91%|                   | 244/268 [5:26:55<40:12, 100.51s/it]
 91%|                    | 245/268 [5:28:51<40:16, 105.09s/it]
 92%|                    | 246/268 [5:30:38<38:46, 105.76s/it]
 92%|                    | 247/268 [5:31:40<32:24, 92.59s/it] 
 93%|                    | 248/268 [5:32:40<27:38, 82.91s/it]
 93%|                    | 249/268 [5:33:45<24:30, 77.41s/it]
 93%|                    | 250/268 [5:35:25<25:18, 84.36s/it]
 94%|                    | 251/268 [5:36:48<23:43, 83.72s/it]
 94%|                    | 252/268 [5:38:06<21:55, 82.24s/it]
 94%|                    | 253/268 [5:39:45<21:47, 87.18s/it]
 95%|                    | 254/268 [5:40:48<18:38, 79.87s/it]
 95%|                    | 255/268 [5:42:11<17:29, 80.73s/it]
 96%|                    | 256/268 [5:44:14<18:43, 93.63s/it]
 96%|                    | 257/268 [5:45:54<17:29, 95.42s/it]
 96%|                    | 258/268 [5:47:11<14:58, 89.87s/it]
 97%|                    | 259/268 [5:48:55<14:06, 94.10s/it]
 97%|                    | 260/268 [5:50:03<11:30, 86.29s/it]
 97%|                    | 261/268 [5:52:02<11:12, 96.13s/it]
 98%|                    | 262/268 [5:53:33<09:28, 94.73s/it]
 98%|                    | 263/268 [5:55:02<07:45, 93.00s/it]
 99%|                    | 264/268 [5:56:05<05:35, 83.78s/it]
 99%|                    | 265/268 [5:57:44<04:25, 88.36s/it]
 99%|                    | 266/268 [5:59:13<02:57, 88.67s/it]
100%|                    | 267/268 [6:00:21<01:22, 82.41s/it]
100%|                    | 268/268 [6:01:27<00:00, 77.49s/it]
100%|                    | 268/268 [6:02:06<00:00, 81.07s/it]
epoch: 2, train loss: 790.9168851482334

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:43<21:03, 43.58s/it]
  7%|           | 2/30 [01:15<17:13, 36.89s/it]
 10%|           | 3/30 [01:34<12:47, 28.44s/it]
 13%|            | 4/30 [02:15<14:34, 33.62s/it]
 17%|            | 5/30 [02:40<12:36, 30.27s/it]
 20%|            | 6/30 [03:10<12:10, 30.42s/it]
 23%|             | 7/30 [03:32<10:32, 27.52s/it]
 27%|             | 8/30 [04:34<14:09, 38.62s/it]
 30%|             | 9/30 [05:10<13:10, 37.64s/it]
 33%|              | 10/30 [05:42<12:00, 36.04s/it]
 37%|              | 11/30 [06:10<10:36, 33.48s/it]
 40%|              | 12/30 [06:42<09:57, 33.17s/it]
 43%|               | 13/30 [07:32<10:48, 38.15s/it]
 47%|               | 14/30 [08:01<09:25, 35.34s/it]
 50%|               | 15/30 [08:52<10:02, 40.19s/it]
 53%|                | 16/30 [09:20<08:30, 36.44s/it]
 57%|                | 17/30 [10:01<08:11, 37.79s/it]
 60%|                | 18/30 [10:21<06:30, 32.53s/it]
 63%|                 | 19/30 [11:00<06:19, 34.52s/it]
 67%|                 | 20/30 [11:22<05:05, 30.53s/it]
 70%|                 | 21/30 [11:43<04:10, 27.83s/it]
 73%|                  | 22/30 [12:12<03:44, 28.07s/it]
 77%|                  | 23/30 [12:38<03:12, 27.44s/it]
 80%|                  | 24/30 [13:20<03:11, 31.92s/it]
 83%|                   | 25/30 [13:59<02:50, 34.18s/it]
 87%|                   | 26/30 [14:24<02:05, 31.40s/it]
 90%|                   | 27/30 [15:25<02:00, 40.25s/it]
 93%|                    | 28/30 [15:59<01:16, 38.15s/it]
 97%|                    | 29/30 [16:15<00:31, 31.73s/it]
100%|                    | 30/30 [16:42<00:00, 30.32s/it]
100%|                    | 30/30 [16:49<00:00, 33.64s/it]
epoch: 2, f1 score: 0.9425961825584537, dev loss: 664.8272786458333
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [01:09<5:07:28, 69.10s/it]
  1%|          | 2/268 [04:10<9:59:09, 135.15s/it]
  1%|          | 3/268 [05:25<7:56:38, 107.92s/it]
  1%|           | 4/268 [06:05<5:55:29, 80.79s/it] 
  2%|           | 5/268 [07:08<5:26:13, 74.42s/it]
  2%|           | 6/268 [08:10<5:06:13, 70.13s/it]
  3%|           | 7/268 [08:55<4:30:31, 62.19s/it]
  3%|           | 8/268 [10:04<4:38:46, 64.33s/it]
  3%|           | 9/268 [11:11<4:40:37, 65.01s/it]
  4%|           | 10/268 [12:05<4:24:49, 61.59s/it]
  4%|           | 11/268 [13:29<4:53:59, 68.64s/it]
  4%|           | 12/268 [14:54<5:13:03, 73.37s/it]
  5%|           | 13/268 [16:24<5:34:02, 78.60s/it]
  5%|           | 14/268 [18:16<6:14:30, 88.47s/it]
  6%|           | 15/268 [19:50<6:20:43, 90.29s/it]
  6%|           | 16/268 [21:36<6:39:06, 95.03s/it]
  6%|           | 17/268 [23:32<7:03:47, 101.30s/it]
  7%|           | 18/268 [24:39<6:19:36, 91.10s/it] 
  7%|           | 19/268 [25:32<5:30:09, 79.56s/it]
  7%|           | 20/268 [26:25<4:56:04, 71.63s/it]
  8%|           | 21/268 [26:55<4:03:49, 59.23s/it]
  8%|           | 22/268 [27:54<4:02:34, 59.16s/it]
  9%|           | 23/268 [28:37<3:41:35, 54.27s/it]
  9%|           | 24/268 [29:42<3:52:55, 57.28s/it]
  9%|           | 25/268 [30:43<3:56:54, 58.50s/it]
 10%|           | 26/268 [31:40<3:53:41, 57.94s/it]
 10%|           | 27/268 [32:30<3:43:41, 55.69s/it]
 10%|           | 28/268 [33:06<3:18:45, 49.69s/it]
 11%|           | 29/268 [34:16<3:42:24, 55.84s/it]
 11%|           | 30/268 [35:29<4:01:46, 60.95s/it]
 12%|            | 31/268 [36:05<3:31:59, 53.67s/it]
 12%|            | 32/268 [37:37<4:15:52, 65.05s/it]
 12%|            | 33/268 [39:36<5:18:19, 81.27s/it]
 13%|            | 34/268 [40:13<4:25:22, 68.04s/it]
 13%|            | 35/268 [41:08<4:08:07, 63.89s/it]
 13%|            | 36/268 [43:08<5:12:27, 80.81s/it]
 14%|            | 37/268 [43:51<4:27:59, 69.61s/it]
 14%|            | 38/268 [45:12<4:39:08, 72.82s/it]
 15%|            | 39/268 [45:54<4:02:30, 63.54s/it]
 15%|            | 40/268 [46:46<3:48:59, 60.26s/it]
 15%|            | 41/268 [48:08<4:12:53, 66.84s/it]
 16%|            | 42/268 [50:07<5:10:28, 82.43s/it]
 16%|            | 43/268 [51:01<4:37:26, 73.98s/it]
 16%|            | 44/268 [52:19<4:39:49, 74.96s/it]
 17%|            | 45/268 [53:16<4:18:47, 69.63s/it]
 17%|            | 46/268 [53:50<3:37:56, 58.90s/it]
 18%|            | 47/268 [54:47<3:34:50, 58.33s/it]
 18%|            | 48/268 [56:03<3:53:08, 63.58s/it]
 18%|            | 49/268 [56:48<3:31:59, 58.08s/it]
 19%|            | 50/268 [58:30<4:19:24, 71.40s/it]
 19%|            | 51/268 [59:27<4:01:47, 66.86s/it]
 19%|            | 52/268 [1:01:10<4:39:41, 77.69s/it]
 20%|            | 53/268 [1:02:28<4:39:18, 77.95s/it]
 20%|            | 54/268 [1:03:15<4:04:24, 68.53s/it]
 21%|            | 55/268 [1:04:37<4:18:02, 72.69s/it]
 21%|            | 56/268 [1:05:23<3:48:33, 64.68s/it]
 21%|             | 57/268 [1:06:06<3:24:57, 58.28s/it]
 22%|             | 58/268 [1:07:34<3:54:52, 67.11s/it]
 22%|             | 59/268 [1:08:29<3:40:45, 63.37s/it]
 22%|             | 60/268 [1:10:17<4:26:08, 76.77s/it]
 23%|             | 61/268 [1:11:21<4:11:49, 72.99s/it]
 23%|             | 62/268 [1:12:12<3:47:44, 66.33s/it]
 24%|             | 63/268 [1:13:32<4:00:43, 70.46s/it]
 24%|             | 64/268 [1:14:25<3:41:44, 65.22s/it]
 24%|             | 65/268 [1:15:14<3:24:40, 60.50s/it]
 25%|             | 66/268 [1:17:08<4:17:21, 76.44s/it]
 25%|             | 67/268 [1:18:13<4:04:31, 72.99s/it]
 25%|             | 68/268 [1:19:28<4:05:27, 73.64s/it]
 26%|             | 69/268 [1:20:17<3:40:04, 66.35s/it]
 26%|             | 70/268 [1:21:47<4:02:01, 73.34s/it]
 26%|             | 71/268 [1:22:44<3:44:34, 68.40s/it]
 27%|             | 72/268 [1:23:43<3:33:55, 65.49s/it]
 27%|             | 73/268 [1:24:50<3:34:41, 66.06s/it]
 28%|             | 74/268 [1:26:09<3:46:12, 69.96s/it]
 28%|             | 75/268 [1:27:31<3:56:10, 73.42s/it]
 28%|             | 76/268 [1:28:43<3:54:02, 73.14s/it]
 29%|             | 77/268 [1:30:30<4:25:19, 83.35s/it]
 29%|             | 78/268 [1:31:15<3:47:35, 71.87s/it]
 29%|             | 79/268 [1:32:14<3:33:38, 67.82s/it]
 30%|             | 80/268 [1:32:50<3:03:13, 58.47s/it]
 30%|             | 81/268 [1:33:41<2:55:13, 56.22s/it]
 31%|             | 82/268 [1:34:57<3:12:50, 62.21s/it]
 31%|             | 83/268 [1:36:52<3:59:55, 77.81s/it]
 31%|              | 84/268 [1:37:45<3:36:08, 70.48s/it]
 32%|              | 85/268 [1:39:39<4:15:07, 83.65s/it]
 32%|              | 86/268 [1:41:03<4:13:37, 83.61s/it]
 32%|              | 87/268 [1:41:58<3:46:20, 75.03s/it]
 33%|              | 88/268 [1:43:21<3:52:09, 77.39s/it]
 33%|              | 89/268 [1:44:12<3:27:50, 69.67s/it]
 34%|              | 90/268 [1:45:00<3:06:49, 62.97s/it]
 34%|              | 91/268 [1:45:48<2:52:20, 58.42s/it]
 34%|              | 92/268 [1:46:38<2:44:07, 55.95s/it]
 35%|              | 93/268 [1:47:55<3:02:03, 62.42s/it]
 35%|              | 94/268 [1:50:26<4:17:37, 88.84s/it]
 35%|              | 95/268 [1:51:26<3:51:15, 80.21s/it]
 36%|              | 96/268 [1:52:39<3:43:30, 77.97s/it]
 36%|              | 97/268 [1:53:52<3:38:06, 76.53s/it]
 37%|              | 98/268 [1:54:29<3:03:43, 64.84s/it]
 37%|              | 99/268 [1:55:31<3:00:17, 64.01s/it]
 37%|              | 100/268 [1:58:04<4:13:23, 90.49s/it]
 38%|              | 101/268 [1:59:08<3:49:45, 82.55s/it]
 38%|              | 102/268 [2:00:38<3:55:05, 84.97s/it]
 38%|              | 103/268 [2:02:17<4:04:31, 88.92s/it]
 39%|              | 104/268 [2:03:23<3:44:36, 82.17s/it]
 39%|              | 105/268 [2:05:34<4:23:05, 96.84s/it]
 40%|              | 106/268 [2:06:06<3:28:57, 77.39s/it]
 40%|              | 107/268 [2:07:02<3:10:26, 70.97s/it]
 40%|              | 108/268 [2:07:38<2:40:55, 60.35s/it]
 41%|              | 109/268 [2:08:36<2:38:00, 59.62s/it]
 41%|              | 110/268 [2:09:59<2:56:10, 66.90s/it]
 41%|               | 111/268 [2:11:21<3:06:51, 71.41s/it]
 42%|               | 112/268 [2:13:17<3:40:03, 84.64s/it]
 42%|               | 113/268 [2:14:22<3:23:41, 78.85s/it]
 43%|               | 114/268 [2:15:20<3:06:34, 72.69s/it]
 43%|               | 115/268 [2:16:35<3:07:06, 73.37s/it]
 43%|               | 116/268 [2:17:20<2:44:03, 64.76s/it]
 44%|               | 117/268 [2:18:25<2:43:07, 64.82s/it]
 44%|               | 118/268 [2:20:04<3:07:30, 75.00s/it]
 44%|               | 119/268 [2:21:47<3:27:12, 83.44s/it]
 45%|               | 120/268 [2:25:19<5:01:03, 122.05s/it]
 45%|               | 121/268 [2:26:44<4:31:54, 110.98s/it]
 46%|               | 122/268 [2:28:25<4:22:20, 107.81s/it]
 46%|               | 123/268 [2:29:43<3:59:26, 99.08s/it] 
 46%|               | 124/268 [2:30:48<3:32:37, 88.59s/it]
 47%|               | 125/268 [2:33:11<4:10:34, 105.14s/it]
 47%|               | 126/268 [2:35:31<4:33:22, 115.51s/it]
 47%|               | 127/268 [2:38:23<5:10:57, 132.32s/it]
 48%|               | 128/268 [2:39:28<4:21:42, 112.16s/it]
 48%|               | 129/268 [2:40:17<3:36:06, 93.28s/it] 
 49%|               | 130/268 [2:42:15<3:51:55, 100.84s/it]
 49%|               | 131/268 [2:43:51<3:46:53, 99.37s/it] 
 49%|               | 132/268 [2:45:45<3:54:43, 103.55s/it]
 50%|               | 133/268 [2:47:58<4:13:19, 112.59s/it]
 50%|               | 134/268 [2:50:15<4:27:17, 119.69s/it]
 50%|               | 135/268 [2:54:09<5:41:49, 154.21s/it]
 51%|               | 136/268 [2:57:29<6:09:26, 167.93s/it]
 51%|               | 137/268 [3:03:31<8:13:25, 226.00s/it]
 51%|                | 138/268 [3:05:35<7:03:45, 195.58s/it]
 52%|                | 139/268 [3:08:32<6:47:59, 189.77s/it]
 52%|                | 140/268 [3:11:53<6:52:17, 193.26s/it]
 53%|                | 141/268 [3:13:29<5:47:28, 164.16s/it]
 53%|                | 142/268 [3:15:17<5:09:07, 147.20s/it]
 53%|                | 143/268 [3:18:44<5:44:05, 165.16s/it]
 54%|                | 144/268 [3:20:54<5:19:39, 154.67s/it]
 54%|                | 145/268 [3:22:11<4:29:16, 131.35s/it]
 54%|                | 146/268 [3:24:19<4:25:18, 130.48s/it]
 55%|                | 147/268 [3:25:22<3:42:07, 110.14s/it]
 55%|                | 148/268 [3:27:06<3:36:21, 108.18s/it]
 56%|                | 149/268 [3:28:26<3:17:55, 99.80s/it] 
 56%|                | 150/268 [3:29:34<2:57:46, 90.39s/it]
 56%|                | 151/268 [3:32:27<3:44:24, 115.08s/it]
 57%|                | 152/268 [3:33:20<3:06:31, 96.48s/it] 
 57%|                | 153/268 [3:34:24<2:46:03, 86.64s/it]
 57%|                | 154/268 [3:35:24<2:29:37, 78.75s/it]
 58%|                | 155/268 [3:37:09<2:43:11, 86.65s/it]
 58%|                | 156/268 [3:38:43<2:45:26, 88.63s/it]
 59%|                | 157/268 [3:39:58<2:36:38, 84.67s/it]
 59%|                | 158/268 [3:40:58<2:21:35, 77.23s/it]
 59%|                | 159/268 [3:42:09<2:16:56, 75.38s/it]
 60%|                | 160/268 [3:42:58<2:01:13, 67.35s/it]
 60%|                | 161/268 [3:44:34<2:15:45, 76.13s/it]
 60%|                | 162/268 [3:46:24<2:32:26, 86.28s/it]
 61%|                | 163/268 [3:48:23<2:48:05, 96.05s/it]
 61%|                | 164/268 [3:50:12<2:53:23, 100.04s/it]
 62%|                 | 165/268 [3:51:13<2:31:38, 88.34s/it] 
 62%|                 | 166/268 [3:52:33<2:25:48, 85.77s/it]
 62%|                 | 167/268 [3:54:08<2:28:59, 88.51s/it]
 63%|                 | 168/268 [3:56:12<2:45:18, 99.19s/it]
 63%|                 | 169/268 [3:57:45<2:40:31, 97.29s/it]
 63%|                 | 170/268 [3:59:27<2:41:26, 98.85s/it]
 64%|                 | 171/268 [4:03:32<3:50:20, 142.48s/it]
 64%|                 | 172/268 [4:04:49<3:16:24, 122.75s/it]
 65%|                 | 173/268 [4:07:38<3:36:27, 136.71s/it]
 65%|                 | 174/268 [4:09:07<3:11:43, 122.38s/it]
 65%|                 | 175/268 [4:11:05<3:07:41, 121.10s/it]
 66%|                 | 176/268 [4:13:08<3:06:37, 121.71s/it]
 66%|                 | 177/268 [4:14:58<2:59:13, 118.17s/it]
 66%|                 | 178/268 [4:16:59<2:58:45, 119.17s/it]
 67%|                 | 179/268 [4:19:20<3:06:31, 125.75s/it]
 67%|                 | 180/268 [4:21:00<2:52:46, 117.80s/it]
 68%|                 | 181/268 [4:24:06<3:20:44, 138.45s/it]
 68%|                 | 182/268 [4:26:50<3:29:22, 146.07s/it]
 68%|                 | 183/268 [4:28:58<3:19:12, 140.62s/it]
 69%|                 | 184/268 [4:31:52<3:30:48, 150.57s/it]
 69%|                 | 185/268 [4:33:08<2:57:21, 128.21s/it]
 69%|                 | 186/268 [4:35:09<2:52:27, 126.19s/it]
 70%|                 | 187/268 [4:38:14<3:14:00, 143.71s/it]
 70%|                 | 188/268 [4:39:43<2:49:37, 127.22s/it]
 71%|                 | 189/268 [4:41:05<2:29:32, 113.58s/it]
 71%|                 | 190/268 [4:43:04<2:30:05, 115.45s/it]
 71%|                  | 191/268 [4:44:41<2:21:00, 109.88s/it]
 72%|                  | 192/268 [4:46:42<2:23:30, 113.29s/it]
 72%|                  | 193/268 [4:49:07<2:33:28, 122.78s/it]
 72%|                  | 194/268 [4:50:57<2:26:22, 118.69s/it]
 73%|                  | 195/268 [4:53:19<2:32:53, 125.67s/it]
 73%|                  | 196/268 [4:54:55<2:20:12, 116.84s/it]
 74%|                  | 197/268 [4:58:21<2:50:02, 143.69s/it]
 74%|                  | 198/268 [5:00:01<2:32:15, 130.50s/it]
 74%|                  | 199/268 [5:01:45<2:21:02, 122.65s/it]
 75%|                  | 200/268 [5:04:22<2:30:37, 132.91s/it]
 75%|                  | 201/268 [5:06:50<2:33:34, 137.52s/it]
 75%|                  | 202/268 [5:08:03<2:09:54, 118.09s/it]
 76%|                  | 203/268 [5:09:34<1:59:08, 109.97s/it]
 76%|                  | 204/268 [5:11:43<2:03:24, 115.69s/it]
 76%|                  | 205/268 [5:14:33<2:18:42, 132.10s/it]
 77%|                  | 206/268 [5:16:10<2:05:27, 121.41s/it]
 77%|                  | 207/268 [5:17:57<1:58:58, 117.02s/it]
 78%|                  | 208/268 [5:19:02<1:41:25, 101.42s/it]
 78%|                  | 209/268 [5:20:24<1:34:00, 95.61s/it] 
 78%|                  | 210/268 [5:22:21<1:38:43, 102.13s/it]
 79%|                  | 211/268 [5:23:53<1:34:02, 98.99s/it] 
 79%|                  | 212/268 [5:26:59<1:56:47, 125.13s/it]
 79%|                  | 213/268 [5:29:19<1:58:51, 129.67s/it]
 80%|                  | 214/268 [5:30:44<1:44:34, 116.20s/it]
 80%|                  | 215/268 [5:32:50<1:45:08, 119.04s/it]
 81%|                  | 216/268 [5:34:20<1:35:50, 110.58s/it]
 81%|                  | 217/268 [5:36:05<1:32:30, 108.84s/it]
 81%|                   | 218/268 [5:37:13<1:20:30, 96.60s/it] 
 82%|                   | 219/268 [5:38:35<1:15:09, 92.03s/it]
 82%|                   | 220/268 [5:40:17<1:16:07, 95.16s/it]
 82%|                   | 221/268 [5:43:06<1:31:48, 117.19s/it]
 83%|                   | 222/268 [5:44:34<1:23:09, 108.46s/it]
 83%|                   | 223/268 [5:46:29<1:22:49, 110.43s/it]
 84%|                   | 224/268 [5:49:32<1:36:53, 132.13s/it]
 84%|                   | 225/268 [5:51:57<1:37:33, 136.12s/it]
 84%|                   | 226/268 [5:54:38<1:40:31, 143.60s/it]
 85%|                   | 227/268 [5:57:36<1:45:07, 153.83s/it]
 85%|                   | 228/268 [5:59:29<1:34:29, 141.73s/it]
 85%|                   | 229/268 [6:01:10<1:24:06, 129.41s/it]
 86%|                   | 230/268 [6:03:50<1:27:47, 138.61s/it]
 86%|                   | 231/268 [6:05:29<1:18:08, 126.71s/it]
 87%|                   | 232/268 [6:07:24<1:13:59, 123.31s/it]
 87%|                   | 233/268 [6:09:04<1:07:52, 116.36s/it]
 87%|                   | 234/268 [6:13:06<1:27:17, 154.04s/it]
 88%|                   | 235/268 [6:15:14<1:20:25, 146.24s/it]
 88%|                   | 236/268 [6:17:14<1:13:39, 138.10s/it]
 88%|                   | 237/268 [6:20:35<1:21:11, 157.15s/it]
 89%|                   | 238/268 [6:22:09<1:09:04, 138.14s/it]
 89%|                   | 239/268 [6:25:01<1:11:39, 148.26s/it]
 90%|                   | 240/268 [6:26:19<59:25, 127.34s/it]  
 90%|                   | 241/268 [6:28:32<58:03, 129.03s/it]
 90%|                   | 242/268 [6:31:13<1:00:03, 138.61s/it]
 91%|                   | 243/268 [6:33:10<54:57, 131.91s/it]  
 91%|                   | 244/268 [6:34:57<49:46, 124.45s/it]
 91%|                    | 245/268 [6:36:26<43:43, 114.05s/it]
 92%|                    | 246/268 [6:38:13<40:58, 111.73s/it]
 92%|                    | 247/268 [6:40:33<42:06, 120.32s/it]
 93%|                    | 248/268 [6:42:24<39:11, 117.57s/it]
 93%|                    | 249/268 [6:45:11<41:53, 132.29s/it]
 93%|                    | 250/268 [17:58:59<61:06:18, 12221.01s/it]
 94%|                    | 251/268 [18:01:30<40:36:39, 8599.97s/it] 
 94%|                    | 252/268 [18:04:57<27:01:56, 6082.26s/it]
 94%|                    | 253/268 [18:07:03<17:53:49, 4295.31s/it]
 95%|                    | 254/268 [18:08:26<11:47:22, 3031.58s/it]
 95%|                    | 255/268 [18:11:26<7:51:30, 2176.19s/it] 
 96%|                    | 256/268 [18:14:02<5:14:00, 1570.08s/it]
 96%|                    | 257/268 [18:16:23<3:29:13, 1141.25s/it]
 96%|                    | 258/268 [18:19:31<2:22:34, 855.43s/it] 
 97%|                    | 259/268 [18:21:10<1:34:15, 628.36s/it]
 97%|                    | 260/268 [18:23:01<1:03:05, 473.23s/it]
 97%|                    | 261/268 [18:25:10<43:09, 369.86s/it]  
 98%|                    | 262/268 [18:27:24<29:55, 299.18s/it]
 98%|                    | 263/268 [18:29:16<20:14, 242.94s/it]
 99%|                    | 264/268 [18:32:16<14:56, 224.25s/it]
 99%|                    | 265/268 [18:35:32<10:47, 215.79s/it]
 99%|                    | 266/268 [18:38:27<06:46, 203.42s/it]
100%|                    | 267/268 [18:40:31<02:59, 179.71s/it]
100%|                    | 268/268 [18:44:20<00:00, 194.54s/it]
100%|                    | 268/268 [18:45:38<00:00, 252.01s/it]
epoch: 3, train loss: 500.1025682136194

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:33<15:59, 33.07s/it]
  7%|           | 2/30 [01:30<22:10, 47.51s/it]
 10%|           | 3/30 [02:21<21:58, 48.83s/it]
 13%|            | 4/30 [03:16<22:18, 51.50s/it]
 17%|            | 5/30 [03:53<19:15, 46.21s/it]
 20%|            | 6/30 [04:56<20:49, 52.07s/it]
 23%|             | 7/30 [05:52<20:22, 53.14s/it]
 27%|             | 8/30 [06:41<18:59, 51.79s/it]
 30%|             | 9/30 [07:46<19:38, 56.13s/it]
 33%|              | 10/30 [08:37<18:08, 54.45s/it]
 37%|              | 11/30 [09:25<16:34, 52.36s/it]
 40%|              | 12/30 [10:15<15:33, 51.86s/it]
 43%|               | 13/30 [11:57<18:57, 66.92s/it]
 47%|               | 14/30 [12:51<16:48, 63.01s/it]
 50%|               | 15/30 [13:13<12:39, 50.60s/it]
 53%|                | 16/30 [14:03<11:46, 50.44s/it]
 57%|                | 17/30 [14:48<10:35, 48.89s/it]
 60%|                | 18/30 [15:12<08:16, 41.39s/it]
 63%|                 | 19/30 [16:13<08:39, 47.21s/it]
 67%|                 | 20/30 [16:49<07:19, 43.92s/it]
 70%|                 | 21/30 [17:50<07:20, 48.90s/it]
 73%|                  | 22/30 [19:02<07:28, 56.05s/it]
 77%|                  | 23/30 [19:43<06:00, 51.44s/it]
 80%|                  | 24/30 [20:52<05:40, 56.68s/it]
 83%|                   | 25/30 [21:28<04:13, 50.64s/it]
 87%|                   | 26/30 [22:02<03:02, 45.57s/it]
 90%|                   | 27/30 [22:51<02:19, 46.54s/it]
 93%|                    | 28/30 [24:18<01:57, 58.79s/it]
 97%|                    | 29/30 [24:57<00:52, 52.73s/it]
100%|                    | 30/30 [25:29<00:00, 46.65s/it]
100%|                    | 30/30 [25:40<00:00, 51.35s/it]
epoch: 3, f1 score: 0.9497536571705223, dev loss: 564.7330729166666
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [02:48<12:28:17, 168.16s/it]
  1%|          | 2/268 [04:35<9:45:50, 132.15s/it] 
  1%|          | 3/268 [06:51<9:52:29, 134.15s/it]
  1%|           | 4/268 [07:58<7:53:56, 107.71s/it]
  2%|           | 5/268 [09:41<7:44:23, 105.95s/it]
  2%|           | 6/268 [10:37<6:27:34, 88.76s/it] 
  3%|           | 7/268 [11:54<6:10:09, 85.09s/it]
  3%|           | 8/268 [12:59<5:41:32, 78.82s/it]
  3%|           | 9/268 [15:30<7:17:12, 101.28s/it]
  4%|           | 10/268 [17:15<7:20:02, 102.33s/it]
  4%|           | 11/268 [19:19<7:47:01, 109.03s/it]
  4%|           | 12/268 [20:54<7:26:34, 104.67s/it]
  5%|           | 13/268 [23:23<8:22:24, 118.21s/it]
  5%|           | 14/268 [25:36<8:39:03, 122.61s/it]
  6%|           | 15/268 [27:25<8:19:55, 118.56s/it]
  6%|           | 16/268 [29:01<7:49:19, 111.74s/it]
  6%|           | 17/268 [30:58<7:54:22, 113.39s/it]
  7%|           | 18/268 [33:51<9:07:03, 131.29s/it]
  7%|           | 19/268 [35:45<8:43:40, 126.19s/it]
  7%|           | 20/268 [37:28<8:11:37, 118.94s/it]
  8%|           | 21/268 [40:06<8:58:28, 130.80s/it]
  8%|           | 22/268 [42:00<8:36:11, 125.90s/it]
  9%|           | 23/268 [42:50<7:01:03, 103.12s/it]
  9%|           | 24/268 [45:33<8:11:55, 120.96s/it]
  9%|           | 25/268 [46:53<7:20:04, 108.66s/it]
 10%|           | 26/268 [48:32<7:06:34, 105.76s/it]
 10%|           | 27/268 [51:55<9:01:29, 134.81s/it]
 10%|           | 28/268 [53:13<7:51:53, 117.97s/it]
 11%|           | 29/268 [54:49<7:23:20, 111.30s/it]
 11%|           | 30/268 [56:27<7:05:14, 107.20s/it]
 12%|            | 31/268 [57:15<5:53:45, 89.56s/it] 
 12%|            | 32/268 [58:35<5:41:10, 86.74s/it]
 12%|            | 33/268 [1:00:10<5:49:43, 89.29s/it]
 13%|            | 34/268 [1:01:25<5:31:32, 85.01s/it]
 13%|            | 35/268 [1:02:42<5:20:16, 82.48s/it]
 13%|            | 36/268 [1:03:40<4:51:01, 75.26s/it]
 14%|            | 37/268 [1:05:32<5:31:20, 86.06s/it]
 14%|            | 38/268 [1:06:40<5:09:26, 80.72s/it]
 15%|            | 39/268 [1:07:49<4:55:05, 77.32s/it]
 15%|            | 40/268 [1:09:28<5:18:33, 83.83s/it]
 15%|            | 41/268 [1:10:45<5:09:22, 81.78s/it]
 16%|            | 42/268 [1:12:35<5:39:10, 90.04s/it]
 16%|            | 43/268 [1:16:10<7:58:36, 127.63s/it]
 16%|            | 44/268 [1:17:24<6:56:38, 111.60s/it]
 17%|            | 45/268 [1:20:36<8:24:29, 135.74s/it]
 17%|            | 46/268 [1:21:37<6:59:07, 113.28s/it]
 18%|            | 47/268 [1:23:58<7:27:26, 121.48s/it]
 18%|            | 48/268 [1:25:32<6:56:01, 113.46s/it]
 18%|            | 49/268 [1:26:30<5:52:25, 96.56s/it] 
 19%|            | 50/268 [1:28:31<6:18:01, 104.04s/it]
 19%|            | 51/268 [1:29:39<5:36:35, 93.07s/it] 
 19%|            | 52/268 [1:30:48<5:09:28, 85.97s/it]
 20%|            | 53/268 [1:32:07<5:01:05, 84.02s/it]
 20%|            | 54/268 [1:36:39<8:20:50, 140.42s/it]
 21%|            | 55/268 [1:38:29<7:45:59, 131.26s/it]
 21%|            | 56/268 [1:39:48<6:47:59, 115.47s/it]
 21%|             | 57/268 [1:40:58<5:58:01, 101.81s/it]
 22%|             | 58/268 [1:41:50<5:04:28, 86.99s/it] 
 22%|             | 59/268 [1:43:41<5:27:29, 94.02s/it]
 22%|             | 60/268 [1:45:20<5:31:21, 95.58s/it]
 23%|             | 61/268 [1:46:39<5:12:32, 90.59s/it]
 23%|             | 62/268 [1:49:27<6:31:17, 113.97s/it]
 24%|             | 63/268 [1:51:36<6:44:45, 118.47s/it]
 24%|             | 64/268 [1:53:57<7:05:00, 125.00s/it]
 24%|             | 65/268 [1:56:45<7:47:18, 138.12s/it]
 25%|             | 66/268 [1:59:22<8:03:55, 143.74s/it]
 25%|             | 67/268 [2:01:28<7:43:43, 138.42s/it]
 25%|             | 68/268 [2:03:04<6:58:38, 125.59s/it]
 26%|             | 69/268 [2:05:14<7:01:15, 127.01s/it]
 26%|             | 70/268 [2:06:22<6:00:40, 109.30s/it]
 26%|             | 71/268 [2:08:07<5:54:53, 108.09s/it]
 27%|             | 72/268 [2:09:28<5:25:37, 99.68s/it] 
 27%|             | 73/268 [2:11:41<5:56:29, 109.69s/it]
 28%|             | 74/268 [2:13:27<5:51:31, 108.72s/it]
 28%|             | 75/268 [2:15:00<5:34:13, 103.90s/it]
 28%|             | 76/268 [2:17:04<5:51:39, 109.89s/it]
 29%|             | 77/268 [2:19:05<6:00:47, 113.34s/it]
 29%|             | 78/268 [2:20:57<5:57:55, 113.03s/it]
 29%|             | 79/268 [2:22:45<5:50:57, 111.42s/it]
 30%|             | 80/268 [2:24:18<5:31:33, 105.81s/it]
 30%|             | 81/268 [2:25:23<4:51:43, 93.60s/it] 
 31%|             | 82/268 [2:27:36<5:26:35, 105.35s/it]
 31%|             | 83/268 [2:28:47<4:53:04, 95.05s/it] 
 31%|              | 84/268 [2:30:26<4:55:18, 96.30s/it]
 32%|              | 85/268 [2:32:06<4:57:18, 97.48s/it]
 32%|              | 86/268 [2:33:17<4:31:39, 89.56s/it]
 32%|              | 87/268 [2:34:47<4:30:29, 89.66s/it]
 33%|              | 88/268 [2:37:21<5:26:30, 108.84s/it]
 33%|              | 89/268 [2:39:06<5:21:45, 107.85s/it]
 34%|              | 90/268 [2:40:31<4:59:47, 101.05s/it]
 34%|              | 91/268 [2:42:15<5:00:39, 101.92s/it]
 34%|              | 92/268 [2:43:36<4:40:23, 95.59s/it] 
 35%|              | 93/268 [2:44:47<4:17:28, 88.28s/it]
 35%|              | 94/268 [2:47:37<5:26:57, 112.75s/it]
 35%|              | 95/268 [2:49:22<5:17:52, 110.24s/it]
 36%|              | 96/268 [2:51:01<5:06:47, 107.02s/it]
 36%|              | 97/268 [2:52:30<4:49:49, 101.69s/it]
 37%|              | 98/268 [2:53:43<4:23:09, 92.88s/it] 
 37%|              | 99/268 [2:56:45<5:37:10, 119.71s/it]
 37%|              | 100/268 [2:58:53<5:41:51, 122.09s/it]
 38%|              | 101/268 [3:00:26<5:16:16, 113.63s/it]
 38%|              | 102/268 [3:02:19<5:13:41, 113.38s/it]
 38%|              | 103/268 [3:03:42<4:46:47, 104.29s/it]
 39%|              | 104/268 [3:05:33<4:50:05, 106.13s/it]
 39%|              | 105/268 [3:06:53<4:27:27, 98.45s/it] 
 40%|              | 106/268 [3:07:55<3:56:01, 87.41s/it]
 40%|              | 107/268 [3:09:50<4:16:36, 95.63s/it]
 40%|              | 108/268 [3:11:07<3:59:56, 89.98s/it]
 41%|              | 109/268 [3:12:05<3:33:01, 80.39s/it]
 41%|              | 110/268 [3:14:26<4:20:03, 98.75s/it]
 41%|               | 111/268 [3:15:55<4:10:47, 95.84s/it]
 42%|               | 112/268 [3:17:11<3:53:44, 89.90s/it]
 42%|               | 113/268 [3:18:16<3:33:09, 82.51s/it]
 43%|               | 114/268 [3:20:53<4:29:03, 104.83s/it]
 43%|               | 115/268 [3:23:06<4:48:29, 113.13s/it]
 43%|               | 116/268 [3:25:02<4:49:11, 114.15s/it]
 44%|               | 117/268 [3:26:24<4:22:51, 104.45s/it]
 44%|               | 118/268 [3:27:31<3:52:54, 93.17s/it] 
 44%|               | 119/268 [3:28:31<3:26:34, 83.19s/it]
 45%|               | 120/268 [3:30:52<4:07:43, 100.43s/it]
 45%|               | 121/268 [3:31:56<3:39:52, 89.74s/it] 
 46%|               | 122/268 [3:33:18<3:32:29, 87.32s/it]
 46%|               | 123/268 [3:35:42<4:11:59, 104.27s/it]
 46%|               | 124/268 [3:36:51<3:45:08, 93.81s/it] 
 47%|               | 125/268 [3:37:57<3:23:36, 85.43s/it]
 47%|               | 126/268 [3:41:55<5:10:41, 131.28s/it]
 47%|               | 127/268 [3:43:13<4:30:47, 115.23s/it]
 48%|               | 128/268 [3:46:01<5:05:39, 130.99s/it]
 48%|               | 129/268 [3:47:54<4:50:40, 125.47s/it]
 49%|               | 130/268 [3:49:29<4:27:38, 116.36s/it]
 49%|               | 131/268 [3:51:06<4:12:56, 110.78s/it]
 49%|               | 132/268 [3:52:06<3:36:29, 95.51s/it] 
 50%|               | 133/268 [3:54:25<4:04:03, 108.47s/it]
 50%|               | 134/268 [3:55:58<3:52:06, 103.93s/it]
 50%|               | 135/268 [3:57:37<3:47:05, 102.44s/it]
 51%|               | 136/268 [3:59:23<3:47:15, 103.30s/it]
 51%|               | 137/268 [4:01:30<4:01:30, 110.61s/it]
 51%|                | 138/268 [4:03:04<3:48:50, 105.62s/it]
 52%|                | 139/268 [4:05:18<4:04:53, 113.90s/it]
 52%|                | 140/268 [4:06:20<3:29:51, 98.37s/it] 
 53%|                | 141/268 [4:07:31<3:11:17, 90.37s/it]
 53%|                | 142/268 [4:11:23<4:38:54, 132.82s/it]
 53%|                | 143/268 [4:13:59<4:50:51, 139.61s/it]
 54%|                | 144/268 [4:16:10<4:43:24, 137.13s/it]
 54%|                | 145/268 [4:17:55<4:21:19, 127.48s/it]
 54%|                | 146/268 [4:19:07<3:45:28, 110.89s/it]
 55%|                | 147/268 [4:20:49<3:37:58, 108.09s/it]
 55%|                | 148/268 [4:22:36<3:35:33, 107.78s/it]
 56%|                | 149/268 [4:24:45<3:46:37, 114.26s/it]
 56%|                | 150/268 [4:26:41<3:45:22, 114.60s/it]
 56%|                | 151/268 [4:27:59<3:22:30, 103.85s/it]
 57%|                | 152/268 [4:28:50<2:49:47, 87.82s/it] 
 57%|                | 153/268 [4:30:08<2:42:33, 84.81s/it]
 57%|                | 154/268 [4:32:47<3:23:36, 107.16s/it]
 58%|                | 155/268 [4:34:43<3:26:46, 109.79s/it]
 58%|                | 156/268 [4:35:51<3:01:47, 97.38s/it] 
 59%|                | 157/268 [4:36:53<2:40:19, 86.66s/it]
 59%|                | 158/268 [4:37:54<2:24:59, 79.08s/it]
 59%|                | 159/268 [4:39:22<2:28:32, 81.77s/it]
 60%|                | 160/268 [4:41:07<2:39:23, 88.55s/it]
 60%|                | 161/268 [4:42:19<2:29:00, 83.56s/it]
 60%|                | 162/268 [4:43:51<2:32:27, 86.30s/it]
 61%|                | 163/268 [4:45:14<2:29:08, 85.23s/it]
 61%|                | 164/268 [4:46:34<2:24:57, 83.63s/it]
 62%|                 | 165/268 [4:47:43<2:16:09, 79.31s/it]
 62%|                 | 166/268 [4:49:36<2:31:55, 89.37s/it]
 62%|                 | 167/268 [4:51:00<2:27:40, 87.73s/it]
 63%|                 | 168/268 [4:53:07<2:45:58, 99.59s/it]
 63%|                 | 169/268 [4:55:10<2:55:42, 106.49s/it]
 63%|                 | 170/268 [4:58:01<3:25:43, 125.96s/it]
 64%|                 | 171/268 [5:00:38<3:38:28, 135.14s/it]
 64%|                 | 172/268 [5:01:42<3:02:04, 113.80s/it]
 65%|                 | 173/268 [5:03:27<2:55:58, 111.14s/it]
 65%|                 | 174/268 [5:06:11<3:18:58, 127.01s/it]
 65%|                 | 175/268 [5:07:26<2:52:47, 111.48s/it]
 66%|                 | 176/268 [5:10:22<3:20:34, 130.81s/it]
 66%|                 | 177/268 [5:12:33<3:18:25, 130.83s/it]
 66%|                 | 178/268 [5:13:53<2:53:38, 115.76s/it]
 67%|                 | 179/268 [5:15:09<2:33:45, 103.66s/it]
 67%|                 | 180/268 [5:16:09<2:12:46, 90.53s/it] 
 68%|                 | 181/268 [5:17:08<1:57:37, 81.12s/it]
 68%|                 | 182/268 [5:19:11<2:14:13, 93.65s/it]
 68%|                 | 183/268 [5:20:30<2:06:31, 89.31s/it]
 69%|                 | 184/268 [5:22:35<2:19:54, 99.94s/it]
 69%|                 | 185/268 [5:24:31<2:24:57, 104.78s/it]
 69%|                 | 186/268 [5:25:58<2:16:02, 99.54s/it] 
 70%|                 | 187/268 [5:27:54<2:21:06, 104.53s/it]
 70%|                 | 188/268 [5:29:22<2:12:35, 99.44s/it] 
 71%|                 | 189/268 [5:31:13<2:15:47, 103.14s/it]
 71%|                 | 190/268 [5:32:22<2:00:32, 92.72s/it] 
 71%|                  | 191/268 [5:33:19<1:45:05, 81.89s/it]
 72%|                  | 192/268 [5:34:33<1:40:59, 79.72s/it]
 72%|                  | 193/268 [5:35:38<1:34:09, 75.33s/it]
 72%|                  | 194/268 [5:37:11<1:39:27, 80.65s/it]
 73%|                  | 195/268 [5:38:21<1:34:03, 77.31s/it]
 73%|                  | 196/268 [5:39:20<1:26:09, 71.80s/it]
 74%|                  | 197/268 [5:40:53<1:32:28, 78.14s/it]
 74%|                  | 198/268 [5:42:16<1:32:57, 79.67s/it]
 74%|                  | 199/268 [5:44:30<1:50:16, 95.89s/it]
 75%|                  | 200/268 [5:45:40<1:39:59, 88.23s/it]
 75%|                  | 201/268 [5:47:45<1:50:45, 99.19s/it]
 75%|                  | 202/268 [5:48:58<1:40:34, 91.43s/it]
 76%|                  | 203/268 [5:50:20<1:35:55, 88.55s/it]
 76%|                  | 204/268 [5:51:23<1:26:21, 80.96s/it]
 76%|                  | 205/268 [5:52:31<1:20:44, 76.89s/it]
 77%|                  | 206/268 [5:54:25<1:31:00, 88.07s/it]
 77%|                  | 207/268 [5:57:13<1:53:50, 111.97s/it]
 78%|                  | 208/268 [5:58:34<1:42:44, 102.75s/it]
 78%|                  | 209/268 [6:01:07<1:55:52, 117.83s/it]
 78%|                  | 210/268 [6:02:33<1:44:42, 108.31s/it]
 79%|                  | 211/268 [6:04:29<1:45:08, 110.68s/it]
 79%|                  | 212/268 [6:06:18<1:42:48, 110.16s/it]
 79%|                  | 213/268 [6:07:34<1:31:42, 100.05s/it]
 80%|                  | 214/268 [6:09:53<1:40:18, 111.45s/it]
 80%|                  | 215/268 [6:11:00<1:26:44, 98.20s/it] 
 81%|                  | 216/268 [6:12:02<1:15:46, 87.43s/it]
 81%|                  | 217/268 [6:13:40<1:16:56, 90.52s/it]
 81%|                   | 218/268 [6:15:01<1:13:07, 87.76s/it]
 82%|                   | 219/268 [6:17:14<1:22:42, 101.28s/it]
 82%|                   | 220/268 [6:18:49<1:19:27, 99.33s/it] 
 82%|                   | 221/268 [6:20:10<1:13:38, 94.02s/it]
 83%|                   | 222/268 [6:22:55<1:28:23, 115.29s/it]
 83%|                   | 223/268 [6:24:55<1:27:21, 116.47s/it]
 84%|                   | 224/268 [6:26:59<1:27:10, 118.88s/it]
 84%|                   | 225/268 [6:28:27<1:18:37, 109.72s/it]
 84%|                   | 226/268 [6:30:29<1:19:12, 113.14s/it]
 85%|                   | 227/268 [6:32:11<1:15:03, 109.83s/it]
 85%|                   | 228/268 [6:34:30<1:19:10, 118.76s/it]
 85%|                   | 229/268 [6:35:31<1:05:51, 101.33s/it]
 86%|                   | 230/268 [6:37:00<1:01:54, 97.76s/it] 
 86%|                   | 231/268 [6:41:03<1:27:02, 141.15s/it]
 87%|                   | 232/268 [6:42:40<1:16:46, 127.96s/it]
 87%|                   | 233/268 [6:44:12<1:08:17, 117.07s/it]
 87%|                   | 234/268 [6:46:35<1:10:46, 124.91s/it]
 88%|                   | 235/268 [6:48:05<1:02:54, 114.39s/it]
 88%|                   | 236/268 [6:50:22<1:04:40, 121.27s/it]
 88%|                   | 237/268 [6:51:43<56:29, 109.34s/it]  
 89%|                   | 238/268 [6:53:54<57:52, 115.77s/it]
 89%|                   | 239/268 [6:56:12<59:05, 122.24s/it]
 90%|                   | 240/268 [6:57:56<54:36, 117.01s/it]
 90%|                   | 241/268 [7:01:00<1:01:38, 136.98s/it]
 90%|                   | 242/268 [7:02:23<52:18, 120.70s/it]  
 91%|                   | 243/268 [7:04:14<49:09, 118.00s/it]
 91%|                   | 244/268 [7:06:24<48:38, 121.61s/it]
 91%|                    | 245/268 [7:08:17<45:33, 118.84s/it]
 92%|                    | 246/268 [7:10:18<43:52, 119.64s/it]
 92%|                    | 247/268 [7:11:32<37:05, 105.96s/it]
 93%|                    | 248/268 [7:15:16<47:07, 141.35s/it]
 93%|                    | 249/268 [7:16:37<39:00, 123.16s/it]
 93%|                    | 250/268 [7:18:32<36:13, 120.75s/it]
 94%|                    | 251/268 [7:19:52<30:45, 108.54s/it]
 94%|                    | 252/268 [7:21:11<26:34, 99.68s/it] 
 94%|                    | 253/268 [7:22:53<25:03, 100.21s/it]
 95%|                    | 254/268 [7:24:29<23:05, 98.97s/it] 
 95%|                    | 255/268 [7:27:43<27:40, 127.71s/it]
 96%|                    | 256/268 [7:29:30<24:15, 121.33s/it]
 96%|                    | 257/268 [7:32:40<26:03, 142.09s/it]
 96%|                    | 258/268 [7:34:46<22:52, 137.25s/it]
 97%|                    | 259/268 [7:37:14<21:03, 140.37s/it]
 97%|                    | 260/268 [7:39:37<18:50, 141.27s/it]
 97%|                    | 261/268 [7:40:57<14:19, 122.74s/it]
 98%|                    | 262/268 [7:42:50<11:58, 119.74s/it]
 98%|                    | 263/268 [7:45:25<10:52, 130.41s/it]
 99%|                    | 264/268 [7:48:16<09:30, 142.68s/it]
 99%|                    | 265/268 [7:50:04<06:36, 132.14s/it]
 99%|                    | 266/268 [7:54:31<05:45, 172.67s/it]
100%|                    | 267/268 [7:56:15<02:32, 152.00s/it]
100%|                    | 268/268 [7:58:49<00:00, 152.72s/it]
100%|                    | 268/268 [7:59:56<00:00, 107.45s/it]
epoch: 4, train loss: 296.1896034923952

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:25<12:07, 25.08s/it]
  7%|           | 2/30 [01:03<15:28, 33.16s/it]
 10%|           | 3/30 [01:45<16:40, 37.06s/it]
 13%|            | 4/30 [02:36<18:25, 42.52s/it]
 17%|            | 5/30 [03:44<21:34, 51.78s/it]
 20%|            | 6/30 [04:40<21:16, 53.19s/it]
 23%|             | 7/30 [06:04<24:15, 63.28s/it]
 27%|             | 8/30 [07:51<28:19, 77.24s/it]
 30%|             | 9/30 [08:47<24:40, 70.48s/it]
 33%|              | 10/30 [09:13<18:57, 56.89s/it]
 37%|              | 11/30 [10:12<18:09, 57.35s/it]
 40%|              | 12/30 [10:46<15:03, 50.21s/it]
 43%|               | 13/30 [11:59<16:14, 57.32s/it]
 47%|               | 14/30 [13:06<16:02, 60.16s/it]
 50%|               | 15/30 [13:33<12:32, 50.17s/it]
 53%|                | 16/30 [14:36<12:36, 54.00s/it]
 57%|                | 17/30 [15:10<10:25, 48.10s/it]
 60%|                | 18/30 [15:55<09:24, 47.00s/it]
 63%|                 | 19/30 [16:58<09:28, 51.72s/it]
 67%|                 | 20/30 [18:23<10:19, 61.96s/it]
 70%|                 | 21/30 [19:13<08:44, 58.26s/it]
 73%|                  | 22/30 [20:24<08:16, 62.05s/it]
 77%|                  | 23/30 [21:12<06:45, 57.90s/it]
 80%|                  | 24/30 [22:27<06:18, 63.15s/it]
 83%|                   | 25/30 [23:10<04:44, 56.87s/it]
 87%|                   | 26/30 [23:39<03:14, 48.70s/it]
 90%|                   | 27/30 [24:15<02:14, 44.92s/it]
 93%|                    | 28/30 [24:46<01:21, 40.66s/it]
 97%|                    | 29/30 [25:32<00:42, 42.19s/it]
100%|                    | 30/30 [26:09<00:00, 40.58s/it]
100%|                    | 30/30 [26:17<00:00, 52.59s/it]
epoch: 4, f1 score: 0.9559617074761144, dev loss: 508.99427083333336
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [02:48<12:28:43, 168.25s/it]
  1%|          | 2/268 [04:52<10:32:11, 142.60s/it]
  1%|          | 3/268 [07:56<11:51:52, 161.18s/it]
  1%|           | 4/268 [08:55<8:52:55, 121.12s/it] 
  2%|           | 5/268 [10:39<8:22:53, 114.73s/it]
  2%|           | 6/268 [11:52<7:18:39, 100.46s/it]
  3%|           | 7/268 [13:38<7:24:49, 102.26s/it]
  3%|           | 8/268 [15:13<7:13:52, 100.12s/it]
  3%|           | 9/268 [18:50<9:50:28, 136.79s/it]
  4%|           | 10/268 [19:59<8:17:18, 115.65s/it]
  4%|           | 11/268 [20:47<6:46:27, 94.89s/it] 
  4%|           | 12/268 [22:43<7:12:11, 101.29s/it]
  5%|           | 13/268 [25:07<8:05:49, 114.31s/it]
  5%|           | 14/268 [27:13<8:18:39, 117.79s/it]
  6%|           | 15/268 [30:59<10:34:59, 150.59s/it]
  6%|           | 16/268 [32:15<8:58:14, 128.15s/it] 
  6%|           | 17/268 [34:13<8:43:05, 125.04s/it]
  7%|           | 18/268 [35:45<7:58:55, 114.94s/it]
  7%|           | 19/268 [38:46<9:19:48, 134.90s/it]
  7%|           | 20/268 [41:49<10:17:30, 149.40s/it]
  8%|           | 21/268 [43:20<9:02:59, 131.90s/it] 
  8%|           | 22/268 [45:07<8:30:02, 124.40s/it]
  9%|           | 23/268 [46:08<7:09:52, 105.28s/it]
  9%|           | 24/268 [47:55<7:09:51, 105.70s/it]
  9%|           | 25/268 [48:47<6:03:31, 89.76s/it] 
 10%|           | 26/268 [51:13<7:09:36, 106.51s/it]
 10%|           | 27/268 [52:43<6:47:55, 101.56s/it]
 10%|           | 28/268 [53:22<5:31:40, 82.92s/it] 
 11%|           | 29/268 [54:31<5:13:35, 78.73s/it]
 11%|           | 30/268 [55:49<5:11:50, 78.62s/it]
 12%|            | 31/268 [56:50<4:48:46, 73.11s/it]
 12%|            | 32/268 [57:50<4:32:11, 69.20s/it]
 12%|            | 33/268 [58:39<4:07:14, 63.13s/it]
 13%|            | 34/268 [59:22<3:43:26, 57.29s/it]
 13%|            | 35/268 [1:00:58<4:26:39, 68.67s/it]
 13%|            | 36/268 [1:01:47<4:03:23, 62.95s/it]
 14%|            | 37/268 [1:03:07<4:22:23, 68.16s/it]
 14%|            | 38/268 [1:04:15<4:20:55, 68.07s/it]
 15%|            | 39/268 [1:05:22<4:18:27, 67.72s/it]
 15%|            | 40/268 [1:07:26<5:20:38, 84.38s/it]
 15%|            | 41/268 [1:09:30<6:05:11, 96.53s/it]
 16%|            | 42/268 [1:12:29<7:36:46, 121.27s/it]
 16%|            | 43/268 [1:14:16<7:17:57, 116.79s/it]
 16%|            | 44/268 [1:15:25<6:23:01, 102.60s/it]
 17%|            | 45/268 [1:16:19<5:26:24, 87.82s/it] 
 17%|            | 46/268 [1:18:53<6:38:20, 107.66s/it]
 18%|            | 47/268 [1:19:58<5:49:38, 94.93s/it] 
 18%|            | 48/268 [1:21:17<5:31:09, 90.32s/it]
 18%|            | 49/268 [1:22:34<5:14:34, 86.18s/it]
 19%|            | 50/268 [1:25:22<6:42:34, 110.80s/it]
 19%|            | 51/268 [1:26:55<6:21:41, 105.54s/it]
 19%|            | 52/268 [1:27:49<5:24:07, 90.03s/it] 
 20%|            | 53/268 [1:30:01<6:07:13, 102.48s/it]
 20%|            | 54/268 [1:31:10<5:29:44, 92.45s/it] 
 21%|            | 55/268 [1:32:44<5:29:41, 92.87s/it]
 21%|            | 56/268 [1:35:01<6:15:10, 106.18s/it]
 21%|             | 57/268 [1:35:45<5:08:10, 87.63s/it] 
 22%|             | 58/268 [1:37:01<4:54:06, 84.03s/it]
 22%|             | 59/268 [1:38:18<4:45:37, 82.00s/it]
 22%|             | 60/268 [1:39:13<4:15:59, 73.84s/it]
 23%|             | 61/268 [1:40:38<4:26:04, 77.12s/it]
 23%|             | 62/268 [14:01:49<766:30:24, 13395.26s/it]
 24%|             | 63/268 [14:02:51<535:01:17, 9395.50s/it] 
 24%|             | 64/268 [14:04:14<374:05:27, 6601.61s/it]
 24%|             | 65/268 [14:05:25<261:47:19, 4642.56s/it]
 25%|             | 66/268 [14:07:52<184:49:21, 3293.87s/it]
 25%|             | 67/268 [14:09:05<129:57:07, 2327.50s/it]
 25%|             | 68/268 [14:10:03<91:29:12, 1646.76s/it] 
 26%|             | 69/268 [14:11:11<64:50:11, 1172.92s/it]
 26%|             | 70/268 [14:12:24<46:22:24, 843.15s/it] 
 26%|             | 71/268 [14:16:53<36:42:46, 670.90s/it]
 27%|             | 72/268 [14:19:34<28:11:51, 517.92s/it]
 27%|             | 73/268 [14:21:05<21:06:47, 389.78s/it]
 28%|             | 74/268 [14:21:59<15:34:40, 289.08s/it]
 28%|             | 75/268 [14:23:31<12:19:11, 229.80s/it]
 28%|             | 76/268 [14:24:45<9:46:00, 183.13s/it] 
 29%|             | 77/268 [14:25:46<7:46:29, 146.54s/it]
 29%|             | 78/268 [14:26:55<6:30:01, 123.17s/it]
 29%|             | 79/268 [14:28:26<5:57:52, 113.61s/it]
 30%|             | 80/268 [14:30:20<5:56:10, 113.67s/it]
 30%|             | 81/268 [14:31:41<5:24:00, 103.96s/it]
 31%|             | 82/268 [14:33:34<5:30:17, 106.55s/it]
 31%|             | 83/268 [14:35:52<5:58:18, 116.21s/it]
 31%|              | 84/268 [14:36:58<5:09:35, 100.96s/it]
 32%|              | 85/268 [14:38:19<4:50:11, 95.14s/it] 
 32%|              | 86/268 [14:39:37<4:32:52, 89.96s/it]
 32%|              | 87/268 [14:40:50<4:15:36, 84.73s/it]
 33%|              | 88/268 [14:41:44<3:47:00, 75.67s/it]
 33%|              | 89/268 [14:43:42<4:23:11, 88.22s/it]
 34%|              | 90/268 [14:45:52<4:59:08, 100.84s/it]
 34%|              | 91/268 [14:47:43<5:06:17, 103.83s/it]
 34%|              | 92/268 [14:48:41<4:24:03, 90.02s/it] 
 35%|              | 93/268 [14:49:44<3:58:56, 81.92s/it]
 35%|              | 94/268 [14:50:35<3:30:48, 72.69s/it]
 35%|              | 95/268 [14:51:59<3:40:01, 76.31s/it]
 36%|              | 96/268 [14:52:47<3:13:51, 67.63s/it]
 36%|              | 97/268 [14:54:19<3:33:45, 75.00s/it]
 37%|              | 98/268 [14:55:17<3:18:20, 70.00s/it]
 37%|              | 99/268 [14:56:45<3:32:05, 75.30s/it]
 37%|              | 100/268 [14:58:19<3:46:08, 80.76s/it]
 38%|              | 101/268 [15:00:40<4:35:13, 98.88s/it]
 38%|              | 102/268 [15:01:56<4:14:43, 92.07s/it]
 38%|              | 103/268 [15:02:45<3:37:30, 79.10s/it]
 39%|              | 104/268 [15:05:05<4:26:06, 97.36s/it]
 39%|              | 105/268 [15:07:29<5:03:00, 111.54s/it]
 40%|              | 106/268 [15:08:48<4:34:09, 101.54s/it]
 40%|              | 107/268 [15:10:07<4:15:02, 95.05s/it] 
 40%|              | 108/268 [15:11:23<3:57:58, 89.24s/it]
 41%|              | 109/268 [15:13:26<4:22:53, 99.20s/it]
 41%|              | 110/268 [15:14:55<4:13:10, 96.14s/it]
 41%|               | 111/268 [15:16:16<4:00:18, 91.84s/it]
 42%|               | 112/268 [15:17:25<3:41:03, 85.02s/it]
 42%|               | 113/268 [15:18:35<3:27:14, 80.22s/it]
 43%|               | 114/268 [15:20:20<3:45:00, 87.67s/it]
 43%|               | 115/268 [15:21:21<3:23:15, 79.71s/it]
 43%|               | 116/268 [15:24:21<4:38:39, 110.00s/it]
 44%|               | 117/268 [15:25:11<3:51:24, 91.95s/it] 
 44%|               | 118/268 [15:27:21<4:18:19, 103.33s/it]
 44%|               | 119/268 [15:29:15<4:24:49, 106.64s/it]
 45%|               | 120/268 [15:31:18<4:34:46, 111.39s/it]
 45%|               | 121/268 [15:33:46<4:59:29, 122.24s/it]
 46%|               | 122/268 [15:35:02<4:24:01, 108.50s/it]
 46%|               | 123/268 [15:35:52<3:39:44, 90.93s/it] 
 46%|               | 124/268 [15:38:27<4:24:37, 110.26s/it]
 47%|               | 125/268 [15:40:36<4:36:17, 115.93s/it]
 47%|               | 126/268 [15:42:26<4:30:02, 114.10s/it]
 47%|               | 127/268 [15:44:32<4:36:22, 117.61s/it]
 48%|               | 128/268 [15:46:29<4:34:17, 117.55s/it]
 48%|               | 129/268 [15:48:12<4:22:08, 113.16s/it]
 49%|               | 130/268 [15:50:55<4:54:35, 128.08s/it]
 49%|               | 131/268 [15:53:00<4:50:25, 127.20s/it]
 49%|               | 132/268 [15:54:52<4:37:37, 122.48s/it]
 50%|               | 133/268 [15:56:26<4:16:37, 114.06s/it]
 50%|               | 134/268 [15:57:15<3:30:58, 94.47s/it] 
 50%|               | 135/268 [15:59:55<4:13:09, 114.21s/it]
 51%|               | 136/268 [16:00:53<3:33:39, 97.12s/it] 
 51%|               | 137/268 [16:02:21<3:26:22, 94.52s/it]
 51%|                | 138/268 [16:04:29<3:46:45, 104.66s/it]
 52%|                | 139/268 [16:06:34<3:58:01, 110.71s/it]
 52%|                | 140/268 [16:08:20<3:52:57, 109.20s/it]
 53%|                | 141/268 [16:09:48<3:37:35, 102.80s/it]
 53%|                | 142/268 [16:10:54<3:12:59, 91.90s/it] 
 53%|                | 143/268 [16:12:05<2:58:28, 85.67s/it]
 54%|                | 144/268 [16:14:03<3:16:54, 95.28s/it]
 54%|                | 145/268 [16:19:17<5:29:49, 160.89s/it]
 54%|                | 146/268 [16:20:34<4:35:43, 135.60s/it]
 55%|                | 147/268 [16:23:21<4:52:33, 145.07s/it]
 55%|                | 148/268 [16:25:05<4:25:41, 132.84s/it]
 56%|                | 149/268 [16:26:28<3:53:50, 117.90s/it]
 56%|                | 150/268 [16:29:09<4:17:28, 130.92s/it]
 56%|                | 151/268 [16:30:35<3:48:42, 117.29s/it]
 57%|                | 152/268 [16:31:57<3:26:17, 106.70s/it]
 57%|                | 153/268 [16:33:03<3:00:57, 94.41s/it] 
 57%|                | 154/268 [16:34:47<3:05:19, 97.54s/it]
 58%|                | 155/268 [16:36:00<2:49:29, 89.99s/it]
 58%|                | 156/268 [16:37:22<2:43:27, 87.57s/it]
 59%|                | 157/268 [16:38:26<2:28:55, 80.50s/it]
 59%|                | 158/268 [16:41:45<3:33:03, 116.21s/it]
 59%|                | 159/268 [16:43:04<3:10:57, 105.11s/it]
 60%|                | 160/268 [16:44:08<2:46:32, 92.52s/it] 
 60%|                | 161/268 [16:45:23<2:35:56, 87.45s/it]
 60%|                | 162/268 [16:46:38<2:28:00, 83.78s/it]
 61%|                | 163/268 [16:48:23<2:37:26, 89.97s/it]
 61%|                | 164/268 [16:50:35<2:58:03, 102.73s/it]
 62%|                 | 165/268 [16:52:07<2:50:46, 99.48s/it] 
 62%|                 | 166/268 [16:53:25<2:37:47, 92.82s/it]
 62%|                 | 167/268 [16:55:04<2:39:45, 94.90s/it]
 63%|                 | 168/268 [16:56:53<2:44:57, 98.97s/it]
 63%|                 | 169/268 [16:58:45<2:50:05, 103.09s/it]
 63%|                 | 170/268 [16:59:53<2:30:47, 92.32s/it] 
 64%|                 | 171/268 [17:01:53<2:42:54, 100.77s/it]
 64%|                 | 172/268 [17:03:40<2:44:16, 102.67s/it]
 65%|                 | 173/268 [17:06:03<3:01:49, 114.84s/it]
 65%|                 | 174/268 [17:07:41<2:51:32, 109.49s/it]
 65%|                 | 175/268 [17:09:06<2:38:24, 102.20s/it]
 66%|                 | 176/268 [17:10:36<2:31:06, 98.55s/it] 
 66%|                 | 177/268 [17:11:34<2:11:00, 86.38s/it]
 66%|                 | 178/268 [17:13:49<2:31:35, 101.06s/it]
 67%|                 | 179/268 [17:15:50<2:38:53, 107.12s/it]
 67%|                 | 180/268 [17:17:02<2:21:44, 96.64s/it] 
 68%|                 | 181/268 [17:19:24<2:39:26, 109.96s/it]
 68%|                 | 182/268 [17:20:35<2:20:56, 98.33s/it] 
 68%|                 | 183/268 [17:21:47<2:08:03, 90.39s/it]
 69%|                 | 184/268 [17:23:28<2:11:10, 93.70s/it]
 69%|                 | 185/268 [17:25:49<2:29:12, 107.86s/it]
 69%|                 | 186/268 [17:27:08<2:15:45, 99.33s/it] 
 70%|                 | 187/268 [17:28:31<2:07:13, 94.24s/it]
 70%|                 | 188/268 [17:30:06<2:05:59, 94.50s/it]
 71%|                 | 189/268 [17:30:52<1:45:24, 80.06s/it]
 71%|                 | 190/268 [17:31:40<1:31:19, 70.25s/it]
 71%|                  | 191/268 [17:33:13<1:38:59, 77.13s/it]
 72%|                  | 192/268 [17:35:24<1:58:14, 93.35s/it]
 72%|                  | 193/268 [17:36:17<1:41:38, 81.31s/it]
 72%|                  | 194/268 [17:37:39<1:40:25, 81.42s/it]
 73%|                  | 195/268 [17:38:34<1:29:19, 73.42s/it]
 73%|                  | 196/268 [17:39:36<1:24:08, 70.11s/it]
 74%|                  | 197/268 [17:41:49<1:45:21, 89.04s/it]
 74%|                  | 198/268 [17:44:32<2:09:43, 111.20s/it]
 74%|                  | 199/268 [17:46:06<2:01:57, 106.05s/it]
 75%|                  | 200/268 [17:48:24<2:10:51, 115.47s/it]
 75%|                  | 201/268 [17:50:35<2:14:08, 120.12s/it]
 75%|                  | 202/268 [17:51:36<1:52:40, 102.43s/it]
 76%|                  | 203/268 [17:52:55<1:43:24, 95.46s/it] 
 76%|                  | 204/268 [17:54:15<1:37:00, 90.95s/it]
 76%|                  | 205/268 [17:55:23<1:28:02, 83.84s/it]
 77%|                  | 206/268 [17:57:38<1:42:29, 99.19s/it]
 77%|                  | 207/268 [17:59:13<1:39:38, 98.01s/it]
 78%|                  | 208/268 [18:00:46<1:36:42, 96.71s/it]
 78%|                  | 209/268 [18:02:48<1:42:28, 104.22s/it]
 78%|                  | 210/268 [18:03:53<1:29:10, 92.26s/it] 
 79%|                  | 211/268 [18:05:13<1:24:17, 88.73s/it]
 79%|                  | 212/268 [18:06:36<1:21:12, 87.00s/it]
 79%|                  | 213/268 [18:08:56<1:34:22, 102.96s/it]
 80%|                  | 214/268 [18:10:08<1:24:18, 93.67s/it] 
 80%|                  | 215/268 [18:11:35<1:20:58, 91.66s/it]
 81%|                  | 216/268 [18:12:47<1:14:21, 85.79s/it]
 81%|                  | 217/268 [18:14:02<1:10:09, 82.53s/it]
 81%|                   | 218/268 [18:15:29<1:09:45, 83.70s/it]
 82%|                   | 219/268 [18:17:27<1:16:57, 94.23s/it]
 82%|                   | 220/268 [18:18:43<1:10:56, 88.68s/it]
 82%|                   | 221/268 [18:19:58<1:06:19, 84.67s/it]
 83%|                   | 222/268 [18:21:10<1:01:50, 80.66s/it]
 83%|                   | 223/268 [18:22:39<1:02:23, 83.20s/it]
 84%|                   | 224/268 [18:23:42<56:31, 77.07s/it]  
 84%|                   | 225/268 [18:25:15<58:39, 81.85s/it]
 84%|                   | 226/268 [18:26:07<51:00, 72.87s/it]
 85%|                   | 227/268 [18:27:07<47:10, 69.03s/it]
 85%|                   | 228/268 [18:29:20<58:55, 88.38s/it]
 85%|                   | 229/268 [18:30:32<54:11, 83.36s/it]
 86%|                   | 230/268 [18:31:53<52:24, 82.76s/it]
 86%|                   | 231/268 [18:34:08<1:00:35, 98.27s/it]
 87%|                   | 232/268 [18:36:22<1:05:23, 108.99s/it]
 87%|                   | 233/268 [18:38:35<1:07:52, 116.37s/it]
 87%|                   | 234/268 [18:40:11<1:02:24, 110.12s/it]
 88%|                   | 235/268 [18:42:03<1:00:49, 110.60s/it]
 88%|                   | 236/268 [18:43:43<57:21, 107.55s/it]  
 88%|                   | 237/268 [18:48:12<1:20:39, 156.11s/it]
 89%|                   | 238/268 [18:49:33<1:06:41, 133.39s/it]
 89%|                   | 239/268 [18:50:38<54:38, 113.07s/it]  
 90%|                   | 240/268 [18:52:41<54:09, 116.07s/it]
 90%|                   | 241/268 [18:54:58<54:57, 122.12s/it]
 90%|                   | 242/268 [18:57:08<53:59, 124.58s/it]
 91%|                   | 243/268 [18:58:37<47:30, 114.03s/it]
 91%|                   | 244/268 [19:00:49<47:40, 119.18s/it]
 91%|                    | 245/268 [19:02:19<42:24, 110.63s/it]
 92%|                    | 246/268 [19:03:49<38:18, 104.49s/it]
 92%|                    | 247/268 [19:05:10<34:03, 97.33s/it] 
 93%|                    | 248/268 [19:06:20<29:39, 88.97s/it]
 93%|                    | 249/268 [19:07:59<29:08, 92.01s/it]
 93%|                    | 250/268 [19:08:59<24:44, 82.45s/it]
 94%|                    | 251/268 [19:10:22<23:26, 82.71s/it]
 94%|                    | 252/268 [19:12:02<23:24, 87.76s/it]
 94%|                    | 253/268 [19:14:14<25:17, 101.18s/it]
 95%|                    | 254/268 [19:18:21<33:50, 145.01s/it]
 95%|                    | 255/268 [19:21:16<33:20, 153.91s/it]
 96%|                    | 256/268 [19:23:57<31:13, 156.14s/it]
 96%|                    | 257/268 [19:25:29<25:05, 136.84s/it]
 96%|                    | 258/268 [19:26:58<20:25, 122.54s/it]
 97%|                    | 259/268 [19:30:40<22:49, 152.14s/it]
 97%|                    | 260/268 [19:33:15<20:25, 153.24s/it]
 97%|                    | 261/268 [19:35:46<17:47, 152.44s/it]
 98%|                    | 262/268 [19:38:11<15:01, 150.26s/it]
 98%|                    | 263/268 [19:40:02<11:32, 138.41s/it]
 99%|                    | 264/268 [19:42:04<08:53, 133.37s/it]
 99%|                    | 265/268 [19:44:15<06:38, 132.76s/it]
 99%|                    | 266/268 [19:45:40<03:57, 118.51s/it]
100%|                    | 267/268 [19:48:09<02:07, 127.74s/it]
100%|                    | 268/268 [19:50:06<00:00, 124.44s/it]
100%|                    | 268/268 [19:51:02<00:00, 266.65s/it]
epoch: 5, train loss: 219.44269365339136

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:57<27:35, 57.09s/it]
  7%|           | 2/30 [02:02<28:56, 62.01s/it]
 10%|           | 3/30 [03:29<32:58, 73.30s/it]
 13%|            | 4/30 [04:29<29:27, 67.99s/it]
 17%|            | 5/30 [05:04<23:25, 56.20s/it]
 20%|            | 6/30 [06:15<24:29, 61.25s/it]
 23%|             | 7/30 [06:54<20:44, 54.10s/it]
 27%|             | 8/30 [08:13<22:41, 61.88s/it]
 30%|             | 9/30 [09:26<22:55, 65.49s/it]
 33%|              | 10/30 [10:35<22:06, 66.34s/it]
 37%|              | 11/30 [11:29<19:49, 62.59s/it]
 40%|              | 12/30 [11:53<15:18, 51.01s/it]
 43%|               | 13/30 [13:38<19:03, 67.27s/it]
 47%|               | 14/30 [14:26<16:24, 61.54s/it]
 50%|               | 15/30 [15:31<15:36, 62.42s/it]
 53%|                | 16/30 [16:14<13:13, 56.65s/it]
 57%|                | 17/30 [17:56<15:13, 70.29s/it]
 60%|                | 18/30 [18:40<12:28, 62.36s/it]
 63%|                 | 19/30 [19:33<10:55, 59.63s/it]
 67%|                 | 20/30 [20:10<08:48, 52.85s/it]
 70%|                 | 21/30 [20:49<07:16, 48.55s/it]
 73%|                  | 22/30 [21:22<05:51, 43.95s/it]
 77%|                  | 23/30 [22:06<05:08, 44.03s/it]
 80%|                  | 24/30 [22:59<04:40, 46.81s/it]
 83%|                   | 25/30 [23:42<03:47, 45.45s/it]
 87%|                   | 26/30 [24:35<03:11, 47.81s/it]
 90%|                   | 27/30 [25:46<02:44, 54.78s/it]
 93%|                    | 28/30 [26:23<01:38, 49.42s/it]
 97%|                    | 29/30 [27:04<00:47, 47.05s/it]
100%|                    | 30/30 [28:02<00:00, 50.07s/it]
100%|                    | 30/30 [28:13<00:00, 56.44s/it]
epoch: 5, f1 score: 0.9562274922729378, dev loss: 522.7730143229167
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [02:11<9:44:29, 131.35s/it]
  1%|          | 2/268 [04:26<9:53:10, 133.80s/it]
  1%|          | 3/268 [05:39<7:48:33, 106.09s/it]
  1%|           | 4/268 [07:05<7:11:00, 97.96s/it] 
  2%|           | 5/268 [10:14<9:33:19, 130.80s/it]
  2%|           | 6/268 [13:50<11:37:39, 159.77s/it]
  3%|           | 7/268 [17:41<13:15:58, 182.98s/it]
  3%|           | 8/268 [19:00<10:49:49, 149.96s/it]
  3%|           | 9/268 [21:28<10:45:04, 149.44s/it]
  4%|           | 10/268 [23:37<10:15:15, 143.08s/it]
  4%|           | 11/268 [25:31<9:34:22, 134.10s/it] 
  4%|           | 12/268 [28:36<10:38:30, 149.65s/it]
  5%|           | 13/268 [29:44<8:50:15, 124.77s/it] 
  5%|           | 14/268 [31:28<8:22:11, 118.63s/it]
  6%|           | 15/268 [32:52<7:36:07, 108.17s/it]
  6%|           | 16/268 [34:03<6:47:51, 97.11s/it] 
  6%|           | 17/268 [35:53<7:02:03, 100.89s/it]
  7%|           | 18/268 [36:56<6:13:17, 89.59s/it] 
  7%|           | 19/268 [38:33<6:20:19, 91.64s/it]
  7%|           | 20/268 [39:56<6:08:49, 89.23s/it]
  8%|           | 21/268 [41:28<6:09:42, 89.81s/it]
  8%|           | 22/268 [43:10<6:23:18, 93.49s/it]
  9%|           | 23/268 [45:56<7:50:56, 115.33s/it]
  9%|           | 24/268 [48:13<8:15:23, 121.82s/it]
  9%|           | 25/268 [52:07<10:29:46, 155.50s/it]
 10%|           | 26/268 [53:36<9:06:12, 135.43s/it] 
 10%|           | 27/268 [55:11<8:15:36, 123.39s/it]
 10%|           | 28/268 [57:34<8:37:44, 129.44s/it]
 11%|           | 29/268 [59:33<8:22:37, 126.18s/it]
 11%|           | 30/268 [1:01:11<7:47:16, 117.80s/it]
 12%|            | 31/268 [1:02:54<7:26:56, 113.15s/it]
 12%|            | 32/268 [1:06:19<9:14:14, 140.91s/it]
 12%|            | 33/268 [1:09:16<9:54:21, 151.75s/it]
 13%|            | 34/268 [1:10:22<8:10:48, 125.85s/it]
 13%|            | 35/268 [1:13:09<8:56:45, 138.22s/it]
 13%|            | 36/268 [1:15:26<8:53:27, 137.96s/it]
 14%|            | 37/268 [1:17:37<8:43:18, 135.93s/it]
 14%|            | 38/268 [1:19:51<8:38:23, 135.23s/it]
 15%|            | 39/268 [1:21:46<8:12:48, 129.12s/it]
 15%|            | 40/268 [1:24:17<8:36:21, 135.88s/it]
 15%|            | 41/268 [1:25:25<7:17:04, 115.53s/it]
 16%|            | 42/268 [1:27:36<7:32:04, 120.02s/it]
 16%|            | 43/268 [1:29:26<7:19:16, 117.14s/it]
 16%|            | 44/268 [1:30:40<6:28:51, 104.16s/it]
 17%|            | 45/268 [1:32:41<6:46:05, 109.26s/it]
 17%|            | 46/268 [1:33:47<5:56:18, 96.30s/it] 
 18%|            | 47/268 [1:35:20<5:50:01, 95.03s/it]
 18%|            | 48/268 [1:37:09<6:04:35, 99.43s/it]
 18%|            | 49/268 [1:40:32<7:55:43, 130.34s/it]
 19%|            | 50/268 [1:43:23<8:37:45, 142.50s/it]
 19%|            | 51/268 [1:45:21<8:09:17, 135.29s/it]
 19%|            | 52/268 [1:48:23<8:57:28, 149.30s/it]
 20%|            | 53/268 [1:51:56<10:03:23, 168.39s/it]
 20%|            | 54/268 [1:53:36<8:47:47, 147.98s/it] 
 21%|            | 55/268 [1:54:41<7:17:07, 123.14s/it]
 21%|            | 56/268 [1:56:30<6:59:30, 118.73s/it]
 21%|             | 57/268 [1:57:31<5:56:18, 101.32s/it]
 22%|             | 58/268 [1:59:29<6:12:04, 106.31s/it]
 22%|             | 59/268 [2:00:22<5:14:35, 90.31s/it] 
 22%|             | 60/268 [2:02:09<5:30:23, 95.31s/it]
 23%|             | 61/268 [2:03:51<5:36:36, 97.57s/it]
 23%|             | 62/268 [2:05:59<6:05:42, 106.52s/it]
 24%|             | 63/268 [2:07:00<5:17:23, 92.90s/it] 
 24%|             | 64/268 [2:09:19<6:03:22, 106.87s/it]
 24%|             | 65/268 [2:11:54<6:49:34, 121.06s/it]
 25%|             | 66/268 [2:13:17<6:09:34, 109.78s/it]
 25%|             | 67/268 [2:17:12<8:13:18, 147.25s/it]
 25%|             | 68/268 [2:18:55<7:26:29, 133.95s/it]
 26%|             | 69/268 [2:21:10<7:25:35, 134.35s/it]
 26%|             | 70/268 [2:23:31<7:30:12, 136.43s/it]
 26%|             | 71/268 [2:26:08<7:48:07, 142.57s/it]
 27%|             | 72/268 [2:30:04<9:17:40, 170.71s/it]
 27%|             | 73/268 [2:33:10<9:29:02, 175.09s/it]
 28%|             | 74/268 [2:36:55<10:14:34, 190.07s/it]
 28%|             | 75/268 [2:38:44<8:53:33, 165.87s/it] 
 28%|             | 76/268 [2:40:59<8:20:58, 156.55s/it]
 29%|             | 77/268 [2:42:27<7:13:17, 136.11s/it]
 29%|             | 78/268 [2:45:07<7:33:42, 143.28s/it]
 29%|             | 79/268 [2:46:34<6:37:38, 126.24s/it]
 30%|             | 80/268 [2:47:41<5:39:43, 108.42s/it]
 30%|             | 81/268 [2:49:11<5:20:57, 102.98s/it]
 31%|             | 82/268 [2:50:35<5:01:52, 97.38s/it] 
 31%|             | 83/268 [2:52:03<4:51:23, 94.51s/it]
 31%|              | 84/268 [2:52:56<4:11:49, 82.12s/it]
 32%|              | 85/268 [2:54:05<3:57:46, 77.96s/it]
 32%|              | 86/268 [2:55:42<4:14:01, 83.75s/it]
 32%|              | 87/268 [2:59:37<6:29:49, 129.23s/it]
 33%|              | 88/268 [3:00:56<5:42:39, 114.22s/it]
 33%|              | 89/268 [3:05:10<7:45:36, 156.07s/it]
 34%|              | 90/268 [3:06:46<6:49:38, 138.08s/it]
 34%|              | 91/268 [3:08:22<6:10:08, 125.47s/it]
 34%|              | 92/268 [3:09:34<5:21:11, 109.50s/it]
 35%|              | 93/268 [3:10:34<4:35:40, 94.52s/it] 
 35%|              | 94/268 [3:11:59<4:25:46, 91.65s/it]
 35%|              | 95/268 [3:13:46<4:37:13, 96.15s/it]
 36%|              | 96/268 [3:15:13<4:28:14, 93.57s/it]
 36%|              | 97/268 [3:16:18<4:01:39, 84.79s/it]
 37%|              | 98/268 [3:19:14<5:18:07, 112.28s/it]
 37%|              | 99/268 [3:20:25<4:41:40, 100.01s/it]
 37%|              | 100/268 [3:22:03<4:38:09, 99.35s/it]
 38%|              | 101/268 [3:23:32<4:27:32, 96.12s/it]
 38%|              | 102/268 [3:26:36<5:38:58, 122.52s/it]
 38%|              | 103/268 [3:29:51<6:37:09, 144.42s/it]
 39%|              | 104/268 [3:30:55<5:28:06, 120.04s/it]
 39%|              | 105/268 [3:32:14<4:52:55, 107.82s/it]
 40%|              | 106/268 [3:34:13<5:00:14, 111.20s/it]
 40%|              | 107/268 [3:36:28<5:17:14, 118.23s/it]
 40%|              | 108/268 [3:38:04<4:57:54, 111.72s/it]
 41%|              | 109/268 [3:40:54<5:42:35, 129.28s/it]
 41%|              | 110/268 [3:42:12<4:59:31, 113.74s/it]
 41%|               | 111/268 [3:43:24<4:25:05, 101.31s/it]
 42%|               | 112/268 [3:44:43<4:05:41, 94.49s/it] 
 42%|               | 113/268 [3:46:35<4:18:12, 99.95s/it]
 43%|               | 114/268 [3:48:00<4:04:30, 95.27s/it]
 43%|               | 115/268 [3:51:02<5:09:22, 121.33s/it]
 43%|               | 116/268 [3:53:49<5:42:28, 135.19s/it]
 44%|               | 117/268 [3:55:12<5:00:51, 119.55s/it]
 44%|               | 118/268 [3:58:09<5:41:43, 136.69s/it]
 44%|               | 119/268 [3:59:59<5:19:42, 128.74s/it]
 45%|               | 120/268 [4:02:00<5:11:43, 126.38s/it]
 45%|               | 121/268 [4:03:49<4:57:02, 121.24s/it]
 46%|               | 122/268 [4:05:40<4:46:52, 117.90s/it]
 46%|               | 123/268 [4:07:38<4:45:10, 118.01s/it]
 46%|               | 124/268 [4:10:38<5:28:08, 136.72s/it]
 47%|               | 125/268 [4:12:34<5:11:14, 130.59s/it]
 47%|               | 126/268 [4:14:32<5:00:01, 126.77s/it]
 47%|               | 127/268 [4:15:41<4:17:16, 109.48s/it]
 48%|               | 128/268 [4:16:57<3:51:29, 99.21s/it] 
 48%|               | 129/268 [4:18:24<3:41:22, 95.56s/it]
 49%|               | 130/268 [4:20:07<3:45:10, 97.90s/it]
 49%|               | 131/268 [4:21:45<3:43:22, 97.82s/it]
 49%|               | 132/268 [4:22:52<3:20:41, 88.54s/it]
 50%|               | 133/268 [4:24:16<3:16:29, 87.33s/it]
 50%|               | 134/268 [4:25:12<2:53:48, 77.82s/it]
 50%|               | 135/268 [4:27:53<3:48:15, 102.97s/it]
 51%|               | 136/268 [4:30:09<4:07:51, 112.66s/it]
 51%|               | 137/268 [4:33:09<4:50:17, 132.95s/it]
 51%|                | 138/268 [4:34:35<4:17:16, 118.74s/it]
 52%|                | 139/268 [4:37:07<4:36:51, 128.77s/it]
 52%|                | 140/268 [4:39:03<4:26:45, 125.04s/it]
 53%|                | 141/268 [4:42:23<5:12:03, 147.43s/it]
 53%|                | 142/268 [4:44:12<4:45:24, 135.91s/it]
 53%|                | 143/268 [4:46:49<4:56:40, 142.40s/it]
 54%|                | 144/268 [4:49:05<4:49:53, 140.27s/it]
 54%|                | 145/268 [4:51:04<4:34:36, 133.96s/it]
 54%|                | 146/268 [4:52:09<3:50:07, 113.18s/it]
 55%|                | 147/268 [4:54:54<4:19:59, 128.92s/it]
 55%|                | 148/268 [4:57:10<4:22:10, 131.09s/it]
 56%|                | 149/268 [4:59:18<4:18:08, 130.15s/it]
 56%|                | 150/268 [5:00:58<3:57:47, 120.91s/it]
 56%|                | 151/268 [5:02:13<3:29:06, 107.23s/it]
 57%|                | 152/268 [5:03:31<3:10:07, 98.34s/it] 
 57%|                | 153/268 [5:04:56<3:00:54, 94.39s/it]
 57%|                | 154/268 [5:07:12<3:23:03, 106.87s/it]
 58%|                | 155/268 [5:09:40<3:44:38, 119.28s/it]
 58%|                | 156/268 [5:11:13<3:28:05, 111.47s/it]
 59%|                | 157/268 [5:14:08<4:01:21, 130.47s/it]
 59%|                | 158/268 [5:15:27<3:30:54, 115.04s/it]
 59%|                | 159/268 [5:17:14<3:24:27, 112.55s/it]
 60%|                | 160/268 [5:19:02<3:20:23, 111.33s/it]
 60%|                | 161/268 [5:21:10<3:27:24, 116.30s/it]
 60%|                | 162/268 [5:22:19<3:00:29, 102.16s/it]
 61%|                | 163/268 [5:23:41<2:47:46, 95.87s/it] 
 61%|                | 164/268 [5:25:10<2:42:43, 93.88s/it]
 62%|                 | 165/268 [5:27:06<2:52:45, 100.63s/it]
 62%|                 | 166/268 [5:29:02<2:58:46, 105.16s/it]
 62%|                 | 167/268 [5:30:56<3:01:18, 107.70s/it]
 63%|                 | 168/268 [5:32:12<2:44:00, 98.40s/it] 
 63%|                 | 169/268 [5:36:42<4:07:07, 149.77s/it]
 63%|                 | 170/268 [5:39:07<4:02:35, 148.52s/it]
 64%|                 | 171/268 [5:41:17<3:50:49, 142.78s/it]
 64%|                 | 172/268 [5:42:48<3:23:25, 127.14s/it]
 65%|                 | 173/268 [18:23:37<363:44:20, 13783.79s/it]
 65%|                 | 174/268 [18:25:12<252:40:44, 9677.07s/it] 
 65%|                 | 175/268 [18:27:03<175:51:39, 6807.52s/it]
 66%|                 | 176/268 [18:29:29<122:53:30, 4808.81s/it]
 66%|                 | 177/268 [18:31:33<86:01:49, 3403.40s/it] 
 66%|                 | 178/268 [18:33:45<60:32:57, 2421.97s/it]
 67%|                 | 179/268 [18:35:18<42:36:20, 1723.37s/it]
 67%|                 | 180/268 [18:37:23<30:24:19, 1243.86s/it]
 68%|                 | 181/268 [18:38:45<21:38:10, 895.29s/it] 
 68%|                 | 182/268 [18:40:08<15:33:54, 651.57s/it]
 68%|                 | 183/268 [18:41:52<11:30:19, 487.29s/it]
 69%|                 | 184/268 [18:43:54<8:48:41, 377.64s/it] 
 69%|                 | 185/268 [18:45:14<6:38:57, 288.40s/it]
 69%|                 | 186/268 [18:46:25<5:04:57, 223.14s/it]
 70%|                 | 187/268 [18:48:03<4:10:48, 185.78s/it]
 70%|                 | 188/268 [18:50:19<3:47:48, 170.86s/it]
 71%|                 | 189/268 [18:51:52<3:14:14, 147.53s/it]
 71%|                 | 190/268 [18:53:26<2:50:40, 131.29s/it]
 71%|                  | 191/268 [18:54:52<2:31:10, 117.80s/it]
 72%|                  | 192/268 [18:57:02<2:33:49, 121.44s/it]
 72%|                  | 193/268 [18:59:48<2:48:25, 134.74s/it]
 72%|                  | 194/268 [19:01:35<2:35:55, 126.42s/it]
 73%|                  | 195/268 [19:03:01<2:19:15, 114.46s/it]
 73%|                  | 196/268 [19:05:03<2:19:58, 116.65s/it]
 74%|                  | 197/268 [19:07:13<2:22:47, 120.67s/it]
 74%|                  | 198/268 [19:09:54<2:34:50, 132.73s/it]
 74%|                  | 199/268 [19:11:32<2:20:42, 122.36s/it]
 75%|                  | 200/268 [19:14:50<2:44:21, 145.02s/it]
 75%|                  | 201/268 [19:18:07<2:59:14, 160.51s/it]
 75%|                  | 202/268 [19:19:47<2:36:40, 142.43s/it]
 76%|                  | 203/268 [19:21:36<2:23:25, 132.39s/it]
 76%|                  | 204/268 [19:23:07<2:08:04, 120.07s/it]
 76%|                  | 205/268 [19:25:02<2:04:26, 118.52s/it]
 77%|                  | 206/268 [19:28:16<2:25:50, 141.14s/it]
 77%|                  | 207/268 [19:30:53<2:28:21, 145.93s/it]
 78%|                  | 208/268 [19:32:44<2:15:21, 135.36s/it]
 78%|                  | 209/268 [19:34:37<2:06:35, 128.73s/it]
 78%|                  | 210/268 [19:36:17<1:56:03, 120.06s/it]
 79%|                  | 211/268 [19:40:10<2:26:15, 153.95s/it]
 79%|                  | 212/268 [19:43:41<2:39:30, 170.91s/it]
 79%|                  | 213/268 [19:46:21<2:33:46, 167.76s/it]
 80%|                  | 214/268 [19:48:28<2:19:55, 155.48s/it]
 80%|                  | 215/268 [19:50:13<2:04:07, 140.51s/it]
 81%|                  | 216/268 [19:51:53<1:51:05, 128.17s/it]
 81%|                  | 217/268 [19:53:45<1:44:56, 123.46s/it]
 81%|                   | 218/268 [19:55:42<1:41:11, 121.43s/it]
 82%|                   | 219/268 [19:58:11<1:46:00, 129.80s/it]
 82%|                   | 220/268 [20:01:47<2:04:27, 155.58s/it]
 82%|                   | 221/268 [20:05:43<2:20:46, 179.72s/it]
 83%|                   | 222/268 [20:07:46<2:04:42, 162.66s/it]
 83%|                   | 223/268 [20:10:36<2:03:37, 164.84s/it]
 84%|                   | 224/268 [20:11:56<1:42:11, 139.34s/it]
 84%|                   | 225/268 [20:13:27<1:29:32, 124.95s/it]
 84%|                   | 226/268 [20:15:49<1:31:07, 130.18s/it]
 85%|                   | 227/268 [20:19:19<1:45:14, 154.01s/it]
 85%|                   | 228/268 [20:23:55<2:07:10, 190.75s/it]
 85%|                   | 229/268 [20:26:15<1:54:04, 175.49s/it]
 86%|                   | 230/268 [20:28:58<1:48:42, 171.65s/it]
 86%|                   | 231/268 [20:32:51<1:57:16, 190.18s/it]
 87%|                   | 232/268 [20:35:02<1:43:23, 172.33s/it]
 87%|                   | 233/268 [20:36:46<1:28:35, 151.87s/it]
 87%|                   | 234/268 [20:38:55<1:22:06, 144.88s/it]
 88%|                   | 235/268 [20:42:44<1:33:36, 170.20s/it]
 88%|                   | 236/268 [20:45:18<1:28:08, 165.26s/it]
 88%|                   | 237/268 [20:47:56<1:24:19, 163.19s/it]
 89%|                   | 238/268 [20:50:12<1:17:30, 155.01s/it]
 89%|                   | 239/268 [20:52:50<1:15:19, 155.83s/it]
 90%|                   | 240/268 [20:55:19<1:11:48, 153.89s/it]
 90%|                   | 241/268 [20:57:26<1:05:39, 145.90s/it]
 90%|                   | 242/268 [20:59:52<1:03:07, 145.66s/it]
 91%|                   | 243/268 [21:01:23<53:51, 129.25s/it]  
 91%|                   | 244/268 [21:03:18<50:00, 125.02s/it]
 91%|                    | 245/268 [21:05:20<47:38, 124.30s/it]
 92%|                    | 246/268 [21:07:51<48:28, 132.19s/it]
 92%|                    | 247/268 [21:10:16<47:39, 136.15s/it]
 93%|                    | 248/268 [21:12:23<44:28, 133.41s/it]
 93%|                    | 249/268 [21:14:23<40:55, 129.23s/it]
 93%|                    | 250/268 [21:16:52<40:36, 135.35s/it]
 94%|                    | 251/268 [21:19:29<40:10, 141.77s/it]
 94%|                    | 252/268 [21:22:45<42:08, 158.00s/it]
 94%|                    | 253/268 [21:25:03<37:58, 151.90s/it]
 95%|                    | 254/268 [21:27:19<34:19, 147.12s/it]
 95%|                    | 255/268 [21:30:20<34:04, 157.27s/it]
 96%|                    | 256/268 [21:32:40<30:25, 152.16s/it]
 96%|                    | 257/268 [21:34:52<26:48, 146.20s/it]
 96%|                    | 258/268 [21:36:48<22:51, 137.17s/it]
 97%|                    | 259/268 [21:38:55<20:07, 134.17s/it]
 97%|                    | 260/268 [21:40:54<17:15, 129.39s/it]
 97%|                    | 261/268 [21:43:34<16:09, 138.53s/it]
 98%|                    | 262/268 [21:46:06<14:16, 142.69s/it]
 98%|                    | 263/268 [21:49:17<13:06, 157.31s/it]
 99%|                    | 264/268 [21:51:06<09:31, 142.84s/it]
 99%|                    | 265/268 [21:53:12<06:52, 137.63s/it]
 99%|                    | 266/268 [21:55:27<04:33, 136.98s/it]
100%|                    | 267/268 [21:58:18<02:26, 146.95s/it]
100%|                    | 268/268 [21:59:59<00:00, 133.27s/it]
100%|                    | 268/268 [22:01:13<00:00, 295.80s/it]
epoch: 6, train loss: 164.52658596323496

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:25<12:31, 25.91s/it]
  7%|           | 2/30 [01:21<20:08, 43.17s/it]
 10%|           | 3/30 [02:14<21:34, 47.96s/it]
 13%|            | 4/30 [03:27<25:05, 57.90s/it]
 17%|            | 5/30 [04:08<21:30, 51.64s/it]
 20%|            | 6/30 [05:03<21:08, 52.85s/it]
 23%|             | 7/30 [05:44<18:42, 48.78s/it]
 27%|             | 8/30 [06:47<19:38, 53.58s/it]
 30%|             | 9/30 [08:02<21:04, 60.20s/it]
 33%|              | 10/30 [08:57<19:33, 58.65s/it]
 37%|              | 11/30 [10:11<20:03, 63.35s/it]
 40%|              | 12/30 [11:38<21:07, 70.42s/it]
 43%|               | 13/30 [12:43<19:27, 68.66s/it]
 47%|               | 14/30 [13:50<18:14, 68.43s/it]
 50%|               | 15/30 [14:43<15:53, 63.54s/it]
 53%|                | 16/30 [16:22<17:21, 74.42s/it]
 57%|                | 17/30 [17:59<17:33, 81.04s/it]
 60%|                | 18/30 [18:33<13:23, 66.94s/it]
 63%|                 | 19/30 [19:29<11:40, 63.72s/it]
 67%|                 | 20/30 [19:51<08:31, 51.17s/it]
 70%|                 | 21/30 [20:48<07:56, 52.90s/it]
 73%|                  | 22/30 [21:40<07:01, 52.69s/it]
 77%|                  | 23/30 [22:20<05:41, 48.78s/it]
 80%|                  | 24/30 [22:56<04:29, 44.91s/it]
 83%|                   | 25/30 [23:44<03:50, 46.03s/it]
 87%|                   | 26/30 [24:57<03:35, 53.90s/it]
 90%|                   | 27/30 [26:15<03:03, 61.28s/it]
 93%|                    | 28/30 [27:09<01:57, 59.00s/it]
 97%|                    | 29/30 [27:48<00:53, 53.14s/it]
100%|                    | 30/30 [28:28<00:00, 49.02s/it]
100%|                    | 30/30 [28:40<00:00, 57.36s/it]
epoch: 6, f1 score: 0.9564525675323753, dev loss: 552.3326171875
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [02:20<10:26:50, 140.86s/it]
  1%|          | 2/268 [04:35<10:08:48, 137.32s/it]
  1%|          | 3/268 [05:48<7:56:39, 107.92s/it] 
  1%|           | 4/268 [08:42<9:50:03, 134.10s/it]
  2%|           | 5/268 [10:25<8:57:19, 122.58s/it]
  2%|           | 6/268 [15:49<13:54:52, 191.19s/it]
  3%|           | 7/268 [17:13<11:18:42, 156.02s/it]
  3%|           | 8/268 [18:53<9:59:27, 138.34s/it] 
  3%|           | 9/268 [21:35<10:28:56, 145.70s/it]
  4%|           | 10/268 [23:43<10:03:34, 140.37s/it]
  4%|           | 11/268 [25:58<9:53:59, 138.67s/it] 
  4%|           | 12/268 [27:14<8:30:40, 119.69s/it]
  5%|           | 13/268 [29:06<8:18:23, 117.27s/it]
  5%|           | 14/268 [30:57<8:08:05, 115.30s/it]
  6%|           | 15/268 [32:19<7:24:07, 105.33s/it]
  6%|           | 16/268 [33:33<6:43:07, 95.98s/it] 
  6%|           | 17/268 [35:02<6:32:40, 93.87s/it]
  7%|           | 18/268 [38:02<8:18:30, 119.64s/it]
  7%|           | 19/268 [39:23<7:28:01, 107.96s/it]
  7%|           | 20/268 [41:54<8:20:07, 121.00s/it]
  8%|           | 21/268 [43:17<7:30:27, 109.42s/it]
  8%|           | 22/268 [45:14<7:38:46, 111.89s/it]
  9%|           | 23/268 [46:57<7:25:40, 109.15s/it]
  9%|           | 24/268 [48:33<7:07:48, 105.20s/it]
  9%|           | 25/268 [49:55<6:37:40, 98.19s/it] 
 10%|           | 26/268 [52:39<7:56:17, 118.09s/it]
 10%|           | 27/268 [54:06<7:16:03, 108.56s/it]
 10%|           | 28/268 [55:33<6:48:21, 102.09s/it]
 11%|           | 29/268 [57:25<6:58:53, 105.16s/it]
 11%|           | 30/268 [58:50<6:33:17, 99.15s/it] 
 12%|            | 31/268 [1:01:06<7:15:26, 110.24s/it]
 12%|            | 32/268 [1:02:43<6:58:20, 106.36s/it]
 12%|            | 33/268 [1:04:00<6:21:08, 97.31s/it] 
 13%|            | 34/268 [1:06:39<7:32:01, 115.90s/it]
 13%|            | 35/268 [1:08:14<7:05:35, 109.59s/it]
 13%|            | 36/268 [1:10:11<7:12:45, 111.92s/it]
 14%|            | 37/268 [1:11:12<6:12:20, 96.71s/it] 
 14%|            | 38/268 [1:11:58<5:12:24, 81.50s/it]
 15%|            | 39/268 [1:13:50<5:46:00, 90.66s/it]
 15%|            | 40/268 [1:16:45<7:20:32, 115.93s/it]
 15%|            | 41/268 [1:17:43<6:12:54, 98.57s/it] 
 16%|            | 42/268 [1:18:58<5:44:46, 91.54s/it]
 16%|            | 43/268 [1:20:47<6:02:14, 96.60s/it]
 16%|            | 44/268 [1:22:27<6:04:31, 97.64s/it]
 17%|            | 45/268 [1:24:50<6:53:31, 111.26s/it]
 17%|            | 46/268 [1:26:14<6:21:16, 103.05s/it]
 18%|            | 47/268 [1:27:36<5:55:52, 96.62s/it] 
 18%|            | 48/268 [1:31:14<8:08:17, 133.17s/it]
 18%|            | 49/268 [1:33:15<7:52:25, 129.43s/it]
 19%|            | 50/268 [1:34:43<7:05:06, 117.00s/it]
 19%|            | 51/268 [1:35:48<6:07:15, 101.54s/it]
 19%|            | 52/268 [1:36:59<5:31:56, 92.21s/it] 
 20%|            | 53/268 [1:38:33<5:32:51, 92.89s/it]
 20%|            | 54/268 [1:41:06<6:35:33, 110.90s/it]
 21%|            | 55/268 [1:42:22<5:56:19, 100.37s/it]
 21%|            | 56/268 [1:44:58<6:53:36, 117.06s/it]
 21%|             | 57/268 [1:46:03<5:56:39, 101.42s/it]
 22%|             | 58/268 [1:46:52<5:00:25, 85.84s/it] 
 22%|             | 59/268 [1:48:16<4:57:04, 85.28s/it]
 22%|             | 60/268 [1:50:47<6:03:52, 104.96s/it]
 23%|             | 61/268 [1:55:29<9:05:41, 158.17s/it]
 23%|             | 62/268 [1:58:35<9:31:04, 166.33s/it]
 24%|             | 63/268 [1:59:49<7:54:00, 138.73s/it]
 24%|             | 64/268 [2:02:47<8:31:52, 150.55s/it]
 24%|             | 65/268 [2:06:18<9:30:58, 168.76s/it]
 25%|             | 66/268 [2:07:48<8:08:26, 145.08s/it]
 25%|             | 67/268 [2:09:08<7:00:06, 125.41s/it]
 25%|             | 68/268 [2:11:01<6:45:52, 121.76s/it]
 26%|             | 69/268 [2:11:44<5:25:23, 98.11s/it] 
 26%|             | 70/268 [2:13:01<5:02:23, 91.64s/it]
 26%|             | 71/268 [2:14:03<4:32:02, 82.86s/it]
 27%|             | 72/268 [2:15:17<4:22:10, 80.26s/it]
 27%|             | 73/268 [2:16:16<3:59:52, 73.81s/it]
 28%|             | 74/268 [2:17:46<4:14:34, 78.73s/it]
 28%|             | 75/268 [2:18:47<3:55:51, 73.33s/it]
 28%|             | 76/268 [2:21:05<4:57:20, 92.92s/it]
 29%|             | 77/268 [2:23:48<6:02:20, 113.83s/it]
 29%|             | 78/268 [2:25:09<5:29:25, 104.03s/it]
 29%|             | 79/268 [2:28:53<7:20:36, 139.87s/it]
 30%|             | 80/268 [2:32:25<8:26:14, 161.57s/it]
 30%|             | 81/268 [2:34:45<8:03:09, 155.02s/it]
 31%|             | 82/268 [2:36:35<7:18:49, 141.55s/it]
 31%|             | 83/268 [2:38:57<7:16:44, 141.65s/it]
 31%|              | 84/268 [2:40:42<6:40:50, 130.71s/it]
 32%|              | 85/268 [2:45:09<8:43:09, 171.53s/it]
 32%|              | 86/268 [2:46:21<7:09:52, 141.72s/it]
 32%|              | 87/268 [2:48:24<6:51:04, 136.27s/it]
 33%|              | 88/268 [2:51:36<7:38:51, 152.95s/it]
 33%|              | 89/268 [2:56:42<9:53:13, 198.84s/it]
 34%|              | 90/268 [3:00:27<10:13:29, 206.80s/it]
 34%|              | 91/268 [3:02:42<9:05:48, 185.02s/it] 
 34%|              | 92/268 [3:04:38<8:02:15, 164.40s/it]
 35%|              | 93/268 [3:07:57<8:29:53, 174.82s/it]
 35%|              | 94/268 [3:09:15<7:02:26, 145.67s/it]
 35%|              | 95/268 [3:10:40<6:08:01, 127.64s/it]
 36%|              | 96/268 [3:12:04<5:28:21, 114.54s/it]
 36%|              | 97/268 [3:14:30<5:53:11, 123.93s/it]
 37%|              | 98/268 [3:18:43<7:40:36, 162.57s/it]
 37%|              | 99/268 [3:21:30<7:41:31, 163.85s/it]
 37%|              | 100/268 [3:23:04<6:40:07, 142.90s/it]
 38%|              | 101/268 [3:24:25<5:45:53, 124.27s/it]
 38%|              | 102/268 [3:26:53<6:03:50, 131.51s/it]
 38%|              | 103/268 [3:28:56<5:55:06, 129.13s/it]
 39%|              | 104/268 [3:30:09<5:06:19, 112.07s/it]
 39%|              | 105/268 [3:31:12<4:24:25, 97.33s/it] 
 40%|              | 106/268 [3:33:30<4:55:39, 109.50s/it]
 40%|              | 107/268 [3:34:13<4:00:24, 89.59s/it] 
 40%|              | 108/268 [3:36:10<4:20:44, 97.78s/it]
 41%|              | 109/268 [3:38:05<4:33:00, 103.02s/it]
 41%|              | 110/268 [3:40:06<4:45:13, 108.31s/it]
 41%|               | 111/268 [3:43:11<5:43:56, 131.44s/it]
 42%|               | 112/268 [3:46:29<6:33:20, 151.28s/it]
 42%|               | 113/268 [3:47:22<5:15:19, 122.06s/it]
 43%|               | 114/268 [3:49:14<5:04:52, 118.78s/it]
 43%|               | 115/268 [3:51:37<5:22:07, 126.33s/it]
 43%|               | 116/268 [3:53:27<5:07:13, 121.27s/it]
 44%|               | 117/268 [3:54:47<4:34:10, 108.94s/it]
 44%|               | 118/268 [3:56:38<4:33:29, 109.40s/it]
 44%|               | 119/268 [3:57:51<4:04:59, 98.65s/it] 
 45%|               | 120/268 [3:59:56<4:22:25, 106.39s/it]
 45%|               | 121/268 [4:01:49<4:25:29, 108.36s/it]
 46%|               | 122/268 [4:04:21<4:56:09, 121.71s/it]
 46%|               | 123/268 [4:06:28<4:57:21, 123.05s/it]
 46%|               | 124/268 [4:08:31<4:55:25, 123.10s/it]
 47%|               | 125/268 [4:09:39<4:14:20, 106.72s/it]
 47%|               | 126/268 [4:11:28<4:14:14, 107.43s/it]
 47%|               | 127/268 [4:12:48<3:52:44, 99.04s/it] 
 48%|               | 128/268 [4:13:53<3:27:37, 88.98s/it]
 48%|               | 129/268 [4:15:19<3:24:08, 88.12s/it]
 49%|               | 130/268 [4:18:25<4:29:44, 117.28s/it]
 49%|               | 131/268 [4:21:01<4:54:35, 129.02s/it]
 49%|               | 132/268 [4:23:15<4:55:35, 130.41s/it]
 50%|               | 133/268 [4:24:49<4:29:15, 119.67s/it]
 50%|               | 134/268 [4:27:07<4:39:29, 125.14s/it]
 50%|               | 135/268 [4:29:49<5:01:27, 136.00s/it]
 51%|               | 136/268 [4:32:38<5:21:04, 145.94s/it]
 51%|               | 137/268 [4:34:20<4:50:01, 132.83s/it]
 51%|                | 138/268 [4:35:45<4:16:39, 118.46s/it]
 52%|                | 139/268 [4:37:29<4:05:06, 114.00s/it]
 52%|                | 140/268 [4:39:18<3:59:57, 112.48s/it]
 53%|                | 141/268 [4:41:20<4:04:13, 115.38s/it]
 53%|                | 142/268 [4:43:16<4:02:53, 115.67s/it]
 53%|                | 143/268 [4:45:01<3:54:10, 112.40s/it]
 54%|                | 144/268 [4:47:25<4:11:53, 121.89s/it]
 54%|                | 145/268 [4:48:56<3:51:10, 112.76s/it]
 54%|                | 146/268 [4:50:45<3:46:48, 111.54s/it]
 55%|                | 147/268 [4:53:57<4:33:22, 135.55s/it]
 55%|                | 148/268 [4:55:14<3:56:04, 118.04s/it]
 56%|                | 149/268 [4:57:51<4:17:28, 129.82s/it]
 56%|                | 150/268 [4:59:10<3:45:20, 114.58s/it]
 56%|                | 151/268 [5:00:39<3:28:12, 106.77s/it]
 57%|                | 152/268 [5:02:48<3:39:33, 113.56s/it]
 57%|                | 153/268 [5:06:18<4:33:00, 142.43s/it]
 57%|                | 154/268 [5:08:35<4:27:35, 140.84s/it]
 58%|                | 155/268 [5:10:23<4:06:51, 131.07s/it]
 58%|                | 156/268 [5:12:09<3:50:32, 123.50s/it]
 59%|                | 157/268 [5:14:01<3:42:16, 120.15s/it]
 59%|                | 158/268 [5:16:51<4:07:26, 134.97s/it]
 59%|                | 159/268 [5:19:47<4:27:31, 147.26s/it]
 60%|                | 160/268 [5:21:53<4:13:31, 140.85s/it]
 60%|                | 161/268 [5:23:38<3:52:05, 130.15s/it]
 60%|                | 162/268 [5:27:22<4:39:32, 158.23s/it]
 61%|                | 163/268 [5:29:18<4:14:39, 145.52s/it]
 61%|                | 164/268 [5:30:54<3:46:46, 130.83s/it]
 62%|                 | 165/268 [5:33:57<4:11:16, 146.37s/it]
 62%|                 | 166/268 [5:36:15<4:04:49, 144.02s/it]
 62%|                 | 167/268 [5:37:34<3:29:17, 124.33s/it]
 63%|                 | 168/268 [5:39:19<3:17:40, 118.60s/it]
 63%|                 | 169/268 [5:41:44<3:28:46, 126.53s/it]
 63%|                 | 170/268 [5:43:14<3:08:49, 115.61s/it]
 64%|                 | 171/268 [5:44:50<2:57:32, 109.82s/it]
 64%|                 | 172/268 [5:46:48<2:59:40, 112.29s/it]
 65%|                 | 173/268 [5:47:52<2:34:30, 97.58s/it] 
 65%|                 | 174/268 [5:49:31<2:33:40, 98.09s/it]
 65%|                 | 175/268 [5:50:50<2:23:18, 92.45s/it]
 66%|                 | 176/268 [5:53:05<2:40:58, 104.98s/it]
 66%|                 | 177/268 [5:54:42<2:35:43, 102.68s/it]
 66%|                 | 178/268 [5:58:15<3:23:40, 135.78s/it]
 67%|                 | 179/268 [5:59:49<3:02:42, 123.17s/it]
 67%|                 | 180/268 [6:02:12<3:09:21, 129.11s/it]
 68%|                 | 181/268 [6:03:29<2:44:42, 113.59s/it]
 68%|                 | 182/268 [6:05:17<2:40:35, 112.04s/it]
 68%|                 | 183/268 [6:06:39<2:25:38, 102.80s/it]
 69%|                 | 184/268 [6:09:13<2:45:46, 118.41s/it]
 69%|                 | 185/268 [6:10:30<2:26:31, 105.92s/it]
 69%|                 | 186/268 [6:12:36<2:32:51, 111.85s/it]
 70%|                 | 187/268 [6:16:11<3:12:57, 142.93s/it]
 70%|                 | 188/268 [6:18:53<3:18:00, 148.51s/it]
 71%|                 | 189/268 [6:21:23<3:16:11, 149.00s/it]
 71%|                 | 190/268 [6:25:41<3:56:20, 181.80s/it]
 71%|                  | 191/268 [6:27:44<3:30:38, 164.14s/it]
 72%|                  | 192/268 [6:29:15<3:00:10, 142.24s/it]
 72%|                  | 193/268 [6:31:28<2:54:11, 139.35s/it]
 72%|                  | 194/268 [6:33:01<2:34:46, 125.49s/it]
 73%|                  | 195/268 [6:35:12<2:34:48, 127.23s/it]
 73%|                  | 196/268 [6:37:04<2:27:02, 122.53s/it]
 74%|                  | 197/268 [6:39:00<2:22:43, 120.62s/it]
 74%|                  | 198/268 [6:42:31<2:52:12, 147.61s/it]
 74%|                  | 199/268 [6:43:48<2:25:29, 126.51s/it]
 75%|                  | 200/268 [6:46:13<2:29:38, 132.03s/it]
 75%|                  | 201/268 [6:49:23<2:46:59, 149.54s/it]
 75%|                  | 202/268 [6:51:48<2:42:44, 147.94s/it]
 76%|                  | 203/268 [6:53:38<2:28:08, 136.75s/it]
 76%|                  | 204/268 [6:55:40<2:21:08, 132.31s/it]
 76%|                  | 205/268 [6:58:14<2:25:39, 138.72s/it]
 77%|                  | 206/268 [7:01:51<2:47:45, 162.34s/it]
 77%|                  | 207/268 [7:03:53<2:32:41, 150.18s/it]
 78%|                  | 208/268 [7:05:36<2:16:07, 136.13s/it]
 78%|                  | 209/268 [7:08:35<2:26:15, 148.74s/it]
 78%|                  | 210/268 [7:10:40<2:16:55, 141.65s/it]
 79%|                  | 211/268 [7:14:47<2:44:34, 173.24s/it]
 79%|                  | 212/268 [7:16:24<2:20:22, 150.40s/it]
 79%|                  | 213/268 [7:17:43<1:58:17, 129.04s/it]
 80%|                  | 214/268 [7:20:37<2:08:17, 142.54s/it]
 80%|                  | 215/268 [7:22:55<2:04:45, 141.23s/it]
 81%|                  | 216/268 [7:24:57<1:57:23, 135.46s/it]
 81%|                  | 217/268 [7:27:00<1:51:50, 131.58s/it]
 81%|                   | 218/268 [7:30:08<2:03:48, 148.57s/it]
 82%|                   | 219/268 [7:31:27<1:44:23, 127.83s/it]
 82%|                   | 220/268 [7:34:24<1:54:02, 142.56s/it]
 82%|                   | 221/268 [7:36:15<1:44:05, 132.89s/it]
 83%|                   | 222/268 [7:39:13<1:52:15, 146.43s/it]
 83%|                   | 223/268 [7:40:52<1:39:15, 132.35s/it]
 84%|                   | 224/268 [7:42:21<1:27:34, 119.41s/it]
 84%|                   | 225/268 [7:44:50<1:31:51, 128.18s/it]
 84%|                   | 226/268 [7:47:01<1:30:18, 129.02s/it]
 85%|                   | 227/268 [7:49:28<1:31:50, 134.40s/it]
 85%|                   | 228/268 [7:53:13<1:47:42, 161.57s/it]
 85%|                   | 229/268 [17:54:13<118:25:10, 10931.05s/it]
 86%|                   | 230/268 [17:58:32<81:35:22, 7729.55s/it]  
 86%|                   | 231/268 [18:00:33<55:58:53, 5446.84s/it]
 87%|                   | 232/268 [18:02:53<38:32:55, 3854.88s/it]
 87%|                   | 233/268 [18:07:23<27:01:19, 2779.41s/it]
 87%|                   | 234/268 [18:09:42<18:46:11, 1987.39s/it]
 88%|                   | 235/268 [18:11:06<12:58:55, 1416.22s/it]
 88%|                   | 236/268 [18:13:10<9:08:37, 1028.68s/it] 
 88%|                   | 237/268 [18:15:37<6:34:43, 763.99s/it] 
 89%|                   | 238/268 [18:18:24<4:52:31, 585.06s/it]
 89%|                   | 239/268 [18:20:26<3:35:40, 446.23s/it]
 90%|                   | 240/268 [18:22:15<2:41:02, 345.08s/it]
 90%|                   | 241/268 [18:24:55<2:10:18, 289.56s/it]
 90%|                   | 242/268 [18:27:58<1:51:33, 257.44s/it]
 91%|                   | 243/268 [18:30:25<1:33:27, 224.30s/it]
 91%|                   | 244/268 [18:32:12<1:15:42, 189.27s/it]
 91%|                    | 245/268 [18:34:04<1:03:36, 165.94s/it]
 92%|                    | 246/268 [18:36:56<1:01:31, 167.78s/it]
 92%|                    | 247/268 [18:38:51<53:11, 151.98s/it]  
 93%|                    | 248/268 [18:40:43<46:39, 139.97s/it]
 93%|                    | 249/268 [18:42:48<42:52, 135.38s/it]
 93%|                    | 250/268 [18:44:46<39:05, 130.30s/it]
 94%|                    | 251/268 [18:45:58<31:55, 112.68s/it]
 94%|                    | 252/268 [18:47:57<30:36, 114.79s/it]
 94%|                    | 253/268 [18:49:36<27:28, 109.93s/it]
 95%|                    | 254/268 [18:51:41<26:42, 114.43s/it]
 95%|                    | 255/268 [18:53:23<23:57, 110.60s/it]
 96%|                    | 256/268 [18:56:44<27:33, 137.83s/it]
 96%|                    | 257/268 [18:58:53<24:45, 135.02s/it]
 96%|                    | 258/268 [19:00:27<20:28, 122.84s/it]
 97%|                    | 259/268 [19:02:08<17:27, 116.43s/it]
 97%|                    | 260/268 [19:04:16<15:58, 119.86s/it]
 97%|                    | 261/268 [19:06:29<14:25, 123.69s/it]
 98%|                    | 262/268 [19:07:57<11:17, 112.88s/it]
 98%|                    | 263/268 [19:10:42<10:43, 128.78s/it]
 99%|                    | 264/268 [19:12:03<07:37, 114.43s/it]
 99%|                    | 265/268 [19:14:26<06:08, 122.91s/it]
 99%|                    | 266/268 [19:17:47<04:52, 146.23s/it]
100%|                    | 267/268 [19:19:24<02:11, 131.42s/it]
100%|                    | 268/268 [19:21:28<00:00, 129.44s/it]
100%|                    | 268/268 [19:22:19<00:00, 260.22s/it]
epoch: 7, train loss: 105.70736338487312

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [01:01<29:34, 61.19s/it]
  7%|           | 2/30 [01:40<22:31, 48.27s/it]
 10%|           | 3/30 [02:28<21:40, 48.18s/it]
 13%|            | 4/30 [03:31<23:21, 53.92s/it]
 17%|            | 5/30 [03:54<17:53, 42.95s/it]
 20%|            | 6/30 [04:59<20:05, 50.23s/it]
 23%|             | 7/30 [05:31<17:01, 44.42s/it]
 27%|             | 8/30 [06:18<16:33, 45.17s/it]
 30%|             | 9/30 [07:03<15:47, 45.11s/it]
 33%|              | 10/30 [07:56<15:52, 47.62s/it]
 37%|              | 11/30 [08:41<14:48, 46.76s/it]
 40%|              | 12/30 [09:17<13:03, 43.51s/it]
 43%|               | 13/30 [10:20<14:00, 49.43s/it]
 47%|               | 14/30 [11:49<16:20, 61.26s/it]
 50%|               | 15/30 [12:30<13:47, 55.19s/it]
 53%|                | 16/30 [13:06<11:33, 49.54s/it]
 57%|                | 17/30 [13:55<10:42, 49.39s/it]
 60%|                | 18/30 [14:33<09:12, 46.07s/it]
 63%|                 | 19/30 [15:32<09:07, 49.77s/it]
 67%|                 | 20/30 [16:05<07:27, 44.76s/it]
 70%|                 | 21/30 [17:40<08:58, 59.85s/it]
 73%|                  | 22/30 [18:53<08:30, 63.83s/it]
 77%|                  | 23/30 [19:24<06:17, 53.96s/it]
 80%|                  | 24/30 [20:26<05:37, 56.31s/it]
 83%|                   | 25/30 [21:04<04:14, 50.86s/it]
 87%|                   | 26/30 [21:44<03:10, 47.71s/it]
 90%|                   | 27/30 [22:35<02:25, 48.48s/it]
 93%|                    | 28/30 [23:13<01:31, 45.51s/it]
 97%|                    | 29/30 [23:52<00:43, 43.55s/it]
100%|                    | 30/30 [24:32<00:00, 42.47s/it]
100%|                    | 30/30 [24:41<00:00, 49.37s/it]
epoch: 7, f1 score: 0.9592760609085189, dev loss: 569.0494140625
--------Save best model!--------

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [02:01<9:01:32, 121.69s/it]
  1%|          | 2/268 [04:45<10:50:35, 146.75s/it]
  1%|          | 3/268 [06:25<9:13:09, 125.24s/it] 
  1%|           | 4/268 [08:10<8:36:00, 117.27s/it]
  2%|           | 5/268 [09:37<7:45:36, 106.22s/it]
  2%|           | 6/268 [10:35<6:33:04, 90.02s/it] 
  3%|           | 7/268 [12:40<7:20:23, 101.24s/it]
  3%|           | 8/268 [14:35<7:38:11, 105.74s/it]
  3%|           | 9/268 [16:00<7:08:53, 99.36s/it] 
  4%|           | 10/268 [16:57<6:10:55, 86.26s/it]
  4%|           | 11/268 [19:08<7:07:53, 99.89s/it]
  4%|           | 12/268 [20:49<7:07:53, 100.29s/it]
  5%|           | 13/268 [21:54<6:20:06, 89.44s/it] 
  5%|           | 14/268 [23:19<6:12:53, 88.08s/it]
  6%|           | 15/268 [25:18<6:50:56, 97.46s/it]
  6%|           | 16/268 [26:58<6:52:07, 98.12s/it]
  6%|           | 17/268 [28:07<6:13:47, 89.35s/it]
  7%|           | 18/268 [29:02<5:30:18, 79.27s/it]
  7%|           | 19/268 [31:58<7:29:20, 108.27s/it]
  7%|           | 20/268 [34:36<8:28:45, 123.09s/it]
  8%|           | 21/268 [36:45<8:34:25, 124.96s/it]
  8%|           | 22/268 [38:39<8:18:11, 121.51s/it]
  9%|           | 23/268 [40:05<7:33:07, 110.97s/it]
  9%|           | 24/268 [41:13<6:38:53, 98.09s/it] 
  9%|           | 25/268 [42:55<6:41:50, 99.22s/it]
 10%|           | 26/268 [43:56<5:54:04, 87.79s/it]
 10%|           | 27/268 [45:38<6:10:12, 92.17s/it]
 10%|           | 28/268 [47:07<6:03:56, 90.99s/it]
 11%|           | 29/268 [48:38<6:03:19, 91.21s/it]
 11%|           | 30/268 [51:16<7:20:23, 111.02s/it]
 12%|            | 31/268 [55:05<9:38:42, 146.51s/it]
 12%|            | 32/268 [56:28<8:21:32, 127.51s/it]
 12%|            | 33/268 [57:32<7:04:10, 108.30s/it]
 13%|            | 34/268 [1:00:32<8:26:12, 129.80s/it]
 13%|            | 35/268 [1:01:48<7:22:02, 113.83s/it]
 13%|            | 36/268 [1:02:40<6:08:18, 95.25s/it] 
 14%|            | 37/268 [1:03:42<5:27:45, 85.13s/it]
 14%|            | 38/268 [1:07:23<8:02:33, 125.88s/it]
 15%|            | 39/268 [1:08:26<6:48:35, 107.05s/it]
 15%|            | 40/268 [1:10:45<7:23:19, 116.66s/it]
 15%|            | 41/268 [1:12:19<6:56:20, 110.04s/it]
 16%|            | 42/268 [1:15:06<7:58:03, 126.92s/it]
 16%|            | 43/268 [1:16:09<6:44:48, 107.95s/it]
 16%|            | 44/268 [1:18:23<7:11:27, 115.57s/it]
 17%|            | 45/268 [1:20:47<7:41:55, 124.28s/it]
 17%|            | 46/268 [1:24:23<9:21:18, 151.70s/it]
 18%|            | 47/268 [1:25:54<8:11:48, 133.52s/it]
 18%|            | 48/268 [1:27:40<7:39:30, 125.32s/it]
 18%|            | 49/268 [1:29:22<7:11:40, 118.27s/it]
 19%|            | 50/268 [1:30:25<6:08:53, 101.53s/it]
 19%|            | 51/268 [1:31:40<5:38:24, 93.57s/it] 
 19%|            | 52/268 [1:32:49<5:11:05, 86.42s/it]
 20%|            | 53/268 [1:36:00<7:02:10, 117.82s/it]
 20%|            | 54/268 [1:37:37<6:37:38, 111.49s/it]
 21%|            | 55/268 [1:39:32<6:39:31, 112.54s/it]
 21%|            | 56/268 [1:41:04<6:16:05, 106.44s/it]
 21%|             | 57/268 [1:43:15<6:39:36, 113.63s/it]
 22%|             | 58/268 [1:46:18<7:50:39, 134.47s/it]
 22%|             | 59/268 [1:47:15<6:27:33, 111.26s/it]
 22%|             | 60/268 [1:48:47<6:05:45, 105.51s/it]
 23%|             | 61/268 [1:49:49<5:19:24, 92.58s/it] 
 23%|             | 62/268 [1:51:29<5:25:29, 94.81s/it]
 24%|             | 63/268 [1:52:35<4:53:57, 86.04s/it]
 24%|             | 64/268 [1:53:25<4:15:32, 75.16s/it]
 24%|             | 65/268 [1:55:05<4:39:24, 82.58s/it]
 25%|             | 66/268 [1:57:01<5:11:44, 92.60s/it]
 25%|             | 67/268 [1:58:31<5:08:13, 92.01s/it]
 25%|             | 68/268 [1:59:44<4:47:29, 86.25s/it]
 26%|             | 69/268 [2:00:44<4:19:26, 78.22s/it]
 26%|             | 70/268 [2:02:12<4:28:01, 81.22s/it]
 26%|             | 71/268 [2:04:03<4:55:51, 90.11s/it]
 27%|             | 72/268 [2:05:39<5:00:20, 91.94s/it]
 27%|             | 73/268 [2:07:15<5:03:18, 93.33s/it]
 28%|             | 74/268 [2:08:24<4:37:21, 85.78s/it]
 28%|             | 75/268 [2:09:45<4:31:47, 84.49s/it]
 28%|             | 76/268 [2:11:20<4:40:02, 87.51s/it]
 29%|             | 77/268 [2:12:40<4:31:27, 85.27s/it]
 29%|             | 78/268 [2:17:16<7:31:23, 142.54s/it]
 29%|             | 79/268 [2:18:56<6:48:55, 129.82s/it]
 30%|             | 80/268 [2:20:33<6:16:02, 120.01s/it]
 30%|             | 81/268 [2:23:34<7:11:06, 138.32s/it]
 31%|             | 82/268 [2:25:38<6:55:12, 133.94s/it]
 31%|             | 83/268 [2:27:50<6:51:37, 133.50s/it]
 31%|              | 84/268 [2:31:05<7:45:22, 151.75s/it]
 32%|              | 85/268 [2:33:38<7:44:28, 152.29s/it]
 32%|              | 86/268 [2:34:48<6:26:44, 127.50s/it]
 32%|              | 87/268 [2:36:12<5:45:43, 114.61s/it]
 33%|              | 88/268 [2:38:28<6:02:25, 120.81s/it]
 33%|              | 89/268 [2:39:26<5:04:49, 102.18s/it]
 34%|              | 90/268 [2:41:09<5:03:32, 102.32s/it]
 34%|              | 91/268 [2:42:27<4:40:02, 94.93s/it] 
 34%|              | 92/268 [2:43:36<4:15:57, 87.26s/it]
 35%|              | 93/268 [2:45:39<4:45:41, 97.95s/it]
 35%|              | 94/268 [2:46:33<4:05:41, 84.72s/it]
 35%|              | 95/268 [2:49:07<5:04:39, 105.66s/it]
 36%|              | 96/268 [2:50:04<4:20:55, 91.02s/it] 
 36%|              | 97/268 [2:52:09<4:48:34, 101.25s/it]
 37%|              | 98/268 [2:53:43<4:40:18, 98.93s/it] 
 37%|              | 99/268 [2:54:50<4:11:45, 89.38s/it]
 37%|              | 100/268 [2:56:07<3:59:43, 85.62s/it]
 38%|              | 101/268 [2:57:50<4:12:48, 90.83s/it]
 38%|              | 102/268 [2:59:44<4:30:49, 97.89s/it]
 38%|              | 103/268 [3:00:53<4:05:29, 89.27s/it]
 39%|              | 104/268 [3:04:15<5:35:59, 122.92s/it]
 39%|              | 105/268 [3:05:23<4:49:13, 106.46s/it]
 40%|              | 106/268 [3:06:37<4:21:45, 96.95s/it] 
 40%|              | 107/268 [3:08:23<4:27:19, 99.63s/it]
 40%|              | 108/268 [3:09:36<4:03:52, 91.45s/it]
 41%|              | 109/268 [3:11:44<4:31:23, 102.41s/it]
 41%|              | 110/268 [3:14:39<5:27:21, 124.32s/it]
 41%|               | 111/268 [3:16:25<5:11:07, 118.90s/it]
 42%|               | 112/268 [3:18:34<5:17:02, 121.94s/it]
 42%|               | 113/268 [3:19:31<4:24:12, 102.28s/it]
 43%|               | 114/268 [3:21:18<4:26:23, 103.79s/it]
 43%|               | 115/268 [3:23:05<4:26:53, 104.66s/it]
 43%|               | 116/268 [3:24:14<3:58:01, 93.96s/it] 
 44%|               | 117/268 [3:26:22<4:21:59, 104.10s/it]
 44%|               | 118/268 [3:28:55<4:57:14, 118.89s/it]
 44%|               | 119/268 [3:30:15<4:26:07, 107.16s/it]
 45%|               | 120/268 [3:32:56<5:04:36, 123.49s/it]
 45%|               | 121/268 [3:34:11<4:26:35, 108.81s/it]
 46%|               | 122/268 [3:36:06<4:29:26, 110.73s/it]
 46%|               | 123/268 [3:37:46<4:19:58, 107.58s/it]
 46%|               | 124/268 [3:39:01<3:54:05, 97.54s/it] 
 47%|               | 125/268 [3:41:54<4:47:06, 120.46s/it]
 47%|               | 126/268 [3:43:09<4:12:29, 106.69s/it]
 47%|               | 127/268 [3:46:30<5:17:14, 134.99s/it]
 48%|               | 128/268 [3:49:45<5:57:05, 153.04s/it]
 48%|               | 129/268 [3:50:55<4:56:45, 128.10s/it]
 49%|               | 130/268 [3:52:33<4:34:06, 119.18s/it]
 49%|               | 131/268 [3:54:02<4:10:57, 109.91s/it]
 49%|               | 132/268 [3:55:50<4:07:45, 109.30s/it]
 50%|               | 133/268 [3:57:59<4:19:40, 115.41s/it]
 50%|               | 134/268 [4:00:15<4:31:33, 121.60s/it]
 50%|               | 135/268 [4:02:03<4:20:24, 117.47s/it]
 51%|               | 136/268 [4:03:49<4:10:44, 113.97s/it]
 51%|               | 137/268 [4:06:56<4:56:49, 135.95s/it]
 51%|                | 138/268 [4:08:37<4:31:31, 125.32s/it]
 52%|                | 139/268 [4:10:38<4:26:30, 123.96s/it]
 52%|                | 140/268 [4:11:51<3:52:04, 108.78s/it]
 53%|                | 141/268 [4:13:59<4:02:46, 114.70s/it]
 53%|                | 142/268 [4:17:19<4:54:11, 140.09s/it]
 53%|                | 143/268 [4:18:57<4:25:25, 127.40s/it]
 54%|                | 144/268 [4:21:49<4:51:13, 140.92s/it]
 54%|                | 145/268 [4:23:40<4:30:37, 132.01s/it]
 54%|                | 146/268 [4:25:28<4:13:56, 124.89s/it]
 55%|                | 147/268 [4:28:28<4:45:12, 141.42s/it]
 55%|                | 148/268 [4:32:18<5:35:39, 167.83s/it]
 56%|                | 149/268 [4:33:48<4:46:22, 144.39s/it]
 56%|                | 150/268 [4:37:17<5:22:12, 163.83s/it]
 56%|                | 151/268 [4:39:19<4:55:23, 151.49s/it]
 57%|                | 152/268 [4:41:15<4:32:01, 140.70s/it]
 57%|                | 153/268 [4:42:53<4:04:59, 127.82s/it]
 57%|                | 154/268 [4:44:11<3:34:38, 112.97s/it]
 58%|                | 155/268 [4:45:42<3:20:30, 106.46s/it]
 58%|                | 156/268 [4:48:12<3:43:08, 119.54s/it]
 59%|                | 157/268 [4:53:28<5:29:58, 178.37s/it]
 59%|                | 158/268 [4:55:45<5:04:13, 165.94s/it]
 59%|                | 159/268 [4:58:33<5:02:27, 166.49s/it]
 60%|                | 160/268 [5:00:10<4:22:07, 145.62s/it]
 60%|                | 161/268 [5:01:53<3:56:55, 132.85s/it]
 60%|                | 162/268 [5:03:58<3:50:37, 130.55s/it]
 61%|                | 163/268 [5:06:09<3:48:32, 130.59s/it]
 61%|                | 164/268 [5:07:56<3:34:31, 123.76s/it]
 62%|                 | 165/268 [5:10:45<3:55:27, 137.16s/it]
 62%|                 | 166/268 [5:12:33<3:38:23, 128.47s/it]
 62%|                 | 167/268 [5:14:14<3:22:19, 120.19s/it]
 63%|                 | 168/268 [5:15:51<3:08:49, 113.30s/it]
 63%|                 | 169/268 [5:18:41<3:35:01, 130.32s/it]
 63%|                 | 170/268 [5:20:07<3:11:11, 117.06s/it]
 64%|                 | 171/268 [5:21:38<2:56:16, 109.04s/it]
 64%|                 | 172/268 [5:22:43<2:33:28, 95.92s/it] 
 65%|                 | 173/268 [5:24:40<2:41:53, 102.25s/it]
 65%|                 | 174/268 [5:25:59<2:29:24, 95.37s/it] 
 65%|                 | 175/268 [5:27:54<2:36:45, 101.13s/it]
 66%|                 | 176/268 [5:29:45<2:39:47, 104.21s/it]
 66%|                 | 177/268 [5:31:07<2:27:37, 97.33s/it] 
 66%|                 | 178/268 [5:32:43<2:25:36, 97.07s/it]
 67%|                 | 179/268 [5:34:37<2:31:36, 102.21s/it]
 67%|                 | 180/268 [5:35:44<2:14:28, 91.69s/it] 
 68%|                 | 181/268 [5:37:22<2:15:24, 93.38s/it]
 68%|                 | 182/268 [5:40:39<2:58:33, 124.57s/it]
 68%|                 | 183/268 [5:42:14<2:43:59, 115.75s/it]
 69%|                 | 184/268 [5:43:40<2:29:35, 106.85s/it]
 69%|                 | 185/268 [5:45:20<2:24:49, 104.69s/it]
 69%|                 | 186/268 [5:47:18<2:28:41, 108.80s/it]
 70%|                 | 187/268 [5:49:05<2:26:00, 108.16s/it]
 70%|                 | 188/268 [5:50:37<2:17:52, 103.40s/it]
 71%|                 | 189/268 [5:52:05<2:10:02, 98.76s/it] 
 71%|                 | 190/268 [5:53:46<2:09:13, 99.40s/it]
 71%|                  | 191/268 [5:56:35<2:34:25, 120.33s/it]
 72%|                  | 192/268 [5:58:13<2:23:39, 113.42s/it]
 72%|                  | 193/268 [6:03:10<3:30:38, 168.51s/it]
 72%|                  | 194/268 [6:06:14<3:33:51, 173.40s/it]
 73%|                  | 195/268 [6:07:56<3:04:45, 151.85s/it]
 73%|                  | 196/268 [6:09:44<2:46:17, 138.58s/it]
 74%|                  | 197/268 [6:11:31<2:32:53, 129.20s/it]
 74%|                  | 198/268 [6:13:33<2:28:06, 126.95s/it]
 74%|                  | 199/268 [6:14:44<2:06:57, 110.40s/it]
 75%|                  | 200/268 [6:16:24<2:01:24, 107.13s/it]
 75%|                  | 201/268 [6:17:37<1:48:17, 96.98s/it] 
 75%|                  | 202/268 [6:19:31<1:52:17, 102.08s/it]
 76%|                  | 203/268 [6:21:21<1:53:06, 104.40s/it]
 76%|                  | 204/268 [6:23:07<1:51:46, 104.79s/it]
 76%|                  | 205/268 [6:25:05<1:54:19, 108.88s/it]
 77%|                  | 206/268 [6:26:26<1:43:55, 100.57s/it]
 77%|                  | 207/268 [6:28:47<1:54:23, 112.52s/it]
 78%|                  | 208/268 [6:30:14<1:44:48, 104.81s/it]
 78%|                  | 209/268 [6:32:25<1:50:47, 112.67s/it]
 78%|                  | 210/268 [6:33:46<1:39:53, 103.33s/it]
 79%|                  | 211/268 [6:35:09<1:32:17, 97.14s/it] 
 79%|                  | 212/268 [6:36:37<1:28:05, 94.39s/it]
 79%|                  | 213/268 [6:38:43<1:35:21, 104.03s/it]
 80%|                  | 214/268 [6:41:33<1:51:22, 123.76s/it]
 80%|                  | 215/268 [6:44:38<2:05:24, 141.97s/it]
 81%|                  | 216/268 [6:47:38<2:13:10, 153.66s/it]
 81%|                  | 217/268 [6:50:17<2:11:56, 155.23s/it]
 81%|                   | 218/268 [6:51:59<1:55:57, 139.14s/it]
 82%|                   | 219/268 [6:53:38<1:43:47, 127.08s/it]
 82%|                   | 220/268 [6:56:41<1:55:07, 143.90s/it]
 82%|                   | 221/268 [6:59:34<1:59:37, 152.71s/it]
 83%|                   | 222/268 [7:01:54<1:53:58, 148.66s/it]
 83%|                   | 223/268 [7:04:17<1:50:16, 147.02s/it]
 84%|                   | 224/268 [7:05:55<1:37:05, 132.41s/it]
 84%|                   | 225/268 [7:07:47<1:30:32, 126.33s/it]
 84%|                   | 226/268 [7:09:10<1:19:18, 113.29s/it]
 85%|                   | 227/268 [7:11:42<1:25:18, 124.85s/it]
 85%|                   | 228/268 [7:13:14<1:16:36, 114.92s/it]
 85%|                   | 229/268 [7:15:16<1:16:14, 117.30s/it]
 86%|                   | 230/268 [7:17:13<1:14:12, 117.18s/it]
 86%|                   | 231/268 [7:19:31<1:15:57, 123.19s/it]
 87%|                   | 232/268 [7:22:24<1:23:01, 138.37s/it]
 87%|                   | 233/268 [7:24:29<1:18:15, 134.14s/it]
 87%|                   | 234/268 [7:26:32<1:14:09, 130.88s/it]
 88%|                   | 235/268 [7:28:05<1:05:47, 119.63s/it]
 88%|                   | 236/268 [7:30:47<1:10:36, 132.39s/it]
 88%|                   | 237/268 [7:32:48<1:06:35, 128.88s/it]
 89%|                   | 238/268 [7:34:18<58:33, 117.12s/it]  
 89%|                   | 239/268 [7:35:48<52:41, 109.03s/it]
 90%|                   | 240/268 [7:38:58<1:02:10, 133.22s/it]
 90%|                   | 241/268 [7:42:30<1:10:33, 156.81s/it]
 90%|                   | 242/268 [7:44:48<1:05:37, 151.43s/it]
 91%|                   | 243/268 [7:47:19<1:02:56, 151.07s/it]
 91%|                   | 244/268 [7:49:19<56:46, 141.92s/it]  
 91%|                    | 245/268 [7:51:10<50:47, 132.51s/it]
 92%|                    | 246/268 [7:53:16<47:55, 130.71s/it]
 92%|                    | 247/268 [7:56:26<51:58, 148.50s/it]
 93%|                    | 248/268 [7:58:29<46:52, 140.65s/it]
 93%|                    | 249/268 [8:02:15<52:41, 166.39s/it]
 93%|                    | 250/268 [8:04:44<48:23, 161.30s/it]
 94%|                    | 251/268 [8:07:16<44:52, 158.40s/it]
 94%|                    | 252/268 [8:10:31<45:09, 169.37s/it]
 94%|                    | 253/268 [8:12:24<38:07, 152.47s/it]
 95%|                    | 254/268 [8:14:44<34:43, 148.82s/it]
 95%|                    | 255/268 [8:18:03<35:26, 163.60s/it]
 96%|                    | 256/268 [8:20:08<30:27, 152.30s/it]
 96%|                    | 257/268 [8:22:24<26:59, 147.21s/it]
 96%|                    | 258/268 [8:25:14<25:41, 154.16s/it]
 97%|                    | 259/268 [8:27:15<21:38, 144.25s/it]
 97%|                    | 260/268 [8:30:25<21:02, 157.77s/it]
 97%|                    | 261/268 [8:32:39<17:35, 150.79s/it]
 98%|                    | 262/268 [8:34:29<13:50, 138.48s/it]
 98%|                    | 263/268 [8:36:22<10:54, 130.90s/it]
 99%|                    | 264/268 [8:38:50<09:04, 136.07s/it]
 99%|                    | 265/268 [8:42:02<07:38, 152.84s/it]
 99%|                    | 266/268 [8:44:41<05:09, 154.61s/it]
100%|                    | 267/268 [8:47:08<02:32, 152.33s/it]
100%|                    | 268/268 [8:48:44<00:00, 135.54s/it]
100%|                    | 268/268 [8:50:15<00:00, 118.71s/it]
epoch: 8, train loss: 81.6465308488305

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [01:05<31:52, 65.95s/it]
  7%|           | 2/30 [02:09<30:12, 64.71s/it]
 10%|           | 3/30 [03:12<28:37, 63.61s/it]
 13%|            | 4/30 [04:25<29:12, 67.40s/it]
 17%|            | 5/30 [05:10<24:48, 59.56s/it]
 20%|            | 6/30 [06:41<28:01, 70.06s/it]
 23%|             | 7/30 [07:49<26:37, 69.48s/it]
 27%|             | 8/30 [10:23<35:19, 96.33s/it]
 30%|             | 9/30 [11:24<29:52, 85.37s/it]
 33%|              | 10/30 [12:35<26:56, 80.84s/it]
 37%|              | 11/30 [13:46<24:40, 77.94s/it]
 40%|              | 12/30 [15:11<23:57, 79.84s/it]
 43%|               | 13/30 [16:27<22:19, 78.77s/it]
 47%|               | 14/30 [17:21<19:01, 71.32s/it]
 50%|               | 15/30 [17:53<14:50, 59.37s/it]
 53%|                | 16/30 [19:56<18:19, 78.53s/it]
 57%|                | 17/30 [21:31<18:06, 83.58s/it]
 60%|                | 18/30 [22:54<16:40, 83.36s/it]
 63%|                 | 19/30 [25:47<20:14, 110.38s/it]
 67%|                 | 20/30 [26:29<14:58, 89.80s/it] 
 70%|                 | 21/30 [27:22<11:48, 78.73s/it]
 73%|                  | 22/30 [28:59<11:14, 84.29s/it]
 77%|                  | 23/30 [29:59<08:58, 76.88s/it]
 80%|                  | 24/30 [30:38<06:34, 65.69s/it]
 83%|                   | 25/30 [31:38<05:20, 64.03s/it]
 87%|                   | 26/30 [32:22<03:51, 57.82s/it]
 90%|                   | 27/30 [34:27<03:54, 78.12s/it]
 93%|                    | 28/30 [35:28<02:26, 73.01s/it]
 97%|                    | 29/30 [36:15<01:05, 65.06s/it]
100%|                    | 30/30 [36:53<00:00, 57.08s/it]
100%|                    | 30/30 [37:10<00:00, 74.35s/it]
epoch: 8, f1 score: 0.9588630769303456, dev loss: 586.9668619791667

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [01:42<7:35:18, 102.32s/it]
  1%|          | 2/268 [03:57<8:58:20, 121.43s/it]
  1%|          | 3/268 [05:26<7:51:42, 106.80s/it]
  1%|           | 4/268 [08:19<9:44:40, 132.88s/it]
  2%|           | 5/268 [09:32<8:08:06, 111.35s/it]
  2%|           | 6/268 [11:10<7:46:20, 106.80s/it]
  3%|           | 7/268 [13:02<7:52:12, 108.55s/it]
  3%|           | 8/268 [15:06<8:10:58, 113.30s/it]
  3%|           | 9/268 [17:05<8:17:46, 115.31s/it]
  4%|           | 10/268 [19:15<8:35:17, 119.84s/it]
  4%|           | 11/268 [21:16<8:34:21, 120.08s/it]
  4%|           | 12/268 [24:47<10:30:18, 147.73s/it]
  5%|           | 13/268 [26:05<8:57:59, 126.59s/it] 
  5%|           | 14/268 [29:19<10:22:24, 147.02s/it]
  6%|           | 15/268 [31:21<9:47:30, 139.33s/it] 
  6%|           | 16/268 [33:11<9:08:28, 130.59s/it]
  6%|           | 17/268 [35:37<9:26:20, 135.38s/it]
  7%|           | 18/268 [39:51<11:52:31, 171.00s/it]
  7%|           | 19/268 [42:10<11:09:04, 161.22s/it]
  7%|           | 20/268 [44:04<10:07:46, 147.04s/it]
  8%|           | 21/268 [46:56<10:36:29, 154.61s/it]
  8%|           | 22/268 [51:23<12:51:45, 188.23s/it]
  9%|           | 23/268 [53:58<12:08:45, 178.47s/it]
  9%|           | 24/268 [55:32<10:22:47, 153.14s/it]
  9%|           | 25/268 [58:21<10:38:51, 157.74s/it]
 10%|           | 26/268 [59:53<9:17:10, 138.14s/it] 
 10%|           | 27/268 [1:03:28<10:46:37, 160.99s/it]
 10%|           | 28/268 [1:06:23<11:01:13, 165.31s/it]
 11%|           | 29/268 [1:09:17<11:09:09, 167.99s/it]
 11%|           | 30/268 [1:11:30<10:24:41, 157.49s/it]
 12%|            | 31/268 [1:14:07<10:20:48, 157.17s/it]
 12%|            | 32/268 [1:16:39<10:12:55, 155.83s/it]
 12%|            | 33/268 [1:17:50<8:30:42, 130.39s/it] 
 13%|            | 34/268 [1:20:02<8:29:33, 130.66s/it]
 13%|            | 35/268 [1:22:43<9:03:18, 139.91s/it]
 13%|            | 36/268 [1:26:47<11:00:55, 170.93s/it]
 14%|            | 37/268 [1:29:23<10:41:43, 166.68s/it]
 14%|            | 38/268 [1:31:12<9:32:17, 149.29s/it] 
 15%|            | 39/268 [1:33:34<9:21:12, 147.04s/it]
 15%|            | 40/268 [1:36:22<9:43:23, 153.52s/it]
 15%|            | 41/268 [1:38:36<9:18:14, 147.55s/it]
 16%|            | 42/268 [1:40:43<8:52:16, 141.31s/it]
 16%|            | 43/268 [1:42:38<8:20:11, 133.38s/it]
 16%|            | 44/268 [1:44:36<8:01:16, 128.91s/it]
 17%|            | 45/268 [1:46:28<7:39:58, 123.76s/it]
 17%|            | 46/268 [1:48:26<7:31:33, 122.04s/it]
 18%|            | 47/268 [1:50:26<7:27:28, 121.48s/it]
 18%|            | 48/268 [1:52:50<7:50:25, 128.30s/it]
 18%|            | 49/268 [1:55:10<8:01:12, 131.84s/it]
 19%|            | 50/268 [1:57:21<7:57:30, 131.43s/it]
 19%|            | 51/268 [1:59:54<8:18:41, 137.89s/it]
 19%|            | 52/268 [2:03:16<9:25:57, 157.21s/it]
 20%|            | 53/268 [2:05:11<8:37:28, 144.41s/it]
 20%|            | 54/268 [2:09:34<10:42:04, 180.02s/it]
 21%|            | 55/268 [2:11:40<9:41:54, 163.92s/it] 
 21%|            | 56/268 [2:16:08<11:29:08, 195.04s/it]
 21%|             | 57/268 [2:18:08<10:06:23, 172.43s/it]
 22%|             | 58/268 [2:20:02<9:02:11, 154.91s/it] 
 22%|             | 59/268 [2:22:11<8:33:22, 147.38s/it]
 22%|             | 60/268 [2:24:09<8:00:17, 138.55s/it]
 23%|             | 61/268 [2:29:37<11:13:54, 195.34s/it]
 23%|             | 62/268 [2:32:44<11:01:42, 192.73s/it]
 24%|             | 63/268 [2:34:52<9:52:20, 173.37s/it] 
 24%|             | 64/268 [2:37:02<9:05:42, 160.50s/it]
 24%|             | 65/268 [2:38:53<8:12:28, 145.56s/it]
 25%|             | 66/268 [2:40:41<7:31:55, 134.23s/it]
 25%|             | 67/268 [2:43:10<7:44:41, 138.71s/it]
 25%|             | 68/268 [2:47:24<9:37:10, 173.15s/it]
 26%|             | 69/268 [2:50:23<9:40:46, 175.11s/it]
 26%|             | 70/268 [2:51:58<8:18:18, 151.00s/it]
 26%|             | 71/268 [2:55:41<9:26:23, 172.51s/it]
 27%|             | 72/268 [3:02:13<12:58:59, 238.46s/it]
 27%|             | 73/268 [3:04:18<11:04:42, 204.53s/it]
 28%|             | 74/268 [3:05:53<9:14:43, 171.56s/it] 
 28%|             | 75/268 [3:08:02<8:31:06, 158.90s/it]
 28%|             | 76/268 [3:10:31<8:18:34, 155.80s/it]
 29%|             | 77/268 [3:12:57<8:06:24, 152.80s/it]
 29%|             | 78/268 [3:16:03<8:35:50, 162.90s/it]
 29%|             | 79/268 [3:18:59<8:44:58, 166.66s/it]
 30%|             | 80/268 [13:59:18<607:59:56, 11642.54s/it]
 30%|             | 81/268 [14:02:26<426:15:37, 8206.08s/it] 
 31%|             | 82/268 [14:04:27<298:39:42, 5780.55s/it]
 31%|             | 83/268 [14:07:37<210:51:54, 4103.32s/it]
 31%|              | 84/268 [14:10:15<149:13:59, 2919.78s/it]
 32%|              | 85/268 [14:12:38<106:04:21, 2086.68s/it]
 32%|              | 86/268 [14:14:09<75:13:35, 1488.00s/it] 
 32%|              | 87/268 [14:17:02<54:58:56, 1093.57s/it]
 33%|              | 88/268 [14:20:35<41:28:17, 829.43s/it] 
 33%|              | 89/268 [14:22:35<30:39:21, 616.54s/it]
 34%|              | 90/268 [14:25:07<23:35:56, 477.29s/it]
 34%|              | 91/268 [14:26:40<17:48:02, 362.05s/it]
 34%|              | 92/268 [14:28:33<14:02:12, 287.12s/it]
 35%|              | 93/268 [14:31:56<12:44:11, 262.01s/it]
 35%|              | 94/268 [14:36:32<12:51:55, 266.18s/it]
 35%|              | 95/268 [14:40:31<12:23:55, 258.01s/it]
 36%|              | 96/268 [14:43:08<10:53:09, 227.84s/it]
 36%|              | 97/268 [14:45:10<9:18:14, 195.88s/it] 
 37%|              | 98/268 [14:47:56<8:50:13, 187.14s/it]
 37%|              | 99/268 [14:50:34<8:21:42, 178.12s/it]
 37%|              | 100/268 [14:52:22<7:20:11, 157.21s/it]
 38%|              | 101/268 [14:55:44<7:54:48, 170.59s/it]
 38%|              | 102/268 [14:57:27<6:55:45, 150.27s/it]
 38%|              | 103/268 [14:59:17<6:20:11, 138.25s/it]
 39%|              | 104/268 [15:01:48<6:28:40, 142.20s/it]
 39%|              | 105/268 [15:03:35<5:57:39, 131.66s/it]
 40%|              | 106/268 [15:06:39<6:37:29, 147.22s/it]
 40%|              | 107/268 [15:08:08<5:48:05, 129.72s/it]
 40%|              | 108/268 [15:10:56<6:16:47, 141.30s/it]
 41%|              | 109/268 [15:15:30<7:59:55, 181.11s/it]
 41%|              | 110/268 [15:18:04<7:35:39, 173.04s/it]
 41%|               | 111/268 [15:21:21<7:51:18, 180.12s/it]
 42%|               | 112/268 [15:23:21<7:01:35, 162.15s/it]
 42%|               | 113/268 [15:26:02<6:57:33, 161.64s/it]
 43%|               | 114/268 [15:27:17<5:48:29, 135.77s/it]
 43%|               | 115/268 [15:28:42<5:07:19, 120.52s/it]
 43%|               | 116/268 [15:31:00<5:18:53, 125.88s/it]
 44%|               | 117/268 [15:32:20<4:41:48, 111.97s/it]
 44%|               | 118/268 [15:34:47<5:06:06, 122.44s/it]
 44%|               | 119/268 [15:35:54<4:23:18, 106.03s/it]
 45%|               | 120/268 [15:37:19<4:05:51, 99.67s/it] 
 45%|               | 121/268 [15:40:23<5:05:41, 124.77s/it]
 46%|               | 122/268 [15:42:33<5:07:32, 126.39s/it]
 46%|               | 123/268 [15:44:56<5:17:53, 131.54s/it]
 46%|               | 124/268 [15:46:17<4:38:53, 116.20s/it]
 47%|               | 125/268 [15:47:49<4:19:40, 108.95s/it]
 47%|               | 126/268 [15:49:20<4:05:24, 103.70s/it]
 47%|               | 127/268 [15:51:02<4:02:06, 103.02s/it]
 48%|               | 128/268 [15:52:53<4:05:56, 105.40s/it]
 48%|               | 129/268 [15:55:38<4:46:01, 123.46s/it]
 49%|               | 130/268 [15:58:57<5:36:06, 146.14s/it]
 49%|               | 131/268 [16:00:35<5:00:30, 131.61s/it]
 49%|               | 132/268 [16:03:37<5:32:43, 146.79s/it]
 50%|               | 133/268 [16:04:56<4:44:16, 126.34s/it]
 50%|               | 134/268 [16:05:59<3:59:59, 107.46s/it]
 50%|               | 135/268 [16:08:02<4:08:35, 112.14s/it]
 51%|               | 136/268 [16:09:07<3:35:27, 97.93s/it] 
 51%|               | 137/268 [16:10:51<3:37:37, 99.67s/it]
 51%|                | 138/268 [16:13:32<4:15:47, 118.06s/it]
 52%|                | 139/268 [16:14:47<3:45:54, 105.08s/it]
 52%|                | 140/268 [16:16:20<3:36:44, 101.59s/it]
 53%|                | 141/268 [16:18:29<3:52:29, 109.84s/it]
 53%|                | 142/268 [16:20:04<3:41:02, 105.26s/it]
 53%|                | 143/268 [16:21:47<3:37:53, 104.59s/it]
 54%|                | 144/268 [16:22:58<3:15:20, 94.52s/it] 
 54%|                | 145/268 [16:24:40<3:18:46, 96.96s/it]
 54%|                | 146/268 [16:26:25<3:21:48, 99.25s/it]
 55%|                | 147/268 [16:27:33<3:01:03, 89.78s/it]
 55%|                | 148/268 [16:29:58<3:33:07, 106.56s/it]
 56%|                | 149/268 [16:32:15<3:49:09, 115.55s/it]
 56%|                | 150/268 [16:33:48<3:33:57, 108.79s/it]
 56%|                | 151/268 [16:36:48<4:13:43, 130.11s/it]
 57%|                | 152/268 [16:39:08<4:17:12, 133.04s/it]
 57%|                | 153/268 [16:40:57<4:01:35, 126.05s/it]
 57%|                | 154/268 [16:42:23<3:36:12, 113.80s/it]
 58%|                | 155/268 [16:45:13<4:06:04, 130.66s/it]
 58%|                | 156/268 [16:47:24<4:04:30, 130.99s/it]
 59%|                | 157/268 [16:48:44<3:33:51, 115.60s/it]
 59%|                | 158/268 [16:49:51<3:05:10, 101.00s/it]
 59%|                | 159/268 [16:51:46<3:10:51, 105.06s/it]
 60%|                | 160/268 [16:53:27<3:07:18, 104.06s/it]
 60%|                | 161/268 [16:54:33<2:45:08, 92.60s/it] 
 60%|                | 162/268 [16:56:37<3:00:03, 101.92s/it]
 61%|                | 163/268 [16:57:48<2:42:14, 92.71s/it] 
 61%|                | 164/268 [17:01:01<3:32:45, 122.75s/it]
 62%|                 | 165/268 [17:02:47<3:22:04, 117.72s/it]
 62%|                 | 166/268 [17:05:36<3:46:15, 133.10s/it]
 62%|                 | 167/268 [17:08:11<3:55:05, 139.66s/it]
 63%|                 | 168/268 [17:10:52<4:03:38, 146.19s/it]
 63%|                 | 169/268 [17:11:51<3:17:47, 119.87s/it]
 63%|                 | 170/268 [17:14:48<3:43:45, 136.99s/it]
 64%|                 | 171/268 [17:17:58<4:07:23, 153.03s/it]
 64%|                 | 172/268 [17:20:12<3:55:44, 147.33s/it]
 65%|                 | 173/268 [17:22:04<3:36:18, 136.62s/it]
 65%|                 | 174/268 [17:24:00<3:24:24, 130.48s/it]
 65%|                 | 175/268 [17:25:18<2:58:04, 114.88s/it]
 66%|                 | 176/268 [17:28:05<3:20:09, 130.54s/it]
 66%|                 | 177/268 [17:30:12<3:16:08, 129.32s/it]
 66%|                 | 178/268 [17:31:32<2:51:38, 114.42s/it]
 67%|                 | 179/268 [17:33:15<2:44:41, 111.03s/it]
 67%|                 | 180/268 [17:34:46<2:34:04, 105.05s/it]
 68%|                 | 181/268 [17:36:42<2:37:06, 108.35s/it]
 68%|                 | 182/268 [17:38:11<2:26:57, 102.53s/it]
 68%|                 | 183/268 [17:39:24<2:12:46, 93.72s/it] 
 69%|                 | 184/268 [17:41:28<2:24:09, 102.98s/it]
 69%|                 | 185/268 [17:43:30<2:30:16, 108.64s/it]
 69%|                 | 186/268 [17:45:24<2:30:32, 110.16s/it]
 70%|                 | 187/268 [17:46:52<2:19:44, 103.51s/it]
 70%|                 | 188/268 [17:48:52<2:24:37, 108.47s/it]
 71%|                 | 189/268 [17:50:58<2:29:39, 113.66s/it]
 71%|                 | 190/268 [17:52:03<2:08:47, 99.07s/it] 
 71%|                  | 191/268 [17:54:06<2:16:29, 106.35s/it]
 72%|                  | 192/268 [17:55:59<2:17:09, 108.29s/it]
 72%|                  | 193/268 [17:57:34<2:10:13, 104.18s/it]
 72%|                  | 194/268 [17:59:30<2:12:51, 107.73s/it]
 73%|                  | 195/268 [18:01:35<2:17:29, 113.01s/it]
 73%|                  | 196/268 [18:03:04<2:06:57, 105.80s/it]
 74%|                  | 197/268 [18:04:49<2:04:49, 105.48s/it]
 74%|                  | 198/268 [18:06:14<1:55:53, 99.33s/it] 
 74%|                  | 199/268 [18:11:19<3:05:14, 161.08s/it]
 75%|                  | 200/268 [18:14:16<3:07:51, 165.76s/it]
 75%|                  | 201/268 [18:15:37<2:36:47, 140.41s/it]
 75%|                  | 202/268 [18:17:10<2:18:58, 126.34s/it]
 76%|                  | 203/268 [18:19:13<2:15:47, 125.34s/it]
 76%|                  | 204/268 [18:20:14<1:53:03, 105.99s/it]
 76%|                  | 205/268 [18:21:44<1:46:10, 101.12s/it]
 77%|                  | 206/268 [18:23:31<1:46:11, 102.77s/it]
 77%|                  | 207/268 [18:24:31<1:31:35, 90.09s/it] 
 78%|                  | 208/268 [18:26:38<1:41:10, 101.17s/it]
 78%|                  | 209/268 [18:29:31<2:00:48, 122.85s/it]
 78%|                  | 210/268 [18:32:44<2:19:03, 143.85s/it]
 79%|                  | 211/268 [18:34:16<2:01:45, 128.16s/it]
 79%|                  | 212/268 [18:36:38<2:03:25, 132.25s/it]
 79%|                  | 213/268 [18:37:39<1:41:43, 110.98s/it]
 80%|                  | 214/268 [18:41:19<2:09:14, 143.59s/it]
 80%|                  | 215/268 [18:43:00<1:55:32, 130.80s/it]
 81%|                  | 216/268 [18:44:38<1:44:57, 121.11s/it]
 81%|                  | 217/268 [18:47:21<1:53:33, 133.59s/it]
 81%|                   | 218/268 [18:50:59<2:12:33, 159.08s/it]
 82%|                   | 219/268 [18:52:34<1:54:09, 139.78s/it]
 82%|                   | 220/268 [18:53:56<1:37:55, 122.42s/it]
 82%|                   | 221/268 [18:56:12<1:39:07, 126.55s/it]
 83%|                   | 222/268 [18:57:56<1:31:41, 119.60s/it]
 83%|                   | 223/268 [18:59:27<1:23:18, 111.07s/it]
 84%|                   | 224/268 [19:01:13<1:20:20, 109.57s/it]
 84%|                   | 225/268 [19:02:22<1:09:53, 97.52s/it] 
 84%|                   | 226/268 [19:04:27<1:13:52, 105.53s/it]
 85%|                   | 227/268 [19:05:35<1:04:30, 94.41s/it] 
 85%|                   | 228/268 [19:06:55<1:00:09, 90.24s/it]
 85%|                   | 229/268 [19:09:14<1:08:04, 104.73s/it]
 86%|                   | 230/268 [19:10:22<59:19, 93.67s/it]   
 86%|                   | 231/268 [19:12:42<1:06:25, 107.72s/it]
 87%|                   | 232/268 [19:14:21<1:02:56, 104.91s/it]
 87%|                   | 233/268 [19:17:11<1:12:41, 124.60s/it]
 87%|                   | 234/268 [19:20:06<1:19:10, 139.74s/it]
 88%|                   | 235/268 [19:23:50<1:30:46, 165.03s/it]
 88%|                   | 236/268 [19:26:00<1:22:22, 154.46s/it]
 88%|                   | 237/268 [19:28:02<1:14:40, 144.54s/it]
 89%|                   | 238/268 [19:30:50<1:15:51, 151.72s/it]
 89%|                   | 239/268 [19:32:06<1:02:16, 128.85s/it]
 90%|                   | 240/268 [19:35:45<1:12:50, 156.08s/it]
 90%|                   | 241/268 [19:37:54<1:06:36, 148.01s/it]
 90%|                   | 242/268 [19:40:59<1:08:52, 158.93s/it]
 91%|                   | 243/268 [19:43:15<1:03:24, 152.17s/it]
 91%|                   | 244/268 [19:45:32<59:02, 147.58s/it]  
 91%|                    | 245/268 [19:47:25<52:33, 137.11s/it]
 92%|                    | 246/268 [19:50:50<57:46, 157.59s/it]
 92%|                    | 247/268 [19:54:45<1:03:18, 180.90s/it]
 93%|                    | 248/268 [20:00:10<1:14:42, 224.15s/it]
 93%|                    | 249/268 [20:02:14<1:01:22, 193.84s/it]
 93%|                    | 250/268 [20:05:57<1:00:50, 202.79s/it]
 94%|                    | 251/268 [20:07:40<48:56, 172.73s/it]  
 94%|                    | 252/268 [20:10:19<44:57, 168.59s/it]
 94%|                    | 253/268 [20:11:57<36:53, 147.56s/it]
 95%|                    | 254/268 [20:14:47<35:58, 154.15s/it]
 95%|                    | 255/268 [20:18:26<37:39, 173.82s/it]
 96%|                    | 256/268 [20:21:11<34:12, 171.00s/it]
 96%|                    | 257/268 [20:23:02<28:04, 153.10s/it]
 96%|                    | 258/268 [20:25:16<24:34, 147.45s/it]
 97%|                    | 259/268 [20:27:49<22:21, 149.04s/it]
 97%|                    | 260/268 [20:29:54<18:55, 141.91s/it]
 97%|                    | 261/268 [20:31:47<15:32, 133.15s/it]
 98%|                    | 262/268 [20:34:09<13:33, 135.63s/it]
 98%|                    | 263/268 [20:37:16<12:36, 151.29s/it]
 99%|                    | 264/268 [20:40:01<10:20, 155.17s/it]
 99%|                    | 265/268 [20:41:52<07:05, 141.96s/it]
 99%|                    | 266/268 [20:46:08<05:52, 176.28s/it]
100%|                    | 267/268 [20:48:35<02:47, 167.30s/it]
100%|                    | 268/268 [20:51:11<00:00, 163.98s/it]
100%|                    | 268/268 [20:52:28<00:00, 280.41s/it]
epoch: 9, train loss: 68.24962860078953

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:51<24:56, 51.59s/it]
  7%|           | 2/30 [01:44<24:28, 52.44s/it]
 10%|           | 3/30 [03:06<29:39, 65.91s/it]
 13%|            | 4/30 [04:01<26:45, 61.75s/it]
 17%|            | 5/30 [05:18<27:53, 66.94s/it]
 20%|            | 6/30 [06:21<26:14, 65.60s/it]
 23%|             | 7/30 [06:52<20:54, 54.52s/it]
 27%|             | 8/30 [08:04<22:01, 60.08s/it]
 30%|             | 9/30 [08:59<20:24, 58.33s/it]
 33%|              | 10/30 [09:50<18:44, 56.21s/it]
 37%|              | 11/30 [10:29<16:06, 50.88s/it]
 40%|              | 12/30 [11:18<15:03, 50.20s/it]
 43%|               | 13/30 [12:24<15:34, 54.99s/it]
 47%|               | 14/30 [12:58<13:01, 48.83s/it]
 50%|               | 15/30 [13:28<10:47, 43.14s/it]
 53%|                | 16/30 [14:16<10:21, 44.39s/it]
 57%|                | 17/30 [14:46<08:41, 40.08s/it]
 60%|                | 18/30 [15:22<07:48, 39.04s/it]
 63%|                 | 19/30 [16:10<07:39, 41.73s/it]
 67%|                 | 20/30 [17:32<08:59, 53.92s/it]
 70%|                 | 21/30 [18:13<07:30, 50.01s/it]
 73%|                  | 22/30 [18:46<05:58, 44.79s/it]
 77%|                  | 23/30 [19:38<05:28, 46.94s/it]
 80%|                  | 24/30 [20:21<04:34, 45.71s/it]
 83%|                   | 25/30 [21:08<03:50, 46.01s/it]
 87%|                   | 26/30 [21:40<02:47, 41.80s/it]
 90%|                   | 27/30 [22:24<02:07, 42.65s/it]
 93%|                    | 28/30 [23:13<01:28, 44.38s/it]
 97%|                    | 29/30 [23:54<00:43, 43.57s/it]
100%|                    | 30/30 [24:28<00:00, 40.57s/it]
100%|                    | 30/30 [24:38<00:00, 49.29s/it]
epoch: 9, f1 score: 0.9580188167093889, dev loss: 619.0008463541667

  0%|          | 0/268 [00:00<?, ?it/s]
  0%|          | 1/268 [01:23<6:13:01, 83.83s/it]
  1%|          | 2/268 [04:04<9:31:20, 128.87s/it]
  1%|          | 3/268 [05:48<8:40:01, 117.74s/it]
  1%|           | 4/268 [07:48<8:41:13, 118.46s/it]
  2%|           | 5/268 [09:06<7:35:48, 103.99s/it]
  2%|           | 6/268 [10:50<7:33:52, 103.94s/it]
  3%|           | 7/268 [13:39<9:05:00, 125.29s/it]
  3%|           | 8/268 [15:10<8:14:52, 114.20s/it]
  3%|           | 9/268 [16:53<7:58:25, 110.83s/it]
  4%|           | 10/268 [18:23<7:28:35, 104.32s/it]
  4%|           | 11/268 [19:54<7:08:58, 100.15s/it]
  4%|           | 12/268 [21:13<6:40:28, 93.86s/it] 
  5%|           | 13/268 [22:20<6:04:18, 85.72s/it]
  5%|           | 14/268 [23:29<5:41:18, 80.62s/it]
  6%|           | 15/268 [26:39<7:58:53, 113.57s/it]
  6%|           | 16/268 [27:26<6:33:05, 93.59s/it] 
  6%|           | 17/268 [29:00<6:31:48, 93.66s/it]
  7%|           | 18/268 [29:54<5:40:29, 81.72s/it]
  7%|           | 19/268 [31:45<6:16:18, 90.68s/it]
  7%|           | 20/268 [33:26<6:27:17, 93.70s/it]
  8%|           | 21/268 [34:35<5:55:29, 86.36s/it]
  8%|           | 22/268 [38:20<8:44:11, 127.85s/it]
  9%|           | 23/268 [41:32<10:01:16, 147.25s/it]
  9%|           | 24/268 [42:47<8:29:49, 125.37s/it] 
  9%|           | 25/268 [43:55<7:18:58, 108.39s/it]
 10%|           | 26/268 [45:26<6:56:02, 103.15s/it]
 10%|           | 27/268 [47:20<7:06:31, 106.19s/it]
 10%|           | 28/268 [49:24<7:26:28, 111.62s/it]
 11%|           | 29/268 [50:45<6:47:59, 102.42s/it]
 11%|           | 30/268 [53:51<8:26:23, 127.66s/it]
 12%|            | 31/268 [58:11<11:00:47, 167.29s/it]
 12%|            | 32/268 [1:00:14<10:05:33, 153.95s/it]
 12%|            | 33/268 [1:02:31<9:42:26, 148.71s/it] 
 13%|            | 34/268 [1:04:06<8:37:26, 132.68s/it]
 13%|            | 35/268 [1:06:19<8:35:31, 132.75s/it]
 13%|            | 36/268 [1:10:45<11:08:39, 172.93s/it]
 14%|            | 37/268 [1:13:03<10:24:31, 162.21s/it]
 14%|            | 38/268 [1:19:07<14:14:47, 222.99s/it]
 15%|            | 39/268 [1:21:05<12:10:28, 191.39s/it]
 15%|            | 40/268 [1:23:56<11:44:06, 185.29s/it]
 15%|            | 41/268 [1:27:09<11:49:12, 187.46s/it]
 16%|            | 42/268 [1:30:10<11:38:53, 185.55s/it]
 16%|            | 43/268 [1:31:55<10:05:16, 161.41s/it]
 16%|            | 44/268 [1:34:26<9:50:51, 158.27s/it] 
 17%|            | 45/268 [1:39:42<12:44:20, 205.65s/it]
 17%|            | 46/268 [1:41:48<11:12:46, 181.83s/it]
 18%|            | 47/268 [1:44:52<11:12:00, 182.44s/it]
 18%|            | 48/268 [1:47:04<10:13:15, 167.25s/it]
 18%|            | 49/268 [1:51:39<12:08:10, 199.50s/it]
 19%|            | 50/268 [1:53:23<10:20:45, 170.85s/it]
 19%|            | 51/268 [1:58:06<12:20:03, 204.62s/it]
 19%|            | 52/268 [2:01:55<12:42:27, 211.79s/it]
 20%|            | 53/268 [2:06:11<13:26:32, 225.08s/it]
 20%|            | 54/268 [2:12:44<16:23:05, 275.63s/it]
 21%|            | 55/268 [2:14:35<13:22:26, 226.04s/it]
 21%|            | 56/268 [2:16:54<11:47:11, 200.15s/it]
 21%|             | 57/268 [2:19:18<10:44:16, 183.21s/it]
 22%|             | 58/268 [2:23:59<12:23:48, 212.52s/it]
 22%|             | 59/268 [2:27:18<12:06:36, 208.59s/it]
 22%|             | 60/268 [2:31:52<13:10:17, 227.97s/it]
 23%|             | 61/268 [2:35:53<13:20:37, 232.06s/it]
 23%|             | 62/268 [2:39:02<12:32:18, 219.12s/it]
 24%|             | 63/268 [2:42:28<12:15:09, 215.17s/it]
 24%|             | 64/268 [2:44:56<11:03:09, 195.05s/it]
 24%|             | 65/268 [2:47:07<9:54:29, 175.71s/it] 
 25%|             | 66/268 [2:49:52<9:41:14, 172.65s/it]
 25%|             | 67/268 [2:52:06<8:59:22, 161.01s/it]
 25%|             | 68/268 [2:54:36<8:45:20, 157.60s/it]
 26%|             | 69/268 [2:57:21<8:50:14, 159.87s/it]
 26%|             | 70/268 [2:59:39<8:25:53, 153.30s/it]
 26%|             | 71/268 [3:05:46<11:54:10, 217.51s/it]
 27%|             | 72/268 [3:07:06<9:35:53, 176.29s/it] 
 27%|             | 73/268 [3:10:31<10:00:13, 184.69s/it]
 28%|             | 74/268 [3:13:04<9:26:36, 175.24s/it] 
 28%|             | 75/268 [3:16:30<9:53:24, 184.48s/it]
 28%|             | 76/268 [3:20:18<10:32:37, 197.70s/it]
 29%|             | 77/268 [3:22:49<9:44:03, 183.47s/it] 
 29%|             | 78/268 [3:25:04<8:55:13, 169.02s/it]
 29%|             | 79/268 [3:27:31<8:31:36, 162.41s/it]
 30%|             | 80/268 [3:31:28<9:38:48, 184.73s/it]
 30%|             | 81/268 [3:34:40<9:42:30, 186.90s/it]
 31%|             | 82/268 [3:37:45<9:37:33, 186.31s/it]
 31%|             | 83/268 [3:39:45<8:33:12, 166.44s/it]
 31%|              | 84/268 [3:43:12<9:07:44, 178.61s/it]
 32%|              | 85/268 [3:45:49<8:45:11, 172.19s/it]
 32%|              | 86/268 [3:51:52<11:35:54, 229.42s/it]
 32%|              | 87/268 [3:55:03<10:57:40, 218.02s/it]
 33%|              | 88/268 [4:00:31<12:32:41, 250.90s/it]
 33%|              | 89/268 [4:03:52<11:43:30, 235.82s/it]
 34%|              | 90/268 [4:05:07<9:17:12, 187.82s/it] 
 34%|              | 91/268 [4:07:18<8:23:11, 170.57s/it]
 34%|              | 92/268 [4:11:22<9:25:06, 192.65s/it]
 35%|              | 93/268 [4:13:16<8:13:28, 169.19s/it]
 35%|              | 94/268 [4:16:12<8:16:22, 171.16s/it]
 35%|              | 95/268 [4:18:55<8:06:23, 168.69s/it]
 36%|              | 96/268 [4:21:35<7:56:08, 166.10s/it]
 36%|              | 97/268 [4:24:26<7:57:36, 167.58s/it]
 37%|              | 98/268 [4:26:59<7:42:10, 163.12s/it]
 37%|              | 99/268 [4:30:06<7:59:56, 170.39s/it]
 37%|              | 100/268 [4:33:35<8:29:03, 181.81s/it]
 38%|              | 101/268 [4:36:16<8:09:00, 175.69s/it]
 38%|              | 102/268 [4:38:54<7:51:15, 170.34s/it]
 38%|              | 103/268 [4:41:19<7:27:25, 162.70s/it]
 39%|              | 104/268 [4:45:39<8:44:28, 191.88s/it]
 39%|              | 105/268 [4:47:03<7:13:19, 159.50s/it]
 40%|              | 106/268 [4:49:14<6:47:47, 151.04s/it]
 40%|              | 107/268 [4:51:14<6:20:19, 141.74s/it]
 40%|              | 108/268 [4:54:32<7:03:09, 158.68s/it]
 41%|              | 109/268 [4:58:51<8:20:13, 188.76s/it]
 41%|              | 110/268 [5:02:41<8:49:11, 200.96s/it]
 41%|               | 111/268 [5:05:23<8:15:31, 189.37s/it]
 42%|               | 112/268 [5:09:04<8:36:51, 198.79s/it]
 42%|               | 113/268 [5:10:22<7:00:19, 162.70s/it]
 43%|               | 114/268 [5:16:03<9:14:51, 216.18s/it]
 43%|               | 115/268 [5:21:08<10:19:10, 242.82s/it]
 43%|               | 116/268 [5:24:51<10:00:08, 236.90s/it]
 44%|               | 117/268 [5:27:19<8:49:06, 210.24s/it] 
 44%|               | 118/268 [5:32:16<9:50:42, 236.28s/it]
 44%|               | 119/268 [5:34:38<8:36:24, 207.95s/it]
 45%|               | 120/268 [5:36:23<7:16:18, 176.88s/it]
 45%|               | 121/268 [5:39:28<7:19:39, 179.45s/it]
 46%|               | 122/268 [5:41:04<6:15:51, 154.46s/it]
 46%|               | 123/268 [5:43:08<5:51:01, 145.25s/it]
 46%|               | 124/268 [5:45:23<5:41:13, 142.18s/it]
 47%|               | 125/268 [5:49:07<6:37:29, 166.78s/it]
 47%|               | 126/268 [5:52:08<6:44:43, 171.01s/it]
 47%|               | 127/268 [5:57:57<8:47:28, 224.46s/it]
 48%|               | 128/268 [6:00:49<8:07:05, 208.75s/it]
 48%|               | 129/268 [6:04:42<8:20:09, 215.89s/it]
 49%|               | 130/268 [6:08:24<8:20:43, 217.71s/it]
 49%|               | 131/268 [6:11:20<7:48:29, 205.18s/it]
 49%|               | 132/268 [6:16:02<8:37:17, 228.22s/it]
 50%|               | 133/268 [6:18:41<7:47:04, 207.59s/it]
 50%|               | 134/268 [6:21:03<6:59:23, 187.79s/it]
 50%|               | 135/268 [6:23:30<6:29:05, 175.53s/it]
 51%|               | 136/268 [6:25:29<5:49:18, 158.78s/it]
 51%|               | 137/268 [6:28:46<6:11:27, 170.13s/it]
 51%|                | 138/268 [6:31:53<6:19:46, 175.28s/it]
 52%|                | 139/268 [6:36:02<7:04:23, 197.39s/it]
 52%|                | 140/268 [6:38:10<6:16:35, 176.53s/it]
 53%|                | 141/268 [6:41:06<6:13:20, 176.38s/it]
 53%|                | 142/268 [6:44:31<6:28:13, 184.87s/it]
 53%|                | 143/268 [6:49:14<7:26:25, 214.28s/it]
 54%|                | 144/268 [6:54:17<8:18:02, 240.99s/it]
 54%|                | 145/268 [6:56:08<6:54:13, 202.06s/it]
 54%|                | 146/268 [7:01:16<7:55:08, 233.68s/it]
 55%|                | 147/268 [7:04:19<7:20:46, 218.56s/it]
 55%|                | 148/268 [7:06:48<6:35:35, 197.80s/it]
 56%|                | 149/268 [7:09:25<6:08:00, 185.55s/it]
 56%|                | 150/268 [7:12:19<5:57:46, 181.92s/it]
 56%|                | 151/268 [7:14:13<5:15:20, 161.72s/it]
 57%|                | 152/268 [7:18:39<6:13:01, 192.94s/it]
 57%|                | 153/268 [7:20:54<5:36:17, 175.46s/it]
 57%|                | 154/268 [7:23:16<5:14:18, 165.42s/it]
 58%|                | 155/268 [7:26:45<5:36:08, 178.48s/it]
 58%|                | 156/268 [7:32:02<6:50:55, 220.14s/it]
 59%|                | 157/268 [7:34:21<6:02:12, 195.79s/it]
 59%|                | 158/268 [7:40:08<7:22:12, 241.20s/it]
 59%|                | 159/268 [7:44:47<7:38:54, 252.61s/it]
 60%|                | 160/268 [7:50:29<8:22:33, 279.20s/it]
 60%|                | 161/268 [7:55:47<8:38:51, 290.95s/it]
 60%|                | 162/268 [8:00:16<8:22:12, 284.27s/it]
 61%|                | 163/268 [8:05:43<8:39:51, 297.07s/it]
 61%|                | 164/268 [8:08:12<7:18:04, 252.74s/it]
 62%|                 | 165/268 [8:10:34<6:16:57, 219.59s/it]
 62%|                 | 166/268 [8:15:07<6:40:17, 235.47s/it]
 62%|                 | 167/268 [8:17:35<5:52:19, 209.31s/it]
 63%|                 | 168/268 [8:19:58<5:15:43, 189.43s/it]
 63%|                 | 169/268 [8:22:37<4:57:33, 180.34s/it]
 63%|                 | 170/268 [8:24:23<4:17:48, 157.84s/it]
 64%|                 | 171/268 [8:27:57<4:42:40, 174.85s/it]
 64%|                 | 172/268 [8:30:15<4:21:54, 163.70s/it]
 65%|                 | 173/268 [8:33:20<4:29:23, 170.15s/it]
 65%|                 | 174/268 [8:38:15<5:25:04, 207.50s/it]
 65%|                 | 175/268 [8:42:19<5:38:53, 218.64s/it]
 66%|                 | 176/268 [8:46:07<5:39:33, 221.45s/it]
 66%|                 | 177/268 [8:49:30<5:27:26, 215.89s/it]
 66%|                 | 178/268 [8:53:01<5:21:35, 214.40s/it]
 67%|                 | 179/268 [8:55:15<4:42:09, 190.22s/it]
 67%|                 | 180/268 [9:00:39<5:37:50, 230.35s/it]
 68%|                 | 181/268 [9:04:07<5:24:17, 223.65s/it]
 68%|                 | 182/268 [9:08:25<5:35:35, 234.13s/it]
 68%|                 | 183/268 [9:11:59<5:22:52, 227.92s/it]
 69%|                 | 184/268 [9:14:06<4:36:37, 197.59s/it]
 69%|                 | 185/268 [9:18:12<4:53:35, 212.24s/it]
 69%|                 | 186/268 [9:24:10<5:49:37, 255.82s/it]
 70%|                 | 187/268 [9:26:23<4:55:56, 219.21s/it]
 70%|                 | 188/268 [9:29:30<4:39:19, 209.49s/it]
 71%|                 | 189/268 [9:32:29<4:23:35, 200.19s/it]
 71%|                 | 190/268 [9:39:31<5:46:42, 266.70s/it]
 71%|                  | 191/268 [9:41:29<4:45:15, 222.28s/it]
 72%|                  | 192/268 [9:45:04<4:38:40, 220.00s/it]
 72%|                  | 193/268 [9:47:53<4:15:45, 204.61s/it]
 72%|                  | 194/268 [9:50:27<3:53:49, 189.58s/it]
 73%|                  | 195/268 [9:56:06<4:45:05, 234.32s/it]
 73%|                  | 196/268 [9:59:08<4:22:21, 218.63s/it]
 74%|                  | 197/268 [10:02:56<4:21:55, 221.35s/it]
 74%|                  | 198/268 [10:06:12<4:09:25, 213.79s/it]
 74%|                  | 199/268 [10:12:14<4:56:59, 258.26s/it]
 75%|                  | 200/268 [10:17:15<5:07:21, 271.20s/it]
 75%|                  | 201/268 [10:20:36<4:39:09, 250.00s/it]
 75%|                  | 202/268 [10:22:51<3:57:06, 215.56s/it]
 76%|                  | 203/268 [10:25:52<3:42:28, 205.36s/it]
 76%|                  | 204/268 [10:28:40<3:27:03, 194.12s/it]
 76%|                  | 205/268 [10:33:36<3:55:45, 224.54s/it]
 77%|                  | 206/268 [10:42:00<5:18:43, 308.44s/it]
 77%|                  | 207/268 [10:44:28<4:24:34, 260.23s/it]
 78%|                  | 208/268 [10:48:29<4:14:28, 254.48s/it]
 78%|                  | 209/268 [10:51:02<3:40:12, 223.94s/it]
 78%|                  | 210/268 [10:57:00<4:15:33, 264.37s/it]
 79%|                  | 211/268 [11:00:38<3:57:51, 250.38s/it]
 79%|                  | 212/268 [11:03:51<3:37:40, 233.23s/it]
 79%|                  | 213/268 [11:06:53<3:19:36, 217.76s/it]
 80%|                  | 214/268 [11:10:45<3:19:46, 221.96s/it]
 80%|                  | 215/268 [11:15:56<3:39:45, 248.78s/it]
 81%|                  | 216/268 [11:18:38<3:13:00, 222.69s/it]
 81%|                  | 217/268 [11:22:05<3:05:26, 218.18s/it]
 81%|                   | 218/268 [11:30:16<4:09:53, 299.88s/it]
 82%|                   | 219/268 [11:33:35<3:40:15, 269.70s/it]
 82%|                   | 220/268 [11:36:38<3:14:48, 243.50s/it]
 82%|                   | 221/268 [11:40:27<3:07:27, 239.30s/it]
 83%|                   | 222/268 [11:43:51<2:55:19, 228.70s/it]
 83%|                   | 223/268 [11:47:28<2:48:55, 225.24s/it]
 84%|                   | 224/268 [11:52:25<3:01:01, 246.84s/it]
 84%|                   | 225/268 [11:54:34<2:31:23, 211.24s/it]
 84%|                   | 226/268 [11:58:02<2:27:19, 210.47s/it]
 85%|                   | 227/268 [12:01:21<2:21:24, 206.94s/it]
 85%|                   | 228/268 [12:03:56<2:07:35, 191.38s/it]
 85%|                   | 229/268 [12:06:49<2:00:50, 185.91s/it]
 86%|                   | 230/268 [12:10:13<2:01:06, 191.23s/it]
 86%|                   | 231/268 [12:14:29<2:10:00, 210.81s/it]
 87%|                   | 232/268 [12:18:05<2:07:20, 212.23s/it]
 87%|                   | 233/268 [12:20:28<1:51:38, 191.39s/it]
 87%|                   | 234/268 [12:24:08<1:53:23, 200.10s/it]
 88%|                   | 235/268 [12:26:32<1:40:42, 183.12s/it]
 88%|                   | 236/268 [12:29:31<1:37:01, 181.91s/it]
 88%|                   | 237/268 [12:34:59<1:56:36, 225.68s/it]
 89%|                   | 238/268 [12:39:59<2:04:06, 248.22s/it]
 89%|                   | 239/268 [12:42:39<1:47:08, 221.69s/it]
 90%|                   | 240/268 [12:46:11<1:42:05, 218.76s/it]
 90%|                   | 241/268 [12:49:14<1:33:36, 208.03s/it]
 90%|                   | 242/268 [12:57:59<2:11:19, 303.08s/it]
 91%|                   | 243/268 [13:00:41<1:48:41, 260.87s/it]
 91%|                   | 244/268 [13:04:52<1:43:06, 257.76s/it]
 91%|                    | 245/268 [13:08:46<1:36:03, 250.60s/it]
 92%|                    | 246/268 [13:11:04<1:19:34, 217.02s/it]
 92%|                    | 247/268 [13:13:37<1:09:14, 197.81s/it]
 93%|                    | 248/268 [13:15:48<59:10, 177.52s/it]  
 93%|                    | 249/268 [13:18:35<55:14, 174.44s/it]
 93%|                    | 250/268 [13:21:13<50:52, 169.58s/it]
 94%|                    | 251/268 [13:24:09<48:36, 171.53s/it]
 94%|                    | 252/268 [13:27:11<46:35, 174.71s/it]
 94%|                    | 253/268 [13:32:48<55:50, 223.34s/it]
 95%|                    | 254/268 [13:35:11<46:27, 199.09s/it]
 95%|                    | 255/268 [13:40:12<49:49, 229.95s/it]
 96%|                    | 256/268 [13:44:10<46:26, 232.22s/it]
 96%|                    | 257/268 [13:47:12<39:48, 217.17s/it]
 96%|                    | 258/268 [13:51:28<38:08, 228.85s/it]
 97%|                    | 259/268 [13:54:26<32:02, 213.56s/it]
 97%|                    | 260/268 [13:57:36<27:31, 206.43s/it]
 97%|                    | 261/268 [14:01:15<24:32, 210.31s/it]
 98%|                    | 262/268 [14:05:40<22:39, 226.52s/it]
 98%|                    | 263/268 [14:11:53<22:33, 270.68s/it]
 99%|                    | 264/268 [14:16:37<18:17, 274.49s/it]
 99%|                    | 265/268 [14:20:35<13:11, 263.78s/it]
 99%|                    | 266/268 [14:23:48<08:05, 242.53s/it]
100%|                    | 267/268 [14:28:32<04:14, 254.73s/it]
100%|                    | 268/268 [14:30:53<00:00, 220.88s/it]
100%|                    | 268/268 [14:33:02<00:00, 195.46s/it]
epoch: 10, train loss: 50.453206403931574

  0%|          | 0/30 [00:00<?, ?it/s]
  3%|           | 1/30 [00:54<26:20, 54.50s/it]
  7%|           | 2/30 [02:55<43:33, 93.33s/it]
 10%|           | 3/30 [04:00<36:10, 80.40s/it]
 13%|            | 4/30 [05:58<41:23, 95.53s/it]
 17%|            | 5/30 [07:30<39:09, 94.00s/it]
 20%|            | 6/30 [10:18<47:43, 119.31s/it]
 23%|             | 7/30 [11:37<40:44, 106.29s/it]
 27%|             | 8/30 [12:56<35:41, 97.34s/it] 
 30%|             | 9/30 [14:54<36:24, 104.01s/it]
 33%|              | 10/30 [15:50<29:44, 89.20s/it]
 37%|              | 11/30 [18:51<37:05, 117.12s/it]
 40%|              | 12/30 [19:43<29:14, 97.48s/it] 
 43%|               | 13/30 [21:19<27:25, 96.79s/it]
 47%|               | 14/30 [22:54<25:42, 96.41s/it]
 50%|               | 15/30 [23:49<20:56, 83.75s/it]
 53%|                | 16/30 [25:31<20:50, 89.33s/it]
 57%|                | 17/30 [26:27<17:11, 79.32s/it]
 60%|                | 18/30 [27:11<13:45, 68.79s/it]
 63%|                 | 19/30 [28:09<12:02, 65.64s/it]
 67%|                 | 20/30 [28:58<10:06, 60.61s/it]
 70%|                 | 21/30 [31:37<13:29, 89.97s/it]
 73%|                  | 22/30 [33:06<11:58, 89.76s/it]
 77%|                  | 23/30 [34:00<09:14, 79.15s/it]
 80%|                  | 24/30 [35:22<07:59, 79.93s/it]
 83%|                   | 25/30 [36:26<06:15, 75.07s/it]
 87%|                   | 26/30 [38:05<05:29, 82.34s/it]
 90%|                   | 27/30 [38:41<03:24, 68.26s/it]
 93%|                    | 28/30 [39:33<02:06, 63.43s/it]
 97%|                    | 29/30 [41:00<01:10, 70.71s/it]
100%|                    | 30/30 [41:41<00:00, 61.53s/it]
100%|                    | 30/30 [41:55<00:00, 83.86s/it]
epoch: 10, f1 score: 0.959052549464577, dev loss: 635.6026692708333
Best val f1: 0.9592760609085189
Training Finished!
-------- Process Done! --------
--------Load model from E:\      Ϣ  ȡģ  ʵ     \  Ϣ      ģ  ѵ  ʵ     \BiLSTM-CRF/experiments/model_5.pth--------

  0%|          | 0/31 [00:00<?, ?it/s]
  3%|           | 1/31 [00:39<19:48, 39.61s/it]
  6%|           | 2/31 [01:24<20:44, 42.92s/it]
 10%|           | 3/31 [02:12<20:58, 44.96s/it]
 13%|            | 4/31 [02:44<17:57, 39.89s/it]
 16%|            | 5/31 [02:59<13:22, 30.88s/it]
 19%|            | 6/31 [03:11<10:15, 24.62s/it]
 23%|             | 7/31 [03:30<09:03, 22.65s/it]
 26%|             | 8/31 [04:00<09:35, 25.00s/it]
 29%|             | 9/31 [04:54<12:30, 34.11s/it]
 32%|              | 10/31 [05:17<10:46, 30.80s/it]
 35%|              | 11/31 [06:16<13:04, 39.22s/it]
 39%|              | 12/31 [06:29<09:53, 31.23s/it]
 42%|               | 13/31 [07:03<09:39, 32.22s/it]
 45%|               | 14/31 [07:36<09:11, 32.43s/it]
 48%|               | 15/31 [08:16<09:12, 34.56s/it]
 52%|                | 16/31 [09:15<10:31, 42.09s/it]
 55%|                | 17/31 [10:26<11:51, 50.84s/it]
 58%|                | 18/31 [11:21<11:17, 52.13s/it]
 61%|                 | 19/31 [12:09<10:07, 50.63s/it]
 65%|                 | 20/31 [13:19<10:21, 56.51s/it]
 68%|                 | 21/31 [13:54<08:19, 49.99s/it]
 71%|                 | 22/31 [14:23<06:35, 43.92s/it]
 74%|                  | 23/31 [15:30<06:45, 50.72s/it]
 77%|                  | 24/31 [16:07<05:26, 46.59s/it]
 81%|                  | 25/31 [16:53<04:37, 46.32s/it]
 84%|                   | 26/31 [17:22<03:26, 41.39s/it]
 87%|                   | 27/31 [18:07<02:49, 42.32s/it]
 90%|                   | 28/31 [18:33<01:52, 37.51s/it]
 94%|                    | 29/31 [19:01<01:09, 34.59s/it]
 97%|                    | 30/31 [19:48<00:38, 38.40s/it]
100%|                    | 31/31 [20:01<00:00, 30.68s/it]
100%|                    | 31/31 [20:02<00:00, 38.80s/it]
--------Bad Cases reserved !--------
0.9233161873022774
final test loss: 1259.6277721774193, f1 score: 0.9233161873022774, precision:0.9309555579363611, recall: 0.915801172728318
>>>