new111 / 0527_192135_judge_eval.log
zhang9302002's picture
Upload folder using huggingface_hub
11c3233 verified
1000
Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.18s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.85s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.85s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.89s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.85s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.87s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.86s/it] Loading checkpoint shards: 50%|█████ | 1/2 [00:33<00:33, 33.84s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.05s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.57s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.11s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.63s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.10s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.10s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.10s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.61s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.61s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.61s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.22s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.61s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.09s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.61s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 17.10s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:39<00:00, 19.62s/it]
GPU 1: 0%| | 0/175 [00:00<?, ?it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 0%| | 0/175 [00:00<?, ?it/s] GPU 4: 0%| | 0/175 [00:00<?, ?it/s] GPU 7: 0%| | 0/175 [00:00<?, ?it/s] GPU 5: 0%| | 0/175 [00:00<?, ?it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 0%| | 0/175 [00:00<?, ?it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 0%| | 0/175 [00:00<?, ?it/s] GPU 0: 0%| | 0/175 [00:00<?, ?it/s]The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
The `seen_tokens` attribute is deprecated and will be removed in v4.41. Use the `cache_position` model input instead.
GPU 4: 1%| | 1/175 [00:01<03:16, 1.13s/it] GPU 6: 1%| | 1/175 [00:01<03:18, 1.14s/it] GPU 5: 1%| | 1/175 [00:01<03:15, 1.12s/it] GPU 0: 1%| | 1/175 [00:01<03:10, 1.10s/it]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 1%| | 1/175 [00:01<03:15, 1.12s/it]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 1%| | 1/175 [00:01<03:16, 1.13s/it]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 1%| | 1/175 [00:01<03:17, 1.14s/it] GPU 1: 1%| | 1/175 [00:01<03:39, 1.26s/it]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 1%| | 2/175 [00:01<01:31, 1.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 1%| | 2/175 [00:01<01:32, 1.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 1%| | 2/175 [00:01<01:31, 1.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 1%| | 2/175 [00:01<01:29, 1.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 1%| | 2/175 [00:01<01:32, 1.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 1%| | 2/175 [00:01<01:34, 1.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 1%| | 2/175 [00:01<01:41, 1.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 1%| | 2/175 [00:01<01:35, 1.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 2%|▏ | 3/175 [00:01<00:57, 2.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 2%|▏ | 3/175 [00:01<00:57, 3.00it/s] GPU 4: 2%|▏ | 3/175 [00:01<00:58, 2.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 2%|▏ | 3/175 [00:01<00:59, 2.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 2%|▏ | 3/175 [00:01<00:58, 2.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 2%|▏ | 3/175 [00:01<01:03, 2.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 2%|▏ | 3/175 [00:01<01:02, 2.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 2%|▏ | 3/175 [00:01<01:03, 2.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 2%|▏ | 4/175 [00:01<00:42, 4.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 2%|▏ | 4/175 [00:01<00:41, 4.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 2%|▏ | 4/175 [00:01<00:42, 4.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 2%|▏ | 4/175 [00:01<00:43, 3.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 2%|▏ | 4/175 [00:01<00:43, 3.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 2%|▏ | 4/175 [00:01<00:45, 3.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 2%|▏ | 4/175 [00:01<00:45, 3.80it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 3%|▎ | 5/175 [00:01<00:33, 5.09it/s] GPU 0: 3%|▎ | 5/175 [00:01<00:32, 5.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 3%|▎ | 5/175 [00:01<00:33, 5.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 3%|▎ | 5/175 [00:01<00:34, 4.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 3%|▎ | 5/175 [00:01<00:35, 4.81it/s] GPU 2: 2%|▏ | 4/175 [00:01<00:47, 3.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 3%|▎ | 5/175 [00:01<00:36, 4.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 3%|▎ | 5/175 [00:01<00:35, 4.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 3%|▎ | 6/175 [00:01<00:27, 6.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 3%|▎ | 6/175 [00:01<00:28, 5.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 3%|▎ | 6/175 [00:01<00:29, 5.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 3%|▎ | 6/175 [00:01<00:30, 5.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 3%|▎ | 6/175 [00:01<00:30, 5.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 3%|▎ | 6/175 [00:01<00:29, 5.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 3%|▎ | 5/175 [00:01<00:39, 4.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 3%|▎ | 6/175 [00:01<00:32, 5.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 4%|▍ | 7/175 [00:01<00:24, 6.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 4%|▍ | 7/175 [00:01<00:24, 6.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 4%|▍ | 7/175 [00:01<00:25, 6.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 4%|▍ | 7/175 [00:01<00:26, 6.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 4%|▍ | 7/175 [00:01<00:25, 6.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 4%|▍ | 7/175 [00:01<00:28, 5.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 4%|▍ | 7/175 [00:01<00:27, 6.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 5%|▍ | 8/175 [00:01<00:22, 7.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 5%|▍ | 8/175 [00:01<00:22, 7.44it/s] GPU 2: 3%|▎ | 6/175 [00:01<00:34, 4.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 5%|▍ | 8/175 [00:02<00:23, 7.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 5%|▍ | 8/175 [00:01<00:23, 7.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 5%|▍ | 8/175 [00:01<00:25, 6.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 5%|▍ | 8/175 [00:01<00:24, 6.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 5%|▍ | 8/175 [00:01<00:24, 6.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 5%|▌ | 9/175 [00:01<00:20, 8.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 4%|▍ | 7/175 [00:01<00:28, 5.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 5%|▌ | 9/175 [00:02<00:22, 7.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 5%|▌ | 9/175 [00:02<00:21, 7.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 5%|▌ | 9/175 [00:02<00:21, 7.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 5%|▌ | 9/175 [00:02<00:22, 7.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 5%|▌ | 9/175 [00:02<00:22, 7.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 6%|▌ | 10/175 [00:02<00:19, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 5%|▍ | 8/175 [00:02<00:25, 6.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 5%|▌ | 9/175 [00:02<00:24, 6.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 6%|▌ | 10/175 [00:02<00:20, 8.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 6%|▌ | 10/175 [00:02<00:22, 7.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 6%|▌ | 10/175 [00:02<00:20, 7.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 6%|▌ | 10/175 [00:02<00:20, 7.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 6%|▌ | 10/175 [00:02<00:20, 7.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 6%|▋ | 11/175 [00:02<00:18, 8.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 5%|▌ | 9/175 [00:02<00:22, 7.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 6%|▌ | 10/175 [00:02<00:22, 7.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 6%|▋ | 11/175 [00:02<00:19, 8.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 6%|▋ | 11/175 [00:02<00:21, 7.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 6%|▋ | 11/175 [00:02<00:19, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 6%|▋ | 11/175 [00:02<00:20, 8.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 7%|▋ | 12/175 [00:02<00:18, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 6%|▌ | 10/175 [00:02<00:21, 7.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 6%|▋ | 11/175 [00:02<00:21, 7.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 6%|▋ | 11/175 [00:02<00:21, 7.63it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 7%|▋ | 12/175 [00:02<00:19, 8.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 7%|▋ | 12/175 [00:02<00:19, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 7%|▋ | 12/175 [00:02<00:20, 7.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 7%|▋ | 12/175 [00:02<00:19, 8.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 7%|▋ | 13/175 [00:02<00:19, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 6%|▋ | 11/175 [00:02<00:22, 7.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 7%|▋ | 12/175 [00:02<00:21, 7.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 7%|▋ | 12/175 [00:02<00:22, 7.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 7%|▋ | 13/175 [00:02<00:19, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 7%|▋ | 13/175 [00:02<00:18, 8.76it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 7%|▋ | 13/175 [00:02<00:19, 8.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 7%|▋ | 13/175 [00:02<00:21, 7.63it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 8%|▊ | 14/175 [00:02<00:20, 7.98it/s] GPU 6: 7%|▋ | 13/175 [00:02<00:20, 7.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 8%|▊ | 14/175 [00:02<00:18, 8.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 8%|▊ | 14/175 [00:02<00:18, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 7%|▋ | 12/175 [00:02<00:22, 7.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 7%|▋ | 13/175 [00:02<00:22, 7.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 8%|▊ | 14/175 [00:02<00:19, 8.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 8%|▊ | 14/175 [00:02<00:20, 7.74it/s] GPU 0: 9%|▊ | 15/175 [00:02<00:19, 8.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 8%|▊ | 14/175 [00:02<00:19, 8.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 9%|▊ | 15/175 [00:02<00:17, 8.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 9%|▊ | 15/175 [00:02<00:17, 9.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 7%|▋ | 13/175 [00:02<00:20, 7.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 8%|▊ | 14/175 [00:02<00:21, 7.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 9%|▊ | 15/175 [00:02<00:18, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 9%|▉ | 16/175 [00:02<00:18, 8.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 9%|▊ | 15/175 [00:02<00:18, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 9%|▉ | 16/175 [00:02<00:17, 9.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 9%|▊ | 15/175 [00:02<00:21, 7.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 9%|▉ | 16/175 [00:02<00:19, 8.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 9%|▊ | 15/175 [00:02<00:20, 7.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 9%|▉ | 16/175 [00:02<00:18, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 8%|▊ | 14/175 [00:02<00:21, 7.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 10%|▉ | 17/175 [00:02<00:17, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 9%|▉ | 16/175 [00:02<00:18, 8.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 10%|▉ | 17/175 [00:02<00:17, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 9%|▉ | 16/175 [00:02<00:20, 7.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 10%|▉ | 17/175 [00:03<00:17, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 9%|▉ | 16/175 [00:02<00:19, 8.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 9%|▊ | 15/175 [00:02<00:20, 7.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 10%|█ | 18/175 [00:02<00:17, 9.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 10%|▉ | 17/175 [00:02<00:20, 7.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 10%|▉ | 17/175 [00:03<00:17, 8.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 10%|█ | 18/175 [00:03<00:17, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 10%|▉ | 17/175 [00:03<00:19, 8.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 10%|█ | 18/175 [00:03<00:17, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 10%|▉ | 17/175 [00:03<00:18, 8.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 9%|▉ | 16/175 [00:03<00:19, 8.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 11%|█ | 19/175 [00:03<00:16, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 10%|█ | 18/175 [00:03<00:17, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 11%|█ | 19/175 [00:03<00:16, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 10%|█ | 18/175 [00:03<00:20, 7.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 10%|█ | 18/175 [00:03<00:18, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 11%|█ | 19/175 [00:03<00:17, 9.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 10%|▉ | 17/175 [00:03<00:18, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 10%|█ | 18/175 [00:03<00:18, 8.47it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 11%|█▏ | 20/175 [00:03<00:16, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 11%|█ | 19/175 [00:03<00:17, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 11%|█▏ | 20/175 [00:03<00:16, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 11%|█ | 19/175 [00:03<00:17, 8.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 11%|█ | 19/175 [00:03<00:21, 7.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 11%|█▏ | 20/175 [00:03<00:16, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 10%|█ | 18/175 [00:03<00:18, 8.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 12%|█▏ | 21/175 [00:03<00:16, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 11%|█ | 19/175 [00:03<00:18, 8.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 11%|█▏ | 20/175 [00:03<00:16, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 12%|█▏ | 21/175 [00:03<00:16, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 11%|█▏ | 20/175 [00:03<00:17, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 11%|█▏ | 20/175 [00:03<00:19, 7.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 12%|█▏ | 21/175 [00:03<00:16, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 13%|█▎ | 22/175 [00:03<00:16, 9.42it/s] GPU 2: 11%|█ | 19/175 [00:03<00:17, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 11%|█▏ | 20/175 [00:03<00:17, 8.76it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 12%|█▏ | 21/175 [00:03<00:16, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 13%|█▎ | 22/175 [00:03<00:16, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 12%|█▏ | 21/175 [00:03<00:18, 8.25it/s] GPU 5: 12%|█▏ | 21/175 [00:03<00:18, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 13%|█▎ | 22/175 [00:03<00:16, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 11%|█▏ | 20/175 [00:03<00:17, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 12%|█▏ | 21/175 [00:03<00:17, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 13%|█▎ | 22/175 [00:03<00:16, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 13%|█▎ | 23/175 [00:03<00:17, 8.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 13%|█▎ | 23/175 [00:03<00:16, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 13%|█▎ | 23/175 [00:03<00:16, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 13%|█▎ | 22/175 [00:03<00:18, 8.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 13%|█▎ | 22/175 [00:03<00:18, 8.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 12%|█▏ | 21/175 [00:03<00:16, 9.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 13%|█▎ | 22/175 [00:03<00:17, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 13%|█▎ | 23/175 [00:03<00:16, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 14%|█▎ | 24/175 [00:03<00:16, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 14%|█▎ | 24/175 [00:03<00:18, 8.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 14%|█▎ | 24/175 [00:03<00:16, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 13%|█▎ | 23/175 [00:03<00:17, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 13%|█▎ | 23/175 [00:03<00:17, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 13%|█▎ | 22/175 [00:03<00:16, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 13%|█▎ | 23/175 [00:03<00:16, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 14%|█▎ | 24/175 [00:03<00:16, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 14%|█▍ | 25/175 [00:03<00:16, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 14%|█▍ | 25/175 [00:03<00:17, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 14%|█▍ | 25/175 [00:03<00:16, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 14%|█▎ | 24/175 [00:03<00:17, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 14%|█▎ | 24/175 [00:03<00:17, 8.67it/s] GPU 2: 13%|█▎ | 23/175 [00:03<00:16, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 14%|█▎ | 24/175 [00:03<00:16, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 15%|█▍ | 26/175 [00:03<00:15, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 14%|█▍ | 25/175 [00:03<00:17, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 15%|█▍ | 26/175 [00:03<00:16, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 15%|█▍ | 26/175 [00:04<00:15, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 14%|█▍ | 25/175 [00:03<00:16, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 14%|█▎ | 24/175 [00:03<00:16, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 14%|█▍ | 25/175 [00:03<00:17, 8.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 14%|█▍ | 25/175 [00:03<00:16, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 15%|█▌ | 27/175 [00:03<00:15, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 15%|█▌ | 27/175 [00:04<00:17, 8.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 15%|█▍ | 26/175 [00:04<00:18, 7.95it/s] GPU 1: 15%|█▌ | 27/175 [00:04<00:15, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 15%|█▍ | 26/175 [00:04<00:16, 9.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 14%|█▍ | 25/175 [00:04<00:16, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 15%|█▍ | 26/175 [00:04<00:16, 9.18it/s] GPU 5: 15%|█▍ | 26/175 [00:04<00:17, 8.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 16%|█▌ | 28/175 [00:04<00:15, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 16%|█▌ | 28/175 [00:04<00:15, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 15%|█▌ | 27/175 [00:04<00:17, 8.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 15%|█▌ | 27/175 [00:04<00:16, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 15%|█▍ | 26/175 [00:04<00:16, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 16%|█▌ | 28/175 [00:04<00:18, 7.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 15%|█▌ | 27/175 [00:04<00:16, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 15%|█▌ | 27/175 [00:04<00:16, 8.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 17%|█▋ | 29/175 [00:04<00:17, 8.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 17%|█▋ | 29/175 [00:04<00:15, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 16%|█▌ | 28/175 [00:04<00:17, 8.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 16%|█▌ | 28/175 [00:04<00:16, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 15%|█▌ | 27/175 [00:04<00:16, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 17%|█▋ | 29/175 [00:04<00:17, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 16%|█▌ | 28/175 [00:04<00:15, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 16%|█▌ | 28/175 [00:04<00:16, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 17%|█▋ | 30/175 [00:04<00:16, 9.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 17%|█▋ | 29/175 [00:04<00:17, 8.47it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 17%|█▋ | 30/175 [00:04<00:18, 7.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 17%|█▋ | 29/175 [00:04<00:16, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 17%|█▋ | 30/175 [00:04<00:17, 8.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 16%|█▌ | 28/175 [00:04<00:16, 8.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 17%|█▋ | 29/175 [00:04<00:16, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 17%|█▋ | 29/175 [00:04<00:17, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 18%|█▊ | 31/175 [00:04<00:15, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 17%|█▋ | 30/175 [00:04<00:16, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 18%|█▊ | 31/175 [00:04<00:17, 8.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 17%|█▋ | 30/175 [00:04<00:17, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 18%|█▊ | 31/175 [00:04<00:17, 8.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 17%|█▋ | 29/175 [00:04<00:17, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 17%|█▋ | 30/175 [00:04<00:17, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 17%|█▋ | 30/175 [00:04<00:18, 8.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 18%|█▊ | 32/175 [00:04<00:16, 8.63it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 18%|█▊ | 31/175 [00:04<00:17, 8.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 18%|█▊ | 32/175 [00:04<00:17, 8.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 18%|█▊ | 31/175 [00:04<00:16, 8.62it/s] GPU 0: 18%|█▊ | 32/175 [00:04<00:16, 8.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 17%|█▋ | 30/175 [00:04<00:16, 8.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 18%|█▊ | 31/175 [00:04<00:16, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 18%|█▊ | 31/175 [00:04<00:17, 8.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 19%|█▉ | 33/175 [00:04<00:16, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 18%|█▊ | 32/175 [00:04<00:16, 8.55it/s] GPU 4: 19%|█▉ | 33/175 [00:04<00:16, 8.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 19%|█▉ | 33/175 [00:04<00:16, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 18%|█▊ | 32/175 [00:04<00:16, 8.80it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 18%|█▊ | 31/175 [00:04<00:16, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 18%|█▊ | 32/175 [00:04<00:16, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 18%|█▊ | 32/175 [00:04<00:17, 8.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 19%|█▉ | 34/175 [00:04<00:15, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 19%|█▉ | 34/175 [00:04<00:16, 8.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 19%|█▉ | 33/175 [00:04<00:16, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 19%|█▉ | 34/175 [00:04<00:15, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 19%|█▉ | 33/175 [00:04<00:15, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 18%|█▊ | 32/175 [00:04<00:15, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 19%|█▉ | 33/175 [00:04<00:15, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 19%|█▉ | 33/175 [00:04<00:16, 8.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 20%|██ | 35/175 [00:05<00:15, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 20%|██ | 35/175 [00:04<00:15, 8.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 20%|██ | 35/175 [00:04<00:15, 9.19it/s] GPU 6: 19%|█▉ | 34/175 [00:04<00:15, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 19%|█▉ | 33/175 [00:04<00:15, 9.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 19%|█▉ | 34/175 [00:04<00:15, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 19%|█▉ | 34/175 [00:04<00:17, 8.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 19%|█▉ | 34/175 [00:05<00:16, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 21%|██ | 36/175 [00:05<00:15, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 21%|██ | 36/175 [00:05<00:15, 9.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 21%|██ | 36/175 [00:05<00:14, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 19%|█▉ | 34/175 [00:05<00:15, 9.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 20%|██ | 35/175 [00:05<00:15, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 20%|██ | 35/175 [00:05<00:17, 8.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 20%|██ | 35/175 [00:05<00:18, 7.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 20%|██ | 35/175 [00:05<00:16, 8.51it/s] GPU 1: 21%|██ | 37/175 [00:05<00:15, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 21%|██ | 37/175 [00:05<00:15, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 21%|██ | 37/175 [00:05<00:14, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 20%|██ | 35/175 [00:05<00:15, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 21%|██ | 36/175 [00:05<00:15, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 21%|██ | 36/175 [00:05<00:17, 7.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 21%|██ | 36/175 [00:05<00:17, 8.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 22%|██▏ | 38/175 [00:05<00:14, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 22%|██▏ | 38/175 [00:05<00:14, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 22%|██▏ | 38/175 [00:05<00:14, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 21%|██ | 36/175 [00:05<00:16, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 21%|██ | 36/175 [00:05<00:15, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 21%|██ | 37/175 [00:05<00:14, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 21%|██ | 37/175 [00:05<00:16, 8.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 21%|██ | 37/175 [00:05<00:16, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 22%|██▏ | 39/175 [00:05<00:14, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 22%|██▏ | 39/175 [00:05<00:14, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 22%|██▏ | 39/175 [00:05<00:14, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 21%|██ | 37/175 [00:05<00:16, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 21%|██ | 37/175 [00:05<00:15, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 22%|██▏ | 38/175 [00:05<00:14, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 22%|██▏ | 38/175 [00:05<00:16, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 22%|██▏ | 38/175 [00:05<00:15, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 23%|██▎ | 40/175 [00:05<00:14, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 23%|██▎ | 40/175 [00:05<00:14, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 23%|██▎ | 40/175 [00:05<00:14, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 22%|██▏ | 38/175 [00:05<00:15, 8.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 22%|██▏ | 38/175 [00:05<00:14, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 22%|██▏ | 39/175 [00:05<00:14, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 22%|██▏ | 39/175 [00:05<00:15, 8.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 22%|██▏ | 39/175 [00:05<00:15, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 23%|██▎ | 41/175 [00:05<00:14, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 23%|██▎ | 41/175 [00:05<00:14, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 23%|██▎ | 41/175 [00:05<00:14, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 22%|██▏ | 39/175 [00:05<00:15, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 23%|██▎ | 40/175 [00:05<00:14, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 22%|██▏ | 39/175 [00:05<00:16, 8.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 23%|██▎ | 40/175 [00:05<00:15, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 23%|██▎ | 40/175 [00:05<00:15, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 24%|██▍ | 42/175 [00:05<00:14, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 24%|██▍ | 42/175 [00:05<00:14, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 24%|██▍ | 42/175 [00:05<00:14, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 23%|██▎ | 40/175 [00:05<00:15, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 23%|██▎ | 41/175 [00:05<00:14, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 23%|██▎ | 41/175 [00:05<00:14, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 23%|██▎ | 41/175 [00:05<00:14, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 25%|██▍ | 43/175 [00:05<00:14, 9.26it/s] GPU 2: 23%|██▎ | 40/175 [00:05<00:17, 7.90it/s] GPU 4: 25%|██▍ | 43/175 [00:05<00:14, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 25%|██▍ | 43/175 [00:05<00:14, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 23%|██▎ | 41/175 [00:05<00:14, 9.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 24%|██▍ | 42/175 [00:05<00:14, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 24%|██▍ | 42/175 [00:05<00:14, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 24%|██▍ | 42/175 [00:05<00:14, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 25%|██▌ | 44/175 [00:06<00:14, 9.27it/s] GPU 4: 25%|██▌ | 44/175 [00:05<00:14, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 23%|██▎ | 41/175 [00:05<00:16, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 25%|██▌ | 44/175 [00:05<00:14, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 24%|██▍ | 42/175 [00:05<00:14, 9.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 25%|██▍ | 43/175 [00:05<00:14, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 25%|██▍ | 43/175 [00:06<00:14, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 25%|██▍ | 43/175 [00:06<00:14, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 26%|██▌ | 45/175 [00:06<00:13, 9.36it/s] GPU 1: 26%|██▌ | 45/175 [00:06<00:13, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 24%|██▍ | 42/175 [00:05<00:15, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 25%|██▍ | 43/175 [00:06<00:14, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 26%|██▌ | 45/175 [00:06<00:14, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 25%|██▌ | 44/175 [00:06<00:14, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 25%|██▌ | 44/175 [00:06<00:14, 9.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 26%|██▋ | 46/175 [00:06<00:13, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 26%|██▋ | 46/175 [00:06<00:13, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 25%|██▌ | 44/175 [00:06<00:14, 9.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 25%|██▍ | 43/175 [00:06<00:15, 8.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 25%|██▌ | 44/175 [00:06<00:14, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 26%|██▋ | 46/175 [00:06<00:14, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 26%|██▌ | 45/175 [00:06<00:14, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 26%|██▌ | 45/175 [00:06<00:14, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 27%|██▋ | 47/175 [00:06<00:13, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 27%|██▋ | 47/175 [00:06<00:13, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 26%|██▌ | 45/175 [00:06<00:14, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 25%|██▌ | 44/175 [00:06<00:14, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 26%|██▌ | 45/175 [00:06<00:13, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 27%|██▋ | 47/175 [00:06<00:14, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 26%|██▋ | 46/175 [00:06<00:13, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 26%|██▋ | 46/175 [00:06<00:13, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 27%|██▋ | 48/175 [00:06<00:13, 9.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 27%|██▋ | 48/175 [00:06<00:13, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 26%|██▋ | 46/175 [00:06<00:14, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 26%|██▌ | 45/175 [00:06<00:14, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 26%|██▋ | 46/175 [00:06<00:13, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 27%|██▋ | 48/175 [00:06<00:14, 9.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 27%|██▋ | 47/175 [00:06<00:13, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 27%|██▋ | 47/175 [00:06<00:13, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 28%|██▊ | 49/175 [00:06<00:13, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 27%|██▋ | 47/175 [00:06<00:13, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 26%|██▋ | 46/175 [00:06<00:14, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 27%|██▋ | 47/175 [00:06<00:13, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 28%|██▊ | 49/175 [00:06<00:14, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 27%|██▋ | 48/175 [00:06<00:13, 9.26it/s] GPU 0: 28%|██▊ | 49/175 [00:06<00:14, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 27%|██▋ | 48/175 [00:06<00:13, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 29%|██▊ | 50/175 [00:06<00:13, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 27%|██▋ | 48/175 [00:06<00:13, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 29%|██▊ | 50/175 [00:06<00:14, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 28%|██▊ | 49/175 [00:06<00:13, 9.27it/s] GPU 2: 27%|██▋ | 47/175 [00:06<00:15, 8.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 29%|██▊ | 50/175 [00:06<00:14, 8.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 27%|██▋ | 48/175 [00:06<00:14, 8.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 28%|██▊ | 49/175 [00:06<00:13, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 29%|██▉ | 51/175 [00:06<00:13, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 28%|██▊ | 49/175 [00:06<00:13, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 29%|██▉ | 51/175 [00:06<00:13, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 29%|██▉ | 51/175 [00:06<00:13, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 29%|██▊ | 50/175 [00:06<00:14, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 27%|██▋ | 48/175 [00:06<00:16, 7.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 28%|██▊ | 49/175 [00:06<00:15, 8.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 29%|██▊ | 50/175 [00:06<00:13, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 30%|██▉ | 52/175 [00:06<00:13, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 29%|██▊ | 50/175 [00:06<00:13, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 30%|██▉ | 52/175 [00:06<00:13, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 30%|██▉ | 52/175 [00:06<00:13, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 29%|██▊ | 50/175 [00:06<00:14, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 29%|██▉ | 51/175 [00:06<00:13, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 30%|███ | 53/175 [00:06<00:12, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 29%|██▉ | 51/175 [00:06<00:13, 9.18it/s] GPU 7: 29%|██▉ | 51/175 [00:06<00:15, 7.90it/s] GPU 2: 28%|██▊ | 49/175 [00:06<00:16, 7.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 30%|███ | 53/175 [00:06<00:13, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 30%|███ | 53/175 [00:06<00:13, 8.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 29%|██▉ | 51/175 [00:06<00:14, 8.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 30%|██▉ | 52/175 [00:06<00:13, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 31%|███ | 54/175 [00:06<00:12, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 30%|██▉ | 52/175 [00:06<00:13, 9.19it/s] GPU 7: 30%|██▉ | 52/175 [00:06<00:14, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 31%|███ | 54/175 [00:07<00:13, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 29%|██▊ | 50/175 [00:06<00:17, 7.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 31%|███ | 54/175 [00:07<00:13, 8.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 30%|██▉ | 52/175 [00:07<00:13, 8.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 31%|███▏ | 55/175 [00:07<00:12, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 30%|███ | 53/175 [00:07<00:13, 9.23it/s] GPU 7: 30%|███ | 53/175 [00:07<00:14, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 30%|███ | 53/175 [00:07<00:14, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 31%|███▏ | 55/175 [00:07<00:12, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 29%|██▉ | 51/175 [00:07<00:15, 7.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 31%|███▏ | 55/175 [00:07<00:13, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 30%|███ | 53/175 [00:07<00:13, 9.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 32%|███▏ | 56/175 [00:07<00:12, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 31%|███ | 54/175 [00:07<00:13, 9.24it/s] GPU 7: 31%|███ | 54/175 [00:07<00:13, 8.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 32%|███▏ | 56/175 [00:07<00:12, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 30%|██▉ | 52/175 [00:07<00:15, 8.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 31%|███ | 54/175 [00:07<00:15, 7.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 32%|███▏ | 56/175 [00:07<00:13, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 31%|███ | 54/175 [00:07<00:13, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 31%|███▏ | 55/175 [00:07<00:12, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 31%|███▏ | 55/175 [00:07<00:13, 8.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 33%|███▎ | 57/175 [00:07<00:13, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 33%|███▎ | 57/175 [00:07<00:12, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 31%|███▏ | 55/175 [00:07<00:14, 8.35it/s] GPU 2: 30%|███ | 53/175 [00:07<00:14, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 31%|███▏ | 55/175 [00:07<00:12, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 32%|███▏ | 56/175 [00:07<00:12, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 32%|███▏ | 56/175 [00:07<00:13, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 33%|███▎ | 57/175 [00:07<00:14, 8.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 33%|███▎ | 58/175 [00:07<00:12, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 33%|███▎ | 58/175 [00:07<00:14, 8.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 32%|███▏ | 56/175 [00:07<00:13, 8.62it/s] GPU 2: 31%|███ | 54/175 [00:07<00:13, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 32%|███▏ | 56/175 [00:07<00:12, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 33%|███▎ | 57/175 [00:07<00:12, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 33%|███▎ | 57/175 [00:07<00:13, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 34%|███▎ | 59/175 [00:07<00:12, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 34%|███▎ | 59/175 [00:07<00:13, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 33%|███▎ | 57/175 [00:07<00:13, 8.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 31%|███▏ | 55/175 [00:07<00:13, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 33%|███▎ | 58/175 [00:07<00:15, 7.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 33%|███▎ | 57/175 [00:07<00:12, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 33%|███▎ | 58/175 [00:07<00:12, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 33%|███▎ | 58/175 [00:07<00:12, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 34%|███▍ | 60/175 [00:07<00:12, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 34%|███▍ | 60/175 [00:07<00:13, 8.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 33%|███▎ | 58/175 [00:07<00:13, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 32%|███▏ | 56/175 [00:07<00:13, 8.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 34%|███▎ | 59/175 [00:07<00:14, 7.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 33%|███▎ | 58/175 [00:07<00:12, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 34%|███▎ | 59/175 [00:07<00:12, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 34%|███▎ | 59/175 [00:07<00:12, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 35%|███▍ | 61/175 [00:07<00:12, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 35%|███▍ | 61/175 [00:07<00:12, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 34%|███▎ | 59/175 [00:07<00:12, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 33%|███▎ | 57/175 [00:07<00:13, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 34%|███▍ | 60/175 [00:07<00:13, 8.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 34%|███▎ | 59/175 [00:07<00:12, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 34%|███▍ | 60/175 [00:07<00:12, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 34%|███▍ | 60/175 [00:07<00:12, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 35%|███▌ | 62/175 [00:07<00:12, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 35%|███▌ | 62/175 [00:07<00:12, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 34%|███▍ | 60/175 [00:07<00:12, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 33%|███▎ | 58/175 [00:07<00:12, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 34%|███▍ | 60/175 [00:07<00:12, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 35%|███▍ | 61/175 [00:07<00:14, 7.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 35%|███▍ | 61/175 [00:07<00:12, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 35%|███▍ | 61/175 [00:07<00:12, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 36%|███▌ | 63/175 [00:08<00:12, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 36%|███▌ | 63/175 [00:07<00:12, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 34%|███▎ | 59/175 [00:07<00:12, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 35%|███▍ | 61/175 [00:08<00:12, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 35%|███▌ | 62/175 [00:08<00:12, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 35%|███▌ | 62/175 [00:08<00:12, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 35%|███▌ | 62/175 [00:08<00:15, 7.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 37%|███▋ | 64/175 [00:08<00:12, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 34%|███▍ | 60/175 [00:08<00:12, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 37%|███▋ | 64/175 [00:08<00:13, 8.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 35%|███▍ | 61/175 [00:08<00:17, 6.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 35%|███▌ | 62/175 [00:08<00:13, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 36%|███▌ | 63/175 [00:08<00:12, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 36%|███▌ | 63/175 [00:08<00:12, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 36%|███▌ | 63/175 [00:08<00:14, 7.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 37%|███▋ | 65/175 [00:08<00:11, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 35%|███▍ | 61/175 [00:08<00:12, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 35%|███▌ | 62/175 [00:08<00:15, 7.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 37%|███▋ | 65/175 [00:08<00:13, 7.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 37%|███▋ | 64/175 [00:08<00:11, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 37%|███▋ | 64/175 [00:08<00:12, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 36%|███▌ | 63/175 [00:08<00:13, 8.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 37%|███▋ | 64/175 [00:08<00:13, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 38%|███▊ | 66/175 [00:08<00:11, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 35%|███▌ | 62/175 [00:08<00:12, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 36%|███▌ | 63/175 [00:08<00:14, 7.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 37%|███▋ | 65/175 [00:08<00:11, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 37%|███▋ | 65/175 [00:08<00:11, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 38%|███▊ | 66/175 [00:08<00:14, 7.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 37%|███▋ | 64/175 [00:08<00:13, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 37%|███▋ | 65/175 [00:08<00:12, 8.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 38%|███▊ | 67/175 [00:08<00:11, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 36%|███▌ | 63/175 [00:08<00:12, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 37%|███▋ | 64/175 [00:08<00:13, 8.14it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 38%|███▊ | 66/175 [00:08<00:11, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 37%|███▋ | 65/175 [00:08<00:12, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 38%|███▊ | 66/175 [00:08<00:12, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 39%|███▉ | 68/175 [00:08<00:11, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 38%|███▊ | 66/175 [00:08<00:12, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 38%|███▊ | 67/175 [00:08<00:14, 7.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 37%|███▋ | 64/175 [00:08<00:12, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 37%|███▋ | 65/175 [00:08<00:13, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 38%|███▊ | 67/175 [00:08<00:11, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 38%|███▊ | 66/175 [00:08<00:12, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 39%|███▉ | 69/175 [00:08<00:11, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 38%|███▊ | 67/175 [00:08<00:12, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 38%|███▊ | 67/175 [00:08<00:13, 8.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 38%|███▊ | 66/175 [00:08<00:12, 8.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 37%|███▋ | 65/175 [00:08<00:12, 8.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 39%|███▉ | 68/175 [00:08<00:14, 7.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 39%|███▉ | 68/175 [00:08<00:11, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 38%|███▊ | 67/175 [00:08<00:11, 9.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 39%|███▉ | 68/175 [00:08<00:12, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 40%|████ | 70/175 [00:08<00:12, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 39%|███▉ | 68/175 [00:08<00:12, 8.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 38%|███▊ | 67/175 [00:08<00:12, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 38%|███▊ | 66/175 [00:08<00:13, 8.25it/s] GPU 3: 39%|███▉ | 69/175 [00:08<00:11, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 39%|███▉ | 69/175 [00:08<00:14, 7.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 39%|███▉ | 68/175 [00:08<00:12, 8.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 39%|███▉ | 69/175 [00:08<00:12, 8.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 41%|████ | 71/175 [00:08<00:11, 8.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 39%|███▉ | 69/175 [00:08<00:12, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 39%|███▉ | 68/175 [00:08<00:11, 8.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 40%|████ | 70/175 [00:08<00:11, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 40%|████ | 70/175 [00:09<00:13, 7.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 40%|████ | 70/175 [00:08<00:12, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 41%|████ | 72/175 [00:08<00:11, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 40%|████ | 70/175 [00:08<00:11, 8.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 39%|███▉ | 69/175 [00:08<00:13, 7.99it/s] GPU 2: 38%|███▊ | 67/175 [00:08<00:15, 7.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 39%|███▉ | 69/175 [00:09<00:11, 9.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 41%|████ | 71/175 [00:09<00:11, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 41%|████ | 71/175 [00:09<00:12, 8.14it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 42%|████▏ | 73/175 [00:09<00:11, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 41%|████ | 71/175 [00:09<00:12, 8.63it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 41%|████ | 71/175 [00:09<00:11, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 40%|████ | 70/175 [00:09<00:11, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 41%|████ | 72/175 [00:09<00:11, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 40%|████ | 70/175 [00:09<00:13, 7.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 41%|████ | 72/175 [00:09<00:12, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 39%|███▉ | 68/175 [00:09<00:16, 6.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 42%|████▏ | 74/175 [00:09<00:11, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 41%|████ | 72/175 [00:09<00:11, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 41%|████ | 72/175 [00:09<00:11, 8.63it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 41%|████ | 71/175 [00:09<00:11, 9.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 42%|████▏ | 73/175 [00:09<00:10, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 42%|████▏ | 73/175 [00:09<00:11, 8.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 41%|████ | 71/175 [00:09<00:14, 7.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 43%|████▎ | 75/175 [00:09<00:10, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 42%|████▏ | 73/175 [00:09<00:11, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 39%|███▉ | 69/175 [00:09<00:15, 6.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 42%|████▏ | 73/175 [00:09<00:11, 8.63it/s] GPU 6: 41%|████ | 72/175 [00:09<00:11, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 42%|████▏ | 74/175 [00:09<00:10, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 42%|████▏ | 74/175 [00:09<00:11, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 41%|████ | 72/175 [00:09<00:13, 7.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 43%|████▎ | 76/175 [00:09<00:10, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 42%|████▏ | 74/175 [00:09<00:10, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 40%|████ | 70/175 [00:09<00:14, 7.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 42%|████▏ | 73/175 [00:09<00:11, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 42%|████▏ | 74/175 [00:09<00:11, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 43%|████▎ | 75/175 [00:09<00:10, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 43%|████▎ | 75/175 [00:09<00:11, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 42%|████▏ | 73/175 [00:09<00:12, 7.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 43%|████▎ | 75/175 [00:09<00:10, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 41%|████ | 71/175 [00:09<00:13, 7.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 42%|████▏ | 74/175 [00:09<00:10, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 44%|████▍ | 77/175 [00:09<00:11, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 43%|████▎ | 75/175 [00:09<00:11, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 43%|████▎ | 76/175 [00:09<00:10, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 43%|████▎ | 76/175 [00:09<00:10, 9.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 43%|████▎ | 76/175 [00:09<00:10, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 42%|████▏ | 74/175 [00:09<00:12, 8.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 41%|████ | 72/175 [00:09<00:12, 8.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 43%|████▎ | 75/175 [00:09<00:10, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 43%|████▎ | 76/175 [00:09<00:11, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 44%|████▍ | 77/175 [00:09<00:10, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 44%|████▍ | 77/175 [00:09<00:10, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 45%|████▍ | 78/175 [00:09<00:12, 8.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 44%|████▍ | 77/175 [00:09<00:10, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 43%|████▎ | 75/175 [00:09<00:12, 8.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 42%|████▏ | 73/175 [00:09<00:12, 8.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 43%|████▎ | 76/175 [00:09<00:10, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 45%|████▍ | 78/175 [00:09<00:10, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 44%|████▍ | 77/175 [00:09<00:11, 8.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 45%|████▍ | 78/175 [00:09<00:10, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 45%|████▌ | 79/175 [00:09<00:11, 8.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 45%|████▍ | 78/175 [00:09<00:10, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 42%|████▏ | 74/175 [00:09<00:11, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 43%|████▎ | 76/175 [00:09<00:11, 8.44it/s] GPU 6: 44%|████▍ | 77/175 [00:09<00:10, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 45%|████▌ | 79/175 [00:09<00:10, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 45%|████▌ | 79/175 [00:10<00:10, 9.23it/s] GPU 4: 46%|████▌ | 80/175 [00:09<00:10, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 45%|████▍ | 78/175 [00:09<00:11, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 45%|████▌ | 79/175 [00:09<00:10, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 45%|████▍ | 78/175 [00:09<00:10, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 44%|████▍ | 77/175 [00:09<00:11, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 46%|████▌ | 80/175 [00:10<00:10, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 43%|████▎ | 75/175 [00:09<00:12, 8.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 46%|████▋ | 81/175 [00:10<00:10, 8.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 46%|████▌ | 80/175 [00:10<00:10, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 45%|████▌ | 79/175 [00:09<00:11, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 46%|████▌ | 80/175 [00:10<00:10, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 45%|████▌ | 79/175 [00:10<00:10, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 45%|████▍ | 78/175 [00:10<00:11, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 46%|████▋ | 81/175 [00:10<00:10, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 46%|████▋ | 81/175 [00:10<00:10, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 47%|████▋ | 82/175 [00:10<00:10, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 46%|████▌ | 80/175 [00:10<00:11, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 43%|████▎ | 76/175 [00:10<00:12, 7.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 46%|████▋ | 81/175 [00:10<00:10, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 46%|████▌ | 80/175 [00:10<00:10, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 45%|████▌ | 79/175 [00:10<00:11, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 47%|████▋ | 82/175 [00:10<00:10, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 47%|████▋ | 82/175 [00:10<00:10, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 44%|████▍ | 77/175 [00:10<00:12, 8.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 46%|████▋ | 81/175 [00:10<00:11, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 47%|████▋ | 82/175 [00:10<00:09, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 47%|████▋ | 83/175 [00:10<00:11, 7.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 46%|████▋ | 81/175 [00:10<00:10, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 47%|████▋ | 83/175 [00:10<00:09, 9.23it/s] GPU 5: 46%|████▌ | 80/175 [00:10<00:11, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 47%|████▋ | 83/175 [00:10<00:09, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 45%|████▍ | 78/175 [00:10<00:11, 8.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 47%|████▋ | 82/175 [00:10<00:10, 8.48it/s] GPU 7: 47%|████▋ | 83/175 [00:10<00:09, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 48%|████▊ | 84/175 [00:10<00:10, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 47%|████▋ | 82/175 [00:10<00:10, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 48%|████▊ | 84/175 [00:10<00:09, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 48%|████▊ | 84/175 [00:10<00:09, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 46%|████▋ | 81/175 [00:10<00:10, 8.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 45%|████▌ | 79/175 [00:10<00:11, 8.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 48%|████▊ | 84/175 [00:10<00:09, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 49%|████▊ | 85/175 [00:10<00:10, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 47%|████▋ | 83/175 [00:10<00:10, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 47%|████▋ | 83/175 [00:10<00:09, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 49%|████▊ | 85/175 [00:10<00:09, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 49%|████▊ | 85/175 [00:10<00:09, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 47%|████▋ | 82/175 [00:10<00:10, 8.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 46%|████▌ | 80/175 [00:10<00:10, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 49%|████▊ | 85/175 [00:10<00:09, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 49%|████▉ | 86/175 [00:10<00:10, 8.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 48%|████▊ | 84/175 [00:10<00:10, 8.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 48%|████▊ | 84/175 [00:10<00:09, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 49%|████▉ | 86/175 [00:10<00:09, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 49%|████▉ | 86/175 [00:10<00:09, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 47%|████▋ | 83/175 [00:10<00:10, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 46%|████▋ | 81/175 [00:10<00:10, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 49%|████▉ | 86/175 [00:10<00:09, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 49%|████▊ | 85/175 [00:10<00:09, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 49%|████▊ | 85/175 [00:10<00:10, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 50%|████▉ | 87/175 [00:10<00:10, 8.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 50%|████▉ | 87/175 [00:10<00:09, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 50%|████▉ | 87/175 [00:10<00:09, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 48%|████▊ | 84/175 [00:10<00:10, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 47%|████▋ | 82/175 [00:10<00:10, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 50%|████▉ | 87/175 [00:10<00:09, 9.47it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 49%|████▉ | 86/175 [00:10<00:09, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 49%|████▉ | 86/175 [00:10<00:10, 8.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 50%|█████ | 88/175 [00:10<00:09, 9.36it/s] GPU 3: 50%|█████ | 88/175 [00:10<00:09, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 50%|█████ | 88/175 [00:10<00:11, 7.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 47%|████▋ | 83/175 [00:10<00:10, 9.08it/s] GPU 7: 50%|█████ | 88/175 [00:10<00:09, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 49%|████▊ | 85/175 [00:10<00:10, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 50%|████▉ | 87/175 [00:10<00:09, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 50%|████▉ | 87/175 [00:10<00:10, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 51%|█████ | 89/175 [00:11<00:09, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 51%|█████ | 89/175 [00:10<00:09, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 51%|█████ | 89/175 [00:10<00:10, 8.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 48%|████▊ | 84/175 [00:10<00:09, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 49%|████▉ | 86/175 [00:11<00:10, 8.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 51%|█████ | 89/175 [00:11<00:10, 8.59it/s] GPU 6: 50%|█████ | 88/175 [00:11<00:09, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 51%|█████▏ | 90/175 [00:11<00:09, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 50%|█████ | 88/175 [00:11<00:10, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 51%|█████▏ | 90/175 [00:11<00:09, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 51%|█████▏ | 90/175 [00:11<00:09, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 49%|████▊ | 85/175 [00:11<00:09, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 50%|████▉ | 87/175 [00:11<00:10, 8.67it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 51%|█████▏ | 90/175 [00:11<00:09, 8.82it/s] GPU 6: 51%|█████ | 89/175 [00:11<00:09, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 52%|█████▏ | 91/175 [00:11<00:09, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 52%|█████▏ | 91/175 [00:11<00:09, 8.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 51%|█████ | 89/175 [00:11<00:10, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 49%|████▉ | 86/175 [00:11<00:09, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 50%|█████ | 88/175 [00:11<00:09, 8.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 52%|█████▏ | 91/175 [00:11<00:10, 7.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 52%|█████▏ | 91/175 [00:11<00:09, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 53%|█████▎ | 92/175 [00:11<00:08, 9.28it/s] GPU 6: 51%|█████▏ | 90/175 [00:11<00:10, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 53%|█████▎ | 92/175 [00:11<00:09, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 51%|█████▏ | 90/175 [00:11<00:10, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 50%|████▉ | 87/175 [00:11<00:09, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 51%|█████ | 89/175 [00:11<00:09, 8.68it/s] GPU 1: 53%|█████▎ | 92/175 [00:11<00:10, 8.29it/s] GPU 7: 53%|█████▎ | 92/175 [00:11<00:09, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 53%|█████▎ | 93/175 [00:11<00:08, 9.29it/s] GPU 6: 52%|█████▏ | 91/175 [00:11<00:09, 8.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 53%|█████▎ | 93/175 [00:11<00:08, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 52%|█████▏ | 91/175 [00:11<00:09, 8.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 50%|█████ | 88/175 [00:11<00:09, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 53%|█████▎ | 93/175 [00:11<00:08, 9.19it/s] GPU 1: 53%|█████▎ | 93/175 [00:11<00:09, 8.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 51%|█████▏ | 90/175 [00:11<00:09, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 54%|█████▎ | 94/175 [00:11<00:08, 9.30it/s] GPU 6: 53%|█████▎ | 92/175 [00:11<00:09, 8.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 54%|█████▎ | 94/175 [00:11<00:08, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 53%|█████▎ | 92/175 [00:11<00:09, 8.50it/s] GPU 2: 51%|█████ | 89/175 [00:11<00:09, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 54%|█████▎ | 94/175 [00:11<00:09, 8.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 52%|█████▏ | 91/175 [00:11<00:09, 8.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 54%|█████▎ | 94/175 [00:11<00:09, 8.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 54%|█████▍ | 95/175 [00:11<00:08, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 53%|█████▎ | 93/175 [00:11<00:09, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 54%|█████▍ | 95/175 [00:11<00:08, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 51%|█████▏ | 90/175 [00:11<00:09, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 53%|█████▎ | 93/175 [00:11<00:09, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 54%|█████▍ | 95/175 [00:11<00:08, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 53%|█████▎ | 92/175 [00:11<00:09, 8.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 55%|█████▍ | 96/175 [00:11<00:08, 9.31it/s] GPU 4: 55%|█████▍ | 96/175 [00:11<00:08, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 54%|█████▎ | 94/175 [00:11<00:08, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 54%|█████▍ | 95/175 [00:11<00:10, 7.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 54%|█████▎ | 94/175 [00:11<00:09, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 55%|█████▍ | 96/175 [00:11<00:08, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 52%|█████▏ | 91/175 [00:11<00:09, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 53%|█████▎ | 93/175 [00:11<00:09, 8.76it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 55%|█████▌ | 97/175 [00:11<00:08, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 55%|█████▌ | 97/175 [00:11<00:08, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 54%|█████▍ | 95/175 [00:11<00:08, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 55%|█████▍ | 96/175 [00:11<00:09, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 55%|█████▌ | 97/175 [00:12<00:08, 9.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 54%|█████▍ | 95/175 [00:11<00:09, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 56%|█████▌ | 98/175 [00:11<00:08, 9.43it/s] GPU 5: 54%|█████▎ | 94/175 [00:11<00:09, 8.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 56%|█████▌ | 98/175 [00:11<00:08, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 55%|█████▍ | 96/175 [00:11<00:08, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 53%|█████▎ | 92/175 [00:11<00:10, 7.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 55%|█████▌ | 97/175 [00:11<00:09, 8.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 56%|█████▌ | 98/175 [00:12<00:08, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 55%|█████▍ | 96/175 [00:11<00:09, 8.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 57%|█████▋ | 99/175 [00:12<00:08, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 57%|█████▋ | 99/175 [00:12<00:08, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 55%|█████▌ | 97/175 [00:12<00:08, 9.22it/s] GPU 5: 54%|█████▍ | 95/175 [00:12<00:09, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 53%|█████▎ | 93/175 [00:12<00:09, 8.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 56%|█████▌ | 98/175 [00:12<00:08, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 57%|█████▋ | 99/175 [00:12<00:08, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 55%|█████▌ | 97/175 [00:12<00:09, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 57%|█████▋ | 100/175 [00:12<00:07, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 57%|█████▋ | 100/175 [00:12<00:08, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 56%|█████▌ | 98/175 [00:12<00:08, 9.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 54%|█████▎ | 94/175 [00:12<00:09, 8.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 57%|█████▋ | 99/175 [00:12<00:08, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 55%|█████▍ | 96/175 [00:12<00:09, 7.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 58%|█████▊ | 101/175 [00:12<00:07, 9.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 57%|█████▋ | 100/175 [00:12<00:08, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 56%|█████▌ | 98/175 [00:12<00:09, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 58%|█████▊ | 101/175 [00:12<00:07, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 57%|█████▋ | 99/175 [00:12<00:08, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 54%|█████▍ | 95/175 [00:12<00:09, 8.76it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 57%|█████▋ | 100/175 [00:12<00:09, 8.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 55%|█████▌ | 97/175 [00:12<00:10, 7.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 58%|█████▊ | 102/175 [00:12<00:07, 9.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 58%|█████▊ | 102/175 [00:12<00:07, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 57%|█████▋ | 100/175 [00:12<00:08, 9.23it/s] GPU 0: 57%|█████▋ | 99/175 [00:12<00:08, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 58%|█████▊ | 101/175 [00:12<00:09, 8.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 55%|█████▍ | 96/175 [00:12<00:09, 8.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 59%|█████▉ | 103/175 [00:12<00:07, 9.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 58%|█████▊ | 101/175 [00:12<00:09, 7.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 59%|█████▉ | 103/175 [00:12<00:07, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 58%|█████▊ | 101/175 [00:12<00:07, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 57%|█████▋ | 100/175 [00:12<00:08, 8.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 58%|█████▊ | 102/175 [00:12<00:08, 8.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 56%|█████▌ | 98/175 [00:12<00:10, 7.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 55%|█████▌ | 97/175 [00:12<00:09, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 59%|█████▉ | 104/175 [00:12<00:07, 9.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 58%|█████▊ | 102/175 [00:12<00:08, 8.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 59%|█████▉ | 104/175 [00:12<00:07, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 58%|█████▊ | 102/175 [00:12<00:07, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 59%|█████▉ | 103/175 [00:12<00:08, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 58%|█████▊ | 101/175 [00:12<00:08, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 56%|█████▌ | 98/175 [00:12<00:08, 8.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 57%|█████▋ | 99/175 [00:12<00:10, 7.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 60%|██████ | 105/175 [00:12<00:07, 9.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 59%|█████▉ | 103/175 [00:12<00:08, 8.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 60%|██████ | 105/175 [00:12<00:07, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 59%|█████▉ | 103/175 [00:12<00:07, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 59%|█████▉ | 104/175 [00:12<00:07, 8.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 58%|█████▊ | 102/175 [00:12<00:08, 8.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 57%|█████▋ | 99/175 [00:12<00:08, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 57%|█████▋ | 100/175 [00:12<00:10, 7.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 61%|██████ | 106/175 [00:12<00:07, 9.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 59%|█████▉ | 104/175 [00:12<00:08, 8.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 61%|██████ | 106/175 [00:12<00:07, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 59%|█████▉ | 104/175 [00:12<00:07, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 60%|██████ | 105/175 [00:12<00:07, 9.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 57%|█████▋ | 100/175 [00:12<00:08, 9.01it/s] GPU 0: 59%|█████▉ | 103/175 [00:12<00:08, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 58%|█████▊ | 101/175 [00:12<00:09, 7.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 60%|██████ | 105/175 [00:12<00:07, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 61%|██████ | 107/175 [00:12<00:07, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 61%|██████ | 107/175 [00:12<00:07, 8.72it/s] GPU 6: 60%|██████ | 105/175 [00:12<00:07, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 61%|██████ | 106/175 [00:13<00:08, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 59%|█████▉ | 104/175 [00:12<00:08, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 58%|█████▊ | 101/175 [00:12<00:08, 8.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 58%|█████▊ | 102/175 [00:12<00:08, 8.14it/s] GPU 7: 61%|██████ | 106/175 [00:13<00:07, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 62%|██████▏ | 108/175 [00:13<00:07, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 61%|██████ | 106/175 [00:13<00:07, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 62%|██████▏ | 108/175 [00:13<00:08, 8.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 60%|██████ | 105/175 [00:13<00:08, 8.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 61%|██████ | 107/175 [00:13<00:07, 9.28it/s] GPU 1: 61%|██████ | 107/175 [00:13<00:08, 7.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 59%|█████▉ | 103/175 [00:13<00:08, 8.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 62%|██████▏ | 109/175 [00:13<00:07, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 61%|██████ | 107/175 [00:13<00:07, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 58%|█████▊ | 102/175 [00:13<00:09, 7.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 62%|██████▏ | 109/175 [00:13<00:07, 8.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 61%|██████ | 106/175 [00:13<00:08, 8.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 62%|██████▏ | 108/175 [00:13<00:07, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 62%|██████▏ | 108/175 [00:13<00:08, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 59%|█████▉ | 104/175 [00:13<00:08, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 62%|██████▏ | 108/175 [00:13<00:07, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 63%|██████▎ | 110/175 [00:13<00:07, 8.52it/s] GPU 4: 63%|██████▎ | 110/175 [00:13<00:07, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 59%|█████▉ | 103/175 [00:13<00:09, 7.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 61%|██████ | 107/175 [00:13<00:07, 8.62it/s] GPU 7: 62%|██████▏ | 109/175 [00:13<00:07, 9.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 62%|██████▏ | 109/175 [00:13<00:07, 8.67it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 60%|██████ | 105/175 [00:13<00:08, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 62%|██████▏ | 109/175 [00:13<00:07, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 63%|██████▎ | 111/175 [00:13<00:07, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 63%|██████▎ | 111/175 [00:13<00:07, 8.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 63%|██████▎ | 110/175 [00:13<00:06, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 59%|█████▉ | 104/175 [00:13<00:09, 7.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 62%|██████▏ | 108/175 [00:13<00:07, 8.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 63%|██████▎ | 110/175 [00:13<00:07, 8.14it/s] GPU 6: 63%|██████▎ | 110/175 [00:13<00:07, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 64%|██████▍ | 112/175 [00:13<00:06, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 61%|██████ | 106/175 [00:13<00:08, 7.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 64%|██████▍ | 112/175 [00:13<00:07, 8.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 63%|██████▎ | 111/175 [00:13<00:06, 9.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 60%|██████ | 105/175 [00:13<00:08, 7.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 62%|██████▏ | 109/175 [00:13<00:07, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 63%|██████▎ | 111/175 [00:13<00:06, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 65%|██████▍ | 113/175 [00:13<00:06, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 63%|██████▎ | 111/175 [00:13<00:08, 7.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 65%|██████▍ | 113/175 [00:13<00:07, 8.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 64%|██████▍ | 112/175 [00:13<00:06, 9.47it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 61%|██████ | 107/175 [00:13<00:09, 7.53it/s] GPU 2: 61%|██████ | 106/175 [00:13<00:08, 8.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 63%|██████▎ | 110/175 [00:13<00:07, 8.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 64%|██████▍ | 112/175 [00:13<00:06, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 65%|██████▌ | 114/175 [00:13<00:06, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 64%|██████▍ | 112/175 [00:13<00:07, 8.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 65%|██████▌ | 114/175 [00:13<00:06, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 65%|██████▍ | 113/175 [00:13<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 61%|██████ | 107/175 [00:13<00:07, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 63%|██████▎ | 111/175 [00:13<00:07, 8.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 65%|██████▍ | 113/175 [00:13<00:06, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 62%|██████▏ | 108/175 [00:13<00:09, 7.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 66%|██████▌ | 115/175 [00:13<00:06, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 65%|██████▍ | 113/175 [00:13<00:07, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 66%|██████▌ | 115/175 [00:13<00:06, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 65%|██████▌ | 114/175 [00:13<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 62%|██████▏ | 108/175 [00:13<00:07, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 65%|██████▌ | 114/175 [00:13<00:06, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 66%|██████▋ | 116/175 [00:13<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 64%|██████▍ | 112/175 [00:13<00:07, 8.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 62%|██████▏ | 109/175 [00:13<00:09, 7.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 66%|██████▋ | 116/175 [00:13<00:06, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 66%|██████▌ | 115/175 [00:13<00:06, 9.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 65%|██████▌ | 114/175 [00:14<00:07, 8.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 62%|██████▏ | 109/175 [00:13<00:07, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 66%|██████▌ | 115/175 [00:14<00:06, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 67%|██████▋ | 117/175 [00:14<00:06, 9.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 67%|██████▋ | 117/175 [00:14<00:06, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 65%|██████▍ | 113/175 [00:14<00:07, 7.81it/s] GPU 7: 66%|██████▋ | 116/175 [00:14<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 63%|██████▎ | 110/175 [00:14<00:07, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 63%|██████▎ | 110/175 [00:14<00:09, 6.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 66%|██████▌ | 115/175 [00:14<00:07, 7.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 67%|██████▋ | 118/175 [00:14<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 66%|██████▋ | 116/175 [00:14<00:06, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 67%|██████▋ | 118/175 [00:14<00:06, 9.18it/s] GPU 7: 67%|██████▋ | 117/175 [00:14<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 63%|██████▎ | 111/175 [00:14<00:07, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 65%|██████▌ | 114/175 [00:14<00:08, 7.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 67%|██████▋ | 117/175 [00:14<00:06, 9.27it/s] GPU 4: 68%|██████▊ | 119/175 [00:14<00:05, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 66%|██████▋ | 116/175 [00:14<00:07, 7.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 63%|██████▎ | 111/175 [00:14<00:09, 6.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 68%|██████▊ | 119/175 [00:14<00:06, 9.24it/s] GPU 7: 67%|██████▋ | 118/175 [00:14<00:06, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 64%|██████▍ | 112/175 [00:14<00:06, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 69%|██████▊ | 120/175 [00:14<00:05, 9.38it/s] GPU 6: 67%|██████▋ | 118/175 [00:14<00:06, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 66%|██████▌ | 115/175 [00:14<00:07, 7.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 64%|██████▍ | 112/175 [00:14<00:08, 7.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 68%|██████▊ | 119/175 [00:14<00:05, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 69%|██████▊ | 120/175 [00:14<00:05, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 67%|██████▋ | 117/175 [00:14<00:07, 7.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 65%|██████▍ | 113/175 [00:14<00:06, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 69%|██████▉ | 121/175 [00:14<00:05, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 68%|██████▊ | 119/175 [00:14<00:06, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 66%|██████▋ | 116/175 [00:14<00:07, 7.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 65%|██████▍ | 113/175 [00:14<00:07, 7.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 69%|██████▊ | 120/175 [00:14<00:05, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 67%|██████▋ | 118/175 [00:14<00:07, 7.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 69%|██████▉ | 121/175 [00:14<00:05, 9.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 65%|██████▌ | 114/175 [00:14<00:06, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 70%|██████▉ | 122/175 [00:14<00:05, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 69%|██████▊ | 120/175 [00:14<00:05, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 67%|██████▋ | 117/175 [00:14<00:07, 8.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 65%|██████▌ | 114/175 [00:14<00:07, 8.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 69%|██████▉ | 121/175 [00:14<00:05, 9.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 68%|██████▊ | 119/175 [00:14<00:06, 8.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 70%|██████▉ | 122/175 [00:14<00:05, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 66%|██████▌ | 115/175 [00:14<00:07, 8.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 70%|███████ | 123/175 [00:14<00:05, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 69%|██████▉ | 121/175 [00:14<00:06, 8.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 67%|██████▋ | 118/175 [00:14<00:07, 7.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 69%|██████▊ | 120/175 [00:14<00:07, 7.44it/s] GPU 5: 66%|██████▌ | 115/175 [00:14<00:08, 7.09it/s] GPU 3: 70%|███████ | 123/175 [00:14<00:06, 8.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 66%|██████▋ | 116/175 [00:14<00:08, 7.25it/s] GPU 4: 71%|███████ | 124/175 [00:14<00:06, 7.79it/s] GPU 7: 70%|██████▉ | 122/175 [00:14<00:07, 6.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 70%|██████▉ | 122/175 [00:14<00:07, 7.28it/s] GPU 0: 68%|██████▊ | 119/175 [00:14<00:07, 7.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 69%|██████▉ | 121/175 [00:15<00:07, 6.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 66%|██████▋ | 116/175 [00:14<00:08, 6.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 71%|███████ | 124/175 [00:14<00:07, 6.66it/s] GPU 4: 71%|███████▏ | 125/175 [00:14<00:06, 7.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 67%|██████▋ | 117/175 [00:14<00:08, 7.19it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 70%|███████ | 123/175 [00:15<00:07, 7.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 69%|██████▊ | 120/175 [00:14<00:07, 7.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 70%|███████ | 123/175 [00:15<00:08, 6.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 67%|██████▋ | 117/175 [00:15<00:08, 6.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 72%|███████▏ | 126/175 [00:15<00:06, 7.87it/s] GPU 1: 70%|██████▉ | 122/175 [00:15<00:07, 6.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 71%|███████▏ | 125/175 [00:15<00:07, 7.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 71%|███████ | 124/175 [00:15<00:07, 7.02it/s] GPU 0: 69%|██████▉ | 121/175 [00:15<00:07, 6.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 71%|███████ | 124/175 [00:15<00:07, 6.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 67%|██████▋ | 118/175 [00:15<00:08, 6.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 72%|███████▏ | 126/175 [00:15<00:07, 6.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 70%|███████ | 123/175 [00:15<00:08, 6.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 73%|███████▎ | 127/175 [00:15<00:06, 6.99it/s] GPU 6: 71%|███████▏ | 125/175 [00:15<00:06, 7.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 70%|██████▉ | 122/175 [00:15<00:07, 7.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 71%|███████▏ | 125/175 [00:15<00:07, 7.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 67%|██████▋ | 118/175 [00:15<00:13, 4.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 73%|███████▎ | 127/175 [00:15<00:09, 5.21it/s] GPU 5: 68%|██████▊ | 119/175 [00:15<00:11, 4.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 72%|███████▏ | 126/175 [00:15<00:09, 5.23it/s] GPU 1: 71%|███████ | 124/175 [00:15<00:10, 4.89it/s] GPU 6: 72%|███████▏ | 126/175 [00:15<00:09, 5.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 70%|███████ | 123/175 [00:15<00:09, 5.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 73%|███████▎ | 128/175 [00:15<00:09, 4.90it/s] GPU 2: 68%|██████▊ | 119/175 [00:15<00:12, 4.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 73%|███████▎ | 128/175 [00:15<00:07, 5.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 69%|██████▊ | 120/175 [00:15<00:09, 5.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 71%|███████▏ | 125/175 [00:15<00:08, 5.70it/s] GPU 7: 73%|███████▎ | 127/175 [00:15<00:07, 6.02it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 71%|███████ | 124/175 [00:15<00:08, 6.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 74%|███████▎ | 129/175 [00:15<00:08, 5.72it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 73%|███████▎ | 127/175 [00:15<00:08, 5.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 69%|██████▊ | 120/175 [00:15<00:10, 5.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 74%|███████▎ | 129/175 [00:15<00:06, 6.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 69%|██████▉ | 121/175 [00:15<00:08, 6.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 73%|███████▎ | 128/175 [00:15<00:06, 6.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 72%|███████▏ | 126/175 [00:15<00:07, 6.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 71%|███████▏ | 125/175 [00:15<00:07, 6.74it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 74%|███████▍ | 130/175 [00:15<00:06, 6.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 69%|██████▉ | 121/175 [00:15<00:08, 6.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 73%|███████▎ | 128/175 [00:15<00:07, 6.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 74%|███████▍ | 130/175 [00:15<00:06, 7.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 70%|██████▉ | 122/175 [00:15<00:07, 7.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 74%|███████▎ | 129/175 [00:15<00:06, 7.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 73%|███████▎ | 127/175 [00:15<00:06, 7.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 72%|███████▏ | 126/175 [00:15<00:06, 7.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 75%|███████▍ | 131/175 [00:15<00:06, 7.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 70%|██████▉ | 122/175 [00:15<00:07, 6.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 75%|███████▍ | 131/175 [00:15<00:05, 7.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 70%|███████ | 123/175 [00:15<00:06, 7.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 74%|███████▎ | 129/175 [00:16<00:07, 6.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 74%|███████▍ | 130/175 [00:16<00:05, 7.80it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 73%|███████▎ | 128/175 [00:16<00:06, 7.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 73%|███████▎ | 127/175 [00:15<00:06, 7.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 75%|███████▌ | 132/175 [00:16<00:05, 7.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 70%|███████ | 123/175 [00:16<00:07, 7.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 75%|███████▌ | 132/175 [00:16<00:05, 8.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 71%|███████ | 124/175 [00:16<00:06, 7.89it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 75%|███████▍ | 131/175 [00:16<00:05, 8.19it/s] GPU 1: 74%|███████▎ | 129/175 [00:16<00:05, 8.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 73%|███████▎ | 128/175 [00:16<00:05, 8.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 74%|███████▍ | 130/175 [00:16<00:06, 6.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 76%|███████▌ | 133/175 [00:16<00:05, 8.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 71%|███████ | 124/175 [00:16<00:06, 7.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 76%|███████▌ | 133/175 [00:16<00:04, 8.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 71%|███████▏ | 125/175 [00:16<00:06, 8.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 75%|███████▌ | 132/175 [00:16<00:05, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 74%|███████▎ | 129/175 [00:16<00:05, 8.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 75%|███████▍ | 131/175 [00:16<00:06, 7.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 77%|███████▋ | 134/175 [00:16<00:04, 8.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 74%|███████▍ | 130/175 [00:16<00:05, 7.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 71%|███████▏ | 125/175 [00:16<00:06, 8.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 77%|███████▋ | 134/175 [00:16<00:04, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 72%|███████▏ | 126/175 [00:16<00:05, 8.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 76%|███████▌ | 133/175 [00:16<00:04, 8.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 75%|███████▌ | 132/175 [00:16<00:05, 7.75it/s] GPU 0: 74%|███████▍ | 130/175 [00:16<00:05, 8.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 77%|███████▋ | 135/175 [00:16<00:04, 8.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 72%|███████▏ | 126/175 [00:16<00:06, 8.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 75%|███████▍ | 131/175 [00:16<00:05, 7.51it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 77%|███████▋ | 135/175 [00:16<00:04, 8.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 73%|███████▎ | 127/175 [00:16<00:05, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 77%|███████▋ | 134/175 [00:16<00:04, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 76%|███████▌ | 133/175 [00:16<00:05, 8.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 75%|███████▍ | 131/175 [00:16<00:05, 8.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 78%|███████▊ | 136/175 [00:16<00:04, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 75%|███████▌ | 132/175 [00:16<00:05, 8.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 73%|███████▎ | 127/175 [00:16<00:06, 7.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 77%|███████▋ | 135/175 [00:16<00:04, 9.08it/s] GPU 5: 73%|███████▎ | 128/175 [00:16<00:05, 8.70it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 78%|███████▊ | 136/175 [00:16<00:04, 8.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 77%|███████▋ | 134/175 [00:16<00:04, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 78%|███████▊ | 137/175 [00:16<00:04, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 75%|███████▌ | 132/175 [00:16<00:04, 8.80it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 76%|███████▌ | 133/175 [00:16<00:05, 8.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 73%|███████▎ | 128/175 [00:16<00:05, 8.21it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 78%|███████▊ | 136/175 [00:16<00:04, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 74%|███████▎ | 129/175 [00:16<00:05, 8.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 77%|███████▋ | 135/175 [00:16<00:04, 8.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 79%|███████▉ | 138/175 [00:16<00:04, 9.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 76%|███████▌ | 133/175 [00:16<00:04, 8.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 78%|███████▊ | 137/175 [00:16<00:04, 7.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 77%|███████▋ | 134/175 [00:16<00:04, 8.63it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 74%|███████▎ | 129/175 [00:16<00:05, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 78%|███████▊ | 137/175 [00:16<00:04, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 74%|███████▍ | 130/175 [00:16<00:05, 8.80it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 78%|███████▊ | 136/175 [00:16<00:04, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 77%|███████▋ | 134/175 [00:16<00:04, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 79%|███████▉ | 139/175 [00:16<00:04, 8.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 77%|███████▋ | 135/175 [00:16<00:04, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 79%|███████▉ | 138/175 [00:16<00:04, 7.54it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 74%|███████▍ | 130/175 [00:16<00:05, 8.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 79%|███████▉ | 138/175 [00:16<00:03, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 75%|███████▍ | 131/175 [00:16<00:04, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 78%|███████▊ | 137/175 [00:16<00:04, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 78%|███████▊ | 136/175 [00:17<00:04, 8.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 77%|███████▋ | 135/175 [00:16<00:04, 8.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 75%|███████▍ | 131/175 [00:16<00:04, 8.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 80%|████████ | 140/175 [00:16<00:04, 7.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 79%|███████▉ | 139/175 [00:16<00:03, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 79%|███████▉ | 139/175 [00:16<00:04, 7.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 75%|███████▌ | 132/175 [00:16<00:04, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 79%|███████▉ | 138/175 [00:17<00:04, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 78%|███████▊ | 137/175 [00:17<00:04, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 75%|███████▌ | 132/175 [00:17<00:04, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 80%|████████ | 140/175 [00:17<00:03, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 78%|███████▊ | 136/175 [00:17<00:05, 7.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 76%|███████▌ | 133/175 [00:17<00:04, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 81%|████████ | 141/175 [00:17<00:04, 7.69it/s] GPU 6: 79%|███████▉ | 139/175 [00:17<00:03, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 80%|████████ | 140/175 [00:17<00:04, 7.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 79%|███████▉ | 138/175 [00:17<00:04, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 76%|███████▌ | 133/175 [00:17<00:04, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 81%|████████ | 141/175 [00:17<00:03, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 78%|███████▊ | 137/175 [00:17<00:04, 8.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 80%|████████ | 140/175 [00:17<00:03, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 81%|████████ | 142/175 [00:17<00:04, 7.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 77%|███████▋ | 134/175 [00:17<00:05, 8.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 79%|███████▉ | 139/175 [00:17<00:03, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 81%|████████ | 141/175 [00:17<00:04, 7.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 81%|████████ | 142/175 [00:17<00:03, 9.40it/s] GPU 2: 77%|███████▋ | 134/175 [00:17<00:04, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 79%|███████▉ | 138/175 [00:17<00:04, 8.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 81%|████████ | 141/175 [00:17<00:03, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 80%|████████ | 140/175 [00:17<00:03, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 81%|████████ | 142/175 [00:17<00:04, 7.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 82%|████████▏ | 143/175 [00:17<00:04, 7.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 82%|████████▏ | 143/175 [00:17<00:03, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 77%|███████▋ | 135/175 [00:17<00:05, 7.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 77%|███████▋ | 135/175 [00:17<00:04, 9.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 81%|████████ | 142/175 [00:17<00:03, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 79%|███████▉ | 139/175 [00:17<00:04, 8.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 81%|████████ | 141/175 [00:17<00:03, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 82%|████████▏ | 143/175 [00:17<00:03, 8.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 82%|████████▏ | 144/175 [00:17<00:03, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 78%|███████▊ | 136/175 [00:17<00:04, 8.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 78%|███████▊ | 136/175 [00:17<00:04, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 82%|████████▏ | 144/175 [00:17<00:04, 7.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 82%|████████▏ | 143/175 [00:17<00:03, 9.37it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 80%|████████ | 140/175 [00:17<00:04, 8.68it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 81%|████████ | 142/175 [00:17<00:03, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 82%|████████▏ | 144/175 [00:17<00:03, 8.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 83%|████████▎ | 145/175 [00:17<00:03, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 78%|███████▊ | 137/175 [00:17<00:04, 8.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 83%|████████▎ | 145/175 [00:17<00:03, 7.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 82%|████████▏ | 144/175 [00:17<00:03, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 78%|███████▊ | 137/175 [00:17<00:04, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 82%|████████▏ | 143/175 [00:17<00:03, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 81%|████████ | 141/175 [00:17<00:04, 8.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 83%|████████▎ | 145/175 [00:17<00:03, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 83%|████████▎ | 146/175 [00:17<00:03, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 83%|████████▎ | 146/175 [00:17<00:03, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 83%|████████▎ | 145/175 [00:17<00:03, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 79%|███████▉ | 138/175 [00:17<00:04, 8.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 79%|███████▉ | 138/175 [00:17<00:04, 7.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 82%|████████▏ | 144/175 [00:17<00:03, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 83%|████████▎ | 146/175 [00:17<00:03, 8.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 84%|████████▍ | 147/175 [00:17<00:02, 9.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 81%|████████ | 142/175 [00:17<00:04, 7.59it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 84%|████████▍ | 147/175 [00:17<00:03, 8.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 83%|████████▎ | 146/175 [00:17<00:03, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 79%|███████▉ | 139/175 [00:17<00:04, 8.69it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 83%|████████▎ | 145/175 [00:17<00:03, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 84%|████████▍ | 147/175 [00:17<00:03, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 79%|███████▉ | 139/175 [00:17<00:04, 7.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 85%|████████▍ | 148/175 [00:17<00:02, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 82%|████████▏ | 143/175 [00:17<00:04, 7.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 85%|████████▍ | 148/175 [00:17<00:03, 8.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 84%|████████▍ | 147/175 [00:17<00:03, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 80%|████████ | 140/175 [00:17<00:03, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 83%|████████▎ | 146/175 [00:18<00:03, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 85%|████████▍ | 148/175 [00:18<00:02, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 80%|████████ | 140/175 [00:18<00:04, 7.80it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 85%|████████▌ | 149/175 [00:18<00:02, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 82%|████████▏ | 144/175 [00:18<00:03, 8.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 85%|████████▌ | 149/175 [00:18<00:02, 8.98it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 85%|████████▍ | 148/175 [00:18<00:02, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 81%|████████ | 141/175 [00:18<00:03, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 84%|████████▍ | 147/175 [00:18<00:02, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 85%|████████▌ | 149/175 [00:18<00:02, 9.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 81%|████████ | 141/175 [00:18<00:04, 8.15it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 86%|████████▌ | 150/175 [00:18<00:02, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 86%|████████▌ | 150/175 [00:18<00:02, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 85%|████████▌ | 149/175 [00:18<00:02, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 81%|████████ | 142/175 [00:18<00:03, 9.09it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 83%|████████▎ | 145/175 [00:18<00:03, 7.82it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 85%|████████▍ | 148/175 [00:18<00:02, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 86%|████████▌ | 150/175 [00:18<00:02, 9.14it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 86%|████████▋ | 151/175 [00:18<00:02, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 81%|████████ | 142/175 [00:18<00:03, 8.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 86%|████████▋ | 151/175 [00:18<00:02, 9.17it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 86%|████████▌ | 150/175 [00:18<00:02, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 82%|████████▏ | 143/175 [00:18<00:03, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 85%|████████▌ | 149/175 [00:18<00:02, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 83%|████████▎ | 146/175 [00:18<00:03, 7.53it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 86%|████████▋ | 151/175 [00:18<00:02, 9.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 87%|████████▋ | 152/175 [00:18<00:02, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 82%|████████▏ | 143/175 [00:18<00:03, 8.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 87%|████████▋ | 152/175 [00:18<00:02, 9.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 86%|████████▋ | 151/175 [00:18<00:02, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 82%|████████▏ | 144/175 [00:18<00:03, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 86%|████████▌ | 150/175 [00:18<00:02, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 84%|████████▍ | 147/175 [00:18<00:03, 7.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 87%|████████▋ | 153/175 [00:18<00:02, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 82%|████████▏ | 144/175 [00:18<00:03, 8.76it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 87%|████████▋ | 153/175 [00:18<00:02, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 87%|████████▋ | 152/175 [00:18<00:02, 8.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 87%|████████▋ | 152/175 [00:18<00:02, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 83%|████████▎ | 145/175 [00:18<00:03, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 86%|████████▋ | 151/175 [00:18<00:02, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 85%|████████▍ | 148/175 [00:18<00:03, 8.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 83%|████████▎ | 145/175 [00:18<00:03, 8.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 88%|████████▊ | 154/175 [00:18<00:02, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 88%|████████▊ | 154/175 [00:18<00:02, 8.59it/s] GPU 6: 87%|████████▋ | 153/175 [00:18<00:02, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 83%|████████▎ | 146/175 [00:18<00:03, 9.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 87%|████████▋ | 153/175 [00:18<00:02, 7.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 87%|████████▋ | 152/175 [00:18<00:02, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 85%|████████▌ | 149/175 [00:18<00:03, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 83%|████████▎ | 146/175 [00:18<00:03, 8.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 88%|████████▊ | 154/175 [00:18<00:02, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 84%|████████▍ | 147/175 [00:18<00:03, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 89%|████████▊ | 155/175 [00:18<00:02, 8.11it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 87%|████████▋ | 153/175 [00:18<00:02, 9.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 88%|████████▊ | 154/175 [00:18<00:02, 7.64it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 86%|████████▌ | 150/175 [00:18<00:02, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 84%|████████▍ | 147/175 [00:18<00:03, 8.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 89%|████████▊ | 155/175 [00:18<00:02, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 85%|████████▍ | 148/175 [00:18<00:02, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 89%|████████▉ | 156/175 [00:18<00:02, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 88%|████████▊ | 154/175 [00:18<00:02, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 86%|████████▋ | 151/175 [00:18<00:02, 8.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 85%|████████▍ | 148/175 [00:18<00:02, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 89%|████████▊ | 155/175 [00:18<00:02, 7.44it/s] GPU 6: 89%|████████▉ | 156/175 [00:18<00:02, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 85%|████████▌ | 149/175 [00:18<00:02, 9.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 90%|████████▉ | 157/175 [00:18<00:02, 8.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 89%|████████▊ | 155/175 [00:19<00:02, 9.38it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 87%|████████▋ | 152/175 [00:18<00:02, 8.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 85%|████████▌ | 149/175 [00:19<00:02, 9.03it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 90%|████████▉ | 157/175 [00:19<00:01, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 89%|████████▉ | 156/175 [00:19<00:02, 7.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 86%|████████▌ | 150/175 [00:19<00:02, 9.29it/s] GPU 7: 90%|█████████ | 158/175 [00:19<00:01, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 89%|████████▊ | 155/175 [00:19<00:04, 4.52it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 89%|████████▉ | 156/175 [00:19<00:02, 8.56it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 87%|████████▋ | 153/175 [00:19<00:02, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 90%|█████████ | 158/175 [00:19<00:01, 9.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 90%|████████▉ | 157/175 [00:19<00:02, 8.29it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 91%|█████████ | 159/175 [00:19<00:01, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 86%|████████▋ | 151/175 [00:19<00:02, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 86%|████████▌ | 150/175 [00:19<00:03, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 88%|████████▊ | 154/175 [00:19<00:02, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 89%|████████▉ | 156/175 [00:19<00:03, 5.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 91%|█████████ | 159/175 [00:19<00:01, 9.47it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 90%|█████████ | 158/175 [00:19<00:01, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 90%|████████▉ | 157/175 [00:19<00:02, 8.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 87%|████████▋ | 152/175 [00:19<00:02, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 91%|█████████▏| 160/175 [00:19<00:01, 8.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 86%|████████▋ | 151/175 [00:19<00:03, 7.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 90%|████████▉ | 157/175 [00:19<00:03, 5.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 91%|█████████▏| 160/175 [00:19<00:01, 9.48it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 91%|█████████ | 159/175 [00:19<00:01, 8.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 90%|█████████ | 158/175 [00:19<00:02, 8.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 89%|████████▊ | 155/175 [00:19<00:02, 8.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 87%|████████▋ | 153/175 [00:19<00:02, 9.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 87%|████████▋ | 152/175 [00:19<00:02, 8.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 90%|█████████ | 158/175 [00:19<00:02, 6.61it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 92%|█████████▏| 161/175 [00:19<00:01, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 92%|█████████▏| 161/175 [00:19<00:01, 7.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 91%|█████████▏| 160/175 [00:19<00:01, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 91%|█████████ | 159/175 [00:19<00:01, 8.66it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 88%|████████▊ | 154/175 [00:19<00:02, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 89%|████████▉ | 156/175 [00:19<00:02, 7.77it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 87%|████████▋ | 153/175 [00:19<00:02, 8.33it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 93%|█████████▎| 162/175 [00:19<00:01, 9.43it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 93%|█████████▎| 162/175 [00:19<00:01, 8.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 92%|█████████▏| 161/175 [00:19<00:01, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 91%|█████████▏| 160/175 [00:19<00:01, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 91%|█████████ | 159/175 [00:19<00:02, 6.73it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 89%|████████▊ | 155/175 [00:19<00:02, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 90%|████████▉ | 157/175 [00:19<00:02, 8.12it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 88%|████████▊ | 154/175 [00:19<00:02, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 93%|█████████▎| 163/175 [00:19<00:01, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 93%|█████████▎| 163/175 [00:19<00:01, 8.60it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 92%|█████████▏| 161/175 [00:19<00:01, 9.01it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 89%|████████▉ | 156/175 [00:19<00:02, 9.28it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 93%|█████████▎| 162/175 [00:19<00:01, 8.26it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 91%|█████████▏| 160/175 [00:19<00:02, 6.84it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 90%|█████████ | 158/175 [00:19<00:02, 8.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 89%|████████▊ | 155/175 [00:19<00:02, 8.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 94%|█████████▎| 164/175 [00:19<00:01, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 94%|█████████▎| 164/175 [00:19<00:01, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 93%|█████████▎| 162/175 [00:19<00:01, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 90%|████████▉ | 157/175 [00:19<00:01, 9.30it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 92%|█████████▏| 161/175 [00:19<00:01, 7.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 91%|█████████ | 159/175 [00:19<00:01, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 93%|█████████▎| 163/175 [00:19<00:01, 7.86it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 89%|████████▉ | 156/175 [00:19<00:02, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 94%|█████████▍| 165/175 [00:19<00:01, 9.46it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 94%|█████████▍| 165/175 [00:19<00:01, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 93%|█████████▎| 163/175 [00:19<00:01, 9.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 90%|█████████ | 158/175 [00:19<00:01, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 93%|█████████▎| 162/175 [00:19<00:01, 7.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 90%|████████▉ | 157/175 [00:19<00:02, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 95%|█████████▍| 166/175 [00:19<00:00, 9.45it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 95%|█████████▍| 166/175 [00:19<00:00, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 91%|█████████▏| 160/175 [00:19<00:01, 8.06it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 94%|█████████▎| 164/175 [00:19<00:01, 7.58it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 94%|█████████▎| 164/175 [00:20<00:01, 9.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 93%|█████████▎| 163/175 [00:20<00:01, 8.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 91%|█████████ | 159/175 [00:20<00:01, 8.49it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 95%|█████████▌| 167/175 [00:20<00:00, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 95%|█████████▌| 167/175 [00:20<00:00, 9.20it/s] GPU 5: 90%|█████████ | 158/175 [00:20<00:01, 8.92it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 92%|█████████▏| 161/175 [00:20<00:01, 8.23it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 94%|█████████▍| 165/175 [00:20<00:01, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 94%|█████████▍| 165/175 [00:20<00:01, 7.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 94%|█████████▎| 164/175 [00:20<00:01, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 96%|█████████▌| 168/175 [00:20<00:00, 9.37it/s] GPU 7: 96%|█████████▌| 168/175 [00:20<00:00, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 91%|█████████ | 159/175 [00:20<00:01, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 91%|█████████▏| 160/175 [00:20<00:01, 7.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 93%|█████████▎| 162/175 [00:20<00:01, 8.47it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 95%|█████████▍| 166/175 [00:20<00:00, 9.32it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 95%|█████████▍| 166/175 [00:20<00:01, 7.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 94%|█████████▍| 165/175 [00:20<00:01, 8.87it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 97%|█████████▋| 169/175 [00:20<00:00, 9.39it/s] GPU 7: 97%|█████████▋| 169/175 [00:20<00:00, 9.31it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 91%|█████████▏| 160/175 [00:20<00:01, 8.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 92%|█████████▏| 161/175 [00:20<00:01, 8.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 95%|█████████▌| 167/175 [00:20<00:00, 9.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 93%|█████████▎| 163/175 [00:20<00:01, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 95%|█████████▌| 167/175 [00:20<00:00, 8.27it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 95%|█████████▍| 166/175 [00:20<00:00, 9.04it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 97%|█████████▋| 170/175 [00:20<00:00, 9.35it/s] GPU 6: 97%|█████████▋| 170/175 [00:20<00:00, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 93%|█████████▎| 162/175 [00:20<00:01, 8.62it/s] GPU 5: 92%|█████████▏| 161/175 [00:20<00:01, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 96%|█████████▌| 168/175 [00:20<00:00, 9.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 94%|█████████▎| 164/175 [00:20<00:01, 8.79it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 96%|█████████▌| 168/175 [00:20<00:00, 8.55it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 95%|█████████▌| 167/175 [00:20<00:00, 8.36it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 7: 98%|█████████▊| 171/175 [00:20<00:00, 9.40it/s] GPU 6: 98%|█████████▊| 171/175 [00:20<00:00, 9.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 93%|█████████▎| 163/175 [00:20<00:01, 8.83it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 93%|█████████▎| 162/175 [00:20<00:01, 9.04it/s] GPU 1: 97%|█████████▋| 169/175 [00:20<00:00, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 94%|█████████▍| 165/175 [00:20<00:01, 8.91it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 97%|█████████▋| 169/175 [00:20<00:00, 8.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 98%|█████████▊| 172/175 [00:20<00:00, 9.43it/s] GPU 7: 98%|█████████▊| 172/175 [00:20<00:00, 9.40it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 94%|█████████▎| 164/175 [00:20<00:01, 8.91it/s] GPU 1: 97%|█████████▋| 170/175 [00:20<00:00, 9.39it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 96%|█████████▌| 168/175 [00:20<00:00, 7.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 93%|█████████▎| 163/175 [00:20<00:01, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 95%|█████████▍| 166/175 [00:20<00:01, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 97%|█████████▋| 170/175 [00:20<00:00, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 99%|█████████▉| 173/175 [00:20<00:00, 9.44it/s] GPU 7: 99%|█████████▉| 173/175 [00:20<00:00, 9.41it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 98%|█████████▊| 171/175 [00:20<00:00, 9.40it/s] GPU 4: 97%|█████████▋| 169/175 [00:20<00:00, 8.35it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 94%|█████████▍| 165/175 [00:20<00:01, 8.62it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 95%|█████████▌| 167/175 [00:20<00:00, 8.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 98%|█████████▊| 171/175 [00:20<00:00, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 94%|█████████▎| 164/175 [00:20<00:01, 8.25it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 99%|█████████▉| 174/175 [00:20<00:00, 9.47it/s] GPU 7: 99%|█████████▉| 174/175 [00:20<00:00, 9.44it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 98%|█████████▊| 172/175 [00:20<00:00, 9.40it/s] GPU 4: 97%|█████████▋| 170/175 [00:20<00:00, 8.65it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 95%|█████████▍| 166/175 [00:20<00:01, 8.81it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 96%|█████████▌| 168/175 [00:20<00:00, 8.94it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 98%|█████████▊| 172/175 [00:20<00:00, 9.13it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 94%|█████████▍| 165/175 [00:20<00:01, 7.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 6: 100%|██████████| 175/175 [00:20<00:00, 9.48it/s] GPU 6: 100%|██████████| 175/175 [00:20<00:00, 8.36it/s]
GPU 7: 100%|██████████| 175/175 [00:20<00:00, 9.47it/s] GPU 7: 100%|██████████| 175/175 [00:20<00:00, 8.36it/s]
GPU 1: 99%|█████████▉| 173/175 [00:21<00:00, 9.42it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 95%|█████████▌| 167/175 [00:20<00:00, 8.96it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 97%|█████████▋| 169/175 [00:20<00:00, 8.90it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 98%|█████████▊| 171/175 [00:20<00:00, 8.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 99%|█████████▉| 173/175 [00:20<00:00, 9.16it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 95%|█████████▍| 166/175 [00:21<00:01, 8.08it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 99%|█████████▉| 174/175 [00:21<00:00, 9.24it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 96%|█████████▌| 168/175 [00:21<00:00, 8.78it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 97%|█████████▋| 170/175 [00:21<00:00, 8.95it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 99%|█████████▉| 174/175 [00:21<00:00, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 98%|█████████▊| 172/175 [00:21<00:00, 7.76it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 95%|█████████▌| 167/175 [00:21<00:00, 8.34it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 1: 100%|██████████| 175/175 [00:21<00:00, 9.17it/s] GPU 1: 100%|██████████| 175/175 [00:21<00:00, 8.23it/s]
GPU 0: 98%|█████████▊| 171/175 [00:21<00:00, 9.03it/s] GPU 2: 97%|█████████▋| 169/175 [00:21<00:00, 8.85it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 3: 100%|██████████| 175/175 [00:21<00:00, 9.22it/s] GPU 3: 100%|██████████| 175/175 [00:21<00:00, 8.26it/s]
GPU 4: 99%|█████████▉| 173/175 [00:21<00:00, 8.20it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 96%|█████████▌| 168/175 [00:21<00:00, 8.57it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 98%|█████████▊| 172/175 [00:21<00:00, 9.10it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 97%|█████████▋| 170/175 [00:21<00:00, 8.93it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 99%|█████████▉| 174/175 [00:21<00:00, 8.50it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 97%|█████████▋| 169/175 [00:21<00:00, 8.75it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 99%|█████████▉| 173/175 [00:21<00:00, 9.14it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 98%|█████████▊| 171/175 [00:21<00:00, 8.99it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 4: 100%|██████████| 175/175 [00:21<00:00, 8.78it/s] GPU 4: 100%|██████████| 175/175 [00:21<00:00, 8.16it/s]
GPU 5: 97%|█████████▋| 170/175 [00:21<00:00, 8.88it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 99%|█████████▉| 174/175 [00:21<00:00, 9.18it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 98%|█████████▊| 172/175 [00:21<00:00, 9.00it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 98%|█████████▊| 171/175 [00:21<00:00, 8.97it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 0: 100%|██████████| 175/175 [00:21<00:00, 8.40it/s] GPU 0: 100%|██████████| 175/175 [00:21<00:00, 8.09it/s]
GPU 2: 99%|█████████▉| 173/175 [00:21<00:00, 8.22it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 98%|█████████▊| 172/175 [00:21<00:00, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 99%|█████████▉| 173/175 [00:21<00:00, 9.05it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 99%|█████████▉| 174/175 [00:21<00:00, 7.71it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 5: 99%|█████████▉| 174/175 [00:21<00:00, 9.07it/s]Setting `pad_token_id` to `eos_token_id`:2 for open-end generation.
GPU 2: 100%|██████████| 175/175 [00:21<00:00, 8.06it/s] GPU 2: 100%|██████████| 175/175 [00:21<00:00, 7.99it/s]
GPU 5: 100%|██████████| 175/175 [00:22<00:00, 9.09it/s] GPU 5: 100%|██████████| 175/175 [00:22<00:00, 7.95it/s]
Global Confusion Matrix:
Labels: [-1, 0, 1, 2, 3, 4, 5]
[[186 1 1 0 9 0 3]
[ 0 163 35 0 2 0 0]
[ 1 0 188 2 0 9 0]
[ 0 9 3 149 39 0 0]
[ 3 0 39 44 101 7 6]
[ 0 0 0 0 20 156 24]
[ 2 0 6 0 2 5 183]]
Global Metrics (Weighted Average):
Accuracy: 0.8043
Precision: 0.8112
Recall: 0.8043
F1-score: 0.8033
Global Metrics (Macro Average):
Precision: 0.7098
Recall: 0.7038
F1-score: 0.7029
Metrics Summary:
----------------------------------------
Metric Value
----------------------------------------
Accuracy 0.8043
Precision_Weighted 0.8112
Recall_Weighted 0.8043
F1_Weighted 0.8033
Precision_Macro 0.7098
Recall_Macro 0.7038
F1_Macro 0.7029
----------------------------------------
Transposed Metrics (for easy copy):
Accuracy,Precision_Weighted,Recall_Weighted,F1_Weighted,Precision_Macro,Recall_Macro,F1_Macro
0.8043,0.8112,0.8043,0.8033,0.7098,0.7038,0.7029