File size: 7,917 Bytes
c32ee7d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
dataset: climate_fever
templates:
  38632cd9-7c4c-4e1d-85b3-20e7a78d4580: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: 38632cd9-7c4c-4e1d-85b3-20e7a78d4580
    jinja: 'Here''s a statement and accompanying evidence. Does the evidence {{"supports"}},
      {{"refutes"}}, or provide {{"not enough info"}} on climate change?


      Statement: {{claim}}


      Evidence: {{evidences[0]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[0]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: first_evidence_and_claim_itemization
    reference: First evidence and claim with simple itemization
  3970f474-a9e3-4264-aefa-dd4cfadd279c: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information ||| Disputed
    id: 3970f474-a9e3-4264-aefa-dd4cfadd279c
    jinja: 'Here''s a claim and accompanying evidence statements . Do the statements
      {{"support"}}, {{"refute"}},  {{"dispute"}} or provide {{"not enough info"}}
      on climate change?


      Claim: {{claim}}


      Statements:

      - {{ evidences | map(attribute="evidence") | map("trim", "\".")  | join(".\n-
      ") }}.

      |||

      {{ answer_choices[claim_label] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: claim_and_all_supporting_evidences
    reference: A claim and all supproting evidences provided with the associated claim
      label
  5d5062c1-d28f-4b1c-a7da-9b53796ed39f: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: 5d5062c1-d28f-4b1c-a7da-9b53796ed39f
    jinja: 'Here''s a statement and accompanying evidence. Does the evidence {{"supports"}},
      {{"refutes"}}, or provide {{"not enough info"}} on climate change?


      Statement: {{claim}}


      Evidence: {{evidences[4]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[4]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: fifth_evidence_and_claim_itemization
    reference: Fifth evidence and claim with simple itemization
  82c484bd-2ed7-4ee0-aaee-2b31ac68e751: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: 82c484bd-2ed7-4ee0-aaee-2b31ac68e751
    jinja: 'Considering the following claim:

      {{claim}}.

      Does the following statement {{"supports"}}, {{"refutes"}}, or provide {{"not
      enough info"}} on climate change?

      {{evidences[4]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[4]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: fifth_evidence_claim_pair
    reference: Relation between the claim and fifth evidence pair.
  9ba074a2-fbcf-4f69-bf03-bd16dbdec9cd: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: 9ba074a2-fbcf-4f69-bf03-bd16dbdec9cd
    jinja: 'Here''s a statement and accompanying evidence. Does the evidence {{"supports"}},
      {{"refutes"}}, or provide {{"not enough info"}} on climate change?


      Statement: {{claim}}


      Evidence: {{evidences[3]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[3]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: fourth_evidence_and_claim_itemization
    reference: Fourth evidence and claim with simple itemization
  9f68b883-d6a3-4e95-af2a-b7755bc46ba9: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: 9f68b883-d6a3-4e95-af2a-b7755bc46ba9
    jinja: 'Here''s a statement and accompanying evidence. Does the evidence {{"supports"}},
      {{"refutes"}}, or provide {{"not enough info"}} on climate change?


      Statement: {{claim}}


      Evidence: {{evidences[2]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[2]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: third_evidence_and_claim_itemization
    reference: Third evidence and claim with simple itemization
  cb78a363-fd32-4dbd-976f-b56de644ba90: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: cb78a363-fd32-4dbd-976f-b56de644ba90
    jinja: 'Considering the following claim:

      {{claim}}.

      Does the following statement {{"supports"}}, {{"refutes"}}, or provide {{"not
      enough info"}} on climate change?

      {{evidences[1]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[1]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: second_evidence_claim_pair
    reference: Relation between the claim and second evidence pair.
  cca7b6f5-29e3-45a4-bc8b-889f5ab2fc13: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: cca7b6f5-29e3-45a4-bc8b-889f5ab2fc13
    jinja: 'Considering the following claim:

      {{claim}}.

      Does the following statement {{"supports"}}, {{"refutes"}}, or provide {{"not
      enough info"}} on climate change?

      {{evidences[0]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[0]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: first_evidence_claim_pair
    reference: Relation between the claim and first evidence pair.
  dc3e0a0b-4f4d-4a76-9e7b-eafce4967e98: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: dc3e0a0b-4f4d-4a76-9e7b-eafce4967e98
    jinja: 'Considering the following claim:

      {{claim}}.

      Does the following statement {{"supports"}}, {{"refutes"}}, or provide {{"not
      enough info"}} on climate change?

      {{evidences[3]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[3]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: fourth_evidence_claim_pair
    reference: Relation between the claim and fourth evidence pair.
  e3e01825-e256-4098-b7bb-aa07c399e8f6: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: e3e01825-e256-4098-b7bb-aa07c399e8f6
    jinja: 'Here''s a statement and accompanying evidence. Does the evidence {{"supports"}},
      {{"refutes"}}, or provide {{"not enough info"}} on climate change?


      Statement: {{claim}}


      Evidence: {{evidences[1]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[1]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: second_evidence_and_claim_itemization
    reference: Second evidence and claim with simple itemization
  ff9c9c11-92f1-4cb2-a73c-d786d58b00e1: !Template
    answer_choices: Supports ||| Refutes ||| Not enough information
    id: ff9c9c11-92f1-4cb2-a73c-d786d58b00e1
    jinja: 'Considering the following claim:

      {{claim}}.

      Does the following statement {{"supports"}}, {{"refutes"}}, or provide {{"not
      enough info"}} on climate change?

      {{evidences[2]["evidence"].strip(".").strip(''"'')}}.

      |||

      {{ answer_choices[evidences[2]["evidence_label"]] }}'
    metadata: !TemplateMetadata
      choices_in_prompt: null
      metrics: []
      original_task: null
    name: third_evidence_claim_pair
    reference: Relation between the claim and third evidence pair.