rossieRuby commited on
Commit
1fb57b5
·
verified ·
1 Parent(s): 04cc356

Upload fine-tuned LegalBERT retriever

Browse files
Files changed (4) hide show
  1. README.md +336 -285
  2. model.safetensors +1 -1
  3. special_tokens_map.json +35 -5
  4. tokenizer_config.json +7 -0
README.md CHANGED
@@ -6,266 +6,348 @@ tags:
6
  - generated_from_trainer
7
  - dataset_size:999
8
  - loss:CosineSimilarityLoss
9
- base_model: nlpaueb/legal-bert-base-uncased
10
  widget:
11
- - source_sentence: What is a bail application?
12
  sentences:
13
- - 'Duration of Panchayats, etc
14
-
15
- (1) Every Panchayat, unless sooner dissolved under any law for the time being
16
- in force, shall continue for five years from the date appointed for its first
17
- meeting and no longer
18
-
19
- (2) No amendment of any law for the time being in force shall have the effect
20
- of causing dissolution of a Panchayat at any level, which is functioning immediately
21
- before such amendment, till the expiration of its duration specified in clause
22
- ( 1 )
23
-
24
- (3) An election to constitute a Panchayat shall be completed
25
-
26
- (a) before the expiry of its duration specified in clause ( 1 );
27
-
28
- (b) before the expiration of a period of six months from the date of its dissolution:
29
- Provided that where the remainder of the period for which the dissolved Panchayat
30
- would have continued is less than six months, it shall not be necessary to hold
31
- any election under this clause for constituting the Panchayat
32
-
33
- (4) A Panchayat constituted upon the dissolution of a Panchayat before the expiration
34
- of its duration shall continue only for the remainder of the period for which
35
- the dissolved Panchayat would have continued under clause ( 1 ) had it not been
36
- so dissolved"
37
-
38
- Article 243F of Indian Constitution,"Disqualifications for membership
39
-
40
- (1) A person shall be disqualified for being chosen as, and for being, a member
41
- of a Panchayat
42
-
43
- (a) if he is so disqualified by or under any law for the time being in force for
44
- the purposes of elections to the Legislature of the State concerned: Provided
45
- that no person shall be disqualified on the ground that be is less than twenty
46
- five years of age, if he has attained the age of twenty one years;
47
-
48
- (b) if he is so disqualified by or under any law made by the Legislature of the
49
- State
50
-
51
- (2) If any question arises as to whether a member of a Panchayat has become subject
52
- to any of the disqualifications mentioned in clause ( 1 ), the question shall
53
- be referred for the decision of such authority and in such manner as the Legislature
54
- of a State may, by law, provide","Below is an instruction that describes a task
55
- or a question. Write a response that appropriately completes the request.'
56
- - A bail application is a petition filed by an accused person requesting release
57
- from custody during the pendency of legal proceedings. It is filed in the court
58
- where the case is pending trial or appeal. The court has discretion to grant or
59
- deny bail based on criteria like flight risktampering with evidenceprevious criminal
60
- record etc.
61
- - 'Language to be used in Parliament
62
-
63
- (1) Notwithstanding anything in Part XVII, but subject to the Article 348, business
64
- in Parliament shall be transacted in Hindi or in English: Provided that the Chairman
65
- of the Council of States or Speaker of the House of the People, or Person acting
66
- as such, as the Case may be, may permit any member who cannot adequately express
67
- himself in Hindi or in English to address the House in his mother tongue
68
-
69
- (2) Unless Parliament by Law otherwise provides, this article shall, after the
70
- expiration of a period of fifteen years from the commencement of this Constitution,
71
- have effect as if the words or in English were omitted therefrom"
72
-
73
- Article 121 of Indian Constitution,Restriction on discussion in Parliament No
74
- discussions shall take place in Parliament with respect to the conduct of any
75
- Judge of the Supreme Court or of a High Court in the discharge of his duties expect
76
- upon a motion for presenting an address to the President praying for the removal
77
- of the Judge as hereinafter provided,"Below is an instruction that describes a
78
- task or a question. Write a response that appropriately completes the request.'
79
- - source_sentence: What is the meaning of the Benami transaction?
80
- sentences:
81
- - '​​​A Benami transaction means the following transactions or arrangements:
82
-
83
-
84
- (a) A transaction or an arrangement:
85
-
86
-
87
- (A) Where a property is transferred to or is held by a person, and the consideration
88
- for such property has been provided, or paid by, another person; and
89
-
90
-
91
- (B) The property is held for the immediate or future benefit, direct or indirect,
92
- of the person who has provided the consideration.
93
 
 
 
94
 
95
- However, a transaction or an arrangement which satisfies conditions (A) and (B)
96
- above is not treated as benami when the property is held by:
 
 
 
97
 
 
 
 
98
 
99
- ​A Karta, or a member of a HUF, as the case may be, and the property is held for
100
- his benefit or the benefit of other members in the family, and the consideration
101
- for such property has been provided or paid out of the known sources of the HUF;
102
 
103
- A person standing in a fiduciary capacity for the benefit of another person towards
104
- whom he stands in such capacity and includes a trustee, executor, partner, director
105
- of a company, a depository, or a participant as an agent of a depository under
106
- the Depositories Act, 1996 and any other person as may be notified by the Central
107
- Government for this purpose;
108
 
109
- Any person being an individual in the name of his spouse or in the name of any
110
- child of such individual, and the consideration for such property has been provided
111
- or paid out of the known sources of the individual;
112
 
113
- Any person in the name of his brother or sister or lineal ascendant or descendant,
114
- where the names of brother or sister or lineal ascendant or descendent and the
115
- individual appear as joint-owners in any document, and the consideration for such
116
- property has been provided or paid out of the known sources of the individual.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
117
 
118
- Examples
119
 
 
 
120
 
121
- Mr. A buys a house in the name of his sister-in-law Mrs. B. Payment has been made
122
- by A. He and his family live in that house. Even if B is a rich lady, the transaction
123
- is benami. B is the Benamidar, and A is the beneficial owner. [Illustration from
124
- “Keep away from Benami Transaction" leaflet issued by the Income Tax Department].
125
 
126
- It would, however, not be a benami transaction if it can be proved that consider­ation
127
- was paid out of HUF funds and the property was purchased for the benefit of the
128
- HUF family [Exception (i) to Section 2(9)(A)]. It would also not be a benami transaction
129
- if it can be proved that the sister-in-law B was in a fiduciary relationship vis-a-vis
130
- Mr. A [Excep­tion (ii) to Section 2(9)(A)]
131
 
 
132
 
133
- Mr. P wants to take a liquor license from the government. He pays the money in
134
- the name of employee Mr. K, and the contract is awarded to Mr.K, but Mr. P is
135
- deriving benefit from the liquor license. The transaction is a benami transaction.
136
- Mr. K is the benamidar. Mr. P is the beneficial owner and profits from such liquor
137
- business shall be the benami property. [Illustration from “Keep away from Benami
138
- Transaction" leaflet issued by the Income Tax Department].
139
 
140
- (b) A transaction or an arrangement in respect of a property carried out or
141
- made in a fictitious name;
 
142
 
 
 
143
 
144
- Example: Fixed deposits kept in the name of fictitious persons is a benami transaction/benami
145
- property[Illustration from “Keep away from Benami Transaction" leaflet issued
146
- by the Income Tax Department].
147
 
 
148
 
149
- (c) A transaction or an arrangement in respect of a property where the owner
150
- of the property is not aware of, or denies knowledge of, such ownership;
 
151
 
 
152
 
153
- Example: Cash kept in a bank locker in the name of his employee/relative who denies
154
- knowledge is a benami property [Illustration from the leaflet “Keep away from
155
- Benami Transaction" issued by the Income-Tax Department].
156
 
 
157
 
158
- (d) A transaction or an arrangement in respect of a property where the person
159
- providing the consideration is not traceable or is fictitious.​'
160
- - ​​If an informant furnishes false information, such an act is considered as an
161
- offence, and the person giving false information/evidence/ statement will be liable
162
- to be prosecuted for such offence.​​
163
- - 'Recommendations of the Finance Commission The President shall cause every recommendation
164
- made by the Finance Commission under the provisions of this Constitution together
165
- with an explanatory memorandum as to the action taken thereon to be laid before
166
- each House of Parliament Miscellaneous Financial Provisions"
167
 
168
- Article 282 of Indian Constitution,"Expenditure defrayable by the Union or a State
169
- out of its revenues The Union or a State may make any grants for any public purpose,
170
- notwithstanding that the purpose is not one with respect to which Parliament or
171
- the Legislature of the State, as the case may be, may make laws","Below is an
172
- instruction that describes a task or a question. Write a response that appropriately
173
  completes the request.'
174
- - source_sentence: Whether the show-cause notice has to be served to the beneficial
175
- owner also?
176
  sentences:
177
- - '​​Even if a charitable institution cannot utilise 85% of its income for charitable
178
- or religious purposes in India, it shall be deemed to be applied for such purposes
179
- in the situations described below.
180
-
181
-
182
- ​Where income has not been received in the previous year;
183
-
184
- Where income could not be applied due to other reasons.
185
-
186
- Such deemed application of income shall be considered when the institution furnishes
187
- the details electronically in Form 9A at least two months prior to the due date
188
- specified under Section 139(1) for furnishing the return of income for the previous
189
- year.​'
190
- - ​The copy of the show-cause notice has to be sent to the beneficial owner, if
191
- known.​
192
- - 'Oath or affirmation by Judges of High Courts Every person appointed to be a Judge
193
- of a High Court shall, before he enters upon his office, make and subscribe before
194
- the Governor of the State, or some person appointed in that behalf by him, an
195
- oath or affirmation according to the form set out for the purpose in the Third
196
- Schedule"
197
-
198
- Article 220 of Indian Constitution,"Restriction on practice after being a permanent
199
- Judge No person who, after the commencement of this Constitution, has held office
200
- as a permanent Judge of a High Court shall plead or act in any court or before
201
- any authority in India except the Supreme Court and the other High Courts Explanation
202
- In this article, the expression High Court does not include a High Court for a
203
- State specified in Part B of the First Schedule as it existed before the commencement
204
- of the Constitution (seventh Amendment) Act, 1956","Below is an instruction that
205
- describes a task or a question. Write a response that appropriately completes
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
206
  the request.'
207
- - source_sentence: Article 23 of Indian Constitution
208
- sentences:
209
- - 'Prohibition of traffic in human beings and forced labour
210
-
211
- (1) Traffic in human beings and begar and other similar forms of forced labour
212
- are prohibited and any contravention of this provision shall be an offence punishable
213
- in accordance with law
214
-
215
- (2) Nothing in this article shall prevent the State from imposing compulsory service
216
- for public purpose, and in imposing such service the State shall not make any
217
- discrimination on grounds only of religion, race, caste or class or any of them"
218
-
219
- Article 24 of Indian Constitution,"Prohibition of employment of children in factories,
220
- etc No child below the age of fourteen years shall be employed to work in any
221
- factory or mine or engaged in any other hazardous employment Provided that nothing
222
- in this sub clause shall authorise the detention of any person beyond the maximum
223
- period prescribed by any law made by Parliament under sub clause (b) of clause
224
- ( 7 ); or such person is detained in accordance with the provisions of any law
225
- made by Parliament under sub clauses (a) and (b) of clause ( 7 )","Below is an
226
- instruction that describes a task or a question. Write a response that appropriately
227
- completes the request.'
228
- - 'Regulation by law of procedure in the Legislature of the State in relation to
229
- financial business The Legislature of a State may, for the purpose of the timely
230
- completion of financial business, regulate by law the procedure of, and the conduct
231
- of business in, the House or Houses of the Legislature of the State in relation
232
- to any financial matter or to any Bill for the appropriation of moneys out of
233
- the Consolidated Fund of the State, and, if and so far as any provision of any
234
- law so made is inconsistent with any rule made by the House or either House of
235
- the Legislature of the State under clause ( 1 ) of article 208 or with any rule
236
- or standing order having effect in relation to the Legislature of the State under
237
- clause ( 2 ) of that article, such provision shall prevail"
238
-
239
- Article 210 of Indian Constitution,"Language to be used in the Legislature
240
-
241
- (1) Notwithstanding anything in Part XVII, but subject to the provisions of article
242
- 348, business in the Legislature of a State shall be transacted in the official
243
- language or languages of the State or in Hindi or in English: Provided that the
244
- Speaker of the Legislative Assembly or Chairman of the Legislative Council, or
245
- person acting as such, as the case may be, may permit any member who cannot adequately
246
- express himself in any of the languages aforesaid to address the House in his
247
- mother tongue
248
-
249
- (2) Unless the Legislature of the State by law otherwise provides, this article
250
- shall, after the expiration of a period of fifteen years from the commencement
251
- of this Constitution, have effect as if the words or in English were omitted here
252
- from: Provided that in relation to the Legislatures of the States of Himachal
253
- Pradesh, Manipur, Meghalaya and Tripura this clause shall have effect as if for
254
- the words fifteen years occurring therein, the words twenty five years were substituted:
255
- Provided further that in relation to the Legislature of the States of Arunachal
256
- Pradesh, Goa and Mizoram, this clause shall have effect as if for the words fifteen
257
- years occurring therein, the words forty years were substituted","Below is an
258
- instruction that describes a task or a question. Write a response that appropriately
259
- completes the request.'
260
- - 'Admission or establishment of new States: Parliament may by law admit into the
261
- Union, or establish, new States on such terms and conditions, as it thinks fit"
262
-
263
- Article 2A of Indian Constitution,"Sikkim to be associated with the Union Rep
264
- by the Constitution Thirty six Amendment Act, 1975 , Section 5 (w e f 26 04 1975
265
- )","Below is an instruction that describes a task or a question. Write a response
266
- that appropriately completes the request.'
267
- - source_sentence: What is the meaning of borrowing cost?
268
  sentences:
 
 
 
 
 
 
 
 
 
269
  - 'Extent of executive power of State Subject to the provisions of this Constitution,
270
  the executive power of a State shall extend to the matters with respect to which
271
  the Legislature of the State has power to make laws Provided that in any matter
@@ -291,62 +373,31 @@ widget:
291
  to the Governor shall not be inquired into in any court","Below is an instruction
292
  that describes a task or a question. Write a response that appropriately completes
293
  the request.'
294
- - 'Qualifications for election as President
295
-
296
- (1) No person shall be eligible for election as President unless he
297
-
298
- (a) is a citizen of India,
299
-
300
- (b) has completed the age of thirty five years, and
301
-
302
- (c) is qualified for election as a member of the House of the People
303
-
304
- (2) A person shall not be eligible for election as President if he holds any office
305
- of profit under the or the Government of any State or under any local or other
306
- authority subject to the control of any of the said Governments Explanation For
307
- the purposes of this article, a person shall not be deemed to hold any office
308
- of profit by reason only that he is the President or Vice President of the Union
309
- or the Governor of any State or is a Minister either for the Union or for any
310
- State"
311
-
312
- Article 59 of Indian Constitution,"Conditions of Presidents office
313
-
314
- (1) The President shall not be a member of either House of Parliament or of a
315
- House of the Legislature of any State, and if a member of either House of Parliament
316
- or of a House of the Legislature of any State be elected President, he shall be
317
- deemed to have vacated his seat in that House on the date on which he enters upon
318
- his office as President
319
-
320
- (2) The President shall not hold any other office of profit
321
-
322
- (3) The President shall be entitled without payment of rent to the use of his
323
- official residences and shall be also entitled to such emoluments, allowances
324
- and privileges as may be determined by Parliament by law and, until provision
325
- in that behalf is so made, such emoluments, allowances and privileges as are specified
326
- in the Second Schedule
327
-
328
- (4) The emoluments and allowances of the President shall ot be diminished during
329
- his term of office","Below is an instruction that describes a task or a question.
330
- Write a response that appropriately completes the request.'
331
- - ​Borrowing cost means interest and other cost incurred by a person in connection
332
- with the borrowing of funds. It includes commitment charges, amortised amount
333
- of discounts or premiums relating to borrowings, processing charges, charges incurred
334
- under the finance lease or any other similar arrangements. The CBDT, vide Circular
335
- No. 10/2017, dated 23-3-2017, has clarified that bill discounting charges and
336
- other similar charges are also treated as borrowing costs.​
337
  pipeline_tag: sentence-similarity
338
  library_name: sentence-transformers
339
  ---
340
 
341
- # SentenceTransformer based on nlpaueb/legal-bert-base-uncased
342
 
343
- This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nlpaueb/legal-bert-base-uncased](https://huggingface.co/nlpaueb/legal-bert-base-uncased). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
344
 
345
  ## Model Details
346
 
347
  ### Model Description
348
  - **Model Type:** Sentence Transformer
349
- - **Base model:** [nlpaueb/legal-bert-base-uncased](https://huggingface.co/nlpaueb/legal-bert-base-uncased) <!-- at revision 15b570cbf88259610b082a167dacc190124f60f6 -->
350
  - **Maximum Sequence Length:** 512 tokens
351
  - **Output Dimensionality:** 768 dimensions
352
  - **Similarity Function:** Cosine Similarity
@@ -387,9 +438,9 @@ from sentence_transformers import SentenceTransformer
387
  model = SentenceTransformer("sentence_transformers_model_id")
388
  # Run inference
389
  sentences = [
390
- 'What is the meaning of borrowing cost?',
391
- '\u200bBorrowing cost means interest and other cost incurred by a person in connection with the borrowing of funds. It includes commitment charges, amortised amount of discounts or premiums relating to borrowings, processing charges, charges incurred under the finance lease or any other similar arrangements. The CBDT, vide Circular No. 10/2017, dated 23-3-2017, has clarified that bill discounting charges and other similar charges are also treated as borrowing costs.\u200b',
392
- 'Qualifications for election as President\n(1) No person shall be eligible for election as President unless he\n(a) is a citizen of India,\n(b) has completed the age of thirty five years, and\n(c) is qualified for election as a member of the House of the People\n(2) A person shall not be eligible for election as President if he holds any office of profit under the or the Government of any State or under any local or other authority subject to the control of any of the said Governments Explanation For the purposes of this article, a person shall not be deemed to hold any office of profit by reason only that he is the President or Vice President of the Union or the Governor of any State or is a Minister either for the Union or for any State"\nArticle 59 of Indian Constitution,"Conditions of Presidents office\n(1) The President shall not be a member of either House of Parliament or of a House of the Legislature of any State, and if a member of either House of Parliament or of a House of the Legislature of any State be elected President, he shall be deemed to have vacated his seat in that House on the date on which he enters upon his office as President\n(2) The President shall not hold any other office of profit\n(3) The President shall be entitled without payment of rent to the use of his official residences and shall be also entitled to such emoluments, allowances and privileges as may be determined by Parliament by law and, until provision in that behalf is so made, such emoluments, allowances and privileges as are specified in the Second Schedule\n(4) The emoluments and allowances of the President shall ot be diminished during his term of office","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.',
393
  ]
394
  embeddings = model.encode(sentences)
395
  print(embeddings.shape)
@@ -451,11 +502,11 @@ You can finetune this model on your own dataset.
451
  | type | string | string | float |
452
  | details | <ul><li>min: 7 tokens</li><li>mean: 13.33 tokens</li><li>max: 100 tokens</li></ul> | <ul><li>min: 3 tokens</li><li>mean: 210.82 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 1.0</li><li>mean: 1.0</li><li>max: 1.0</li></ul> |
453
  * Samples:
454
- | sentence_0 | sentence_1 | label |
455
- |:--------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
456
- | <code>Article 239A of Indian Constitution</code> | <code>Creation of local Legislatures or Council of Ministers or both for certain Union territories<br>(1) Parliament may by law create for the Union territory of Pondicherry<br>(a) a body, whether elected or partly nominated and partly elected, to function as a Legislature for the Union territory, or<br>(b) a Council of Ministers, or both with such constitution, powers and functions, in each case, as may be specified in the law<br>(2) Any such law as is referred to in clause ( 1 ) shall not be deemed to be an amendment of this Constitution for the purposes of Article 368 notwithstanding that it contains any provision which amends or has the effect of amending this Constitution"<br>Article 239B of Indian Constitution,"Power of administrator to promulgate Ordinances during recess of Legislature<br>(1) If at any time, except when the Legislature of the Union territory of Pondicherry is in session, the administrator thereof is satisfied that circumstances exist which render it necessary for him to take immediate ...</code> | <code>1.0</code> |
457
- | <code>Article 378 of Indian Constitution</code> | <code>Provisions as to Public Service Commissions<br>(1) The members of the Public Service Commission for the Dominion of India holding office immediately before the commencement of this Constitution shall, unless they have elected otherwise, become on such commencement the members of the Public Service Commission for the Union and shall, notwithstanding anything in clauses ( 1 ) and ( 2 ) of Article 316 but subject to the proviso to clause ( 2 ) of that article, continue to hold office until the expiration of their term of office as determined under the rules which were applicable immediately before such commencement to such members<br>(2) The members of a Public Service Commission of a Province or of a Public Service Commission serving the needs of a group of Provinces holding office immediately before the commencement of this Constitution shall, unless they have elected otherwise, become on such commencement the members of the Public Service Commission for the corresponding State or the members...</code> | <code>1.0</code> |
458
- | <code>When prosecution under Section 275B shall be launched?</code> | <code>Prosecution under Section 275B shall be launched if a person fails to provide the facility to the authorised officer to inspect any books of accounts or other documents during the search and seizure.​</code> | <code>1.0</code> |
459
  * Loss: [<code>CosineSimilarityLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosinesimilarityloss) with these parameters:
460
  ```json
461
  {
 
6
  - generated_from_trainer
7
  - dataset_size:999
8
  - loss:CosineSimilarityLoss
9
+ base_model: rossieRuby/nyayadrishti-bert
10
  widget:
11
+ - source_sentence: Article 77 of Indian Constitution
12
  sentences:
13
+ - 'Conditions of Governor office
14
+
15
+ (1) The Governor shall not be a member of either House of Parliament or of a House
16
+ of the Legislature of any State specified in the First Schedule, and if a member
17
+ of either House of Parliament or of a House of the Legislature of any such State
18
+ be appointed Governor, he shall be deemed to have vacated his seat in that House
19
+ on the date on which he enters upon his office as Governor
20
+
21
+ (2) The Governor shall not hold any other office of profit
22
+
23
+ (3) The Governor shall be entitled without payment of rent to the use of his official
24
+ residences and shall be also entitled to such emoluments, allowances and privileges
25
+ as may be determined by Parliament by law and, until provision in that behalf
26
+ is so made, such emoluments, allowances and privileges as are specified in Second
27
+ Schedule
28
+
29
+ (3A) Where the same person is appointed as Governor of two or more States, the
30
+ emoluments and allowances payable to the Governor shall be allocated among the
31
+ States in such proportion as the President may by order determine
32
+
33
+ (4) The emoluments and allowances of the Governor shall not be diminished during
34
+ his term of office"
35
+
36
+ Article 159 of Indian Constitution,"Oath or affirmation by Governor Every Governor
37
+ and every person discharging the functions of the Governor shall, before entering
38
+ upon his office, make and subscribe in the presence of the chief Justice of the
39
+ High Court exercising jurisdiction in relation to the State, or, in his absence,
40
+ the senior most Judge of that court available, an oath or affirmation in the following
41
+ form, that is to say swear in the name of God I, A B, do that I solemnly affirm
42
+ will faithfully execute the office of Governor (or discharge the functions of
43
+ the Governor) of (name of the State) and will to the best of my ability preserve,
44
+ protect and defend the Constitution and the law and that I will devote myself
45
+ to the service and well being of the people of (name of the State)","Below is
46
+ an instruction that describes a task or a question. Write a response that appropriately
47
+ completes the request.'
48
+ - 'Conduct of business of the Government of India
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
 
50
+ (1) All executive action of the Government of India shall be expressed to be taken
51
+ in the name of the President
52
 
53
+ (2) Orders and other instruments made and executed in the name of the President
54
+ shall be authenticated in such manner as may be specified in rules to be made
55
+ by the President, and the validity of an order or instrument which is so authenticated
56
+ shall nor be called in question on the ground that it is not an order or instrument
57
+ made or executed by the President
58
 
59
+ (3) The President shall make rules for the more convenient transaction of the
60
+ business of the Government of India, and for the allocation among Ministers of
61
+ the said business"
62
 
63
+ Article 78 of Indian Constitution,"Duties of Prime Minister as respects the furnishing
64
+ of information to the President, etc It shall be the duty of the Prime Minister
 
65
 
66
+ (a) to communicate to the President all decisions of the council of Ministers
67
+ relating to the administration of the affairs of the union and proposals for legislation;
 
 
 
68
 
69
+ (b) to furnish such information relating to the administration of the affairs
70
+ of the Union and proposals for legislation as the President may call for; and
 
71
 
72
+ (c) if the President so requires, to submit for the consideration of the Council
73
+ of Ministers any matter on which a decision has been taken by a Minister but which
74
+ has not been considered by the Council CHAPTER II PARLIAMENT General","Below is
75
+ an instruction that describes a task or a question. Write a response that appropriately
76
+ completes the request.'
77
+ - If the Informant has claimed the reward for giving information of evasion of tax
78
+ payable under Black Money (Undisclosed Foreign Income and Assets) and Imposition
79
+ of Tax Act, 2015, as well as benami properties based upon substantially the same
80
+ facts and has been found eligible for grant of reward under both the schemes,
81
+ the total amount of reward under both the schemes taken together shall not exceed
82
+ Rs. 5 crores.​​​
83
+ - source_sentence: Article 249 of Indian Constitution
84
+ sentences:
85
+ - 'Power of Parliament to legislate with respect to a matter in the State List in
86
+ the national interest
87
+
88
+ (1) Notwithstanding anything in the foregoing provisions of this Chapter, if the
89
+ Council of States has declared by resolution supported by not less than two thirds
90
+ of the members present and voting that it is necessary or expedient in national
91
+ interest that Parliament should make laws with respect to any matter enumerated
92
+ in the State List specified in the resolution, it shall be lawful for Parliament
93
+ to make laws for the whole or any part of the territory of India with respect
94
+ to that matter while the resolution remains in force
95
+
96
+ (2) A resolution passed under clause ( 1 ) shall remain in force for such period
97
+ not exceeding one year as may be specified therein: Provided that, if and so often
98
+ as a resolution approving the continuance in force of any such resolution is passed
99
+ in the manner provided in clause ( 1 ), such resolution shall continue in force
100
+ for a further period of one year from the date on which under this clause it would
101
+ otherwise have ceased to be in force
102
+
103
+ (3) A law made by Parliament which Parliament would not but for the passing of
104
+ a resolution under clause ( 1 ) have been competent to make shall, to the extent
105
+ of the incompetency, cease to have effect on the expiration of a period of six
106
+ months after the resolution has ceased to be in force, except as respects things
107
+ done or omitted to be done before the expiration of the said period"
108
+
109
+ Article 250 of Indian Constitution,"Power of Parliament to legislate with respect
110
+ to any matter in the State List if a Proclamation of Emergency is in operation
111
+
112
+ (1) Notwithstanding anything in this Chapter, Parliament shall, while a Proclamation
113
+ of Emergency is in operation, have, power to make laws for the whole or any part
114
+ of the territory of India with respect to any of the matters enumerated in the
115
+ State List
116
+
117
+ (2) A law made by Parliament which Parliament would not but for the issue of a
118
+ Proclamation of Emergency have been competent to make shall, to the extent of
119
+ the incompetency, cease to have effect on the expiration of a period of six months
120
+ after the Proclamation has ceased to operate, except as respects things done or
121
+ omitted to be done before the expiration of the said period","Below is an instruction
122
+ that describes a task or a question. Write a response that appropriately completes
123
+ the request.'
124
+ - 'Penalty for sitting and voting before making oath or affirmation under Article
125
+ 99 or when not qualified or when disqualified If a person sits or votes as a member
126
+ of either House of Parliament before he has complied with the requirements of
127
+ Article 99, or when he knows that he is not qualified or that he is disqualified
128
+ for membership thereof, or that he is prohibited from so doing by the provisions
129
+ of any law made by Parliament, he shall be liable in respect of each day on which
130
+ he so sits or votes to a penalty of five hundred rupees to be recovered as a debt
131
+ due to the Union Powers, Privileges and Immunities of Parliament and its Members"
132
+
133
+ Article 105 of Indian Constitution,"Powers, privileges, etc of the Houses of Parliament
134
+ and of the members and committees thereof
135
+
136
+ (1) Subject to the provisions of this constitution and the rules and standing
137
+ orders regulating the procedure of Parliament, there shall be freedom of speech
138
+ in Parliament
139
+
140
+ (2) No member of Parliament shall be liable to any proceedings in any court in
141
+ respect of anything said or any vote given by him in Parliament or any committee
142
+ thereof, and no person shall be so liable in respect of the publication by or
143
+ under the authority of either House of Parliament of any report, paper, votes
144
+ or proceedings
145
+
146
+ (3) In other respects, the powers, privileges and immunities of each House of
147
+ Parliament, and of the members and the committees of each House, shall be such
148
+ as may from time to time be defined by Parliament by law, and, until so defined
149
+ shall be those of that House and of its members and committees immediately before
150
+ the coming into force of Section 15 of the Constitution (Forty fourth Amendment)
151
+ Act 1978
152
+
153
+ (4) The provisions of clauses ( 1 ), ( 2 ) and ( 3 ) shall apply in relation to
154
+ persons who by virtue of this constitution have the right to speak in, and otherwise
155
+ to take part in the proceedings of, a House of Parliament or any committee thereof
156
+ as they apply in relation to members of Parliament","Below is an instruction that
157
+ describes a task or a question. Write a response that appropriately completes
158
+ the request.'
159
+ - 'Special provision with respect to the State of Mizoram Notwithstanding anything
160
+ in this Constitution,
161
+
162
+ (a) no Act of President in respect of
163
+
164
+ (i) religious or social practices of the Mizos,
165
+
166
+ (ii) Mizo customary law and procedure,
167
+
168
+ (iii) administration of civil and criminal justice involving decisions according
169
+ to Mizo customary law,
170
+
171
+ (iv) ownership and transfer of land, shall apply to the State of Mizoram unless
172
+ the Legislative Assembly of the State of Mizoram by a resolution so decides: Provided
173
+ that nothing in this clause shall apply to any Central Act in force in the union
174
+ territory of Mizoram immediately before the commencement of the Constitution (Fifty
175
+ third Amendment) Act, 1986 ;
176
+
177
+ (b) the Legislative Assembly of the State of Mizoram shall consist of not less
178
+ than forty members"
179
+
180
+ Article 371H of Indian Constitution,"Special provision with respect to the State
181
+ of Arunachal Pradesh Notwithstanding anything in this Constitution,
182
+
183
+ (a) the Governor of Arunachal Pradesh shall have special responsibility with respect
184
+ to law and order in the State of Arunachal Pradesh and in the discharge of his
185
+ functions in relation thereto, the Governor shall, after consulting the Council
186
+ of Ministers, exercise his individual judgment as to the action to be taken: Provided
187
+ that if any question arises whether any matter is or is not a matter as respects
188
+ which the Governor is under this clause required to act in the exercise of his
189
+ individual judgment, the decision of the Governor in his discretion shall be final,
190
+ and the validity of anything done by the Governor shall not be called in question
191
+ on the ground that he ought or ought not to have acted in the exercise of his
192
+ individual judgment: Provided further that if the President on receipt of a report
193
+ from the Governor or otherwise is satisfied that it is no longer necessary for
194
+ the Governor to have special responsibility with respect to law and order in the
195
+ State of Arunachal Pradesh, he may by order direct that the Governor shall cease
196
+ to have such responsibility with effect from such date as may be specified in
197
+ the order;
198
+
199
+ (b) the Legislative Assembly of the State of Arunachal Pradesh shall consist of
200
+ not less than thirty members","Below is an instruction that describes a task or
201
+ a question. Write a response that appropriately completes the request.'
202
+ - source_sentence: What is the provision of Section 2(1A)(b)(ii)?
203
+ sentences:
204
+ - Reward in accordance with this scheme shall be ex-gratia payment granted at the
205
+ absolute discretion of the authority competent to grant reward. The decision of
206
+ the authority shall be final, and it shall not be subject to any litigation, appeal,
207
+ adjudication and arbitration except review as provided in this scheme.​​​
208
+ - '​​Any income derived by performing the marketing process by the cultivator is
209
+ an agricultural income if the following conditions are fulfilled:
210
 
 
211
 
212
+ ​The process to which the agricultural produce is subjected should be ordinarily
213
+ employed by a cultivator or receiver of rent-in-kind.
214
 
215
+ The process should be employed to render the produce fit to be taken to market
216
+ and not for any other purpose.​'
217
+ - 'Promotion of international peace and security The State shall endeavour to
 
218
 
219
+ (a) promote international peace and security;
 
 
 
 
220
 
221
+ (b) maintain just and honourable relations between nations;
222
 
223
+ (c) foster respect for international law and treaty obligations in the dealings
224
+ of organised peoples with one another; and encourage settlement of international
225
+ disputes by arbitration PART IVA FUNDAMENTAL DUTIES"
 
 
 
226
 
227
+ Article 51A of Indian Constitution,"Fundamental duties It shall be the duty of
228
+ every citizen of India (a) to abide by the Constitution and respect its ideals
229
+ and institutions, the national Flag and the National Anthem;
230
 
231
+ (b) to cherish and follow the noble ideals which inspired our national struggle
232
+ for freedom;
233
 
234
+ (c) to uphold and protect the sovereignty, unity and integrity of India;
 
 
235
 
236
+ (d) to defend the country and render national service when called upon to do so;
237
 
238
+ (e) to promote harmony and the spirit of common brotherhood amongst all the people
239
+ of India transcending religious, linguistic and regional or sectional diversities;
240
+ to renounce practices derogatory to the dignity of women;
241
 
242
+ (f) to value and preserve the rich heritage of our composite culture;
243
 
244
+ (g) to protect and improve the natural environment including forests, lakes, rivers
245
+ and wild life, and to have compassion for living creatures;
 
246
 
247
+ (h) to develop the scientific temper, humanism and the spirit of inquiry and reform;
248
 
249
+ (i) to safeguard public property and to abjure violence;
 
 
 
 
 
 
 
 
250
 
251
+ (j) to strive towards excellence in all spheres of individual and collective activity
252
+ so that the nation constantly rises to higher levels of endeavour and achievement
253
+ PART V THE UNION CHAPTER I THE EXECUTIVE The President and Vice President","Below
254
+ is an instruction that describes a task or a question. Write a response that appropriately
 
255
  completes the request.'
256
+ - source_sentence: When prosecution under Section 276A can be launched?
 
257
  sentences:
258
+ - '​​​Prosecution under Section 276A can be launched where any person, appointed
259
+ as liquidator of a company, has committed any of the following defaults:
260
+
261
+
262
+ ​He fails to give notice of his appointment within 30 days to the Assessing Officer
263
+ having jurisdiction over such company;
264
+
265
+ He fails to set aside the amount, notified to him by the Assessing Officer, to
266
+ meet the tax demand;
267
+
268
+ He parts with any of the assets of the company or properties in hand, until the
269
+ amount to be set aside, is notified by the Assessing officer, without the prior
270
+ approval of the prescribed tax authority; or
271
+
272
+ He parts with any of the assets of the company or properties in hand until the
273
+ amount of tax demand notified by the Assessing Officer is set aside.
274
+
275
+ No proceedings shall be initiated under this provision on or after 01-04-2023.​'
276
+ - 'Fundamental duties It shall be the duty of every citizen of India (a) to abide
277
+ by the Constitution and respect its ideals and institutions, the national Flag
278
+ and the National Anthem;
279
+
280
+ (b) to cherish and follow the noble ideals which inspired our national struggle
281
+ for freedom;
282
+
283
+ (c) to uphold and protect the sovereignty, unity and integrity of India;
284
+
285
+ (d) to defend the country and render national service when called upon to do so;
286
+
287
+ (e) to promote harmony and the spirit of common brotherhood amongst all the people
288
+ of India transcending religious, linguistic and regional or sectional diversities;
289
+ to renounce practices derogatory to the dignity of women;
290
+
291
+ (f) to value and preserve the rich heritage of our composite culture;
292
+
293
+ (g) to protect and improve the natural environment including forests, lakes, rivers
294
+ and wild life, and to have compassion for living creatures;
295
+
296
+ (h) to develop the scientific temper, humanism and the spirit of inquiry and reform;
297
+
298
+ (i) to safeguard public property and to abjure violence;
299
+
300
+ (j) to strive towards excellence in all spheres of individual and collective activity
301
+ so that the nation constantly rises to higher levels of endeavour and achievement
302
+ PART V THE UNION CHAPTER I THE EXECUTIVE The President and Vice President"
303
+
304
+ Article 52 of Indian Constitution,The President of India There shall be a President
305
+ of India,"Below is an instruction that describes a task or a question. Write a
306
+ response that appropriately completes the request.'
307
+ - 'Provisions as to Judges of High Courts
308
+
309
+ (1) Notwithstanding anything in this clause ( 2 ) of Article 217, the Judges of
310
+ a High Court in any Province holding office immediately before the commencement
311
+ of this Constitution shall, unless they have elected otherwise, become on such
312
+ commencement the Judges of the High Court in the corresponding State, and shall
313
+ thereupon be entitled to such salaries and allowances and to such rights in respect
314
+ of leave of absence and pension as are provided for under Article 221 in respect
315
+ of the Judges of such High Court Any such Judge shall, notwithstanding that he
316
+ is not a citizen of India, be eligible for appointment as Chief Justice of such
317
+ High Court, or as Chief Justice or other Judge of any other High Court
318
+
319
+ (2) The Judges of a High Court in any Indian State corresponding to any State
320
+ specified in Part B of the First Schedule holding office immediately before the
321
+ commencement of this Constitution shall, unless they have elected otherwise, become
322
+ on such commencement the Judges of the High Court in the State so specified and
323
+ shall, notwithstanding anything in clauses ( 1 ) and ( 2 ) of Article 217 but
324
+ subject to the proviso to clause ( 1 ) of that article, continue to hold office
325
+ until the expiration of such period as the President may by order determine In
326
+ this article, the expression Judge does not include an acting Judge or an additional
327
+ Judge"
328
+
329
+ Article 377 of Indian Constitution,"Provisions as to Comptroller and Auditor General
330
+ of India The Auditor General of India holding office immediately before the commencement
331
+ of this Constitution shall, unless he has elected otherwise, become on such commencement
332
+ the Comptroller and Auditor General of India and shall thereupon be entitled to
333
+ such salaries and to such rights in respect of leave of absence and pension as
334
+ are provided for under clause ( 3 ) of Article 148 in respect of the Comptroller
335
+ and Auditor General of India and be entitled to continue to hold office until
336
+ the expiration of his term of office as determined under the provisions which
337
+ were applicable to him immediately before such commencement","Below is an instruction
338
+ that describes a task or a question. Write a response that appropriately completes
339
  the request.'
340
+ - source_sentence: Article 45 of Indian Constitution
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
341
  sentences:
342
+ - '​​Income derived from land can be termed agricultural income if the following
343
+ conditions are satisfied:
344
+
345
+
346
+ Rent or revenue should be derived from the land;
347
+
348
+ Land should be situated in India; and
349
+
350
+ Land should be used for agricultural purposes.​'
351
  - 'Extent of executive power of State Subject to the provisions of this Constitution,
352
  the executive power of a State shall extend to the matters with respect to which
353
  the Legislature of the State has power to make laws Provided that in any matter
 
373
  to the Governor shall not be inquired into in any court","Below is an instruction
374
  that describes a task or a question. Write a response that appropriately completes
375
  the request.'
376
+ - 'Provision for free and compulsory education for children The State shall endeavour
377
+ to provide, within a period of ten years from the commencement of this Constitution,
378
+ for free and compulsory education for all children until they complete the age
379
+ of fourteen years"
380
+
381
+ Article 46 of Indian Constitution,"Promotion of educational and economic interests
382
+ of Scheduled Castes, Scheduled Tribes and other weaker sections The State shall
383
+ promote with special care the educational and economic interests of the weaker
384
+ sections of the people, and, in particular, of the Scheduled Castes and the Scheduled
385
+ Tribes, and shall protect them from social injustice and all forms of exploitation","Below
386
+ is an instruction that describes a task or a question. Write a response that appropriately
387
+ completes the request.'
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
388
  pipeline_tag: sentence-similarity
389
  library_name: sentence-transformers
390
  ---
391
 
392
+ # SentenceTransformer based on rossieRuby/nyayadrishti-bert
393
 
394
+ This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [rossieRuby/nyayadrishti-bert](https://huggingface.co/rossieRuby/nyayadrishti-bert). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
395
 
396
  ## Model Details
397
 
398
  ### Model Description
399
  - **Model Type:** Sentence Transformer
400
+ - **Base model:** [rossieRuby/nyayadrishti-bert](https://huggingface.co/rossieRuby/nyayadrishti-bert) <!-- at revision 04cc356c2d4494dd15c593a77f26e472a4601028 -->
401
  - **Maximum Sequence Length:** 512 tokens
402
  - **Output Dimensionality:** 768 dimensions
403
  - **Similarity Function:** Cosine Similarity
 
438
  model = SentenceTransformer("sentence_transformers_model_id")
439
  # Run inference
440
  sentences = [
441
+ 'Article 45 of Indian Constitution',
442
+ 'Provision for free and compulsory education for children The State shall endeavour to provide, within a period of ten years from the commencement of this Constitution, for free and compulsory education for all children until they complete the age of fourteen years"\nArticle 46 of Indian Constitution,"Promotion of educational and economic interests of Scheduled Castes, Scheduled Tribes and other weaker sections The State shall promote with special care the educational and economic interests of the weaker sections of the people, and, in particular, of the Scheduled Castes and the Scheduled Tribes, and shall protect them from social injustice and all forms of exploitation","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.',
443
+ 'Extent of executive power of State Subject to the provisions of this Constitution, the executive power of a State shall extend to the matters with respect to which the Legislature of the State has power to make laws Provided that in any matter with respect to which the Legislature of a State and Parliament have power to make laws, the executive power of the State shall be subject to, and limited by, the executive power expressly conferred by the Constitution or by any law made by Parliament upon the Union or authorities thereof Council of Ministers"\nArticle 163 of Indian Constitution,"Council of Ministers to aid and advise Governor\n(1) There shall be a council of Ministers with the chief Minister at the head to aid and advise the Governor in the exercise of his functions, except in so far as he is by or under this constitution required to exercise his functions or any of them in his discretion\n(2) If any question arises whether any matter is or is not a matter as respects which the Governor is by or under this Constitution required to act in his discretion, the decision of the Governor in his discretion shall be final, and the validity of anything done by the Governor shall not be called in question on the ground that he ought or ought not to have acted in his discretion\n(3) The question whether any, and if so what, advice was tendered by Ministers to the Governor shall not be inquired into in any court","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.',
444
  ]
445
  embeddings = model.encode(sentences)
446
  print(embeddings.shape)
 
502
  | type | string | string | float |
503
  | details | <ul><li>min: 7 tokens</li><li>mean: 13.33 tokens</li><li>max: 100 tokens</li></ul> | <ul><li>min: 3 tokens</li><li>mean: 210.82 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 1.0</li><li>mean: 1.0</li><li>max: 1.0</li></ul> |
504
  * Samples:
505
+ | sentence_0 | sentence_1 | label |
506
+ |:--------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
507
+ | <code>What can I do if I disagree with the amount of outstanding demand?</code> | <code>​​You can choose ‘Disagree with Demand (Either in Full or Part)’. After you select the option, you need to select from the list of reasons due to which you disagree with the amount of demand. After selecting the relevant option from the list, you need to provide details for each reason before submitting the response. If you partially disagree with the demand, you should pay the undisputed portion of the demand (i.e. with which you agree).​​</code> | <code>1.0</code> |
508
+ | <code>Article 48A of Indian Constitution</code> | <code>Protection and improvement of environment and safeguarding of forests and wild life The State shall endeavour to protect and improve the environment and to safeguard the forests and wild life of the country"<br>Article 49 of Indian Constitution,"Protection of monuments and places and objects of national importance It shall be the obligation of the State to protect every monument or place or object of artistic or historic interests, declared by or under law made by Parliament to be of national importance, from spoliation, disfigurement, destruction, removal, disposal or export, as the case may be","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.</code> | <code>1.0</code> |
509
+ | <code>Article 165 of Indian Constitution</code> | <code>Advocate General for the State<br>(1) The Governor of each State shall appoint a person who is qualified to be appointed a Judge of a High Court to be Advocate General for the State<br>(2) It shall be the duty of the Advocate General to give advice to the Government of the State upon such legal matters, and to perform such other duties of a legal character, as may from time to time be referred or assigned to him by the Governor, and to discharge the functions conferred on him by or under this Constitution or any other law for the time being in force<br>(3) The Advocate General shall hold office during the pleasure of the Governor, and shall receive such remuneration as the Governor may determine Conduct of Government Business"<br>Article 166 of Indian Constitution,"Conduct of business of the Government of a State<br>(1) All executive action of the Government of a State shall be expressed to be taken in the name of the Governor<br>(2) Orders and other instruments made and executed in the name of the Gove...</code> | <code>1.0</code> |
510
  * Loss: [<code>CosineSimilarityLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosinesimilarityloss) with these parameters:
511
  ```json
512
  {
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:673aafe057be5d357e452c8c86583b65658ef90faf183f3da9872f85243c29ac
3
  size 437951328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe22d3398338d0481668d330126a1a22a5fefadad4f86003740ced96c917a492
3
  size 437951328
special_tokens_map.json CHANGED
@@ -1,7 +1,37 @@
1
  {
2
- "cls_token": "[CLS]",
3
- "mask_token": "[MASK]",
4
- "pad_token": "[PAD]",
5
- "sep_token": "[SEP]",
6
- "unk_token": "[UNK]"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  }
 
1
  {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
  }
tokenizer_config.json CHANGED
@@ -47,12 +47,19 @@
47
  "do_lower_case": true,
48
  "extra_special_tokens": {},
49
  "mask_token": "[MASK]",
 
50
  "model_max_length": 512,
51
  "never_split": null,
 
52
  "pad_token": "[PAD]",
 
 
53
  "sep_token": "[SEP]",
 
54
  "strip_accents": null,
55
  "tokenize_chinese_chars": true,
56
  "tokenizer_class": "BertTokenizer",
 
 
57
  "unk_token": "[UNK]"
58
  }
 
47
  "do_lower_case": true,
48
  "extra_special_tokens": {},
49
  "mask_token": "[MASK]",
50
+ "max_length": 512,
51
  "model_max_length": 512,
52
  "never_split": null,
53
+ "pad_to_multiple_of": null,
54
  "pad_token": "[PAD]",
55
+ "pad_token_type_id": 0,
56
+ "padding_side": "right",
57
  "sep_token": "[SEP]",
58
+ "stride": 0,
59
  "strip_accents": null,
60
  "tokenize_chinese_chars": true,
61
  "tokenizer_class": "BertTokenizer",
62
+ "truncation_side": "right",
63
+ "truncation_strategy": "longest_first",
64
  "unk_token": "[UNK]"
65
  }