Upload fine-tuned LegalBERT retriever

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+  "word_embedding_dimension": 768,
+  "pooling_mode_cls_token": false,
+  "pooling_mode_mean_tokens": true,
+  "pooling_mode_max_tokens": false,
+  "pooling_mode_mean_sqrt_len_tokens": false,
+  "pooling_mode_weightedmean_tokens": false,
+  "pooling_mode_lasttoken": false,
+  "include_prompt": true
+}

README.md

@@ -0,0 +1,634 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- generated_from_trainer
+- dataset_size:999
+- loss:CosineSimilarityLoss
+base_model: nlpaueb/legal-bert-base-uncased
+widget:
+- source_sentence: What is a bail application?
+  sentences:
+  - 'Duration of Panchayats, etc
+
+    (1) Every Panchayat, unless sooner dissolved under any law for the time being
+    in force, shall continue for five years from the date appointed for its first
+    meeting and no longer
+
+    (2) No amendment of any law for the time being in force shall have the effect
+    of causing dissolution of a Panchayat at any level, which is functioning immediately
+    before such amendment, till the expiration of its duration specified in clause
+    ( 1 )
+
+    (3) An election to constitute a Panchayat shall be completed
+
+    (a) before the expiry of its duration specified in clause ( 1 );
+
+    (b) before the expiration of a period of six months from the date of its dissolution:
+    Provided that where the remainder of the period for which the dissolved Panchayat
+    would have continued is less than six months, it shall not be necessary to hold
+    any election under this clause for constituting the Panchayat
+
+    (4) A Panchayat constituted upon the dissolution of a Panchayat before the expiration
+    of its duration shall continue only for the remainder of the period for which
+    the dissolved Panchayat would have continued under clause ( 1 ) had it not been
+    so dissolved"
+
+    Article 243F of Indian Constitution,"Disqualifications for membership
+
+    (1) A person shall be disqualified for being chosen as, and for being, a member
+    of a Panchayat
+
+    (a) if he is so disqualified by or under any law for the time being in force for
+    the purposes of elections to the Legislature of the State concerned: Provided
+    that no person shall be disqualified on the ground that be is less than twenty
+    five years of age, if he has attained the age of twenty one years;
+
+    (b) if he is so disqualified by or under any law made by the Legislature of the
+    State
+
+    (2) If any question arises as to whether a member of a Panchayat has become subject
+    to any of the disqualifications mentioned in clause ( 1 ), the question shall
+    be referred for the decision of such authority and in such manner as the Legislature
+    of a State may, by law, provide","Below is an instruction that describes a task
+    or a question. Write a response that appropriately completes the request.'
+  - A bail application is a petition filed by an accused person requesting release
+    from custody during the pendency of legal proceedings. It is filed in the court
+    where the case is pending trial or appeal. The court has discretion to grant or
+    deny bail based on criteria like flight risktampering with evidenceprevious criminal
+    record etc.
+  - 'Language to be used in Parliament
+
+    (1) Notwithstanding anything in Part XVII, but subject to the Article 348, business
+    in Parliament shall be transacted in Hindi or in English: Provided that the Chairman
+    of the Council of States or Speaker of the House of the People, or Person acting
+    as such, as the Case may be, may permit any member who cannot adequately express
+    himself in Hindi or in English to address the House in his mother tongue
+
+    (2) Unless Parliament by Law otherwise provides, this article shall, after the
+    expiration of a period of fifteen years from the commencement of this Constitution,
+    have effect as if the words or in English were omitted therefrom"
+
+    Article 121 of Indian Constitution,Restriction on discussion in Parliament No
+    discussions shall take place in Parliament with respect to the conduct of any
+    Judge of the Supreme Court or of a High Court in the discharge of his duties expect
+    upon a motion for presenting an address to the President praying for the removal
+    of the Judge as hereinafter provided,"Below is an instruction that describes a
+    task or a question. Write a response that appropriately completes the request.'
+- source_sentence: What is the meaning of the Benami transaction?
+  sentences:
+  - '​​​A Benami transaction means the following transactions or arrangements:
+
+
+    (a)  A transaction or an arrangement:
+
+
+    (A) Where a property is transferred to or is held by a person, and the consideration
+    for such property has been provided, or paid by, another person; and
+
+
+    (B) The property is held for the immediate or future benefit, direct or indirect,
+    of the person who has provided the consideration.
+
+
+    However, a transaction or an arrangement which satisfies conditions (A) and (B)
+    above is not treated as benami when the property is held by:
+
+
+    ​A Karta, or a member of a HUF, as the case may be, and the property is held for
+    his benefit or the benefit of other members in the family, and the consideration
+    for such property has been provided or paid out of the known sources of the HUF;
+
+    A person standing in a fiduciary capacity for the benefit of another person towards
+    whom he stands in such capacity and includes a trustee, executor, partner, director
+    of a company, a depository, or a participant as an agent of a depository under
+    the Depositories Act, 1996 and any other person as may be notified by the Central
+    Government for this purpose;
+
+    Any person being an individual in the name of his spouse or in the name of any
+    child of such individual, and the consideration for such property has been provided
+    or paid out of the known sources of the individual;
+
+    Any person in the name of his brother or sister or lineal ascendant or descendant,
+    where the names of brother or sister or lineal ascendant or descendent and the
+    individual appear as joint-owners in any document, and the consideration for such
+    property has been provided or paid out of the known sources of the individual.
+
+    Examples
+
+
+    Mr. A buys a house in the name of his sister-in-law Mrs. B. Payment has been made
+    by A. He and his family live in that house. Even if B is a rich lady, the transaction
+    is benami. B is the Benamidar, and A is the beneficial owner. [Illustration from
+    “Keep away from Benami Transaction" leaflet issued by the Income Tax Department].
+
+    It would, however, not be a benami transaction if it can be proved that consider­ation
+    was paid out of HUF funds and the property was purchased for the benefit of the
+    HUF family [Exception (i) to Section 2(9)(A)]. It would also not be a benami transaction
+    if it can be proved that the sister-in-law B was in a fiduciary relationship vis-a-vis
+    Mr. A [Excep­tion (ii) to Section 2(9)(A)]
+
+
+    Mr. P wants to take a liquor license from the government. He pays the money in
+    the name of employee Mr. K, and the contract is awarded to Mr.K, but Mr. P is
+    deriving benefit from the liquor license. The transaction is a benami transaction.
+    Mr. K is the benamidar. Mr. P is the beneficial owner and profits from such liquor
+    business shall be the benami property. [Illustration from “Keep away from Benami
+    Transaction" leaflet issued by the Income Tax Department].
+
+    (b)   A transaction or an arrangement in respect of a property carried out or
+    made in a fictitious name;
+
+
+    Example: Fixed deposits kept in the name of fictitious persons is a benami transaction/benami
+    property[Illustration from “Keep away from Benami Transaction" leaflet issued
+    by the Income Tax Department].
+
+
+    (c)   A transaction or an arrangement in respect of a property where the owner
+    of the property is not aware of, or denies knowledge of, such ownership;
+
+
+    Example: Cash kept in a bank locker in the name of his employee/relative who denies
+    knowledge is a benami property [Illustration from the leaflet “Keep away from
+    Benami Transaction" issued by the Income-Tax Department].
+
+
+    (d)  A transaction or an arrangement in respect of a property where the person
+    providing the consideration is not traceable or is fictitious.​'
+  - ​​If an informant furnishes false information, such an act is considered as an
+    offence, and the person giving false information/evidence/ statement will be liable
+    to be prosecuted for such offence.​​
+  - 'Recommendations of the Finance Commission The President shall cause every recommendation
+    made by the Finance Commission under the provisions of this Constitution together
+    with an explanatory memorandum as to the action taken thereon to be laid before
+    each House of Parliament Miscellaneous Financial Provisions"
+
+    Article 282 of Indian Constitution,"Expenditure defrayable by the Union or a State
+    out of its revenues The Union or a State may make any grants for any public purpose,
+    notwithstanding that the purpose is not one with respect to which Parliament or
+    the Legislature of the State, as the case may be, may make laws","Below is an
+    instruction that describes a task or a question. Write a response that appropriately
+    completes the request.'
+- source_sentence: Whether the show-cause notice has to be served to the beneficial
+    owner also?
+  sentences:
+  - '​​Even if a charitable institution cannot utilise 85% of its income for charitable
+    or religious purposes in India, it shall be deemed to be applied for such purposes
+    in the situations described below.
+
+
+    ​Where income has not been received in the previous year;
+
+    Where income could not be applied due to other reasons.
+
+    Such deemed application of income shall be considered when the institution furnishes
+    the details electronically in Form 9A at least two months prior to the due date
+    specified under Section 139(1) for furnishing the return of income for the previous
+    year.​'
+  - ​The copy of the show-cause notice has to be sent to the beneficial owner, if
+    known.​
+  - 'Oath or affirmation by Judges of High Courts Every person appointed to be a Judge
+    of a High Court shall, before he enters upon his office, make and subscribe before
+    the Governor of the State, or some person appointed in that behalf by him, an
+    oath or affirmation according to the form set out for the purpose in the Third
+    Schedule"
+
+    Article 220 of Indian Constitution,"Restriction on practice after being a permanent
+    Judge No person who, after the commencement of this Constitution, has held office
+    as a permanent Judge of a High Court shall plead or act in any court or before
+    any authority in India except the Supreme Court and the other High Courts Explanation
+    In this article, the expression High Court does not include a High Court for a
+    State specified in Part B of the First Schedule as it existed before the commencement
+    of the Constitution (seventh Amendment) Act, 1956","Below is an instruction that
+    describes a task or a question. Write a response that appropriately completes
+    the request.'
+- source_sentence: Article 23 of Indian Constitution
+  sentences:
+  - 'Prohibition of traffic in human beings and forced labour
+
+    (1) Traffic in human beings and begar and other similar forms of forced labour
+    are prohibited and any contravention of this provision shall be an offence punishable
+    in accordance with law
+
+    (2) Nothing in this article shall prevent the State from imposing compulsory service
+    for public purpose, and in imposing such service the State shall not make any
+    discrimination on grounds only of religion, race, caste or class or any of them"
+
+    Article 24 of Indian Constitution,"Prohibition of employment of children in factories,
+    etc No child below the age of fourteen years shall be employed to work in any
+    factory or mine or engaged in any other hazardous employment Provided that nothing
+    in this sub clause shall authorise the detention of any person beyond the maximum
+    period prescribed by any law made by Parliament under sub clause (b) of clause
+    ( 7 ); or such person is detained in accordance with the provisions of any law
+    made by Parliament under sub clauses (a) and (b) of clause ( 7 )","Below is an
+    instruction that describes a task or a question. Write a response that appropriately
+    completes the request.'
+  - 'Regulation by law of procedure in the Legislature of the State in relation to
+    financial business The Legislature of a State may, for the purpose of the timely
+    completion of financial business, regulate by law the procedure of, and the conduct
+    of business in, the House or Houses of the Legislature of the State in relation
+    to any financial matter or to any Bill for the appropriation of moneys out of
+    the Consolidated Fund of the State, and, if and so far as any provision of any
+    law so made is inconsistent with any rule made by the House or either House of
+    the Legislature of the State under clause ( 1 ) of article 208 or with any rule
+    or standing order having effect in relation to the Legislature of the State under
+    clause ( 2 ) of that article, such provision shall prevail"
+
+    Article 210 of Indian Constitution,"Language to be used in the Legislature
+
+    (1) Notwithstanding anything in Part XVII, but subject to the provisions of article
+    348, business in the Legislature of a State shall be transacted in the official
+    language or languages of the State or in Hindi or in English: Provided that the
+    Speaker of the Legislative Assembly or Chairman of the Legislative Council, or
+    person acting as such, as the case may be, may permit any member who cannot adequately
+    express himself in any of the languages aforesaid to address the House in his
+    mother tongue
+
+    (2) Unless the Legislature of the State by law otherwise provides, this article
+    shall, after the expiration of a period of fifteen years from the commencement
+    of this Constitution, have effect as if the words or in English were omitted here
+    from: Provided that in relation to the Legislatures of the States of Himachal
+    Pradesh, Manipur, Meghalaya and Tripura this clause shall have effect as if for
+    the words fifteen years occurring therein, the words twenty five years were substituted:
+    Provided further that in relation to the Legislature of the States of Arunachal
+    Pradesh, Goa and Mizoram, this clause shall have effect as if for the words fifteen
+    years occurring therein, the words forty years were substituted","Below is an
+    instruction that describes a task or a question. Write a response that appropriately
+    completes the request.'
+  - 'Admission or establishment of new States: Parliament may by law admit into the
+    Union, or establish, new States on such terms and conditions, as it thinks fit"
+
+    Article 2A of Indian Constitution,"Sikkim to be associated with the Union Rep
+    by the Constitution Thirty six Amendment Act, 1975 , Section 5 (w e f 26 04 1975
+    )","Below is an instruction that describes a task or a question. Write a response
+    that appropriately completes the request.'
+- source_sentence: What is the meaning of borrowing cost?
+  sentences:
+  - 'Extent of executive power of State Subject to the provisions of this Constitution,
+    the executive power of a State shall extend to the matters with respect to which
+    the Legislature of the State has power to make laws Provided that in any matter
+    with respect to which the Legislature of a State and Parliament have power to
+    make laws, the executive power of the State shall be subject to, and limited by,
+    the executive power expressly conferred by the Constitution or by any law made
+    by Parliament upon the Union or authorities thereof Council of Ministers"
+
+    Article 163 of Indian Constitution,"Council of Ministers to aid and advise Governor
+
+    (1) There shall be a council of Ministers with the chief Minister at the head
+    to aid and advise the Governor in the exercise of his functions, except in so
+    far as he is by or under this constitution required to exercise his functions
+    or any of them in his discretion
+
+    (2) If any question arises whether any matter is or is not a matter as respects
+    which the Governor is by or under this Constitution required to act in his discretion,
+    the decision of the Governor in his discretion shall be final, and the validity
+    of anything done by the Governor shall not be called in question on the ground
+    that he ought or ought not to have acted in his discretion
+
+    (3) The question whether any, and if so what, advice was tendered by Ministers
+    to the Governor shall not be inquired into in any court","Below is an instruction
+    that describes a task or a question. Write a response that appropriately completes
+    the request.'
+  - 'Qualifications for election as President
+
+    (1) No person shall be eligible for election as President unless he
+
+    (a) is a citizen of India,
+
+    (b) has completed the age of thirty five years, and
+
+    (c) is qualified for election as a member of the House of the People
+
+    (2) A person shall not be eligible for election as President if he holds any office
+    of profit under the or the Government of any State or under any local or other
+    authority subject to the control of any of the said Governments Explanation For
+    the purposes of this article, a person shall not be deemed to hold any office
+    of profit by reason only that he is the President or Vice President of the Union
+    or the Governor of any State or is a Minister either for the Union or for any
+    State"
+
+    Article 59 of Indian Constitution,"Conditions of Presidents office
+
+    (1) The President shall not be a member of either House of Parliament or of a
+    House of the Legislature of any State, and if a member of either House of Parliament
+    or of a House of the Legislature of any State be elected President, he shall be
+    deemed to have vacated his seat in that House on the date on which he enters upon
+    his office as President
+
+    (2) The President shall not hold any other office of profit
+
+    (3) The President shall be entitled without payment of rent to the use of his
+    official residences and shall be also entitled to such emoluments, allowances
+    and privileges as may be determined by Parliament by law and, until provision
+    in that behalf is so made, such emoluments, allowances and privileges as are specified
+    in the Second Schedule
+
+    (4) The emoluments and allowances of the President shall ot be diminished during
+    his term of office","Below is an instruction that describes a task or a question.
+    Write a response that appropriately completes the request.'
+  - ​Borrowing cost means interest and other cost incurred by a person in connection
+    with the borrowing of funds. It includes commitment charges, amortised amount
+    of discounts or premiums relating to borrowings, processing charges, charges incurred
+    under the finance lease or any other similar arrangements. The CBDT, vide Circular
+    No. 10/2017, dated 23-3-2017, has clarified that bill discounting charges and
+    other similar charges are also treated as borrowing costs.​
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on nlpaueb/legal-bert-base-uncased
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nlpaueb/legal-bert-base-uncased](https://huggingface.co/nlpaueb/legal-bert-base-uncased). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nlpaueb/legal-bert-base-uncased](https://huggingface.co/nlpaueb/legal-bert-base-uncased) <!-- at revision 15b570cbf88259610b082a167dacc190124f60f6 -->
+- **Maximum Sequence Length:** 512 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+<!-- - **Training Dataset:** Unknown -->
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("sentence_transformers_model_id")
+# Run inference
+sentences = [
+    'What is the meaning of borrowing cost?',
+    '\u200bBorrowing cost means interest and other cost incurred by a person in connection with the borrowing of funds. It includes commitment charges, amortised amount of discounts or premiums relating to borrowings, processing charges, charges incurred under the finance lease or any other similar arrangements. The CBDT, vide Circular No. 10/2017, dated 23-3-2017, has clarified that bill discounting charges and other similar charges are also treated as borrowing costs.\u200b',
+    'Qualifications for election as President\n(1) No person shall be eligible for election as President unless he\n(a) is a citizen of India,\n(b) has completed the age of thirty five years, and\n(c) is qualified for election as a member of the House of the People\n(2) A person shall not be eligible for election as President if he holds any office of profit under the or the Government of any State or under any local or other authority subject to the control of any of the said Governments Explanation For the purposes of this article, a person shall not be deemed to hold any office of profit by reason only that he is the President or Vice President of the Union or the Governor of any State or is a Minister either for the Union or for any State"\nArticle 59 of Indian Constitution,"Conditions of Presidents office\n(1) The President shall not be a member of either House of Parliament or of a House of the Legislature of any State, and if a member of either House of Parliament or of a House of the Legislature of any State be elected President, he shall be deemed to have vacated his seat in that House on the date on which he enters upon his office as President\n(2) The President shall not hold any other office of profit\n(3) The President shall be entitled without payment of rent to the use of his official residences and shall be also entitled to such emoluments, allowances and privileges as may be determined by Parliament by law and, until provision in that behalf is so made, such emoluments, allowances and privileges as are specified in the Second Schedule\n(4) The emoluments and allowances of the President shall ot be diminished during his term of office","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities.shape)
+# [3, 3]
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### Unnamed Dataset
+
+* Size: 999 training samples
+* Columns: <code>sentence_0</code>, <code>sentence_1</code>, and <code>label</code>
+* Approximate statistics based on the first 999 samples:
+  |         | sentence_0                                                                         | sentence_1                                                                          | label                                                         |
+  |:--------|:-----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:--------------------------------------------------------------|
+  | type    | string                                                                             | string                                                                              | float                                                         |
+  | details | <ul><li>min: 7 tokens</li><li>mean: 13.33 tokens</li><li>max: 100 tokens</li></ul> | <ul><li>min: 3 tokens</li><li>mean: 210.82 tokens</li><li>max: 512 tokens</li></ul> | <ul><li>min: 1.0</li><li>mean: 1.0</li><li>max: 1.0</li></ul> |
+* Samples:
+  | sentence_0                                                          | sentence_1                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | label            |
+  |:--------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------|
+  | <code>Article 239A of Indian Constitution</code>                    | <code>Creation of local Legislatures or Council of Ministers or both for certain Union territories<br>(1) Parliament may by law create for the Union territory of Pondicherry<br>(a) a body, whether elected or partly nominated and partly elected, to function as a Legislature for the Union territory, or<br>(b) a Council of Ministers, or both with such constitution, powers and functions, in each case, as may be specified in the law<br>(2) Any such law as is referred to in clause ( 1 ) shall not be deemed to be an amendment of this Constitution for the purposes of Article 368 notwithstanding that it contains any provision which amends or has the effect of amending this Constitution"<br>Article 239B of Indian Constitution,"Power of administrator to promulgate Ordinances during recess of Legislature<br>(1) If at any time, except when the Legislature of the Union territory of Pondicherry is in session, the administrator thereof is satisfied that circumstances exist which render it necessary for him to take immediate ...</code> | <code>1.0</code> |
+  | <code>Article 378 of Indian Constitution</code>                     | <code>Provisions as to Public Service Commissions<br>(1) The members of the Public Service Commission for the Dominion of India holding office immediately before the commencement of this Constitution shall, unless they have elected otherwise, become on such commencement the members of the Public Service Commission for the Union and shall, notwithstanding anything in clauses ( 1 ) and ( 2 ) of Article 316 but subject to the proviso to clause ( 2 ) of that article, continue to hold office until the expiration of their term of office as determined under the rules which were applicable immediately before such commencement to such members<br>(2) The members of a Public Service Commission of a Province or of a Public Service Commission serving the needs of a group of Provinces holding office immediately before the commencement of this Constitution shall, unless they have elected otherwise, become on such commencement the members of the Public Service Commission for the corresponding State or the members...</code>             | <code>1.0</code> |
+  | <code>When prosecution under Section 275B shall be launched?</code> | <code>Prosecution under Section 275B shall be launched if a person fails to provide the facility to the authorised officer to inspect any books of accounts or other documents during the search and seizure.​</code>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      | <code>1.0</code> |
+* Loss: [<code>CosineSimilarityLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#cosinesimilarityloss) with these parameters:
+  ```json
+  {
+      "loss_fct": "torch.nn.modules.loss.MSELoss"
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `num_train_epochs`: 0.1
+- `multi_dataset_batch_sampler`: round_robin
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: no
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 8
+- `per_device_eval_batch_size`: 8
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 5e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1
+- `num_train_epochs`: 0.1
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.0
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: False
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: False
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `tp_size`: 0
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: batch_sampler
+- `multi_dataset_batch_sampler`: round_robin
+
+</details>
+
+### Framework Versions
+- Python: 3.11.12
+- Sentence Transformers: 3.4.1
+- Transformers: 4.51.3
+- PyTorch: 2.6.0+cu124
+- Accelerate: 1.6.0
+- Datasets: 3.6.0
+- Tokenizers: 0.21.1
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,27 @@
+{
+  "architectures": [
+    "BertModel"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "eos_token_ids": 0,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "output_past": true,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.51.3",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}

config_sentence_transformers.json

@@ -0,0 +1,10 @@
+{
+  "__version__": {
+    "sentence_transformers": "3.4.1",
+    "transformers": "4.51.3",
+    "pytorch": "2.6.0+cu124"
+  },
+  "prompts": {},
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:673aafe057be5d357e452c8c86583b65658ef90faf183f3da9872f85243c29ac
+size 437951328

modules.json

@@ -0,0 +1,14 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+  "max_seq_length": 512,
+  "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,7 @@
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,58 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "do_basic_tokenize": true,
+  "do_lower_case": true,
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "never_split": null,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}