nyayadrishti-bert / README.md
rossieRuby's picture
Upload fine-tuned LegalBERT retriever
1fb57b5 verified
metadata
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:999
  - loss:CosineSimilarityLoss
base_model: rossieRuby/nyayadrishti-bert
widget:
  - source_sentence: Article 77 of Indian Constitution
    sentences:
      - >-
        Conditions of Governor office

        (1) The Governor shall not be a member of either House of Parliament or
        of a House of the Legislature of any State specified in the First
        Schedule, and if a member of either House of Parliament or of a House of
        the Legislature of any such State be appointed Governor, he shall be
        deemed to have vacated his seat in that House on the date on which he
        enters upon his office as Governor

        (2) The Governor shall not hold any other office of profit

        (3) The Governor shall be entitled without payment of rent to the use of
        his official residences and shall be also entitled to such emoluments,
        allowances and privileges as may be determined by Parliament by law and,
        until provision in that behalf is so made, such emoluments, allowances
        and privileges as are specified in Second Schedule

        (3A) Where the same person is appointed as Governor of two or more
        States, the emoluments and allowances payable to the Governor shall be
        allocated among the States in such proportion as the President may by
        order determine

        (4) The emoluments and allowances of the Governor shall not be
        diminished during his term of office"

        Article 159 of Indian Constitution,"Oath or affirmation by Governor
        Every Governor and every person discharging the functions of the
        Governor shall, before entering upon his office, make and subscribe in
        the presence of the chief Justice of the High Court exercising
        jurisdiction in relation to the State, or, in his absence, the senior
        most Judge of that court available, an oath or affirmation in the
        following form, that is to say swear in the name of God I, A B, do that
        I solemnly affirm will faithfully execute the office of Governor (or
        discharge the functions of the Governor) of (name of the State) and will
        to the best of my ability preserve, protect and defend the Constitution
        and the law and that I will devote myself to the service and well being
        of the people of (name of the State)","Below is an instruction that
        describes a task or a question. Write a response that appropriately
        completes the request.
      - >-
        Conduct of business of the Government of India

        (1) All executive action of the Government of India shall be expressed
        to be taken in the name of the President

        (2) Orders and other instruments made and executed in the name of the
        President shall be authenticated in such manner as may be specified in
        rules to be made by the President, and the validity of an order or
        instrument which is so authenticated shall nor be called in question on
        the ground that it is not an order or instrument made or executed by the
        President

        (3) The President shall make rules for the more convenient transaction
        of the business of the Government of India, and for the allocation among
        Ministers of the said business"

        Article 78 of Indian Constitution,"Duties of Prime Minister as respects
        the furnishing of information to the President, etc It shall be the duty
        of the Prime Minister

        (a) to communicate to the President all decisions of the council of
        Ministers relating to the administration of the affairs of the union and
        proposals for legislation;

        (b) to furnish such information relating to the administration of the
        affairs of the Union and proposals for legislation as the President may
        call for; and

        (c) if the President so requires, to submit for the consideration of the
        Council of Ministers any matter on which a decision has been taken by a
        Minister but which has not been considered by the Council CHAPTER II
        PARLIAMENT General","Below is an instruction that describes a task or a
        question. Write a response that appropriately completes the request.
      - >-
        If the Informant has claimed the reward for giving information of
        evasion of tax payable under Black Money (Undisclosed Foreign Income and
        Assets) and Imposition of Tax Act, 2015, as well as benami properties
        based upon substantially the same facts and has been found eligible for
        grant of reward under both the schemes, the total amount of reward under
        both the schemes taken together shall not exceed Rs. 5 crores.​​​
  - source_sentence: Article 249 of Indian Constitution
    sentences:
      - >-
        Power of Parliament to legislate with respect to a matter in the State
        List in the national interest

        (1) Notwithstanding anything in the foregoing provisions of this
        Chapter, if the Council of States has declared by resolution supported
        by not less than two thirds of the members present and voting that it is
        necessary or expedient in national interest that Parliament should make
        laws with respect to any matter enumerated in the State List specified
        in the resolution, it shall be lawful for Parliament to make laws for
        the whole or any part of the territory of India with respect to that
        matter while the resolution remains in force

        (2) A resolution passed under clause ( 1 ) shall remain in force for
        such period not exceeding one year as may be specified therein: Provided
        that, if and so often as a resolution approving the continuance in force
        of any such resolution is passed in the manner provided in clause ( 1 ),
        such resolution shall continue in force for a further period of one year
        from the date on which under this clause it would otherwise have ceased
        to be in force

        (3) A law made by Parliament which Parliament would not but for the
        passing of a resolution under clause ( 1 ) have been competent to make
        shall, to the extent of the incompetency, cease to have effect on the
        expiration of a period of six months after the resolution has ceased to
        be in force, except as respects things done or omitted to be done before
        the expiration of the said period"

        Article 250 of Indian Constitution,"Power of Parliament to legislate
        with respect to any matter in the State List if a Proclamation of
        Emergency is in operation

        (1) Notwithstanding anything in this Chapter, Parliament shall, while a
        Proclamation of Emergency is in operation, have, power to make laws for
        the whole or any part of the territory of India with respect to any of
        the matters enumerated in the State List

        (2) A law made by Parliament which Parliament would not but for the
        issue of a Proclamation of Emergency have been competent to make shall,
        to the extent of the incompetency, cease to have effect on the
        expiration of a period of six months after the Proclamation has ceased
        to operate, except as respects things done or omitted to be done before
        the expiration of the said period","Below is an instruction that
        describes a task or a question. Write a response that appropriately
        completes the request.
      - >-
        Penalty for sitting and voting before making oath or affirmation under
        Article 99 or when not qualified or when disqualified If a person sits
        or votes as a member of either House of Parliament before he has
        complied with the requirements of Article 99, or when he knows that he
        is not qualified or that he is disqualified for membership thereof, or
        that he is prohibited from so doing by the provisions of any law made by
        Parliament, he shall be liable in respect of each day on which he so
        sits or votes to a penalty of five hundred rupees to be recovered as a
        debt due to the Union Powers, Privileges and Immunities of Parliament
        and its Members"

        Article 105 of Indian Constitution,"Powers, privileges, etc of the
        Houses of Parliament and of the members and committees thereof

        (1) Subject to the provisions of this constitution and the rules and
        standing orders regulating the procedure of Parliament, there shall be
        freedom of speech in Parliament

        (2) No member of Parliament shall be liable to any proceedings in any
        court in respect of anything said or any vote given by him in Parliament
        or any committee thereof, and no person shall be so liable in respect of
        the publication by or under the authority of either House of Parliament
        of any report, paper, votes or proceedings

        (3) In other respects, the powers, privileges and immunities of each
        House of Parliament, and of the members and the committees of each
        House, shall be such as may from time to time be defined by Parliament
        by law, and, until so defined shall be those of that House and of its
        members and committees immediately before the coming into force of
        Section 15 of the Constitution (Forty fourth Amendment) Act 1978

        (4) The provisions of clauses ( 1 ), ( 2 ) and ( 3 ) shall apply in
        relation to persons who by virtue of this constitution have the right to
        speak in, and otherwise to take part in the proceedings of, a House of
        Parliament or any committee thereof as they apply in relation to members
        of Parliament","Below is an instruction that describes a task or a
        question. Write a response that appropriately completes the request.
      - >-
        Special provision with respect to the State of Mizoram Notwithstanding
        anything in this Constitution,

        (a) no Act of President in respect of

        (i) religious or social practices of the Mizos,

        (ii) Mizo customary law and procedure,

        (iii) administration of civil and criminal justice involving decisions
        according to Mizo customary law,

        (iv) ownership and transfer of land, shall apply to the State of Mizoram
        unless the Legislative Assembly of the State of Mizoram by a resolution
        so decides: Provided that nothing in this clause shall apply to any
        Central Act in force in the union territory of Mizoram immediately
        before the commencement of the Constitution (Fifty third Amendment) Act,
        1986 ;

        (b) the Legislative Assembly of the State of Mizoram shall consist of
        not less than forty members"

        Article 371H of Indian Constitution,"Special provision with respect to
        the State of Arunachal Pradesh Notwithstanding anything in this
        Constitution,

        (a) the Governor of Arunachal Pradesh shall have special responsibility
        with respect to law and order in the State of Arunachal Pradesh and in
        the discharge of his functions in relation thereto, the Governor shall,
        after consulting the Council of Ministers, exercise his individual
        judgment as to the action to be taken: Provided that if any question
        arises whether any matter is or is not a matter as respects which the
        Governor is under this clause required to act in the exercise of his
        individual judgment, the decision of the Governor in his discretion
        shall be final, and the validity of anything done by the Governor shall
        not be called in question on the ground that he ought or ought not to
        have acted in the exercise of his individual judgment: Provided further
        that if the President on receipt of a report from the Governor or
        otherwise is satisfied that it is no longer necessary for the Governor
        to have special responsibility with respect to law and order in the
        State of Arunachal Pradesh, he may by order direct that the Governor
        shall cease to have such responsibility with effect from such date as
        may be specified in the order;

        (b) the Legislative Assembly of the State of Arunachal Pradesh shall
        consist of not less than thirty members","Below is an instruction that
        describes a task or a question. Write a response that appropriately
        completes the request.
  - source_sentence: What is the provision of Section 2(1A)(b)(ii)?
    sentences:
      - >-
        Reward in accordance with this scheme shall be ex-gratia payment granted
        at the absolute discretion of the authority competent to grant reward.
        The decision of the authority shall be final, and it shall not be
        subject to any litigation, appeal, adjudication and arbitration except
        review as provided in this scheme.​​​
      - >-
        ​​Any income derived by performing the marketing process by the
        cultivator is an agricultural income if the following conditions are
        fulfilled:


        ​The process to which the agricultural produce is subjected should be
        ordinarily employed by a cultivator or receiver of rent-in-kind.

        The process should be employed to render the produce fit to be taken to
        market and not for any other purpose.​
      - >-
        Promotion of international peace and security The State shall endeavour
        to

        (a) promote international peace and security;

        (b) maintain just and honourable relations between nations;

        (c) foster respect for international law and treaty obligations in the
        dealings of organised peoples with one another; and encourage settlement
        of international disputes by arbitration PART IVA FUNDAMENTAL DUTIES"

        Article 51A of Indian Constitution,"Fundamental duties It shall be the
        duty of every citizen of India (a) to abide by the Constitution and
        respect its ideals and institutions, the national Flag and the National
        Anthem;

        (b) to cherish and follow the noble ideals which inspired our national
        struggle for freedom;

        (c) to uphold and protect the sovereignty, unity and integrity of India;

        (d) to defend the country and render national service when called upon
        to do so;

        (e) to promote harmony and the spirit of common brotherhood amongst all
        the people of India transcending religious, linguistic and regional or
        sectional diversities; to renounce practices derogatory to the dignity
        of women;

        (f) to value and preserve the rich heritage of our composite culture;

        (g) to protect and improve the natural environment including forests,
        lakes, rivers and wild life, and to have compassion for living
        creatures;

        (h) to develop the scientific temper, humanism and the spirit of inquiry
        and reform;

        (i) to safeguard public property and to abjure violence;

        (j) to strive towards excellence in all spheres of individual and
        collective activity so that the nation constantly rises to higher levels
        of endeavour and achievement PART V THE UNION CHAPTER I THE EXECUTIVE
        The President and Vice President","Below is an instruction that
        describes a task or a question. Write a response that appropriately
        completes the request.
  - source_sentence: When prosecution under Section 276A can be launched?
    sentences:
      - >-
        ​​​Prosecution under Section 276A can be launched where any person,
        appointed as liquidator of a company, has committed any of the following
        defaults:


        ​He fails to give notice of his appointment within 30 days to the
        Assessing Officer having jurisdiction over such company;

        He fails to set aside the amount, notified to him by the Assessing
        Officer, to meet the tax demand;

        He parts with any of the assets of the company or properties in hand,
        until the amount to be set aside, is notified by the Assessing officer,
        without the prior approval of the prescribed tax authority; or

        He parts with any of the assets of the company or properties in hand
        until the amount of tax demand notified by the Assessing Officer is set
        aside.

        No proceedings shall be initiated under this provision on or after
        01-04-2023.​
      - >-
        Fundamental duties It shall be the duty of every citizen of India (a) to
        abide by the Constitution and respect its ideals and institutions, the
        national Flag and the National Anthem;

        (b) to cherish and follow the noble ideals which inspired our national
        struggle for freedom;

        (c) to uphold and protect the sovereignty, unity and integrity of India;

        (d) to defend the country and render national service when called upon
        to do so;

        (e) to promote harmony and the spirit of common brotherhood amongst all
        the people of India transcending religious, linguistic and regional or
        sectional diversities; to renounce practices derogatory to the dignity
        of women;

        (f) to value and preserve the rich heritage of our composite culture;

        (g) to protect and improve the natural environment including forests,
        lakes, rivers and wild life, and to have compassion for living
        creatures;

        (h) to develop the scientific temper, humanism and the spirit of inquiry
        and reform;

        (i) to safeguard public property and to abjure violence;

        (j) to strive towards excellence in all spheres of individual and
        collective activity so that the nation constantly rises to higher levels
        of endeavour and achievement PART V THE UNION CHAPTER I THE EXECUTIVE
        The President and Vice President"

        Article 52 of Indian Constitution,The President of India There shall be
        a President of India,"Below is an instruction that describes a task or a
        question. Write a response that appropriately completes the request.
      - >-
        Provisions as to Judges of High Courts

        (1) Notwithstanding anything in this clause ( 2 ) of Article 217, the
        Judges of a High Court in any Province holding office immediately before
        the commencement of this Constitution shall, unless they have elected
        otherwise, become on such commencement the Judges of the High Court in
        the corresponding State, and shall thereupon be entitled to such
        salaries and allowances and to such rights in respect of leave of
        absence and pension as are provided for under Article 221 in respect of
        the Judges of such High Court Any such Judge shall, notwithstanding that
        he is not a citizen of India, be eligible for appointment as Chief
        Justice of such High Court, or as Chief Justice or other Judge of any
        other High Court

        (2) The Judges of a High Court in any Indian State corresponding to any
        State specified in Part B of the First Schedule holding office
        immediately before the commencement of this Constitution shall, unless
        they have elected otherwise, become on such commencement the Judges of
        the High Court in the State so specified and shall, notwithstanding
        anything in clauses ( 1 ) and ( 2 ) of Article 217 but subject to the
        proviso to clause ( 1 ) of that article, continue to hold office until
        the expiration of such period as the President may by order determine In
        this article, the expression Judge does not include an acting Judge or
        an additional Judge"

        Article 377 of Indian Constitution,"Provisions as to Comptroller and
        Auditor General of India The Auditor General of India holding office
        immediately before the commencement of this Constitution shall, unless
        he has elected otherwise, become on such commencement the Comptroller
        and Auditor General of India and shall thereupon be entitled to such
        salaries and to such rights in respect of leave of absence and pension
        as are provided for under clause ( 3 ) of Article 148 in respect of the
        Comptroller and Auditor General of India and be entitled to continue to
        hold office until the expiration of his term of office as determined
        under the provisions which were applicable to him immediately before
        such commencement","Below is an instruction that describes a task or a
        question. Write a response that appropriately completes the request.
  - source_sentence: Article 45 of Indian Constitution
    sentences:
      - >-
        ​​Income derived from land can be termed agricultural income if the
        following conditions are satisfied:


        Rent or revenue should be derived from the land;

        Land should be situated in India; and

        Land should be used for agricultural purposes.​
      - >-
        Extent of executive power of State Subject to the provisions of this
        Constitution, the executive power of a State shall extend to the matters
        with respect to which the Legislature of the State has power to make
        laws Provided that in any matter with respect to which the Legislature
        of a State and Parliament have power to make laws, the executive power
        of the State shall be subject to, and limited by, the executive power
        expressly conferred by the Constitution or by any law made by Parliament
        upon the Union or authorities thereof Council of Ministers"

        Article 163 of Indian Constitution,"Council of Ministers to aid and
        advise Governor

        (1) There shall be a council of Ministers with the chief Minister at the
        head to aid and advise the Governor in the exercise of his functions,
        except in so far as he is by or under this constitution required to
        exercise his functions or any of them in his discretion

        (2) If any question arises whether any matter is or is not a matter as
        respects which the Governor is by or under this Constitution required to
        act in his discretion, the decision of the Governor in his discretion
        shall be final, and the validity of anything done by the Governor shall
        not be called in question on the ground that he ought or ought not to
        have acted in his discretion

        (3) The question whether any, and if so what, advice was tendered by
        Ministers to the Governor shall not be inquired into in any
        court","Below is an instruction that describes a task or a question.
        Write a response that appropriately completes the request.
      - >-
        Provision for free and compulsory education for children The State shall
        endeavour to provide, within a period of ten years from the commencement
        of this Constitution, for free and compulsory education for all children
        until they complete the age of fourteen years"

        Article 46 of Indian Constitution,"Promotion of educational and economic
        interests of Scheduled Castes, Scheduled Tribes and other weaker
        sections The State shall promote with special care the educational and
        economic interests of the weaker sections of the people, and, in
        particular, of the Scheduled Castes and the Scheduled Tribes, and shall
        protect them from social injustice and all forms of exploitation","Below
        is an instruction that describes a task or a question. Write a response
        that appropriately completes the request.
pipeline_tag: sentence-similarity
library_name: sentence-transformers

SentenceTransformer based on rossieRuby/nyayadrishti-bert

This is a sentence-transformers model finetuned from rossieRuby/nyayadrishti-bert. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

  • Model Type: Sentence Transformer
  • Base model: rossieRuby/nyayadrishti-bert
  • Maximum Sequence Length: 512 tokens
  • Output Dimensionality: 768 dimensions
  • Similarity Function: Cosine Similarity

Model Sources

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Article 45 of Indian Constitution',
    'Provision for free and compulsory education for children The State shall endeavour to provide, within a period of ten years from the commencement of this Constitution, for free and compulsory education for all children until they complete the age of fourteen years"\nArticle 46 of Indian Constitution,"Promotion of educational and economic interests of Scheduled Castes, Scheduled Tribes and other weaker sections The State shall promote with special care the educational and economic interests of the weaker sections of the people, and, in particular, of the Scheduled Castes and the Scheduled Tribes, and shall protect them from social injustice and all forms of exploitation","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.',
    'Extent of executive power of State Subject to the provisions of this Constitution, the executive power of a State shall extend to the matters with respect to which the Legislature of the State has power to make laws Provided that in any matter with respect to which the Legislature of a State and Parliament have power to make laws, the executive power of the State shall be subject to, and limited by, the executive power expressly conferred by the Constitution or by any law made by Parliament upon the Union or authorities thereof Council of Ministers"\nArticle 163 of Indian Constitution,"Council of Ministers to aid and advise Governor\n(1) There shall be a council of Ministers with the chief Minister at the head to aid and advise the Governor in the exercise of his functions, except in so far as he is by or under this constitution required to exercise his functions or any of them in his discretion\n(2) If any question arises whether any matter is or is not a matter as respects which the Governor is by or under this Constitution required to act in his discretion, the decision of the Governor in his discretion shall be final, and the validity of anything done by the Governor shall not be called in question on the ground that he ought or ought not to have acted in his discretion\n(3) The question whether any, and if so what, advice was tendered by Ministers to the Governor shall not be inquired into in any court","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

  • Size: 999 training samples
  • Columns: sentence_0, sentence_1, and label
  • Approximate statistics based on the first 999 samples:
    sentence_0 sentence_1 label
    type string string float
    details
    • min: 7 tokens
    • mean: 13.33 tokens
    • max: 100 tokens
    • min: 3 tokens
    • mean: 210.82 tokens
    • max: 512 tokens
    • min: 1.0
    • mean: 1.0
    • max: 1.0
  • Samples:
    sentence_0 sentence_1 label
    What can I do if I disagree with the amount of outstanding demand? ​​You can choose ‘Disagree with Demand (Either in Full or Part)’. After you select the option, you need to select from the list of reasons due to which you disagree with the amount of demand. After selecting the relevant option from the list, you need to provide details for each reason before submitting the response. If you partially disagree with the demand, you should pay the undisputed portion of the demand (i.e. with which you agree).​​ 1.0
    Article 48A of Indian Constitution Protection and improvement of environment and safeguarding of forests and wild life The State shall endeavour to protect and improve the environment and to safeguard the forests and wild life of the country"
    Article 49 of Indian Constitution,"Protection of monuments and places and objects of national importance It shall be the obligation of the State to protect every monument or place or object of artistic or historic interests, declared by or under law made by Parliament to be of national importance, from spoliation, disfigurement, destruction, removal, disposal or export, as the case may be","Below is an instruction that describes a task or a question. Write a response that appropriately completes the request.
    1.0
    Article 165 of Indian Constitution Advocate General for the State
    (1) The Governor of each State shall appoint a person who is qualified to be appointed a Judge of a High Court to be Advocate General for the State
    (2) It shall be the duty of the Advocate General to give advice to the Government of the State upon such legal matters, and to perform such other duties of a legal character, as may from time to time be referred or assigned to him by the Governor, and to discharge the functions conferred on him by or under this Constitution or any other law for the time being in force
    (3) The Advocate General shall hold office during the pleasure of the Governor, and shall receive such remuneration as the Governor may determine Conduct of Government Business"
    Article 166 of Indian Constitution,"Conduct of business of the Government of a State
    (1) All executive action of the Government of a State shall be expressed to be taken in the name of the Governor
    (2) Orders and other instruments made and executed in the name of the Gove...
    1.0
  • Loss: CosineSimilarityLoss with these parameters:
    {
        "loss_fct": "torch.nn.modules.loss.MSELoss"
    }
    

Training Hyperparameters

Non-Default Hyperparameters

  • num_train_epochs: 0.1
  • multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand
  • overwrite_output_dir: False
  • do_predict: False
  • eval_strategy: no
  • prediction_loss_only: True
  • per_device_train_batch_size: 8
  • per_device_eval_batch_size: 8
  • per_gpu_train_batch_size: None
  • per_gpu_eval_batch_size: None
  • gradient_accumulation_steps: 1
  • eval_accumulation_steps: None
  • torch_empty_cache_steps: None
  • learning_rate: 5e-05
  • weight_decay: 0.0
  • adam_beta1: 0.9
  • adam_beta2: 0.999
  • adam_epsilon: 1e-08
  • max_grad_norm: 1
  • num_train_epochs: 0.1
  • max_steps: -1
  • lr_scheduler_type: linear
  • lr_scheduler_kwargs: {}
  • warmup_ratio: 0.0
  • warmup_steps: 0
  • log_level: passive
  • log_level_replica: warning
  • log_on_each_node: True
  • logging_nan_inf_filter: True
  • save_safetensors: True
  • save_on_each_node: False
  • save_only_model: False
  • restore_callback_states_from_checkpoint: False
  • no_cuda: False
  • use_cpu: False
  • use_mps_device: False
  • seed: 42
  • data_seed: None
  • jit_mode_eval: False
  • use_ipex: False
  • bf16: False
  • fp16: False
  • fp16_opt_level: O1
  • half_precision_backend: auto
  • bf16_full_eval: False
  • fp16_full_eval: False
  • tf32: None
  • local_rank: 0
  • ddp_backend: None
  • tpu_num_cores: None
  • tpu_metrics_debug: False
  • debug: []
  • dataloader_drop_last: False
  • dataloader_num_workers: 0
  • dataloader_prefetch_factor: None
  • past_index: -1
  • disable_tqdm: False
  • remove_unused_columns: True
  • label_names: None
  • load_best_model_at_end: False
  • ignore_data_skip: False
  • fsdp: []
  • fsdp_min_num_params: 0
  • fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
  • tp_size: 0
  • fsdp_transformer_layer_cls_to_wrap: None
  • accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
  • deepspeed: None
  • label_smoothing_factor: 0.0
  • optim: adamw_torch
  • optim_args: None
  • adafactor: False
  • group_by_length: False
  • length_column_name: length
  • ddp_find_unused_parameters: None
  • ddp_bucket_cap_mb: None
  • ddp_broadcast_buffers: False
  • dataloader_pin_memory: True
  • dataloader_persistent_workers: False
  • skip_memory_metrics: True
  • use_legacy_prediction_loop: False
  • push_to_hub: False
  • resume_from_checkpoint: None
  • hub_model_id: None
  • hub_strategy: every_save
  • hub_private_repo: None
  • hub_always_push: False
  • gradient_checkpointing: False
  • gradient_checkpointing_kwargs: None
  • include_inputs_for_metrics: False
  • include_for_metrics: []
  • eval_do_concat_batches: True
  • fp16_backend: auto
  • push_to_hub_model_id: None
  • push_to_hub_organization: None
  • mp_parameters:
  • auto_find_batch_size: False
  • full_determinism: False
  • torchdynamo: None
  • ray_scope: last
  • ddp_timeout: 1800
  • torch_compile: False
  • torch_compile_backend: None
  • torch_compile_mode: None
  • include_tokens_per_second: False
  • include_num_input_tokens_seen: False
  • neftune_noise_alpha: None
  • optim_target_modules: None
  • batch_eval_metrics: False
  • eval_on_start: False
  • use_liger_kernel: False
  • eval_use_gather_object: False
  • average_tokens_across_devices: False
  • prompts: None
  • batch_sampler: batch_sampler
  • multi_dataset_batch_sampler: round_robin

Framework Versions

  • Python: 3.11.12
  • Sentence Transformers: 3.4.1
  • Transformers: 4.51.3
  • PyTorch: 2.6.0+cu124
  • Accelerate: 1.6.0
  • Datasets: 3.6.0
  • Tokenizers: 0.21.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}