Add new CrossEncoder model

Browse files

Files changed (6) hide show

README.md +605 -0
config.json +57 -0
model.safetensors +3 -0
special_tokens_map.json +37 -0
tokenizer.json +0 -0
tokenizer_config.json +945 -0

README.md ADDED Viewed

	@@ -0,0 +1,605 @@

+---
+language:
+- en
+license: apache-2.0
+tags:
+- sentence-transformers
+- cross-encoder
+- generated_from_trainer
+- dataset_size:400343
+- loss:BinaryCrossEntropyLoss
+base_model: answerdotai/ModernBERT-base
+pipeline_tag: text-ranking
+library_name: sentence-transformers
+metrics:
+- map
+- mrr@10
+- ndcg@10
+model-index:
+- name: ModernBERT-base trained on TriviaQA
+  results:
+  - task:
+      type: cross-encoder-reranking
+      name: Cross Encoder Reranking
+    dataset:
+      name: trivia qa dev
+      type: trivia-qa-dev
+    metrics:
+    - type: map
+      value: 0.6543
+      name: Map
+    - type: mrr@10
+      value: 0.6531
+      name: Mrr@10
+    - type: ndcg@10
+      value: 0.6929
+      name: Ndcg@10
+  - task:
+      type: cross-encoder-reranking
+      name: Cross Encoder Reranking
+    dataset:
+      name: NanoMSMARCO R100
+      type: NanoMSMARCO_R100
+    metrics:
+    - type: map
+      value: 0.4994
+      name: Map
+    - type: mrr@10
+      value: 0.4896
+      name: Mrr@10
+    - type: ndcg@10
+      value: 0.5548
+      name: Ndcg@10
+  - task:
+      type: cross-encoder-reranking
+      name: Cross Encoder Reranking
+    dataset:
+      name: NanoNFCorpus R100
+      type: NanoNFCorpus_R100
+    metrics:
+    - type: map
+      value: 0.313
+      name: Map
+    - type: mrr@10
+      value: 0.4962
+      name: Mrr@10
+    - type: ndcg@10
+      value: 0.316
+      name: Ndcg@10
+  - task:
+      type: cross-encoder-reranking
+      name: Cross Encoder Reranking
+    dataset:
+      name: NanoNQ R100
+      type: NanoNQ_R100
+    metrics:
+    - type: map
+      value: 0.4055
+      name: Map
+    - type: mrr@10
+      value: 0.4172
+      name: Mrr@10
+    - type: ndcg@10
+      value: 0.4755
+      name: Ndcg@10
+  - task:
+      type: cross-encoder-nano-beir
+      name: Cross Encoder Nano BEIR
+    dataset:
+      name: NanoBEIR R100 mean
+      type: NanoBEIR_R100_mean
+    metrics:
+    - type: map
+      value: 0.406
+      name: Map
+    - type: mrr@10
+      value: 0.4676
+      name: Mrr@10
+    - type: ndcg@10
+      value: 0.4488
+      name: Ndcg@10
+---
+# ModernBERT-base trained on TriviaQA
+This is a [Cross Encoder](https://www.sbert.net/docs/cross_encoder/usage/usage.html) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) using the [sentence-transformers](https://www.SBERT.net) library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.
+## Model Details
+### Model Description
+- **Model Type:** Cross Encoder
+- **Base model:** [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) <!-- at revision 8949b909ec900327062f0ebf497f51aef5e6f0c8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Number of Output Labels:** 1 label
+<!-- - **Training Dataset:** Unknown -->
+- **Language:** en
+- **License:** apache-2.0
+### Model Sources
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Documentation:** [Cross Encoder Documentation](https://www.sbert.net/docs/cross_encoder/usage/usage.html)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Cross Encoders on Hugging Face](https://huggingface.co/models?library=sentence-transformers&other=cross-encoder)
+## Usage
+### Direct Usage (Sentence Transformers)
+First install the Sentence Transformers library:
+```bash
+pip install -U sentence-transformers
+```
+Then you can load this model and run inference.
+```python
+from sentence_transformers import CrossEncoder
+# Download from the 🤗 Hub
+model = CrossEncoder("tomaarsen/reranker-ModernBERT-base-trivia-qa-bce")
+# Get scores for pairs of texts
+pairs = [
+    ['In human anatomy, in which part of the body is the buccinator muscle?', "Buccinator Origin, Function & Anatomy | Body Maps Your message has been sent. OK We're sorry, an error occurred. We are unable to collect your feedback at this time. However, your feedback is important to us. Please try again later. Close Buccinator The buccinator muscle is the major facial muscle underlying the cheek. It holds the cheek to the teeth and assists with chewing. The buccinator muscle is served by the buccal branch of cranial nerve VII, also known as the facial nerve. The buccinator is one of the first muscles that a human can control; the sucking reflex of a baby depends on it. Smiling, chewing, and whistling are all dependent upon it, and speech would be difficult and slurred without its proper function. If the facial nerve is impaired, as in Bells Palsy or by a stroke, the buccinator is often paralyzed, thus making all functions dependent upon it difficult or impossible. The buccinator muscle and its proper function are of special interest to speech therapists. Because it is the muscle that spreads the mouth wide, bilabial fricative sounds — not used in English but used for Spanish [b] and [v] sounds — and certain sounds that require the mouth to be wider — like the [i] and [e] sounds — are impaired when the buccinator does not work properly. The buccinator muscle also controls the amount of open space in the mouth, affecting many other vocal factors like tone and echo."],
+    ['In human anatomy, in which part of the body is the buccinator muscle?', "The Human Body Parts The Human Body: Body Parts The human body is the entire structure of a human organism, and consists of a head, neck, torso, two arms and two legs. By the time the human reaches adulthood, the body consists of close to 10 trillion cells, the basic unit of life. Groups of cells combine and work in tandem to form tissue, which combines to form organs, which work together to form organ systems. Superficial anatomy or surface anatomy is important in human anatomy being the study of anatomical landmarks that can be readily identified from the contours or other reference points on the surface of the body. With knowledge of superficial anatomy, physicians gauge the position and anatomy of the associated deeper structures. Common names of well known parts of the human body, from top to bottom: Head - Forehead - Jaw - Cheek - Chin Neck - Shoulders Arm - Elbow - Wrist - Hand - Fingers - Thumb Spine - Chest - Thorax Abdomen - Groin Hip - Buttocks - Leg - Thigh - Knee - Calf - Heel - Ankle - Foot - Toes The eye, ear, nose, mouth, teeth, tongue, throat, adam's apple, breast, penis, scrotum, clitoris, vulva, navel are also superficial structures. The Human Body Organs : In biology and anatomy, an organ is a tissue that performs a specific function or group of functions within an organism.. more » Systems : The organ systems of the body include the musculoskeletal system, nervous system, digestive system... more » Skeleton : The average adult human skeleton has around 206 bones. These bones meet at joints, the majority of which are ... more » Muscles : Muscle is the contractile tissue of the body and is derived from the mesodermal layer of embryonic more » Bones : Bones are rigid organs that form part of the endoskeleton of human body. They function to move, support, and protect... more »"],
+    ['In human anatomy, in which part of the body is the buccinator muscle?', "Facts About Massage and the Human Body Facts About Massage and the Human Body Facts About Massage and the Human Body \xa0 Facts About Massage and the Human Body Spinal cord: 1.\xa0How many pairs of cervical nerves are there? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa08 2.\xa0 How many total spinal nerves are there? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa062 3.Wich of the following structures is known as the “horse’s tail”? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Cauda equina 4.\xa0\xa0The length of the average adult spinal cord is: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 16 – 18 inches 5.\xa0\xa0The largest nerve in the body is: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Sciatic 6.\xa0 Carpal tunnel syndrome results from damage to what nerve? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Median nerve 7.\xa0The two divisions of the sciatic nerve are: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Tibial and common Peroneal nerve 8.\xa0\xa0What nerve innervates the diaphragm?\xa0 From which plexus does it arise? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Phrenic nerve; cervical plexus 9.\xa0 Damage to the cervical plexus may cause: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Respiratory arrest 10.\xa0\xa0Which plexus supplies the buttock muscles? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Sacral plexes What muscles make up the quadriceps femoris? Vastus medialis, vastus intermedius, vastus lateralis, and rectus femoris\xa0\xa0\xa0\xa0 How many intermediate (midpalmar) intrinsic muscles of the hand, which act on all the digits except for the thumb, are there? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 11 Which of the following muscles has an action of flexing and rotating the neck and assists in inspiration? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Anterior scalene Runner’s knee” is more technically know as: Patellofemoral stress syndrome The muscle whose action makes you smile is:\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0\xa0 Zygomaticus major The erector spinae is composed of which muscle groups? \xa0\xa0\xa0\xa0\xa0\xa0 Longissmus, iliocostalis, and spinalis Which of the following muscles aids in inspiration? \xa0\xa0\xa0\xa0\xa0\xa0 External intercostal\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0 8.\xa0\xa0 Which muscle is considered to be the “chewing” muscle? \xa0\xa0\xa0\xa0\xa0\xa0 Masseter .\xa0The calcaneal tendon is able to withstand a 1000 pound force without tearing Which of the following muscles directly connects the trunk to the upper extremity? \xa0\xa0\xa0\xa0\xa0\xa0\xa0Pectoralis major and latissimus dorsi \xa0\xa0\xa0\xa0\xa0 11. What is the stronges single muscle in the body? \xa0\xa0\xa0\xa0\xa0\xa0 Gluteus maximus 12. The muscles making up the hamstrings are: Semimembranosus, semitendinosus, and biceps femoris \xa0\xa0 13.\xa0 \xa0The strongest tendon in the body is the: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 The Achilles tendon 14.\xa0 As a general rule, the attachment of a muscle tendon to a stationary bone is called the: \xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0Origin 15.\xa0 If someone loses the ability to point with his index finger, you would suspect a problem with:\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Extensor Indicis 16.\xa0 What is the longest muscle in the body? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Sartorius 17.\xa0 The muscles that make up the rotator cuff are:\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Supraspinatus, infraspinatus, teres minor, and\xa0\xa0 subscapularis \xa018. There are actually three types of muscle in the human body, which are skeletal, cardiac, and smooth. The skeletal muscles are, as you would have guessed, are attached to the bones by tendons. The role of these guys is to move the skeleton (i.e. walking, swinging your arms, or turning your head), to help us maintain posture while sitting or standing, and in a general sense, to create force through movement. These muscles can be controlled both consciously and unconsciously, and make up about 42% of the average man's body mass and 36% of the average woman's. 19. The cardiac muscles are found only in the heart (hence the name). Although these muscles resemble skeletal muscles in structure, they operate on a completely involuntary basis, which is why we don't have to command the heart to beat--it just does! And last, but not least, we have the smooth muscles, which are contained mostly in the walls of organs. This type of muscle also moves on an involuntary basis. For instance, when food is pushed along through the intestines, these muscles are working within the intestines and without our conscious effort. 20. Although most of us have heard that the tongue is the strongest muscle in the human body, this is simply not true. 1) Because the human tongue c"],
+    ['In human anatomy, in which part of the body is the buccinator muscle?', 'Anatomy - definition of anatomy by The Free Dictionary Anatomy - definition of anatomy by The Free Dictionary http://www.thefreedictionary.com/anatomy \xa0(ə-năt′ə-mē) n. pl. a·nat·o·mies 1. The bodily structure of a plant or an animal or of any of its parts. 2. The science of the shape and structure of organisms and their parts. 3. A treatise on anatomic science. 4. Dissection of a plant or animal to study the structure, position, and interrelation of its various parts. 5. A skeleton. 6. The human body. 7. A detailed examination or analysis: the anatomy of a crime. [Middle English anatomie, from Late Latin anatomia, from Greek anatomē, dissection : ana-, ana- + tomē, a cutting (from temnein, to cut; see tem- in the Appendix of Indo-European roots).] anatomy 1. (Anatomy) the science concerned with the physical structure of animals and plants 2. (Anatomy) the physical structure of an animal or plant or any of its parts 3. (Anatomy) a book or treatise on this subject 4. (Anatomy) dissection of an animal or plant 5. any detailed analysis: the anatomy of a crime. 6. informal the human body [C14: from Latin anatomia, from Greek anatomē, from anatemnein to cut up, from ana- + temnein to cut] a•nat•o•my 1. the science dealing with the structure of animals and plants. 2. the structure of an animal or plant, or of any of its parts. 3. dissection of all or part of an animal or plant in order to study its structure. 4. Informal. the human body. 5. an analysis or minute examination. [1350–1400; Middle English < Latin anatomia < Greek anatom(ḗ) a cutting up (see ana -, -tome ) + Latin -ia -y 3] a·nat·o·my 1. The structure of an animal or a plant or any of its parts. 2. The scientific study of the shape and structure of living things. anatomical (ăn′ə-tŏm′ĭ-kəl) adjective Anatomy 1. the branch of anatomy that studies muscles and musculature. 2. the muscular makeup of an animal or anatomical unit. — myologic, adj. 1. an account of the structure and function of the lungs. 2. the recording of the activity of the lungs during respiration. — pneumograph, n. — pneumographic, pneumographical, adj. 1. a person who dissects cadavers for the purpose of anatomical demonstration. 2. a person who performs autopsies. — prosectorial, adj. 1. the anatomy of the ligaments of the body. 2. the science or study of ligaments. 1. the dissection of animals other than man. 2. the anatomy of animals. — zootomist, n. — zootomic, zootomical, adj. anatomy Study of the structure of organisms. ThesaurusAntonymsRelated WordsSynonymsLegend: apparatus - (anatomy) a group of body parts that work together to perform a given function; "the breathing apparatus" vallecula , groove - (anatomy) any furrow or channel on a bodily structure or part partition - (anatomy) a structure that separates areas in an organism septum - (anatomy) a dividing partition between two tissues or cavities fissure - (anatomy) a long narrow slit or groove that divides an organ into lobes sulcus - (anatomy) any of the narrow grooves in an organ or tissue especially those that mark the convolutions on the surface of the brain hilum , hilus - (anatomy) a depression or fissure where vessels or nerves or ducts enter a bodily organ; "the hilus of the kidney" cingulum - (anatomy) an encircling structure (as the ridge around the base of a tooth) concha - (anatomy) a structure that resembles a shell in shape radicle - (anatomy) a small structure resembling a rootlet (such as a fibril of a nerve) tube-shaped structure , tube - (anatomy) any hollow cylindrical body structure fundus - (anatomy) the base of a hollow organ or that part of the organ farthest from its opening; "the uterine fundus"; "the fundus of the stomach" punctum - (anatomy) a point or small area meniscus , semilunar cartilage - (anatomy) a disk of cartilage that serves as a cushion between the ends of bones that meet at a joint bodily cavity , cavum , cavity - (anatomy) a natural hollow or sinus within the body diaphragm , midriff - (anatomy) a muscular partition separating the abdominal and thoracic cavities; functions in respiration apophysi'],
+    ['In human anatomy, in which part of the body is the buccinator muscle?', 'Anatomy/Terminology - Wikiversity Anatomy/Terminology Anatomical Position[ edit ] When discussing the anatomy of the human body, it is useful to first define a standard position in which the body will be presented. This standard allows the relative position of parts of the body to be described accurately and with less confusion. Anatomists use the anatomical position . A person in the anatomical position is standing up straight, with arms at the sides and palms facing forwards with the fingers extended. The feet are facing forward, as are the head and eyes (see the figure to the right). The anatomical planes of the body. Planes of the Body[ edit ] Three planes through the body are used to describe the position and orientation of parts of the body. These are: Median or Sagittal plane - This plane runs through the body from the head (cephalic end) to the feet (plantar end). A cut on the sagittal plane of humans creates a right and left bilaterally symmetrical half. Any plane parallel to this through the body is known as a para-sagittal plane. Coronal plane/lateral/frontal - This plane runs through the body, also from the head to the feet, and divides the body into front and rear halves. Transverse plane - This is any plane that runs left to right through the body and divides it into upper and lower sections. Oblique plane - Any plane through the body that is not parallel to one of the former three. Anatomical Terms[ edit ] When discussing anatomy, the following terms are used to describe the relative positions of the parts of the body. When using these terms, it is assumed that the body is in the anatomical position. Lateral - More distant to the body midline. In the anatomical position, the radius is lateral to the ulna. A simpler example is the "thumb" is lateral to the "pinky." Medial - Closer to the midline; on the inner side. The sternum (breast plate) is medial to the clavcle (shoulder bone). Superior - Above, towards the cephalic (head) end. The cranial cavity (head cavity) is superior to the scapula (shoulder blade). Inferior - Below, towards the plantar (foot) end. The patella (knee cap) is inferior to the femur (thigh bone). Anterior - Towards the front of the body. The sternum is anterior to the spine. Also known as ventral, but this term is not as common in human anatomy. Posterior - Towards the rear/backside of the body. The fibula is posterior to the tibia. Also known as dorsal, but this term is not as common. Superficial - Closer to the skin, nearer the body surface. Skin is superficial to the organs. Deep - Further from the body surface. In the limbs, the following terms are also used: Distal - Further from the limb\'s attachment to the trunk (where \'trunk\' refers to the \'torso\' of the body: the body minus the head, kneck, and limbs). proximal - Nearer to the limb\'s attachment to the trunk. The humerous is proximal to the radius. Terms may also be combined to describe more complicated relative positions, for example anterolateral, meaning in front of and more lateral to something. Movement terms[ edit ] All acts of movement are considered to be a mixture or a single contribution of the following movement terms: Flexion - where there is a reduction in the angle between bones or parts of the body. This term applies only to movement along the sagittal or median plane. An example of arms flexing is lifting a dinner plate. When applied to the trunk of the body, this term means bowing forwards. Extension - is the opposite of flexion, and there is an increase in the angle. This term applies only to movement along the sagittal or median plane. With the trunk of the body, this movement is bowing backwards. Adduction - where there is a reduction in the angle between bones or parts of the body. This only applies to movement along the coronal plane. Abduction - the exact opposite, with an increase in the angle. Also only applies to movement along the coronal plane.An example of this is where extending arms outwards as if to fly. Rotation - is rotation of an entire limb laterally (away from the body) or medially (towards'],
+]
+scores = model.predict(pairs)
+print(scores.shape)
+# (5,)
+# Or rank different texts based on similarity to a single text
+ranks = model.rank(
+    'In human anatomy, in which part of the body is the buccinator muscle?',
+    [
+        "Buccinator Origin, Function & Anatomy | Body Maps Your message has been sent. OK We're sorry, an error occurred. We are unable to collect your feedback at this time. However, your feedback is important to us. Please try again later. Close Buccinator The buccinator muscle is the major facial muscle underlying the cheek. It holds the cheek to the teeth and assists with chewing. The buccinator muscle is served by the buccal branch of cranial nerve VII, also known as the facial nerve. The buccinator is one of the first muscles that a human can control; the sucking reflex of a baby depends on it. Smiling, chewing, and whistling are all dependent upon it, and speech would be difficult and slurred without its proper function. If the facial nerve is impaired, as in Bells Palsy or by a stroke, the buccinator is often paralyzed, thus making all functions dependent upon it difficult or impossible. The buccinator muscle and its proper function are of special interest to speech therapists. Because it is the muscle that spreads the mouth wide, bilabial fricative sounds — not used in English but used for Spanish [b] and [v] sounds — and certain sounds that require the mouth to be wider — like the [i] and [e] sounds — are impaired when the buccinator does not work properly. The buccinator muscle also controls the amount of open space in the mouth, affecting many other vocal factors like tone and echo.",
+        "The Human Body Parts The Human Body: Body Parts The human body is the entire structure of a human organism, and consists of a head, neck, torso, two arms and two legs. By the time the human reaches adulthood, the body consists of close to 10 trillion cells, the basic unit of life. Groups of cells combine and work in tandem to form tissue, which combines to form organs, which work together to form organ systems. Superficial anatomy or surface anatomy is important in human anatomy being the study of anatomical landmarks that can be readily identified from the contours or other reference points on the surface of the body. With knowledge of superficial anatomy, physicians gauge the position and anatomy of the associated deeper structures. Common names of well known parts of the human body, from top to bottom: Head - Forehead - Jaw - Cheek - Chin Neck - Shoulders Arm - Elbow - Wrist - Hand - Fingers - Thumb Spine - Chest - Thorax Abdomen - Groin Hip - Buttocks - Leg - Thigh - Knee - Calf - Heel - Ankle - Foot - Toes The eye, ear, nose, mouth, teeth, tongue, throat, adam's apple, breast, penis, scrotum, clitoris, vulva, navel are also superficial structures. The Human Body Organs : In biology and anatomy, an organ is a tissue that performs a specific function or group of functions within an organism.. more » Systems : The organ systems of the body include the musculoskeletal system, nervous system, digestive system... more » Skeleton : The average adult human skeleton has around 206 bones. These bones meet at joints, the majority of which are ... more » Muscles : Muscle is the contractile tissue of the body and is derived from the mesodermal layer of embryonic more » Bones : Bones are rigid organs that form part of the endoskeleton of human body. They function to move, support, and protect... more »",
+        "Facts About Massage and the Human Body Facts About Massage and the Human Body Facts About Massage and the Human Body \xa0 Facts About Massage and the Human Body Spinal cord: 1.\xa0How many pairs of cervical nerves are there? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa08 2.\xa0 How many total spinal nerves are there? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa062 3.Wich of the following structures is known as the “horse’s tail”? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Cauda equina 4.\xa0\xa0The length of the average adult spinal cord is: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 16 – 18 inches 5.\xa0\xa0The largest nerve in the body is: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Sciatic 6.\xa0 Carpal tunnel syndrome results from damage to what nerve? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Median nerve 7.\xa0The two divisions of the sciatic nerve are: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Tibial and common Peroneal nerve 8.\xa0\xa0What nerve innervates the diaphragm?\xa0 From which plexus does it arise? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Phrenic nerve; cervical plexus 9.\xa0 Damage to the cervical plexus may cause: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Respiratory arrest 10.\xa0\xa0Which plexus supplies the buttock muscles? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Sacral plexes What muscles make up the quadriceps femoris? Vastus medialis, vastus intermedius, vastus lateralis, and rectus femoris\xa0\xa0\xa0\xa0 How many intermediate (midpalmar) intrinsic muscles of the hand, which act on all the digits except for the thumb, are there? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 11 Which of the following muscles has an action of flexing and rotating the neck and assists in inspiration? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Anterior scalene Runner’s knee” is more technically know as: Patellofemoral stress syndrome The muscle whose action makes you smile is:\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0\xa0 Zygomaticus major The erector spinae is composed of which muscle groups? \xa0\xa0\xa0\xa0\xa0\xa0 Longissmus, iliocostalis, and spinalis Which of the following muscles aids in inspiration? \xa0\xa0\xa0\xa0\xa0\xa0 External intercostal\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0 8.\xa0\xa0 Which muscle is considered to be the “chewing” muscle? \xa0\xa0\xa0\xa0\xa0\xa0 Masseter .\xa0The calcaneal tendon is able to withstand a 1000 pound force without tearing Which of the following muscles directly connects the trunk to the upper extremity? \xa0\xa0\xa0\xa0\xa0\xa0\xa0Pectoralis major and latissimus dorsi \xa0\xa0\xa0\xa0\xa0 11. What is the stronges single muscle in the body? \xa0\xa0\xa0\xa0\xa0\xa0 Gluteus maximus 12. The muscles making up the hamstrings are: Semimembranosus, semitendinosus, and biceps femoris \xa0\xa0 13.\xa0 \xa0The strongest tendon in the body is the: \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 The Achilles tendon 14.\xa0 As a general rule, the attachment of a muscle tendon to a stationary bone is called the: \xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0Origin 15.\xa0 If someone loses the ability to point with his index finger, you would suspect a problem with:\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Extensor Indicis 16.\xa0 What is the longest muscle in the body? \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Sartorius 17.\xa0 The muscles that make up the rotator cuff are:\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 \xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0\xa0 Supraspinatus, infraspinatus, teres minor, and\xa0\xa0 subscapularis \xa018. There are actually three types of muscle in the human body, which are skeletal, cardiac, and smooth. The skeletal muscles are, as you would have guessed, are attached to the bones by tendons. The role of these guys is to move the skeleton (i.e. walking, swinging your arms, or turning your head), to help us maintain posture while sitting or standing, and in a general sense, to create force through movement. These muscles can be controlled both consciously and unconsciously, and make up about 42% of the average man's body mass and 36% of the average woman's. 19. The cardiac muscles are found only in the heart (hence the name). Although these muscles resemble skeletal muscles in structure, they operate on a completely involuntary basis, which is why we don't have to command the heart to beat--it just does! And last, but not least, we have the smooth muscles, which are contained mostly in the walls of organs. This type of muscle also moves on an involuntary basis. For instance, when food is pushed along through the intestines, these muscles are working within the intestines and without our conscious effort. 20. Although most of us have heard that the tongue is the strongest muscle in the human body, this is simply not true. 1) Because the human tongue c",
+        'Anatomy - definition of anatomy by The Free Dictionary Anatomy - definition of anatomy by The Free Dictionary http://www.thefreedictionary.com/anatomy \xa0(ə-năt′ə-mē) n. pl. a·nat·o·mies 1. The bodily structure of a plant or an animal or of any of its parts. 2. The science of the shape and structure of organisms and their parts. 3. A treatise on anatomic science. 4. Dissection of a plant or animal to study the structure, position, and interrelation of its various parts. 5. A skeleton. 6. The human body. 7. A detailed examination or analysis: the anatomy of a crime. [Middle English anatomie, from Late Latin anatomia, from Greek anatomē, dissection : ana-, ana- + tomē, a cutting (from temnein, to cut; see tem- in the Appendix of Indo-European roots).] anatomy 1. (Anatomy) the science concerned with the physical structure of animals and plants 2. (Anatomy) the physical structure of an animal or plant or any of its parts 3. (Anatomy) a book or treatise on this subject 4. (Anatomy) dissection of an animal or plant 5. any detailed analysis: the anatomy of a crime. 6. informal the human body [C14: from Latin anatomia, from Greek anatomē, from anatemnein to cut up, from ana- + temnein to cut] a•nat•o•my 1. the science dealing with the structure of animals and plants. 2. the structure of an animal or plant, or of any of its parts. 3. dissection of all or part of an animal or plant in order to study its structure. 4. Informal. the human body. 5. an analysis or minute examination. [1350–1400; Middle English < Latin anatomia < Greek anatom(ḗ) a cutting up (see ana -, -tome ) + Latin -ia -y 3] a·nat·o·my 1. The structure of an animal or a plant or any of its parts. 2. The scientific study of the shape and structure of living things. anatomical (ăn′ə-tŏm′ĭ-kəl) adjective Anatomy 1. the branch of anatomy that studies muscles and musculature. 2. the muscular makeup of an animal or anatomical unit. — myologic, adj. 1. an account of the structure and function of the lungs. 2. the recording of the activity of the lungs during respiration. — pneumograph, n. — pneumographic, pneumographical, adj. 1. a person who dissects cadavers for the purpose of anatomical demonstration. 2. a person who performs autopsies. — prosectorial, adj. 1. the anatomy of the ligaments of the body. 2. the science or study of ligaments. 1. the dissection of animals other than man. 2. the anatomy of animals. — zootomist, n. — zootomic, zootomical, adj. anatomy Study of the structure of organisms. ThesaurusAntonymsRelated WordsSynonymsLegend: apparatus - (anatomy) a group of body parts that work together to perform a given function; "the breathing apparatus" vallecula , groove - (anatomy) any furrow or channel on a bodily structure or part partition - (anatomy) a structure that separates areas in an organism septum - (anatomy) a dividing partition between two tissues or cavities fissure - (anatomy) a long narrow slit or groove that divides an organ into lobes sulcus - (anatomy) any of the narrow grooves in an organ or tissue especially those that mark the convolutions on the surface of the brain hilum , hilus - (anatomy) a depression or fissure where vessels or nerves or ducts enter a bodily organ; "the hilus of the kidney" cingulum - (anatomy) an encircling structure (as the ridge around the base of a tooth) concha - (anatomy) a structure that resembles a shell in shape radicle - (anatomy) a small structure resembling a rootlet (such as a fibril of a nerve) tube-shaped structure , tube - (anatomy) any hollow cylindrical body structure fundus - (anatomy) the base of a hollow organ or that part of the organ farthest from its opening; "the uterine fundus"; "the fundus of the stomach" punctum - (anatomy) a point or small area meniscus , semilunar cartilage - (anatomy) a disk of cartilage that serves as a cushion between the ends of bones that meet at a joint bodily cavity , cavum , cavity - (anatomy) a natural hollow or sinus within the body diaphragm , midriff - (anatomy) a muscular partition separating the abdominal and thoracic cavities; functions in respiration apophysi',
+        'Anatomy/Terminology - Wikiversity Anatomy/Terminology Anatomical Position[ edit ] When discussing the anatomy of the human body, it is useful to first define a standard position in which the body will be presented. This standard allows the relative position of parts of the body to be described accurately and with less confusion. Anatomists use the anatomical position . A person in the anatomical position is standing up straight, with arms at the sides and palms facing forwards with the fingers extended. The feet are facing forward, as are the head and eyes (see the figure to the right). The anatomical planes of the body. Planes of the Body[ edit ] Three planes through the body are used to describe the position and orientation of parts of the body. These are: Median or Sagittal plane - This plane runs through the body from the head (cephalic end) to the feet (plantar end). A cut on the sagittal plane of humans creates a right and left bilaterally symmetrical half. Any plane parallel to this through the body is known as a para-sagittal plane. Coronal plane/lateral/frontal - This plane runs through the body, also from the head to the feet, and divides the body into front and rear halves. Transverse plane - This is any plane that runs left to right through the body and divides it into upper and lower sections. Oblique plane - Any plane through the body that is not parallel to one of the former three. Anatomical Terms[ edit ] When discussing anatomy, the following terms are used to describe the relative positions of the parts of the body. When using these terms, it is assumed that the body is in the anatomical position. Lateral - More distant to the body midline. In the anatomical position, the radius is lateral to the ulna. A simpler example is the "thumb" is lateral to the "pinky." Medial - Closer to the midline; on the inner side. The sternum (breast plate) is medial to the clavcle (shoulder bone). Superior - Above, towards the cephalic (head) end. The cranial cavity (head cavity) is superior to the scapula (shoulder blade). Inferior - Below, towards the plantar (foot) end. The patella (knee cap) is inferior to the femur (thigh bone). Anterior - Towards the front of the body. The sternum is anterior to the spine. Also known as ventral, but this term is not as common in human anatomy. Posterior - Towards the rear/backside of the body. The fibula is posterior to the tibia. Also known as dorsal, but this term is not as common. Superficial - Closer to the skin, nearer the body surface. Skin is superficial to the organs. Deep - Further from the body surface. In the limbs, the following terms are also used: Distal - Further from the limb\'s attachment to the trunk (where \'trunk\' refers to the \'torso\' of the body: the body minus the head, kneck, and limbs). proximal - Nearer to the limb\'s attachment to the trunk. The humerous is proximal to the radius. Terms may also be combined to describe more complicated relative positions, for example anterolateral, meaning in front of and more lateral to something. Movement terms[ edit ] All acts of movement are considered to be a mixture or a single contribution of the following movement terms: Flexion - where there is a reduction in the angle between bones or parts of the body. This term applies only to movement along the sagittal or median plane. An example of arms flexing is lifting a dinner plate. When applied to the trunk of the body, this term means bowing forwards. Extension - is the opposite of flexion, and there is an increase in the angle. This term applies only to movement along the sagittal or median plane. With the trunk of the body, this movement is bowing backwards. Adduction - where there is a reduction in the angle between bones or parts of the body. This only applies to movement along the coronal plane. Abduction - the exact opposite, with an increase in the angle. Also only applies to movement along the coronal plane.An example of this is where extending arms outwards as if to fly. Rotation - is rotation of an entire limb laterally (away from the body) or medially (towards',
+    ]
+)
+# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]
+```
+<!--
+### Direct Usage (Transformers)
+<details><summary>Click to see the direct usage in Transformers</summary>
+</details>
+-->
+<!--
+### Downstream Usage (Sentence Transformers)
+You can finetune this model on your own dataset.
+<details><summary>Click to expand</summary>
+</details>
+-->
+<!--
+### Out-of-Scope Use
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+## Evaluation
+### Metrics
+#### Cross Encoder Reranking
+* Dataset: `trivia-qa-dev`
+* Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
+  ```json
+  {
+      "at_k": 10,
+      "always_rerank_positives": false
+  }
+  ```
+| Metric      | Value                |
+|:------------|:---------------------|
+| map         | 0.6543 (+0.1851)     |
+| mrr@10      | 0.6531 (+0.1912)     |
+| **ndcg@10** | **0.6929 (+0.1698)** |
+#### Cross Encoder Reranking
+* Datasets: `NanoMSMARCO_R100`, `NanoNFCorpus_R100` and `NanoNQ_R100`
+* Evaluated with [<code>CrossEncoderRerankingEvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderRerankingEvaluator) with these parameters:
+  ```json
+  {
+      "at_k": 10,
+      "always_rerank_positives": true
+  }
+  ```
+| Metric      | NanoMSMARCO_R100     | NanoNFCorpus_R100    | NanoNQ_R100          |
+|:------------|:---------------------|:---------------------|:---------------------|
+| map         | 0.4994 (+0.0099)     | 0.3130 (+0.0520)     | 0.4055 (-0.0141)     |
+| mrr@10      | 0.4896 (+0.0121)     | 0.4962 (-0.0036)     | 0.4172 (-0.0095)     |
+| **ndcg@10** | **0.5548 (+0.0144)** | **0.3160 (-0.0091)** | **0.4755 (-0.0251)** |
+#### Cross Encoder Nano BEIR
+* Dataset: `NanoBEIR_R100_mean`
+* Evaluated with [<code>CrossEncoderNanoBEIREvaluator</code>](https://sbert.net/docs/package_reference/cross_encoder/evaluation.html#sentence_transformers.cross_encoder.evaluation.CrossEncoderNanoBEIREvaluator) with these parameters:
+  ```json
+  {
+      "dataset_names": [
+          "msmarco",
+          "nfcorpus",
+          "nq"
+      ],
+      "rerank_k": 100,
+      "at_k": 10,
+      "always_rerank_positives": true
+  }
+  ```
+| Metric      | Value                |
+|:------------|:---------------------|
+| map         | 0.4060 (+0.0159)     |
+| mrr@10      | 0.4676 (-0.0004)     |
+| **ndcg@10** | **0.4488 (-0.0066)** |
+<!--
+## Bias, Risks and Limitations
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+<!--
+### Recommendations
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+## Training Details
+### Training Dataset
+#### Unnamed Dataset
+* Size: 400,343 training samples
+* Columns: <code>query</code>, <code>answer</code>, and <code>label</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | query                                                                                           | answer                                                                                             | label                                           |
+  |:--------|:------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------|:------------------------------------------------|
+  | type    | string                                                                                          | string                                                                                             | int                                             |
+  | details | <ul><li>min: 22 characters</li><li>mean: 71.59 characters</li><li>max: 232 characters</li></ul> | <ul><li>min: 75 characters</li><li>mean: 3231.36 characters</li><li>max: 4096 characters</li></ul> | <ul><li>0: ~82.10%</li><li>1: ~17.90%</li></ul> |
+* Samples:
+  | query                                                                              | answer                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | label          |
+  |:-----------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------|
+  | <code>In human anatomy, in which part of the body is the buccinator muscle?</code> | <code>Buccinator Origin, Function & Anatomy | Body Maps Your message has been sent. OK We're sorry, an error occurred. We are unable to collect your feedback at this time. However, your feedback is important to us. Please try again later. Close Buccinator The buccinator muscle is the major facial muscle underlying the cheek. It holds the cheek to the teeth and assists with chewing. The buccinator muscle is served by the buccal branch of cranial nerve VII, also known as the facial nerve. The buccinator is one of the first muscles that a human can control; the sucking reflex of a baby depends on it. Smiling, chewing, and whistling are all dependent upon it, and speech would be difficult and slurred without its proper function. If the facial nerve is impaired, as in Bells Palsy or by a stroke, the buccinator is often paralyzed, thus making all functions dependent upon it difficult or impossible. The buccinator muscle and its proper function are of special interest to speech therapists. Because ...</code> | <code>1</code> |
+  | <code>In human anatomy, in which part of the body is the buccinator muscle?</code> | <code>The Human Body Parts The Human Body: Body Parts The human body is the entire structure of a human organism, and consists of a head, neck, torso, two arms and two legs. By the time the human reaches adulthood, the body consists of close to 10 trillion cells, the basic unit of life. Groups of cells combine and work in tandem to form tissue, which combines to form organs, which work together to form organ systems. Superficial anatomy or surface anatomy is important in human anatomy being the study of anatomical landmarks that can be readily identified from the contours or other reference points on the surface of the body. With knowledge of superficial anatomy, physicians gauge the position and anatomy of the associated deeper structures. Common names of well known parts of the human body, from top to bottom: Head - Forehead - Jaw - Cheek - Chin Neck - Shoulders Arm - Elbow - Wrist - Hand - Fingers - Thumb Spine - Chest - Thorax Abdomen - Groin Hip - Buttocks - Leg - Thigh - Knee - Calf - ...</code> | <code>0</code> |
+  | <code>In human anatomy, in which part of the body is the buccinator muscle?</code> | <code>Facts About Massage and the Human Body Facts About Massage and the Human Body Facts About Massage and the Human Body   Facts About Massage and the Human Body Spinal cord: 1. How many pairs of cervical nerves are there?                     8 2.  How many total spinal nerves are there?                     62 3.Wich of the following structures is known as the “horse’s tail”?                    Cauda equina 4.  The length of the average adult spinal cord is:                    16 – 18 inches 5.  The largest nerve in the body is:                    Sciatic 6.  Carpal tunnel syndrome results from damage to what nerve?                   Median nerve 7. The two divisions of the sciatic nerve are:                   Tibial and common Peroneal nerve 8.  What nerve innervates the diaphragm?  From which plexus does it arise?                   Phrenic nerve; cervical plexus 9.  Damage to the cervical plexus may cause:                   Respiratory arrest 10.  Which plexus supplies the buttock muscle...</code> | <code>0</code> |
+* Loss: [<code>BinaryCrossEntropyLoss</code>](https://sbert.net/docs/package_reference/cross_encoder/losses.html#binarycrossentropyloss) with these parameters:
+  ```json
+  {
+      "activation_fn": "torch.nn.modules.linear.Identity",
+      "pos_weight": 5
+  }
+  ```
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+- `eval_strategy`: steps
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 1
+- `warmup_ratio`: 0.1
+- `seed`: 12
+- `bf16`: True
+- `dataloader_num_workers`: 4
+- `load_best_model_at_end`: True
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: steps
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 16
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 1
+- `max_steps`: -1
+- `lr_scheduler_type`: linear
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 12
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 4
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`:
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `dispatch_batches`: None
+- `split_batches`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: batch_sampler
+- `multi_dataset_batch_sampler`: proportional
+</details>
+### Training Logs
+<details><summary>Click to expand</summary>
+| Epoch      | Step      | Training Loss | trivia-qa-dev_ndcg@10 | NanoMSMARCO_R100_ndcg@10 | NanoNFCorpus_R100_ndcg@10 | NanoNQ_R100_ndcg@10  | NanoBEIR_R100_mean_ndcg@10 |
+|:----------:|:---------:|:-------------:|:---------------------:|:------------------------:|:-------------------------:|:--------------------:|:--------------------------:|
+| -1         | -1        | -             | 0.1318 (-0.3914)      | 0.0126 (-0.5278)         | 0.2498 (-0.0752)          | 0.0467 (-0.4539)     | 0.1031 (-0.3523)           |
+| 0.0000     | 1         | 1.3271        | -                     | -                        | -                         | -                    | -                          |
+| 0.0080     | 200       | 1.2223        | -                     | -                        | -                         | -                    | -                          |
+| 0.0160     | 400       | 1.2099        | -                     | -                        | -                         | -                    | -                          |
+| 0.0240     | 600       | 1.1758        | -                     | -                        | -                         | -                    | -                          |
+| 0.0320     | 800       | 1.1902        | -                     | -                        | -                         | -                    | -                          |
+| 0.0400     | 1000      | 1.1393        | 0.2318 (-0.2914)      | 0.0432 (-0.4972)         | 0.2489 (-0.0761)          | 0.0551 (-0.4455)     | 0.1157 (-0.3396)           |
+| 0.0480     | 1200      | 1.1652        | -                     | -                        | -                         | -                    | -                          |
+| 0.0560     | 1400      | 1.1082        | -                     | -                        | -                         | -                    | -                          |
+| 0.0639     | 1600      | 1.0283        | -                     | -                        | -                         | -                    | -                          |
+| 0.0719     | 1800      | 1.0013        | -                     | -                        | -                         | -                    | -                          |
+| 0.0799     | 2000      | 1.0483        | 0.5307 (+0.0075)      | 0.1720 (-0.3684)         | 0.2676 (-0.0574)          | 0.1383 (-0.3623)     | 0.1926 (-0.2627)           |
+| 0.0879     | 2200      | 0.966         | -                     | -                        | -                         | -                    | -                          |
+| 0.0959     | 2400      | 0.9216        | -                     | -                        | -                         | -                    | -                          |
+| 0.1039     | 2600      | 0.9412        | -                     | -                        | -                         | -                    | -                          |
+| 0.1119     | 2800      | 0.9191        | -                     | -                        | -                         | -                    | -                          |
+| 0.1199     | 3000      | 0.8675        | 0.6463 (+0.1232)      | 0.4302 (-0.1102)         | 0.3536 (+0.0285)          | 0.3317 (-0.1690)     | 0.3718 (-0.0835)           |
+| 0.1279     | 3200      | 0.8728        | -                     | -                        | -                         | -                    | -                          |
+| 0.1359     | 3400      | 0.9244        | -                     | -                        | -                         | -                    | -                          |
+| 0.1439     | 3600      | 0.9222        | -                     | -                        | -                         | -                    | -                          |
+| 0.1519     | 3800      | 0.8791        | -                     | -                        | -                         | -                    | -                          |
+| 0.1599     | 4000      | 0.8723        | 0.6443 (+0.1211)      | 0.4147 (-0.1257)         | 0.3148 (-0.0102)          | 0.3936 (-0.1071)     | 0.3744 (-0.0810)           |
+| 0.1679     | 4200      | 0.8258        | -                     | -                        | -                         | -                    | -                          |
+| 0.1758     | 4400      | 0.8285        | -                     | -                        | -                         | -                    | -                          |
+| 0.1838     | 4600      | 0.8467        | -                     | -                        | -                         | -                    | -                          |
+| 0.1918     | 4800      | 0.7799        | -                     | -                        | -                         | -                    | -                          |
+| 0.1998     | 5000      | 0.818         | 0.6297 (+0.1065)      | 0.4948 (-0.0456)         | 0.3415 (+0.0165)          | 0.4258 (-0.0749)     | 0.4207 (-0.0347)           |
+| 0.2078     | 5200      | 0.856         | -                     | -                        | -                         | -                    | -                          |
+| 0.2158     | 5400      | 0.8106        | -                     | -                        | -                         | -                    | -                          |
+| 0.2238     | 5600      | 0.777         | -                     | -                        | -                         | -                    | -                          |
+| 0.2318     | 5800      | 0.8114        | -                     | -                        | -                         | -                    | -                          |
+| 0.2398     | 6000      | 0.8141        | 0.6551 (+0.1319)      | 0.4885 (-0.0519)         | 0.3581 (+0.0331)          | 0.4244 (-0.0763)     | 0.4237 (-0.0317)           |
+| 0.2478     | 6200      | 0.7774        | -                     | -                        | -                         | -                    | -                          |
+| 0.2558     | 6400      | 0.7854        | -                     | -                        | -                         | -                    | -                          |
+| 0.2638     | 6600      | 0.8054        | -                     | -                        | -                         | -                    | -                          |
+| 0.2718     | 6800      | 0.7881        | -                     | -                        | -                         | -                    | -                          |
+| 0.2798     | 7000      | 0.7781        | 0.6667 (+0.1436)      | 0.5259 (-0.0145)         | 0.3304 (+0.0053)          | 0.3093 (-0.1914)     | 0.3885 (-0.0668)           |
+| 0.2877     | 7200      | 0.7602        | -                     | -                        | -                         | -                    | -                          |
+| 0.2957     | 7400      | 0.7685        | -                     | -                        | -                         | -                    | -                          |
+| 0.3037     | 7600      | 0.7513        | -                     | -                        | -                         | -                    | -                          |
+| 0.3117     | 7800      | 0.7931        | -                     | -                        | -                         | -                    | -                          |
+| 0.3197     | 8000      | 0.7748        | 0.6727 (+0.1496)      | 0.5589 (+0.0185)         | 0.3294 (+0.0044)          | 0.4668 (-0.0338)     | 0.4517 (-0.0036)           |
+| 0.3277     | 8200      | 0.7644        | -                     | -                        | -                         | -                    | -                          |
+| 0.3357     | 8400      | 0.743         | -                     | -                        | -                         | -                    | -                          |
+| 0.3437     | 8600      | 0.7766        | -                     | -                        | -                         | -                    | -                          |
+| 0.3517     | 8800      | 0.747         | -                     | -                        | -                         | -                    | -                          |
+| 0.3597     | 9000      | 0.7542        | 0.6647 (+0.1415)      | 0.5094 (-0.0311)         | 0.3277 (+0.0026)          | 0.4750 (-0.0256)     | 0.4374 (-0.0180)           |
+| 0.3677     | 9200      | 0.7454        | -                     | -                        | -                         | -                    | -                          |
+| 0.3757     | 9400      | 0.7191        | -                     | -                        | -                         | -                    | -                          |
+| 0.3837     | 9600      | 0.728         | -                     | -                        | -                         | -                    | -                          |
+| 0.3917     | 9800      | 0.7239        | -                     | -                        | -                         | -                    | -                          |
+| 0.3996     | 10000     | 0.6813        | 0.6610 (+0.1378)      | 0.5059 (-0.0346)         | 0.3351 (+0.0101)          | 0.4489 (-0.0517)     | 0.4300 (-0.0254)           |
+| 0.4076     | 10200     | 0.7875        | -                     | -                        | -                         | -                    | -                          |
+| 0.4156     | 10400     | 0.7408        | -                     | -                        | -                         | -                    | -                          |
+| 0.4236     | 10600     | 0.7322        | -                     | -                        | -                         | -                    | -                          |
+| 0.4316     | 10800     | 0.7841        | -                     | -                        | -                         | -                    | -                          |
+| 0.4396     | 11000     | 0.7264        | 0.6491 (+0.1260)      | 0.5050 (-0.0355)         | 0.3321 (+0.0070)          | 0.3930 (-0.1077)     | 0.4100 (-0.0454)           |
+| 0.4476     | 11200     | 0.7011        | -                     | -                        | -                         | -                    | -                          |
+| 0.4556     | 11400     | 0.7747        | -                     | -                        | -                         | -                    | -                          |
+| 0.4636     | 11600     | 0.7052        | -                     | -                        | -                         | -                    | -                          |
+| 0.4716     | 11800     | 0.6655        | -                     | -                        | -                         | -                    | -                          |
+| 0.4796     | 12000     | 0.73          | 0.6669 (+0.1437)      | 0.4888 (-0.0516)         | 0.3073 (-0.0178)          | 0.3785 (-0.1222)     | 0.3915 (-0.0638)           |
+| 0.4876     | 12200     | 0.7504        | -                     | -                        | -                         | -                    | -                          |
+| 0.4956     | 12400     | 0.7495        | -                     | -                        | -                         | -                    | -                          |
+| 0.5036     | 12600     | 0.7094        | -                     | -                        | -                         | -                    | -                          |
+| 0.5115     | 12800     | 0.6755        | -                     | -                        | -                         | -                    | -                          |
+| 0.5195     | 13000     | 0.6782        | 0.6750 (+0.1518)      | 0.4853 (-0.0551)         | 0.3217 (-0.0033)          | 0.4144 (-0.0862)     | 0.4072 (-0.0482)           |
+| 0.5275     | 13200     | 0.678         | -                     | -                        | -                         | -                    | -                          |
+| 0.5355     | 13400     | 0.681         | -                     | -                        | -                         | -                    | -                          |
+| 0.5435     | 13600     | 0.6514        | -                     | -                        | -                         | -                    | -                          |
+| 0.5515     | 13800     | 0.6863        | -                     | -                        | -                         | -                    | -                          |
+| 0.5595     | 14000     | 0.7023        | 0.6789 (+0.1557)      | 0.5437 (+0.0033)         | 0.3427 (+0.0176)          | 0.4433 (-0.0574)     | 0.4432 (-0.0122)           |
+| 0.5675     | 14200     | 0.6769        | -                     | -                        | -                         | -                    | -                          |
+| 0.5755     | 14400     | 0.7304        | -                     | -                        | -                         | -                    | -                          |
+| 0.5835     | 14600     | 0.6913        | -                     | -                        | -                         | -                    | -                          |
+| 0.5915     | 14800     | 0.6877        | -                     | -                        | -                         | -                    | -                          |
+| 0.5995     | 15000     | 0.6988        | 0.6746 (+0.1514)      | 0.5105 (-0.0299)         | 0.3312 (+0.0061)          | 0.3680 (-0.1326)     | 0.4032 (-0.0522)           |
+| 0.6075     | 15200     | 0.6808        | -                     | -                        | -                         | -                    | -                          |
+| 0.6155     | 15400     | 0.7203        | -                     | -                        | -                         | -                    | -                          |
+| 0.6235     | 15600     | 0.7301        | -                     | -                        | -                         | -                    | -                          |
+| 0.6314     | 15800     | 0.6912        | -                     | -                        | -                         | -                    | -                          |
+| 0.6394     | 16000     | 0.6702        | 0.6733 (+0.1502)      | 0.4937 (-0.0467)         | 0.3249 (-0.0002)          | 0.5041 (+0.0034)     | 0.4409 (-0.0145)           |
+| 0.6474     | 16200     | 0.6686        | -                     | -                        | -                         | -                    | -                          |
+| 0.6554     | 16400     | 0.7081        | -                     | -                        | -                         | -                    | -                          |
+| 0.6634     | 16600     | 0.6736        | -                     | -                        | -                         | -                    | -                          |
+| 0.6714     | 16800     | 0.6561        | -                     | -                        | -                         | -                    | -                          |
+| 0.6794     | 17000     | 0.6835        | 0.6858 (+0.1626)      | 0.5074 (-0.0331)         | 0.3146 (-0.0105)          | 0.4786 (-0.0221)     | 0.4335 (-0.0219)           |
+| 0.6874     | 17200     | 0.7044        | -                     | -                        | -                         | -                    | -                          |
+| 0.6954     | 17400     | 0.6629        | -                     | -                        | -                         | -                    | -                          |
+| 0.7034     | 17600     | 0.6937        | -                     | -                        | -                         | -                    | -                          |
+| 0.7114     | 17800     | 0.6219        | -                     | -                        | -                         | -                    | -                          |
+| 0.7194     | 18000     | 0.6892        | 0.6781 (+0.1549)      | 0.5375 (-0.0029)         | 0.2896 (-0.0354)          | 0.4680 (-0.0327)     | 0.4317 (-0.0237)           |
+| 0.7274     | 18200     | 0.6823        | -                     | -                        | -                         | -                    | -                          |
+| 0.7354     | 18400     | 0.6693        | -                     | -                        | -                         | -                    | -                          |
+| 0.7433     | 18600     | 0.6874        | -                     | -                        | -                         | -                    | -                          |
+| 0.7513     | 18800     | 0.665         | -                     | -                        | -                         | -                    | -                          |
+| 0.7593     | 19000     | 0.6665        | 0.6900 (+0.1668)      | 0.5766 (+0.0361)         | 0.3179 (-0.0072)          | 0.5292 (+0.0286)     | 0.4746 (+0.0192)           |
+| 0.7673     | 19200     | 0.6823        | -                     | -                        | -                         | -                    | -                          |
+| 0.7753     | 19400     | 0.6685        | -                     | -                        | -                         | -                    | -                          |
+| 0.7833     | 19600     | 0.6493        | -                     | -                        | -                         | -                    | -                          |
+| 0.7913     | 19800     | 0.6545        | -                     | -                        | -                         | -                    | -                          |
+| 0.7993     | 20000     | 0.6568        | 0.6919 (+0.1688)      | 0.5569 (+0.0164)         | 0.3158 (-0.0092)          | 0.4915 (-0.0092)     | 0.4547 (-0.0007)           |
+| 0.8073     | 20200     | 0.6536        | -                     | -                        | -                         | -                    | -                          |
+| 0.8153     | 20400     | 0.6806        | -                     | -                        | -                         | -                    | -                          |
+| 0.8233     | 20600     | 0.6448        | -                     | -                        | -                         | -                    | -                          |
+| 0.8313     | 20800     | 0.6837        | -                     | -                        | -                         | -                    | -                          |
+| 0.8393     | 21000     | 0.6523        | 0.6887 (+0.1655)      | 0.5273 (-0.0131)         | 0.3058 (-0.0192)          | 0.4337 (-0.0669)     | 0.4223 (-0.0331)           |
+| 0.8473     | 21200     | 0.6556        | -                     | -                        | -                         | -                    | -                          |
+| 0.8552     | 21400     | 0.6394        | -                     | -                        | -                         | -                    | -                          |
+| 0.8632     | 21600     | 0.6704        | -                     | -                        | -                         | -                    | -                          |
+| 0.8712     | 21800     | 0.6934        | -                     | -                        | -                         | -                    | -                          |
+| 0.8792     | 22000     | 0.6308        | 0.6892 (+0.1661)      | 0.5436 (+0.0032)         | 0.3189 (-0.0062)          | 0.4854 (-0.0152)     | 0.4493 (-0.0061)           |
+| 0.8872     | 22200     | 0.6991        | -                     | -                        | -                         | -                    | -                          |
+| 0.8952     | 22400     | 0.6601        | -                     | -                        | -                         | -                    | -                          |
+| 0.9032     | 22600     | 0.6317        | -                     | -                        | -                         | -                    | -                          |
+| 0.9112     | 22800     | 0.6611        | -                     | -                        | -                         | -                    | -                          |
+| **0.9192** | **23000** | **0.6037**    | **0.6929 (+0.1698)**  | **0.5548 (+0.0144)**     | **0.3160 (-0.0091)**      | **0.4755 (-0.0251)** | **0.4488 (-0.0066)**       |
+| 0.9272     | 23200     | 0.619         | -                     | -                        | -                         | -                    | -                          |
+| 0.9352     | 23400     | 0.6511        | -                     | -                        | -                         | -                    | -                          |
+| 0.9432     | 23600     | 0.6534        | -                     | -                        | -                         | -                    | -                          |
+| 0.9512     | 23800     | 0.6567        | -                     | -                        | -                         | -                    | -                          |
+| 0.9592     | 24000     | 0.6863        | 0.6901 (+0.1669)      | 0.5300 (-0.0105)         | 0.3117 (-0.0134)          | 0.4399 (-0.0607)     | 0.4272 (-0.0282)           |
+| 0.9671     | 24200     | 0.6479        | -                     | -                        | -                         | -                    | -                          |
+| 0.9751     | 24400     | 0.6182        | -                     | -                        | -                         | -                    | -                          |
+| 0.9831     | 24600     | 0.5852        | -                     | -                        | -                         | -                    | -                          |
+| 0.9911     | 24800     | 0.6581        | -                     | -                        | -                         | -                    | -                          |
+| 0.9991     | 25000     | 0.6045        | 0.6929 (+0.1697)      | 0.5394 (-0.0011)         | 0.3143 (-0.0108)          | 0.4561 (-0.0445)     | 0.4366 (-0.0188)           |
+| -1         | -1        | -             | 0.6929 (+0.1698)      | 0.5548 (+0.0144)         | 0.3160 (-0.0091)          | 0.4755 (-0.0251)     | 0.4488 (-0.0066)           |
+* The bold row denotes the saved checkpoint.
+</details>
+### Framework Versions
+- Python: 3.11.10
+- Sentence Transformers: 4.0.1
+- Transformers: 4.49.0
+- PyTorch: 2.5.1+cu124
+- Accelerate: 1.5.2
+- Datasets: 2.21.0
+- Tokenizers: 0.21.0
+## Citation
+### BibTeX
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+<!--
+## Glossary
+*Clearly define terms in order to be accessible across audiences.*
+-->
+<!--
+## Model Card Authors
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+<!--
+## Model Card Contact
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json ADDED Viewed

	@@ -0,0 +1,57 @@

+{
+  "_name_or_path": "answerdotai/ModernBERT-base",
+  "architectures": [
+    "ModernBertForSequenceClassification"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "id2label": {
+    "0": "LABEL_0"
+  },
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "label2id": {
+    "LABEL_0": 0
+  },
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "reference_compile": true,
+  "repad_logits_with_grad": false,
+  "sentence_transformers": {
+    "activation_fn": "torch.nn.modules.activation.Sigmoid",
+    "version": "4.0.1"
+  },
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.49.0",
+  "vocab_size": 50368
+}

model.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:96ca458b3dfeac0a1e73801e1b6b215bf5dbf63650ac683b59468adc99c367bd
+size 598436708

special_tokens_map.json ADDED Viewed

	@@ -0,0 +1,37 @@

+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json ADDED Viewed

The diff for this file is too large to render. See raw diff

tokenizer_config.json ADDED Viewed

	@@ -0,0 +1,945 @@

+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizer",
+  "unk_token": "[UNK]"
+}