Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,615 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:6032
+- loss:MultipleNegativesRankingLoss
+base_model: answerdotai/ModernBERT-base
+widget:
+- source_sentence: The Field Sales Executive/Key Account Executive/Sales Operations
+    Management Specialist is responsible for being the contact point with commercial
+    accounts on various logistics services. He/She is also responsible to provide
+    support in identifying potential customers, establishing partnerships to expand
+    the company's businesses, selling solutions and participating in programmes targeting
+    different customers with support of internal departments in building customer
+    relationships. Resourceful and analytical, he is required to understand customer
+    needs and convince customers to adopt the proposed solutions.
+  sentences:
+  - The Sales Operations Coordinator is responsible for being the main point of contact
+    with retail clients on various marketing services. He/She is also tasked with
+    providing assistance in identifying potential partners, establishing collaborations
+    to grow the company's market reach, promoting services, and participating in initiatives
+    targeting diverse clients with support from different departments in nurturing
+    client connections. Resourceful and detail-oriented, he is required to comprehend
+    client preferences and influence clients to consider the proposed offerings.
+  - The Key Account Manager is tasked with serving as the primary liaison for commercial
+    clients regarding a range of logistics services. This role involves identifying
+    potential customers, fostering partnerships to enhance the company's market presence,
+    and delivering tailored solutions. The Key Account Manager collaborates with internal
+    teams to develop strategies aimed at strengthening customer relationships. With
+    a resourceful and analytical mindset, he/she must grasp customer requirements
+    and effectively persuade clients to embrace the recommended solutions.
+  - The Civil and Structural Engineering Manager is responsible for the comprehensive
+    management and execution of engineering projects, ensuring alignment with specific
+    project requirements. This role involves reviewing designs, specifications, calculations,
+    and various submissions to maintain project integrity. The manager oversees all
+    assessment phases of projects, guaranteeing that developed designs and models
+    meet the established criteria. Additionally, he/she leads the tendering process
+    and supervises a team of engineers, fostering a culture of continuous performance
+    enhancement. The position may also entail fulfilling the duties of a Qualified
+    Person as stipulated by the Building Control Act. The ideal candidate will have
+    strong analytical, problem-solving, and decision-making abilities, along with
+    expertise in civil and structural engineering practices and project management.
+    Exceptional leadership and communication skills are essential, and the role requires
+    a balance of office work and on-site project involvement.
+- source_sentence: The Capacity Management Executive assists in capacity planning
+    and management, making recommendations on cargo mixtures based on profit maximisation
+    and customer demand, and proposing alternatives and contingencies to handle capacity
+    issues. He/She coordinates cargo handling and transhipment operations with business
+    partners and stakeholders and is responsible for ensuring dangerous cargo is handled
+    correctly. He tracks vessel movements and assist in adhoc route adjustments to
+    maximise voyage yields and minimise operational expenses. He possesses an innovative
+    mind-set and can work under tight deadlines.
+  sentences:
+  - The Lighting Technician is responsible for overseeing the installation and operation
+    of lighting systems for various productions. This role requires proficiency in
+    working at heights and operating elevated work platforms, as well as a solid understanding
+    of basic electrical principles. Adherence to workplace safety and health regulations
+    is essential. The Lighting Technician serves as the primary point of contact for
+    any safety concerns or incidents that may arise. Additionally, this position may
+    involve supervising entry-level lighting staff to ensure that lighting setups
+    are executed accurately and safely before and during events. Depending on their
+    skills and experiences, Lighting Technicians may also engage in specialized tasks.
+    They can work either on a full-time or casual basis across venues, rental companies,
+    production firms, or directly within production teams.
+  - The Cargo Optimization Specialist plays a crucial role in overseeing capacity
+    planning and management within the logistics sector. This position involves analyzing
+    cargo compositions to enhance profitability while meeting customer needs, as well
+    as suggesting alternatives and contingency plans to address any capacity challenges.
+    The specialist collaborates closely with business partners and stakeholders to
+    ensure efficient cargo handling and transshipment operations, with a strong emphasis
+    on the safe handling of hazardous materials. Additionally, they monitor vessel
+    movements and assist in making real-time route adjustments aimed at maximizing
+    voyage profitability and minimizing operational costs. The ideal candidate will
+    demonstrate innovative thinking and the ability to thrive under pressure.
+  - The Junior Risk Analyst is responsible for identifying and assessing potential
+    risks within the financial services sector. In this role, the analyst gathers
+    data to evaluate risk exposure and develops strategies to mitigate these risks.
+    They work with various teams to ensure compliance with regulatory standards and
+    contribute to the preparation of risk assessment reports. The Junior Risk Analyst
+    must possess strong analytical skills and the ability to communicate findings
+    effectively, while also being adaptable to changing regulations and market conditions.
+    This position requires a detail-oriented individual who can work collaboratively
+    in a fast-paced environment.
+- source_sentence: The Exhibition Producer/Conference Producer/Meeting Planner is
+    responsible for the development of concepts and content curation for meetings,
+    conferences and exhibitions. He/She works closely with internal and external stakeholders
+    to develop incentive programmes, conferences and exhibitions. He utilises findings
+    from market research to develop new meetings and enhance the user experience.
+    Innovative and insightful, he is able to rationalise plethora of ideas into marketable
+    products that meets customer requirements. He stays abreast of industry and market
+    trends to discover current, new, and alternative growth areas and subjects for
+    meetings, conferences and exhibitions. He travels frequently to attend industry
+    events and networks extensively outside of the office to have a deeper understanding
+    on the emerging trends in the industry.
+  sentences:
+  - The Conference Assistant is responsible for supporting the planning and execution
+    of meetings and conferences. This role focuses on administrative tasks such as
+    scheduling, coordinating logistics, and assisting with on-site operations. The
+    Conference Assistant works under the guidance of senior staff to ensure all event
+    details are managed effectively. While they may assist in gathering information
+    from market research, their primary function is to handle logistical aspects rather
+    than develop event concepts. The position requires strong organizational skills
+    and the ability to follow instructions, but it does not involve the responsibility
+    of creating new programs or traveling for industry insights. Instead, the Conference
+    Assistant's role is primarily office-based, with limited external engagement.
+  - The Event Coordinator is tasked with the creation and organization of engaging
+    concepts and content for various events, including meetings, conferences, and
+    exhibitions. This role involves close collaboration with both internal teams and
+    external partners to design incentive programs and curate event experiences. Utilizing
+    insights gained from market research, the Event Coordinator is responsible for
+    innovating new events and enhancing attendee engagement. With a creative mindset,
+    they can distill a wide range of ideas into appealing offerings that align with
+    client needs. Staying informed about industry trends and market developments,
+    the Event Coordinator identifies new opportunities for growth and relevant topics
+    for events. Frequent travel to industry gatherings is essential, as it allows
+    for extensive networking and a deeper understanding of emerging trends.
+  - The Talent Development Manager is responsible for creating and executing comprehensive
+    talent development initiatives that align with the organization's current and
+    future business needs. This role involves designing clear career pathways to enhance
+    employee awareness of advancement opportunities and advising managers on effective
+    career development strategies. The Talent Development Manager oversees high-potential
+    talent programs and succession planning efforts, ensuring a robust pipeline for
+    key positions within the organization to support ongoing success and stability.
+    Additionally, this manager implements policies related to retirement and employee
+    exits, providing guidance on managing transitions effectively. The role also includes
+    managing team performance and operations while integrating Skill Frameworks into
+    talent development initiatives. The ideal candidate for this position is highly
+    people-oriented, possesses exceptional communication skills, and engages diplomatically
+    with various stakeholders. They are adept at analyzing complex challenges and
+    making informed decisions to drive organizational success.
+- source_sentence: The Program Manager plans and oversees multiple inter-dependent
+    programs spanning multiple years that impact one or more business units or one
+    larger project. He/She oversees all aspects of assigned programs throughout program
+    lifecycles to ensure completion within the defined scope, quality, time and cost
+    constraints. He ensures accurate allocations of resources throughout the program.
+    He leads multi-disciplinary teams, composed of various levels of personnel, vendors,
+    and clients to create and deploy successful programs. He coaches team members
+    on Agile practices and values, and Scrum process framework. He is proficient in
+    Agile practices and methodology, project management methodologies and tools, as
+    well as Scrum process framework. The Program Manager is confident and decisive
+    in leading projects, overseeing the completion and integration of inter-dependent
+    programs and parts. He has excellent communication skills, capable of effectively
+    influencing various internal and external stakeholders.
+  sentences:
+  - The Senior Workplace Safety and Health (WSH) Auditor plays a pivotal role in guiding
+    the audit team through comprehensive WSH audits for various client organizations.
+    This individual is tasked with providing expert advice to stakeholders on matters
+    related to WSH audits. The Senior WSH Auditor excels in collaboration, possesses
+    strong analytical skills, is resourceful, and effectively fosters teamwork while
+    facilitating productive discussions.
+  - The Operations Manager is tasked with overseeing daily operational activities
+    within a specific department, ensuring that all processes run smoothly and efficiently.
+    This role involves managing the workflow and performance of the team to meet departmental
+    objectives and targets. The Operations Manager is responsible for resource allocation
+    and optimizing operational procedures to enhance productivity. They lead a team
+    of operational staff, providing support and training as necessary. Knowledge of
+    operational best practices and methodologies is crucial for success in this role.
+    The Operations Manager must be able to communicate effectively with team members
+    and stakeholders to facilitate collaboration and ensure alignment with organizational
+    goals.
+  - The Project Coordinator is responsible for planning and managing various interconnected
+    projects that span several years and affect multiple business units or a significant
+    project. This role involves overseeing all phases of assigned projects throughout
+    their lifecycles to ensure they are completed within the specified scope, quality,
+    timeline, and budget constraints. The Project Coordinator ensures that resources
+    are accurately allocated throughout the project duration. Additionally, they lead
+    cross-functional teams comprising different levels of personnel, vendors, and
+    clients to successfully implement and deliver projects. They provide guidance
+    to team members on Agile methodologies and practices, as well as the Scrum process
+    framework. Proficiency in Agile principles, project management techniques, and
+    Scrum methodologies is essential for this role. The Project Coordinator must be
+    assertive and decisive in managing projects, ensuring the successful completion
+    and integration of interrelated projects. Strong communication skills are crucial,
+    as they will need to effectively influence various stakeholders both internally
+    and externally.
+- source_sentence: The Senior Anchor/Senior Presenter/Anchor/ Presenter - News delivers
+    news stories to the broadcasting station's audience and is the public face or
+    voice of the programmes broadcasted on various platforms. He/She is involved in
+    the collection of news materials and is required to conduct research on stories
+    and interview people who have accurate information on news events. He is also
+    involved in the development and writing of content and is responsible for reviewing
+    and editing materials written by other news reporters to ensure that the content
+    is tailored to the target audience. He is required to host or co-host programmes
+    by providing live commentaries and doing live interviews to create content that
+    links closely to the stories. He often works from a studio and may be expected
+    to travel in order to present news from remote locations in the field related
+    to a particular major news event. He follows a fixed working schedule, but may
+    be required to work at odd hours, including weekends, to cover important events.
+    He should be an effective communicator with an understanding of news editorial
+    process. He should ideally have a background in journalism or mass communications
+    and possesses an understanding of daily newscast content and media ethics. He
+    ought to be able to improvise and ad-lib in a live on-camera setting and be able
+    to work well with others across a variety of situations.
+  sentences:
+  - 'The Sustainability Advisor offers expert guidance to organizations seeking to
+    implement effective waste management practices that comply with environmental
+    standards and align with their corporate social responsibility objectives. This
+    role involves performing comprehensive waste audits and risk evaluations, crafting
+    and proposing strategies for waste reduction, and spearheading initiatives focused
+    on the circular economy and sustainability. The Sustainability Advisor is expected
+    to utilize advanced waste management technologies, ensure adherence to regulations,
+    and conduct life cycle assessments to deliver practical recommendations that facilitate
+    organizational transformation. Additionally, this position is crucial in maintaining
+    regulatory compliance and permits, providing training to stakeholders on best
+    waste management practices, and promoting a culture of engagement and change among
+    all parties involved.
+
+
+    The Sustainability Advisor must possess strong problem-solving abilities, effective
+    communication skills, and the capacity to influence others, enabling them to engage
+    with cross-functional teams and a variety of stakeholders successfully. They will
+    manage waste management projects efficiently and cultivate a sustainable culture
+    within organizations to help achieve long-term waste management objectives.'
+  - The Junior News Reporter is tasked with gathering and compiling news stories for
+    the broadcasting station's audience, acting as a supportive figure in various
+    programs aired on different platforms. This position includes the collection of
+    news materials and conducting basic research on stories, as well as interviewing
+    individuals who may provide information on news events. The Junior News Reporter
+    assists in the writing and editing of content produced by senior reporters, ensuring
+    it meets the audience's needs. This role may also involve supporting hosts during
+    live programs by providing background information and conducting interviews to
+    aid in storytelling. While primarily working from the studio, there may be occasional
+    travel to gather information for specific news events. The Junior News Reporter
+    typically follows a standard work schedule but might be called upon to work during
+    odd hours, including weekends, to assist in covering significant events. Effective
+    communication skills and a foundational understanding of media ethics are important,
+    along with a basic knowledge of the news editorial process. The ability to work
+    collaboratively with colleagues and adapt to various situations is also necessary.
+  - The Lead News Presenter is responsible for delivering engaging news stories to
+    the audience of the broadcasting station, serving as the public face or voice
+    of various programs aired across multiple platforms. This role involves gathering
+    news materials, conducting thorough research, and interviewing credible sources
+    to ensure accurate reporting on current events. The Lead News Presenter also plays
+    a critical role in content development and writing, as well as reviewing and editing
+    articles produced by other reporters to ensure alignment with the target audience's
+    interests. Additionally, this position requires hosting or co-hosting programs,
+    providing live commentary, and conducting live interviews to enhance storytelling.
+    While primarily based in a studio, the Lead News Presenter may travel to report
+    from remote locations for significant news events. The role follows a structured
+    work schedule but may necessitate working irregular hours, including weekends,
+    to cover key happenings. Strong communication skills and a solid understanding
+    of the news editorial process are essential, along with a background in journalism
+    or mass communications, familiarity with daily newscast content, and adherence
+    to media ethics. The ability to improvise and ad-lib during live broadcasts while
+    collaborating effectively with team members is also crucial.
+datasets:
+- Fatin757/ssf-train-valid_v3
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on answerdotai/ModernBERT-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on the [ssf-train-valid_v3](https://huggingface.co/datasets/Fatin757/ssf-train-valid_v3) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) <!-- at revision 8949b909ec900327062f0ebf497f51aef5e6f0c8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+- **Training Dataset:**
+    - [ssf-train-valid_v3](https://huggingface.co/datasets/Fatin757/ssf-train-valid_v3)
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("Fatin757/ssf-retriever-modernbert-v2")
+# Run inference
+sentences = [
+    "The Senior Anchor/Senior Presenter/Anchor/ Presenter - News delivers news stories to the broadcasting station's audience and is the public face or voice of the programmes broadcasted on various platforms. He/She is involved in the collection of news materials and is required to conduct research on stories and interview people who have accurate information on news events. He is also involved in the development and writing of content and is responsible for reviewing and editing materials written by other news reporters to ensure that the content is tailored to the target audience. He is required to host or co-host programmes by providing live commentaries and doing live interviews to create content that links closely to the stories. He often works from a studio and may be expected to travel in order to present news from remote locations in the field related to a particular major news event. He follows a fixed working schedule, but may be required to work at odd hours, including weekends, to cover important events. He should be an effective communicator with an understanding of news editorial process. He should ideally have a background in journalism or mass communications and possesses an understanding of daily newscast content and media ethics. He ought to be able to improvise and ad-lib in a live on-camera setting and be able to work well with others across a variety of situations.",
+    "The Lead News Presenter is responsible for delivering engaging news stories to the audience of the broadcasting station, serving as the public face or voice of various programs aired across multiple platforms. This role involves gathering news materials, conducting thorough research, and interviewing credible sources to ensure accurate reporting on current events. The Lead News Presenter also plays a critical role in content development and writing, as well as reviewing and editing articles produced by other reporters to ensure alignment with the target audience's interests. Additionally, this position requires hosting or co-hosting programs, providing live commentary, and conducting live interviews to enhance storytelling. While primarily based in a studio, the Lead News Presenter may travel to report from remote locations for significant news events. The role follows a structured work schedule but may necessitate working irregular hours, including weekends, to cover key happenings. Strong communication skills and a solid understanding of the news editorial process are essential, along with a background in journalism or mass communications, familiarity with daily newscast content, and adherence to media ethics. The ability to improvise and ad-lib during live broadcasts while collaborating effectively with team members is also crucial.",
+    "The Junior News Reporter is tasked with gathering and compiling news stories for the broadcasting station's audience, acting as a supportive figure in various programs aired on different platforms. This position includes the collection of news materials and conducting basic research on stories, as well as interviewing individuals who may provide information on news events. The Junior News Reporter assists in the writing and editing of content produced by senior reporters, ensuring it meets the audience's needs. This role may also involve supporting hosts during live programs by providing background information and conducting interviews to aid in storytelling. While primarily working from the studio, there may be occasional travel to gather information for specific news events. The Junior News Reporter typically follows a standard work schedule but might be called upon to work during odd hours, including weekends, to assist in covering significant events. Effective communication skills and a foundational understanding of media ethics are important, along with a basic knowledge of the news editorial process. The ability to work collaboratively with colleagues and adapt to various situations is also necessary.",
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.9225, 0.4020],
+#         [0.9225, 1.0000, 0.4397],
+#         [0.4020, 0.4397, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### ssf-train-valid_v3
+
+* Dataset: [ssf-train-valid_v3](https://huggingface.co/datasets/Fatin757/ssf-train-valid_v3) at [5d23d8e](https://huggingface.co/datasets/Fatin757/ssf-train-valid_v3/tree/5d23d8eeff6292b6f2fb97cae6fd2f287dca7758)
+* Size: 6,032 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                            | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                              | string                                                                               |
+  | details | <ul><li>min: 60 tokens</li><li>mean: 168.86 tokens</li><li>max: 403 tokens</li></ul> | <ul><li>min: 74 tokens</li><li>mean: 165.4 tokens</li><li>max: 318 tokens</li></ul> | <ul><li>min: 63 tokens</li><li>mean: 139.63 tokens</li><li>max: 253 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Brokerage Supervisor/ Freight Supervisor is responsible for liaising with customers, logistics operators and customs officials and supervising the custom clearance/freight forwarding operations to ensure goods are cleared through customs or quarantine in accordance with import and export laws and regulations. Analytical and systematic, he/she is required to supervise a freight operations team to execute operations in a timely manner to meet business and customers' requirements. He/She is also expected to work with internal and external stakeholders to accomplish his work.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                            | <code>The Logistics Operations Supervisor is tasked with coordinating communication between clients, transportation providers, and regulatory agencies while overseeing the customs clearance and freight forwarding processes. This role ensures compliance with all import and export regulations, facilitating the smooth transit of goods through customs and quarantine. The ideal candidate will possess strong analytical and organizational skills, leading a team of logistics professionals to execute operations efficiently and meet both business objectives and customer expectations. Collaboration with various internal and external partners is essential to successfully fulfill the responsibilities of this position.</code>                                                                                                                                                                                                                                                                                                        | <code>The Freight Operations Coordinator is responsible for managing interactions with suppliers, transport companies, and regulatory bodies while overseeing the delivery processes to ensure shipments are dispatched in alignment with logistics standards. This role focuses on adherence to transportation guidelines and the timely execution of delivery schedules. The successful candidate should demonstrate excellent problem-solving abilities and be capable of directing a team of logistics personnel to achieve operational targets. Coordination with different departments and external partners is crucial for the effective management of this role.</code>                                                                                                            |
+  | <code>The Senior Quality Engineer evaluates and manages quality systems, tools and standards to meet business needs. He/She, as the subject matter expert, is required to identify risk areas, ensure the robustness of the risk control plans deployed for excursion free launch and conduct qualification and/or validation for new materials. He is responsible for developing a management system to ensure that operations meet both internal and external parties quality requirements. He has to take the lead in managing cross-functional teams in continuous improvement projects and assist in implementing process improvement projects. He plays an important role in organisational development through development of on-the-job training and mentoring of team leaders. The Senior Quality Engineer possesses an analytical mind and leadership skills to steer the team to perform their best and achieve the desired organisational outcomes.</code>                                                                                         | <code>The Quality Assurance Manager is responsible for assessing and overseeing quality systems, methodologies, and standards to align with business objectives. As an expert in the field, this individual will pinpoint areas of risk, ensure that effective risk management strategies are in place for successful product launches, and conduct thorough qualification and validation of new materials. The role involves creating a comprehensive quality management system to guarantee compliance with both internal standards and external regulations. Additionally, the Quality Assurance Manager will lead cross-functional teams in ongoing improvement initiatives and support the execution of process enhancement projects. This position is pivotal in fostering organizational growth through the development of on-the-job training programs and mentoring for team leaders. The ideal candidate will have strong analytical capabilities and leadership qualities to drive team performance and achieve key organizational ...</code> | <code>The Junior Quality Control Technician is tasked with performing routine inspections and testing of products to ensure compliance with quality standards. This role requires the technician to document findings and report any discrepancies to the senior staff. While they contribute to maintaining quality assurance processes, they are not responsible for developing management systems or leading cross-functional teams. Instead, their focus will be on executing established procedures and assisting in minor quality improvement tasks. The Junior Quality Control Technician will work under close supervision and will not engage in risk management or validation processes, limiting their involvement to basic quality checks and reporting.</code>                |
+  | <code>The Waste Process Engineer is responsible for designing, optimising and managing processes and systems for the efficient handling, treatment, transformation and disposal of waste, including electronic waste (e-waste) and plastic waste, for an organisation. He/She is focused on minimising waste generation, exploring new technologies for enhancing waste management efficiency and material recovery, and recommending improved waste management systems and processes within an organisation. Based on life-cycle analyses and evaluation of current waste streams, systems and waste-to-resource initiatives, he will develop and implement new processes, ensuring compliance with environmental regulations. <br><br>The Waste Process Engineer must be meticulous, with an eye for detail and have strong analytical and research skills to stay up to date on best practices and circular economy strategies related to waste management. He is also expected to work collaboratively with cross-functional teams to promote su...</code> | <code>The Waste Management Engineer is tasked with the design, optimization, and oversight of processes and systems aimed at the effective handling, treatment, transformation, and disposal of various waste types, including electronic waste (e-waste) and plastics. This role emphasizes the reduction of waste generation and the exploration of innovative technologies to enhance waste management efficiency and material recovery. Additionally, the engineer will assess current waste streams and implement waste-to-resource initiatives based on thorough life-cycle analyses. Ensuring compliance with environmental regulations, the Waste Management Engineer will develop and execute new processes while collaborating with cross-functional teams to advocate for sustainable practices and advance the organization’s objectives within the Circular Economy.</code>                                                                                                                                                                 | <code>The Environmental Compliance Officer is responsible for monitoring and enforcing adherence to environmental laws and regulations within an organization. This role focuses on assessing the impact of various operations on the environment and ensuring that all practices comply with legal standards. The officer will conduct regular audits, prepare reports, and provide training to staff about environmental policies. They will also work closely with regulatory agencies to maintain compliance and address any environmental concerns that may arise. Strong attention to detail and analytical skills are essential for this position, as is the ability to collaborate with various departments to ensure that the organization meets its sustainability goals.</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Evaluation Dataset
+
+#### ssf-train-valid_v3
+
+* Dataset: [ssf-train-valid_v3](https://huggingface.co/datasets/Fatin757/ssf-train-valid_v3) at [5d23d8e](https://huggingface.co/datasets/Fatin757/ssf-train-valid_v3/tree/5d23d8eeff6292b6f2fb97cae6fd2f287dca7758)
+* Size: 1,508 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                            |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                              |
+  | details | <ul><li>min: 57 tokens</li><li>mean: 166.64 tokens</li><li>max: 349 tokens</li></ul> | <ul><li>min: 67 tokens</li><li>mean: 162.89 tokens</li><li>max: 301 tokens</li></ul> | <ul><li>min: 65 tokens</li><li>mean: 139.7 tokens</li><li>max: 263 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Manager - Standards and Practices (S&P) ensures that content delivered by the organisation complies with the regulatory requirements and censorship norms of the local territories where the content may be available. He/She also provides advisory ratings for the content based on the regulatory guidelines. He keeps abreast of the local, cultural and political norms and sensitivities to support the creation of content classification guidelines. The work involves coordinating internal and external processes for delivery within tight timelines. He is highly accountable for the organisation's brand and reputation given the sensitivities of content classification. He should be comfortable coordinating with internal and external stakeholders in order to balance the organisation's priorities with compliance to guidelines and norms. He should be effective at planning and organising. He should also be aware of the regulatory, political and cultural landscape and possess a keen eye for detail t...</code> | <code>The Content Compliance Manager plays a crucial role in ensuring that all materials produced by the organization meet the necessary regulatory standards and censorship requirements of the respective local markets. This individual will provide expert advisory ratings for content in alignment with established regulatory frameworks. Staying informed about local cultural and political dynamics is essential to aid in the development of content classification guidelines. The role requires effective coordination of both internal and external processes to ensure timely delivery while maintaining the integrity of the organization's brand and reputation. The ideal candidate will excel in stakeholder engagement, balancing organizational objectives with compliance mandates. Strong planning, organizational skills, and a meticulous attention to detail are vital for identifying compliance issues during content reviews. Proficiency in communication and stakeholder management is necessary for successful...</code> | <code>The Junior Risk Analyst is responsible for evaluating potential risks that may impact the organization’s operations and financial performance. This role involves conducting thorough assessments of various risk factors and preparing detailed reports on findings. The Junior Risk Analyst will collaborate with different departments to identify risk mitigation strategies and ensure that appropriate measures are in place. Strong analytical skills and attention to detail are essential for identifying potential vulnerabilities within the organization. The position requires effective communication with team members and management to discuss risk assessments and recommendations. The ideal candidate should also be comfortable working under tight deadlines while maintaining a high level of accuracy in their analyses.</code>                                                                                                                                                                                            |
+  | <code>The Psychologist provides psychological services within multi-disciplinary settings, applying a wide array of psychometric assessments and treatments for clients with routine psychological conditions. He/She conducts psychoeducational programmes and training for other professionals. He is a resourceful, proactive and collaborative professional, and works in varied settings such as public and private institutions, hospitals, healthcare and voluntary welfare organisations. He works under supervision and in collaboration with other professionals in the course of his work.</code>                                                                                                                                                                                                                                                                                                                                                                                                                                             | <code>The Clinical Psychologist delivers comprehensive psychological services in diverse multi-disciplinary environments, utilizing a broad spectrum of psychometric evaluations and therapeutic interventions for clients experiencing common psychological issues. This role involves designing and implementing psychoeducational programs and training sessions aimed at enhancing the skills of fellow professionals. The ideal candidate is resourceful, proactive, and excels in collaboration, working effectively across various settings including public and private institutions, hospitals, healthcare facilities, and voluntary welfare organizations. The Clinical Psychologist operates under supervision while engaging collaboratively with other professionals to ensure the best outcomes for clients.</code>                                                                                                                                                                                                                        | <code>The Clinical Psychologist conducts psychological assessments within corporate environments, focusing primarily on employee mental health and organizational behavior. This position emphasizes the development and implementation of workplace wellness programs and training for management teams. The successful candidate will be an innovative, self-motivated individual who thrives in collaborative settings, working closely with human resources and management to address workplace-related psychological issues. The Clinical Psychologist operates independently while coordinating with various departments to enhance employee well-being and productivity in a corporate context.</code>                                                                                                                                                                                                                                                                                                                                            |
+  | <code>The Planning Manager (Aircraft Engine / Component Maintenance) is responsible for strategising long-term supply chain management plans, optimising aircraft engine and component maintenance planning and resource management, and driving supplier capability and performance enhancement programmes. He/She develops vendor management strategies and leads technology application to strengthen sourcing, inventory and warehousing operations. He provides project management oversight for engine servicing operations and manages technical and programme reviews with customers and suppliers. He manages compliance with airworthiness and legislative requirements, and contributes to development of the organisation's standard operating procedures (SOPs), management systems, lean and sustainability practices, and data analytics plans for strategic decision-making. He drives team performance to achieve business key performance indicators (KPIs) and leads talent recruitment and development plans. He should de...</code> | <code>The Aircraft Maintenance Planning Specialist is tasked with formulating comprehensive long-term strategies for supply chain management, focusing on the optimization of maintenance planning for aircraft engines and components. This role involves enhancing supplier capabilities and performance through targeted programs. The specialist will develop effective vendor management strategies and leverage technology to improve sourcing, inventory control, and warehousing operations. Additionally, they will oversee project management for engine servicing activities and facilitate technical and program reviews with both customers and suppliers. Compliance with airworthiness regulations and legislative requirements is critical, as is contributing to the organization's standard operating procedures (SOPs), management systems, and data analytics initiatives for informed decision-making. The specialist will also drive team performance to meet key performance indicators (KPIs) and lead initiatives for...</code> | <code>The Aircraft Component Quality Assurance Coordinator is responsible for implementing quality control measures and ensuring compliance with industry standards in the maintenance of aircraft components. This role focuses on conducting inspections and audits to assess the performance of suppliers and service providers. The coordinator develops quality assurance strategies and applies technology to enhance inspection processes and documentation practices. They will manage quality-related projects and collaborate with engineering teams to address any compliance issues with regulatory requirements. Additionally, the coordinator contributes to the development of quality management systems and participates in data analysis for quality improvement initiatives. They are expected to drive team engagement to achieve quality performance metrics and support training and development programs for staff. Strong attention to detail, analytical skills, and the ability to work collaboratively across depar...</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `num_train_epochs`: 5
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `bf16`: True
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 1
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 5e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 5
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: None
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `parallelism_config`: None
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch   | Step    | Training Loss | Validation Loss |
+|:-------:|:-------:|:-------------:|:---------------:|
+| 1.0     | 189     | 0.3362        | 0.0096          |
+| 2.0     | 378     | 0.0079        | 0.0056          |
+| 3.0     | 567     | 0.0029        | 0.0042          |
+| 4.0     | 756     | 0.0026        | 0.0037          |
+| **5.0** | **945** | **0.0023**    | **0.0032**      |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.12.11
+- Sentence Transformers: 5.1.0
+- Transformers: 4.56.1
+- PyTorch: 2.8.0+cu128
+- Accelerate: 1.10.0
+- Datasets: 4.0.0
+- Tokenizers: 0.22.0
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "dtype": "float32",
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "transformers_version": "4.56.1",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "model_type": "SentenceTransformer",
+  "__version__": {
+    "sentence_transformers": "5.1.0",
+    "transformers": "4.56.1",
+    "pytorch": "2.8.0+cu128"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2cd52551d2c00c1a833fc5a6a467ed75eee182b1c8744f20ca5181434d0a0a0f
+size 596070136

modules.json

@@ -0,0 +1,14 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}