Upload 35 files

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+nem-onet-to-soc-crosswalk.xlsx filter=lfs diff=lfs merge=lfs -text
+occupation_2023_final.xlsx filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,239 @@
-# Basic AI Model
-
-This project includes essential components for an AI model without any data.
+---
+license: mit
+library_name: transformers
+---
+# DeepSeek-R1
+<!-- markdownlint-disable first-line-h1 -->
+<!-- markdownlint-disable html -->
+<!-- markdownlint-disable no-duplicate-header -->
+
+<div align="center">
+  <img src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/logo.svg?raw=true" width="60%" alt="DeepSeek-V3" />
+</div>
+<hr>
+<div align="center" style="line-height: 1;">
+  <a href="https://www.deepseek.com/" target="_blank" style="margin: 2px;">
+    <img alt="Homepage" src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/badge.svg?raw=true" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+  <a href="https://chat.deepseek.com/" target="_blank" style="margin: 2px;">
+    <img alt="Chat" src="https://img.shields.io/badge/🤖%20Chat-DeepSeek%20R1-536af5?color=536af5&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+  <a href="https://huggingface.co/deepseek-ai" target="_blank" style="margin: 2px;">
+    <img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-DeepSeek%20AI-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+</div>
+
+<div align="center" style="line-height: 1;">
+  <a href="https://discord.gg/Tc7c45Zzu5" target="_blank" style="margin: 2px;">
+    <img alt="Discord" src="https://img.shields.io/badge/Discord-DeepSeek%20AI-7289da?logo=discord&logoColor=white&color=7289da" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+  <a href="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/qr.jpeg?raw=true" target="_blank" style="margin: 2px;">
+    <img alt="Wechat" src="https://img.shields.io/badge/WeChat-DeepSeek%20AI-brightgreen?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+  <a href="https://twitter.com/deepseek_ai" target="_blank" style="margin: 2px;">
+    <img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-deepseek_ai-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+</div>
+
+<div align="center" style="line-height: 1;">
+  <a href="https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE" style="margin: 2px;">
+    <img alt="License" src="https://img.shields.io/badge/License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>
+  </a>
+</div>
+
+
+<p align="center">
+  <a href="https://github.com/deepseek-ai/DeepSeek-R1/blob/main/DeepSeek_R1.pdf"><b>Paper Link</b>👁️</a>
+</p>
+
+
+## 1. Introduction
+
+We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1. 
+DeepSeek-R1-Zero, a model trained via large-scale reinforcement learning (RL) without supervised fine-tuning (SFT) as a preliminary step, demonstrated remarkable performance on reasoning.
+With RL, DeepSeek-R1-Zero naturally emerged with numerous powerful and interesting reasoning behaviors.
+However, DeepSeek-R1-Zero encounters challenges such as endless repetition, poor readability, and language mixing. To address these issues and further enhance reasoning performance,
+we introduce DeepSeek-R1, which incorporates cold-start data before RL.
+DeepSeek-R1 achieves performance comparable to OpenAI-o1 across math, code, and reasoning tasks. 
+To support the research community, we have open-sourced DeepSeek-R1-Zero, DeepSeek-R1, and six dense models distilled from DeepSeek-R1 based on Llama and Qwen. DeepSeek-R1-Distill-Qwen-32B outperforms OpenAI-o1-mini across various benchmarks, achieving new state-of-the-art results for dense models.
+
+**NOTE: Before running DeepSeek-R1 series models locally, we kindly recommend reviewing the [Usage Recommendation](#usage-recommendations) section.**
+
+<p align="center">
+  <img width="80%" src="figures/benchmark.jpg">
+</p>
+
+## 2. Model Summary
+
+---
+
+**Post-Training: Large-Scale Reinforcement Learning on the Base Model**
+
+-  We directly apply reinforcement learning (RL) to the base model without relying on supervised fine-tuning (SFT) as a preliminary step. This approach allows the model to explore chain-of-thought (CoT) for solving complex problems, resulting in the development of DeepSeek-R1-Zero. DeepSeek-R1-Zero demonstrates capabilities such as self-verification, reflection, and generating long CoTs, marking a significant milestone for the research community. Notably, it is the first open research to validate that reasoning capabilities of LLMs can be incentivized purely through RL, without the need for SFT. This breakthrough paves the way for future advancements in this area.
+
+-   We introduce our pipeline to develop DeepSeek-R1. The pipeline incorporates two RL stages aimed at discovering improved reasoning patterns and aligning with human preferences, as well as two SFT stages that serve as the seed for the model's reasoning and non-reasoning capabilities.
+    We believe the pipeline will benefit the industry by creating better models. 
+
+---
+
+**Distillation: Smaller Models Can Be Powerful Too**
+
+-  We demonstrate that the reasoning patterns of larger models can be distilled into smaller models, resulting in better performance compared to the reasoning patterns discovered through RL on small models. The open source DeepSeek-R1, as well as its API, will benefit the research community to distill better smaller models in the future. 
+- Using the reasoning data generated by DeepSeek-R1, we fine-tuned several dense models that are widely used in the research community. The evaluation results demonstrate that the distilled smaller dense models perform exceptionally well on benchmarks. We open-source distilled 1.5B, 7B, 8B, 14B, 32B, and 70B checkpoints based on Qwen2.5 and Llama3 series to the community.
+
+## 3. Model Downloads
+
+### DeepSeek-R1 Models
+
+<div align="center">
+
+| **Model** | **#Total Params** | **#Activated Params** | **Context Length** | **Download** |
+| :------------: | :------------: | :------------: | :------------: | :------------: |
+| DeepSeek-R1-Zero | 671B | 37B | 128K   | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Zero)   |
+| DeepSeek-R1   | 671B | 37B |  128K   | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1)   |
+
+</div>
+
+DeepSeek-R1-Zero & DeepSeek-R1 are trained based on DeepSeek-V3-Base. 
+For more details regarding the model architecture, please refer to [DeepSeek-V3](https://github.com/deepseek-ai/DeepSeek-V3) repository.
+
+### DeepSeek-R1-Distill Models
+
+<div align="center">
+
+| **Model** | **Base Model** | **Download** |
+| :------------: | :------------: | :------------: |
+| DeepSeek-R1-Distill-Qwen-1.5B  | [Qwen2.5-Math-1.5B](https://huggingface.co/Qwen/Qwen2.5-Math-1.5B) | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B)   |
+| DeepSeek-R1-Distill-Qwen-7B  | [Qwen2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B) | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B)   |
+| DeepSeek-R1-Distill-Llama-8B  | [Llama-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B)   |
+| DeepSeek-R1-Distill-Qwen-14B   | [Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B)   |
+|DeepSeek-R1-Distill-Qwen-32B  | [Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B) | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B)   |
+| DeepSeek-R1-Distill-Llama-70B  | [Llama-3.3-70B-Instruct](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct) | [🤗 HuggingFace](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-70B)   |
+
+</div>
+
+DeepSeek-R1-Distill models are fine-tuned based on open-source models, using samples generated by DeepSeek-R1.
+We slightly change their configs and tokenizers. Please use our setting to run these models.
+
+## 4. Evaluation Results
+
+### DeepSeek-R1-Evaluation
+ For all our models, the maximum generation length is set to 32,768 tokens. For benchmarks requiring sampling, we use a temperature of $0.6$, a top-p value of $0.95$, and generate 64 responses per query to estimate pass@1.
+<div align="center">
+
+
+| Category | Benchmark (Metric) | Claude-3.5-Sonnet-1022 | GPT-4o 0513 | DeepSeek V3 | OpenAI o1-mini | OpenAI o1-1217 | DeepSeek R1 |
+|----------|-------------------|----------------------|------------|--------------|----------------|------------|--------------|
+| | Architecture | - | - | MoE | - | - | MoE |
+| | # Activated Params | - | - | 37B | - | - | 37B |
+| | # Total Params | - | - | 671B | - | - | 671B |
+| English | MMLU (Pass@1) | 88.3 | 87.2 | 88.5 | 85.2 | **91.8** | 90.8 |
+| | MMLU-Redux (EM) | 88.9 | 88.0 | 89.1 | 86.7 | - | **92.9** |
+| | MMLU-Pro (EM) | 78.0 | 72.6 | 75.9 | 80.3 | - | **84.0** |
+| | DROP (3-shot F1) | 88.3 | 83.7 | 91.6 | 83.9 | 90.2 | **92.2** |
+| | IF-Eval (Prompt Strict) | **86.5** | 84.3 | 86.1 | 84.8 | - | 83.3 |
+| | GPQA-Diamond (Pass@1) | 65.0 | 49.9 | 59.1 | 60.0 | **75.7** | 71.5 |
+| | SimpleQA (Correct) | 28.4 | 38.2 | 24.9 | 7.0 | **47.0** | 30.1 |
+| | FRAMES (Acc.) | 72.5 | 80.5 | 73.3 | 76.9 | - | **82.5** |
+| | AlpacaEval2.0 (LC-winrate) | 52.0 | 51.1 | 70.0 | 57.8 | - | **87.6** |
+| | ArenaHard (GPT-4-1106) | 85.2 | 80.4 | 85.5 | 92.0 | - | **92.3** |
+| Code | LiveCodeBench (Pass@1-COT) | 33.8 | 34.2 | - | 53.8 | 63.4 | **65.9** |
+| | Codeforces (Percentile) | 20.3 | 23.6 | 58.7 | 93.4 | **96.6** | 96.3 |
+| | Codeforces (Rating) | 717 | 759 | 1134 | 1820 | **2061** | 2029 |
+| | SWE Verified (Resolved) | **50.8** | 38.8 | 42.0 | 41.6 | 48.9 | 49.2 |
+| | Aider-Polyglot (Acc.) | 45.3 | 16.0 | 49.6 | 32.9 | **61.7** | 53.3 |
+| Math | AIME 2024 (Pass@1) | 16.0 | 9.3 | 39.2 | 63.6 | 79.2 | **79.8** |
+| | MATH-500 (Pass@1) | 78.3 | 74.6 | 90.2 | 90.0 | 96.4 | **97.3** |
+| | CNMO 2024 (Pass@1) | 13.1 | 10.8 | 43.2 | 67.6 | - | **78.8** |
+| Chinese | CLUEWSC (EM) | 85.4 | 87.9 | 90.9 | 89.9 | - | **92.8** |
+| | C-Eval (EM) | 76.7 | 76.0 | 86.5 | 68.9 | - | **91.8** |
+| | C-SimpleQA (Correct) | 55.4 | 58.7 | **68.0** | 40.3 | - | 63.7 |
+
+</div>
+
+
+### Distilled Model Evaluation
+
+
+<div align="center">
+
+| Model                                    | AIME 2024 pass@1 | AIME 2024 cons@64 | MATH-500 pass@1 | GPQA Diamond pass@1 | LiveCodeBench pass@1 | CodeForces rating |
+|------------------------------------------|------------------|-------------------|-----------------|----------------------|----------------------|-------------------|
+| GPT-4o-0513                          | 9.3              | 13.4              | 74.6            | 49.9                 | 32.9                 | 759               |
+| Claude-3.5-Sonnet-1022             | 16.0             | 26.7                 | 78.3            | 65.0                 | 38.9                 | 717               |
+| o1-mini                              | 63.6             | 80.0              | 90.0            | 60.0                 | 53.8                 | **1820**          |
+| QwQ-32B-Preview                              | 44.0             | 60.0                 | 90.6            | 54.5               | 41.9                 | 1316              |
+| DeepSeek-R1-Distill-Qwen-1.5B       | 28.9             | 52.7              | 83.9            | 33.8                 | 16.9                 | 954               |
+| DeepSeek-R1-Distill-Qwen-7B          | 55.5             | 83.3              | 92.8            | 49.1                 | 37.6                 | 1189              |
+| DeepSeek-R1-Distill-Qwen-14B         | 69.7             | 80.0              | 93.9            | 59.1                 | 53.1                 | 1481              |
+| DeepSeek-R1-Distill-Qwen-32B        | **72.6**         | 83.3              | 94.3            | 62.1                 | 57.2                 | 1691              |
+| DeepSeek-R1-Distill-Llama-8B         | 50.4             | 80.0              | 89.1            | 49.0                 | 39.6                 | 1205              |
+| DeepSeek-R1-Distill-Llama-70B        | 70.0             | **86.7**          | **94.5**        | **65.2**             | **57.5**             | 1633              |
+
+</div>
+
+
+## 5. Chat Website & API Platform
+You can chat with DeepSeek-R1 on DeepSeek's official website: [chat.deepseek.com](https://chat.deepseek.com), and switch on the button "DeepThink"
+
+We also provide OpenAI-Compatible API at DeepSeek Platform: [platform.deepseek.com](https://platform.deepseek.com/)
+
+## 6. How to Run Locally
+
+### DeepSeek-R1 Models
+
+Please visit [DeepSeek-V3](https://github.com/deepseek-ai/DeepSeek-V3) repo for more information about running DeepSeek-R1 locally.
+
+**NOTE: Hugging Face's Transformers has not been directly supported yet.**
+
+### DeepSeek-R1-Distill Models
+
+DeepSeek-R1-Distill models can be utilized in the same manner as Qwen or Llama models.
+
+For instance, you can easily start a service using [vLLM](https://github.com/vllm-project/vllm):
+
+```shell
+vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
+```
+
+You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
+
+```bash
+python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2
+```
+
+### Usage Recommendations
+
+**We recommend adhering to the following configurations when utilizing the DeepSeek-R1 series models, including benchmarking, to achieve the expected performance:**
+
+1. Set the temperature within the range of 0.5-0.7 (0.6 is recommended) to prevent endless repetitions or incoherent outputs.
+2. **Avoid adding a system prompt; all instructions should be contained within the user prompt.**
+3. For mathematical problems, it is advisable to include a directive in your prompt such as: "Please reason step by step, and put your final answer within \boxed{}."
+4. When evaluating model performance, it is recommended to conduct multiple tests and average the results.
+
+Additionally, we have observed that the DeepSeek-R1 series models tend to bypass thinking pattern (i.e., outputting "\<think\>\n\n\</think\>") when responding to certain queries, which can adversely affect the model's performance.
+**To ensure that the model engages in thorough reasoning, we recommend enforcing the model to initiate its response with "\<think\>\n" at the beginning of every output.**
+
+## 7. License
+This code repository and the model weights are licensed under the [MIT License](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE).
+DeepSeek-R1 series support commercial use, allow for any modifications and derivative works, including, but not limited to, distillation for training other LLMs. Please note that:
+- DeepSeek-R1-Distill-Qwen-1.5B, DeepSeek-R1-Distill-Qwen-7B, DeepSeek-R1-Distill-Qwen-14B and DeepSeek-R1-Distill-Qwen-32B are derived from [Qwen-2.5 series](https://github.com/QwenLM/Qwen2.5), which are originally licensed under [Apache 2.0 License](https://huggingface.co/Qwen/Qwen2.5-1.5B/blob/main/LICENSE), and now finetuned with 800k samples curated with DeepSeek-R1.
+- DeepSeek-R1-Distill-Llama-8B is derived from Llama3.1-8B-Base and is originally licensed under [llama3.1 license](https://huggingface.co/meta-llama/Llama-3.1-8B/blob/main/LICENSE).
+- DeepSeek-R1-Distill-Llama-70B is derived from Llama3.3-70B-Instruct and is originally licensed under [llama3.3 license](https://huggingface.co/meta-llama/Llama-3.3-70B-Instruct/blob/main/LICENSE).
+
+## 8. Citation
+```
+@misc{deepseekai2025deepseekr1incentivizingreasoningcapability,
+      title={DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning}, 
+      author={DeepSeek-AI and Daya Guo and Dejian Yang and Haowei Zhang and Junxiao Song and Ruoyu Zhang and Runxin Xu and Qihao Zhu and Shirong Ma and Peiyi Wang and Xiao Bi and Xiaokang Zhang and Xingkai Yu and Yu Wu and Z. F. Wu and Zhibin Gou and Zhihong Shao and Zhuoshu Li and Ziyi Gao and Aixin Liu and Bing Xue and Bingxuan Wang and Bochao Wu and Bei Feng and Chengda Lu and Chenggang Zhao and Chengqi Deng and Chenyu Zhang and Chong Ruan and Damai Dai and Deli Chen and Dongjie Ji and Erhang Li and Fangyun Lin and Fucong Dai and Fuli Luo and Guangbo Hao and Guanting Chen and Guowei Li and H. Zhang and Han Bao and Hanwei Xu and Haocheng Wang and Honghui Ding and Huajian Xin and Huazuo Gao and Hui Qu and Hui Li and Jianzhong Guo and Jiashi Li and Jiawei Wang and Jingchang Chen and Jingyang Yuan and Junjie Qiu and Junlong Li and J. L. Cai and Jiaqi Ni and Jian Liang and Jin Chen and Kai Dong and Kai Hu and Kaige Gao and Kang Guan and Kexin Huang and Kuai Yu and Lean Wang and Lecong Zhang and Liang Zhao and Litong Wang and Liyue Zhang and Lei Xu and Leyi Xia and Mingchuan Zhang and Minghua Zhang and Minghui Tang and Meng Li and Miaojun Wang and Mingming Li and Ning Tian and Panpan Huang and Peng Zhang and Qiancheng Wang and Qinyu Chen and Qiushi Du and Ruiqi Ge and Ruisong Zhang and Ruizhe Pan and Runji Wang and R. J. Chen and R. L. Jin and Ruyi Chen and Shanghao Lu and Shangyan Zhou and Shanhuang Chen and Shengfeng Ye and Shiyu Wang and Shuiping Yu and Shunfeng Zhou and Shuting Pan and S. S. Li and Shuang Zhou and Shaoqing Wu and Shengfeng Ye and Tao Yun and Tian Pei and Tianyu Sun and T. Wang and Wangding Zeng and Wanjia Zhao and Wen Liu and Wenfeng Liang and Wenjun Gao and Wenqin Yu and Wentao Zhang and W. L. Xiao and Wei An and Xiaodong Liu and Xiaohan Wang and Xiaokang Chen and Xiaotao Nie and Xin Cheng and Xin Liu and Xin Xie and Xingchao Liu and Xinyu Yang and Xinyuan Li and Xuecheng Su and Xuheng Lin and X. Q. Li and Xiangyue Jin and Xiaojin Shen and Xiaosha Chen and Xiaowen Sun and Xiaoxiang Wang and Xinnan Song and Xinyi Zhou and Xianzu Wang and Xinxia Shan and Y. K. Li and Y. Q. Wang and Y. X. Wei and Yang Zhang and Yanhong Xu and Yao Li and Yao Zhao and Yaofeng Sun and Yaohui Wang and Yi Yu and Yichao Zhang and Yifan Shi and Yiliang Xiong and Ying He and Yishi Piao and Yisong Wang and Yixuan Tan and Yiyang Ma and Yiyuan Liu and Yongqiang Guo and Yuan Ou and Yuduan Wang and Yue Gong and Yuheng Zou and Yujia He and Yunfan Xiong and Yuxiang Luo and Yuxiang You and Yuxuan Liu and Yuyang Zhou and Y. X. Zhu and Yanhong Xu and Yanping Huang and Yaohui Li and Yi Zheng and Yuchen Zhu and Yunxian Ma and Ying Tang and Yukun Zha and Yuting Yan and Z. Z. Ren and Zehui Ren and Zhangli Sha and Zhe Fu and Zhean Xu and Zhenda Xie and Zhengyan Zhang and Zhewen Hao and Zhicheng Ma and Zhigang Yan and Zhiyu Wu and Zihui Gu and Zijia Zhu and Zijun Liu and Zilin Li and Ziwei Xie and Ziyang Song and Zizheng Pan and Zhen Huang and Zhipeng Xu and Zhongyu Zhang and Zhen Zhang},
+      year={2025},
+      eprint={2501.12948},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2501.12948}, 
+}
+
+```
+
+## 9. Contact
+If you have any questions, please raise an issue or contact us at [[email protected]]([email protected]).

modeling_deepseek.py

@@ -0,0 +1,1849 @@
+# coding=utf-8
+# Copyright 2023 DeepSeek-AI and The HuggingFace Inc. team. All rights reserved.
+#
+# This code is based on EleutherAI's GPT-NeoX library and the GPT-NeoX
+# and OPT implementations in this library. It has been modified from its
+# original forms to accommodate minor architectural differences compared
+# to GPT-NeoX and OPT used by the Meta AI team that trained the model.
+#
+# Licensed under the Apache License, Version 2.0 (the "License");
+# you may not use this file except in compliance with the License.
+# You may obtain a copy of the License at
+#
+#     http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+""" PyTorch DeepSeek model."""
+import math
+import warnings
+from typing import List, Optional, Tuple, Union
+
+import torch
+import torch.nn.functional as F
+import torch.utils.checkpoint
+from torch import nn
+from torch.nn import BCEWithLogitsLoss, CrossEntropyLoss, MSELoss
+
+from transformers.activations import ACT2FN
+from transformers.cache_utils import Cache, DynamicCache
+from transformers.modeling_attn_mask_utils import (
+    AttentionMaskConverter,
+    _prepare_4d_attention_mask,
+    _prepare_4d_causal_attention_mask,
+)
+from transformers.modeling_outputs import (
+    BaseModelOutputWithPast,
+    CausalLMOutputWithPast,
+    SequenceClassifierOutputWithPast,
+)
+from transformers.modeling_utils import PreTrainedModel
+from transformers.pytorch_utils import (
+    ALL_LAYERNORM_LAYERS,
+    is_torch_greater_or_equal_than_1_13,
+)
+from transformers.utils import (
+    add_start_docstrings,
+    add_start_docstrings_to_model_forward,
+    is_flash_attn_2_available,
+    is_flash_attn_greater_or_equal_2_10,
+    logging,
+    replace_return_docstrings,
+)
+from transformers.utils.import_utils import is_torch_fx_available
+from .configuration_deepseek import DeepseekV3Config
+import torch.distributed as dist
+import numpy as np
+
+if is_flash_attn_2_available():
+    from flash_attn import flash_attn_func, flash_attn_varlen_func
+    from flash_attn.bert_padding import index_first_axis, pad_input, unpad_input  # noqa
+
+
+# This makes `_prepare_4d_causal_attention_mask` a leaf function in the FX graph.
+# It means that the function will not be traced through and simply appear as a node in the graph.
+if is_torch_fx_available():
+    if not is_torch_greater_or_equal_than_1_13:
+        import torch.fx
+
+    _prepare_4d_causal_attention_mask = torch.fx.wrap(_prepare_4d_causal_attention_mask)
+
+
+logger = logging.get_logger(__name__)
+
+_CONFIG_FOR_DOC = "DeepseekV3Config"
+
+
+def _get_unpad_data(attention_mask):
+    seqlens_in_batch = attention_mask.sum(dim=-1, dtype=torch.int32)
+    indices = torch.nonzero(attention_mask.flatten(), as_tuple=False).flatten()
+    max_seqlen_in_batch = seqlens_in_batch.max().item()
+    cu_seqlens = F.pad(
+        torch.cumsum(seqlens_in_batch, dim=0, dtype=torch.torch.int32), (1, 0)
+    )
+    return (
+        indices,
+        cu_seqlens,
+        max_seqlen_in_batch,
+    )
+
+
+class DeepseekV3RMSNorm(nn.Module):
+    def __init__(self, hidden_size, eps=1e-6):
+        """
+        DeepseekV3RMSNorm is equivalent to T5LayerNorm
+        """
+        super().__init__()
+        self.weight = nn.Parameter(torch.ones(hidden_size))
+        self.variance_epsilon = eps
+
+    def forward(self, hidden_states):
+        input_dtype = hidden_states.dtype
+        hidden_states = hidden_states.to(torch.float32)
+        variance = hidden_states.pow(2).mean(-1, keepdim=True)
+        hidden_states = hidden_states * torch.rsqrt(variance + self.variance_epsilon)
+        return self.weight * hidden_states.to(input_dtype)
+
+
+ALL_LAYERNORM_LAYERS.append(DeepseekV3RMSNorm)
+
+
+class DeepseekV3RotaryEmbedding(nn.Module):
+    def __init__(self, dim, max_position_embeddings=2048, base=10000, device=None):
+        super().__init__()
+
+        self.dim = dim
+        self.max_position_embeddings = max_position_embeddings
+        self.base = base
+        inv_freq = 1.0 / (
+            self.base ** (torch.arange(0, self.dim, 2).float().to(device) / self.dim)
+        )
+        self.register_buffer("inv_freq", inv_freq, persistent=False)
+
+        # Build here to make `torch.jit.trace` work.
+        self._set_cos_sin_cache(
+            seq_len=max_position_embeddings,
+            device=self.inv_freq.device,
+            dtype=torch.get_default_dtype(),
+        )
+        self.max_seq_len_cached = None
+
+    def _set_cos_sin_cache(self, seq_len, device, dtype):
+        self.max_seq_len_cached = seq_len
+        t = torch.arange(
+            self.max_seq_len_cached, device=device, dtype=self.inv_freq.dtype
+        )
+
+        freqs = torch.outer(t, self.inv_freq.to(t.device))
+        # Different from paper, but it uses a different permutation in order to obtain the same calculation
+        emb = torch.cat((freqs, freqs), dim=-1)
+        self.register_buffer("cos_cached", emb.cos().to(dtype), persistent=False)
+        self.register_buffer("sin_cached", emb.sin().to(dtype), persistent=False)
+
+    def forward(self, x, seq_len=None):
+        # x: [bs, num_attention_heads, seq_len, head_size]
+        if self.max_seq_len_cached is None or seq_len > self.max_seq_len_cached:
+            self._set_cos_sin_cache(seq_len=seq_len, device=x.device, dtype=x.dtype)
+
+        return (
+            self.cos_cached[:seq_len].to(dtype=x.dtype),
+            self.sin_cached[:seq_len].to(dtype=x.dtype),
+        )
+
+
+# Copied from transformers.models.llama.modeling_llama.LlamaLinearScalingRotaryEmbedding with Llama->DeepseekV3
+class DeepseekV3LinearScalingRotaryEmbedding(DeepseekV3RotaryEmbedding):
+    """DeepseekV3RotaryEmbedding extended with linear scaling. Credits to the Reddit user /u/kaiokendev"""
+
+    def __init__(
+        self,
+        dim,
+        max_position_embeddings=2048,
+        base=10000,
+        device=None,
+        scaling_factor=1.0,
+    ):
+        self.scaling_factor = scaling_factor
+        super().__init__(dim, max_position_embeddings, base, device)
+
+    def _set_cos_sin_cache(self, seq_len, device, dtype):
+        self.max_seq_len_cached = seq_len
+        t = torch.arange(
+            self.max_seq_len_cached, device=device, dtype=self.inv_freq.dtype
+        )
+        t = t / self.scaling_factor
+
+        freqs = torch.outer(t, self.inv_freq)
+        # Different from paper, but it uses a different permutation in order to obtain the same calculation
+        emb = torch.cat((freqs, freqs), dim=-1)
+        self.register_buffer("cos_cached", emb.cos().to(dtype), persistent=False)
+        self.register_buffer("sin_cached", emb.sin().to(dtype), persistent=False)
+
+
+# Copied from transformers.models.llama.modeling_llama.LlamaDynamicNTKScalingRotaryEmbedding with Llama->DeepseekV3
+class DeepseekV3DynamicNTKScalingRotaryEmbedding(DeepseekV3RotaryEmbedding):
+    """DeepseekV3RotaryEmbedding extended with Dynamic NTK scaling. Credits to the Reddit users /u/bloc97 and /u/emozilla"""
+
+    def __init__(
+        self,
+        dim,
+        max_position_embeddings=2048,
+        base=10000,
+        device=None,
+        scaling_factor=1.0,
+    ):
+        self.scaling_factor = scaling_factor
+        super().__init__(dim, max_position_embeddings, base, device)
+
+    def _set_cos_sin_cache(self, seq_len, device, dtype):
+        self.max_seq_len_cached = seq_len
+
+        if seq_len > self.max_position_embeddings:
+            base = self.base * (
+                (self.scaling_factor * seq_len / self.max_position_embeddings)
+                - (self.scaling_factor - 1)
+            ) ** (self.dim / (self.dim - 2))
+            inv_freq = 1.0 / (
+                base ** (torch.arange(0, self.dim, 2).float().to(device) / self.dim)
+            )
+            self.register_buffer("inv_freq", inv_freq, persistent=False)
+
+        t = torch.arange(
+            self.max_seq_len_cached, device=device, dtype=self.inv_freq.dtype
+        )
+
+        freqs = torch.outer(t, self.inv_freq)
+        # Different from paper, but it uses a different permutation in order to obtain the same calculation
+        emb = torch.cat((freqs, freqs), dim=-1)
+        self.register_buffer("cos_cached", emb.cos().to(dtype), persistent=False)
+        self.register_buffer("sin_cached", emb.sin().to(dtype), persistent=False)
+
+
+# Inverse dim formula to find dim based on number of rotations
+def yarn_find_correction_dim(
+    num_rotations, dim, base=10000, max_position_embeddings=2048
+):
+    return (dim * math.log(max_position_embeddings / (num_rotations * 2 * math.pi))) / (
+        2 * math.log(base)
+    )
+
+
+# Find dim range bounds based on rotations
+def yarn_find_correction_range(
+    low_rot, high_rot, dim, base=10000, max_position_embeddings=2048
+):
+    low = math.floor(
+        yarn_find_correction_dim(low_rot, dim, base, max_position_embeddings)
+    )
+    high = math.ceil(
+        yarn_find_correction_dim(high_rot, dim, base, max_position_embeddings)
+    )
+    return max(low, 0), min(high, dim - 1)  # Clamp values just in case
+
+
+def yarn_get_mscale(scale=1, mscale=1):
+    if scale <= 1:
+        return 1.0
+    return 0.1 * mscale * math.log(scale) + 1.0
+
+
+def yarn_linear_ramp_mask(min, max, dim):
+    if min == max:
+        max += 0.001  # Prevent singularity
+
+    linear_func = (torch.arange(dim, dtype=torch.float32) - min) / (max - min)
+    ramp_func = torch.clamp(linear_func, 0, 1)
+    return ramp_func
+
+
+class DeepseekV3YarnRotaryEmbedding(DeepseekV3RotaryEmbedding):
+
+    def __init__(
+        self,
+        dim,
+        max_position_embeddings=2048,
+        base=10000,
+        device=None,
+        scaling_factor=1.0,
+        original_max_position_embeddings=4096,
+        beta_fast=32,
+        beta_slow=1,
+        mscale=1,
+        mscale_all_dim=0,
+    ):
+        self.scaling_factor = scaling_factor
+        self.original_max_position_embeddings = original_max_position_embeddings
+        self.beta_fast = beta_fast
+        self.beta_slow = beta_slow
+        self.mscale = mscale
+        self.mscale_all_dim = mscale_all_dim
+        super().__init__(dim, max_position_embeddings, base, device)
+
+    def _set_cos_sin_cache(self, seq_len, device, dtype):
+        self.max_seq_len_cached = seq_len
+        dim = self.dim
+
+        freq_extra = 1.0 / (
+            self.base
+            ** (torch.arange(0, dim, 2, dtype=torch.float32, device=device) / dim)
+        )
+        freq_inter = 1.0 / (
+            self.scaling_factor
+            * self.base
+            ** (torch.arange(0, dim, 2, dtype=torch.float32, device=device) / dim)
+        )
+
+        low, high = yarn_find_correction_range(
+            self.beta_fast,
+            self.beta_slow,
+            dim,
+            self.base,
+            self.original_max_position_embeddings,
+        )
+        inv_freq_mask = 1.0 - yarn_linear_ramp_mask(low, high, dim // 2).to(
+            device=device, dtype=torch.float32
+        )
+        inv_freq = freq_inter * (1 - inv_freq_mask) + freq_extra * inv_freq_mask
+        self.register_buffer("inv_freq", inv_freq, persistent=False)
+
+        t = torch.arange(seq_len, device=device, dtype=torch.float32)
+
+        freqs = torch.outer(t, inv_freq)
+
+        _mscale = float(
+            yarn_get_mscale(self.scaling_factor, self.mscale)
+            / yarn_get_mscale(self.scaling_factor, self.mscale_all_dim)
+        )
+
+        emb = torch.cat((freqs, freqs), dim=-1)
+        self.register_buffer(
+            "cos_cached", (emb.cos() * _mscale).to(dtype), persistent=False
+        )
+        self.register_buffer(
+            "sin_cached", (emb.sin() * _mscale).to(dtype), persistent=False
+        )
+
+
+# Copied from transformers.models.llama.modeling_llama.rotate_half
+def rotate_half(x):
+    """Rotates half the hidden dims of the input."""
+    x1 = x[..., : x.shape[-1] // 2]
+    x2 = x[..., x.shape[-1] // 2 :]
+    return torch.cat((-x2, x1), dim=-1)
+
+
+# Copied from transformers.models.llama.modeling_llama.apply_rotary_pos_emb
+def apply_rotary_pos_emb(q, k, cos, sin, position_ids, unsqueeze_dim=1):
+    """Applies Rotary Position Embedding to the query and key tensors.
+
+    Args:
+        q (`torch.Tensor`): The query tensor.
+        k (`torch.Tensor`): The key tensor.
+        cos (`torch.Tensor`): The cosine part of the rotary embedding.
+        sin (`torch.Tensor`): The sine part of the rotary embedding.
+        position_ids (`torch.Tensor`):
+            The position indices of the tokens corresponding to the query and key tensors. For example, this can be
+            used to pass offsetted position ids when working with a KV-cache.
+        unsqueeze_dim (`int`, *optional*, defaults to 1):
+            The 'unsqueeze_dim' argument specifies the dimension along which to unsqueeze cos[position_ids] and
+            sin[position_ids] so that they can be properly broadcasted to the dimensions of q and k. For example, note
+            that cos[position_ids] and sin[position_ids] have the shape [batch_size, seq_len, head_dim]. Then, if q and
+            k have the shape [batch_size, heads, seq_len, head_dim], then setting unsqueeze_dim=1 makes
+            cos[position_ids] and sin[position_ids] broadcastable to the shapes of q and k. Similarly, if q and k have
+            the shape [batch_size, seq_len, heads, head_dim], then set unsqueeze_dim=2.
+    Returns:
+        `tuple(torch.Tensor)` comprising of the query and key tensors rotated using the Rotary Position Embedding.
+    """
+    cos = cos[position_ids].unsqueeze(unsqueeze_dim)
+    sin = sin[position_ids].unsqueeze(unsqueeze_dim)
+
+    b, h, s, d = q.shape
+    q = q.view(b, h, s, d // 2, 2).transpose(4, 3).reshape(b, h, s, d)
+
+    b, h, s, d = k.shape
+    k = k.view(b, h, s, d // 2, 2).transpose(4, 3).reshape(b, h, s, d)
+
+    q_embed = (q * cos) + (rotate_half(q) * sin)
+    k_embed = (k * cos) + (rotate_half(k) * sin)
+    return q_embed, k_embed
+
+
+class DeepseekV3MLP(nn.Module):
+    def __init__(self, config, hidden_size=None, intermediate_size=None):
+        super().__init__()
+        self.config = config
+        self.hidden_size = config.hidden_size if hidden_size is None else hidden_size
+        self.intermediate_size = (
+            config.intermediate_size if intermediate_size is None else intermediate_size
+        )
+
+        self.gate_proj = nn.Linear(self.hidden_size, self.intermediate_size, bias=False)
+        self.up_proj = nn.Linear(self.hidden_size, self.intermediate_size, bias=False)
+        self.down_proj = nn.Linear(self.intermediate_size, self.hidden_size, bias=False)
+        self.act_fn = ACT2FN[config.hidden_act]
+
+    def forward(self, x):
+        down_proj = self.down_proj(self.act_fn(self.gate_proj(x)) * self.up_proj(x))
+        return down_proj
+
+
+class MoEGate(nn.Module):
+    def __init__(self, config):
+        super().__init__()
+        self.config = config
+        self.top_k = config.num_experts_per_tok
+        self.n_routed_experts = config.n_routed_experts
+        self.routed_scaling_factor = config.routed_scaling_factor
+        self.scoring_func = config.scoring_func
+        self.seq_aux = config.seq_aux
+        self.topk_method = config.topk_method
+        self.n_group = config.n_group
+        self.topk_group = config.topk_group
+
+        # topk selection algorithm
+        self.norm_topk_prob = config.norm_topk_prob
+        self.gating_dim = config.hidden_size
+        self.weight = nn.Parameter(
+            torch.empty((self.n_routed_experts, self.gating_dim))
+        )
+        if self.topk_method == "noaux_tc":
+            self.e_score_correction_bias = nn.Parameter(
+                torch.empty((self.n_routed_experts))
+            )
+        self.reset_parameters()
+
+    def reset_parameters(self) -> None:
+        import torch.nn.init as init
+
+        init.kaiming_uniform_(self.weight, a=math.sqrt(5))
+
+    def forward(self, hidden_states):
+        bsz, seq_len, h = hidden_states.shape
+        ### compute gating score
+        hidden_states = hidden_states.view(-1, h)
+        logits = F.linear(
+            hidden_states.type(torch.float32), self.weight.type(torch.float32), None
+        )
+        if self.scoring_func == "sigmoid":
+            scores = logits.sigmoid()
+        else:
+            raise NotImplementedError(
+                f"insupportable scoring function for MoE gating: {self.scoring_func}"
+            )
+
+        ### select top-k experts
+        if self.topk_method == "noaux_tc":
+            assert not self.training
+            scores_for_choice = scores.view(bsz * seq_len, -1) + self.e_score_correction_bias.unsqueeze(0)
+            group_scores = (
+                scores_for_choice.view(bsz * seq_len, self.n_group, -1).topk(2, dim=-1)[0].sum(dim = -1)
+            )  # [n, n_group]
+            group_idx = torch.topk(
+                group_scores, k=self.topk_group, dim=-1, sorted=False
+            )[
+                1
+            ]  # [n, top_k_group]
+            group_mask = torch.zeros_like(group_scores)  # [n, n_group]
+            group_mask.scatter_(1, group_idx, 1)  # [n, n_group]
+            score_mask = (
+                group_mask.unsqueeze(-1)
+                .expand(
+                    bsz * seq_len, self.n_group, self.n_routed_experts // self.n_group
+                )
+                .reshape(bsz * seq_len, -1)
+            )  # [n, e]
+            tmp_scores = scores_for_choice.masked_fill(~score_mask.bool(), 0.0)  # [n, e]
+            _, topk_idx = torch.topk(
+                tmp_scores, k=self.top_k, dim=-1, sorted=False
+            )
+            topk_weight = scores.gather(1, topk_idx)
+        else:
+            raise NotImplementedError(
+                f"insupportable TopK function for MoE gating: {self.topk_method}"
+            )
+
+        ### norm gate to sum 1
+        if self.top_k > 1 and self.norm_topk_prob:
+            denominator = topk_weight.sum(dim=-1, keepdim=True) + 1e-20
+            topk_weight = topk_weight / denominator
+        topk_weight = topk_weight * self.routed_scaling_factor # must multiply the scaling factor
+
+        return topk_idx, topk_weight
+
+class DeepseekV3MoE(nn.Module):
+    """
+    A mixed expert module containing shared experts.
+    """
+
+    def __init__(self, config):
+        super().__init__()
+        self.config = config
+        self.num_experts_per_tok = config.num_experts_per_tok
+
+        if hasattr(config, "ep_size") and config.ep_size > 1:
+            assert config.ep_size == dist.get_world_size()
+            self.ep_size = config.ep_size
+            self.experts_per_rank = config.n_routed_experts // config.ep_size
+            self.ep_rank = dist.get_rank()
+            self.experts = nn.ModuleList(
+                [
+                    (
+                        DeepseekV3MLP(
+                            config, intermediate_size=config.moe_intermediate_size
+                        )
+                        if i >= self.ep_rank * self.experts_per_rank
+                        and i < (self.ep_rank + 1) * self.experts_per_rank
+                        else None
+                    )
+                    for i in range(config.n_routed_experts)
+                ]
+            )
+        else:
+            self.ep_size = 1
+            self.experts_per_rank = config.n_routed_experts
+            self.ep_rank = 0
+            self.experts = nn.ModuleList(
+                [
+                    DeepseekV3MLP(
+                        config, intermediate_size=config.moe_intermediate_size
+                    )
+                    for i in range(config.n_routed_experts)
+                ]
+            )
+        self.gate = MoEGate(config)
+        if config.n_shared_experts is not None:
+            intermediate_size = config.moe_intermediate_size * config.n_shared_experts
+            self.shared_experts = DeepseekV3MLP(
+                config=config, intermediate_size=intermediate_size
+            )
+
+    def forward(self, hidden_states):
+        identity = hidden_states
+        orig_shape = hidden_states.shape
+        topk_idx, topk_weight = self.gate(hidden_states)
+        hidden_states = hidden_states.view(-1, hidden_states.shape[-1])
+        flat_topk_idx = topk_idx.view(-1)
+        if not self.training:
+            y = self.moe_infer(hidden_states, topk_idx, topk_weight).view(*orig_shape)
+        if self.config.n_shared_experts is not None:
+            y = y + self.shared_experts(identity)
+        return y
+
+    @torch.no_grad()
+    def moe_infer(self, x, topk_ids, topk_weight):
+        cnts = topk_ids.new_zeros((topk_ids.shape[0], len(self.experts)))
+        cnts.scatter_(1, topk_ids, 1)
+        tokens_per_expert = cnts.sum(dim=0)
+        idxs = topk_ids.view(-1).argsort()
+        sorted_tokens = x[idxs // topk_ids.shape[1]]
+        sorted_tokens_shape = sorted_tokens.shape
+        if self.ep_size > 1:
+            tokens_per_ep_rank = tokens_per_expert.view(self.ep_size, -1).sum(dim=1)
+            tokens_per_expert_group = tokens_per_expert.new_empty(
+                tokens_per_expert.shape[0]
+            )
+            dist.all_to_all_single(tokens_per_expert_group, tokens_per_expert)
+            output_splits = (
+                tokens_per_expert_group.view(self.ep_size, -1)
+                .sum(1)
+                .cpu()
+                .numpy()
+                .tolist()
+            )
+            gathered_tokens = sorted_tokens.new_empty(
+                tokens_per_expert_group.sum(dim=0).cpu().item(), sorted_tokens.shape[1]
+            )
+            input_split_sizes = tokens_per_ep_rank.cpu().numpy().tolist()
+            dist.all_to_all(
+                list(gathered_tokens.split(output_splits)),
+                list(sorted_tokens.split(input_split_sizes)),
+            )
+            tokens_per_expert_post_gather = tokens_per_expert_group.view(
+                self.ep_size, self.experts_per_rank
+            ).sum(dim=0)
+            gatherd_idxs = np.zeros(shape=(gathered_tokens.shape[0],), dtype=np.int32)
+            s = 0
+            for i, k in enumerate(tokens_per_expert_group.cpu().numpy()):
+                gatherd_idxs[s : s + k] = i % self.experts_per_rank
+                s += k
+            gatherd_idxs = gatherd_idxs.argsort()
+            sorted_tokens = gathered_tokens[gatherd_idxs]
+            tokens_per_expert = tokens_per_expert_post_gather
+        tokens_per_expert = tokens_per_expert.cpu().numpy()
+
+        outputs = []
+        start_idx = 0
+        for i, num_tokens in enumerate(tokens_per_expert):
+            end_idx = start_idx + num_tokens
+            if num_tokens == 0:
+                continue
+            expert = self.experts[i + self.ep_rank * self.experts_per_rank]
+            tokens_for_this_expert = sorted_tokens[start_idx:end_idx]
+            expert_out = expert(tokens_for_this_expert)
+            outputs.append(expert_out)
+            start_idx = end_idx
+
+        outs = torch.cat(outputs, dim=0) if len(outputs) else sorted_tokens.new_empty(0)
+        if self.ep_size > 1:
+            new_x = torch.empty_like(outs)
+            new_x[gatherd_idxs] = outs
+            gathered_tokens = new_x.new_empty(*sorted_tokens_shape)
+            dist.all_to_all(
+                list(gathered_tokens.split(input_split_sizes)),
+                list(new_x.split(output_splits)),
+            )
+            outs = gathered_tokens
+
+        new_x = torch.empty_like(outs)
+        new_x[idxs] = outs
+        final_out = (
+            new_x.view(*topk_ids.shape, -1)
+            .type(topk_weight.dtype)
+            .mul_(topk_weight.unsqueeze(dim=-1))
+            .sum(dim=1)
+            .type(new_x.dtype)
+        )
+        return final_out
+
+
+# Copied from transformers.models.llama.modeling_llama.repeat_kv
+def repeat_kv(hidden_states: torch.Tensor, n_rep: int) -> torch.Tensor:
+    """
+    This is the equivalent of torch.repeat_interleave(x, dim=1, repeats=n_rep). The hidden states go from (batch,
+    num_key_value_heads, seqlen, head_dim) to (batch, num_attention_heads, seqlen, head_dim)
+    """
+    batch, num_key_value_heads, slen, head_dim = hidden_states.shape
+    if n_rep == 1:
+        return hidden_states
+    hidden_states = hidden_states[:, :, None, :, :].expand(
+        batch, num_key_value_heads, n_rep, slen, head_dim
+    )
+    return hidden_states.reshape(batch, num_key_value_heads * n_rep, slen, head_dim)
+
+
+# Copied from transformers.models.llama.modeling_llama.LlamaAttention with Llama->DeepseekV3
+class DeepseekV3Attention(nn.Module):
+    """Multi-headed attention from 'Attention Is All You Need' paper"""
+
+    def __init__(self, config: DeepseekV3Config, layer_idx: Optional[int] = None):
+        super().__init__()
+        self.config = config
+        self.layer_idx = layer_idx
+        if layer_idx is None:
+            logger.warning_once(
+                f"Instantiating {self.__class__.__name__} without passing `layer_idx` is not recommended and will "
+                "to errors during the forward call, if caching is used. Please make sure to provide a `layer_idx` "
+                "when creating this class."
+            )
+
+        self.attention_dropout = config.attention_dropout
+        self.hidden_size = config.hidden_size
+        self.num_heads = config.num_attention_heads
+
+        self.max_position_embeddings = config.max_position_embeddings
+        self.rope_theta = config.rope_theta
+        self.q_lora_rank = config.q_lora_rank
+        self.qk_rope_head_dim = config.qk_rope_head_dim
+        self.kv_lora_rank = config.kv_lora_rank
+        self.v_head_dim = config.v_head_dim
+        self.qk_nope_head_dim = config.qk_nope_head_dim
+        self.q_head_dim = config.qk_nope_head_dim + config.qk_rope_head_dim
+
+        self.is_causal = True
+
+        if self.q_lora_rank is None:
+            self.q_proj = nn.Linear(
+                self.hidden_size, self.num_heads * self.q_head_dim, bias=False
+            )
+        else:
+            self.q_a_proj = nn.Linear(
+                self.hidden_size, config.q_lora_rank, bias=config.attention_bias
+            )
+            self.q_a_layernorm = DeepseekV3RMSNorm(config.q_lora_rank)
+            self.q_b_proj = nn.Linear(
+                config.q_lora_rank, self.num_heads * self.q_head_dim, bias=False
+            )
+
+        self.kv_a_proj_with_mqa = nn.Linear(
+            self.hidden_size,
+            config.kv_lora_rank + config.qk_rope_head_dim,
+            bias=config.attention_bias,
+        )
+        self.kv_a_layernorm = DeepseekV3RMSNorm(config.kv_lora_rank)
+        self.kv_b_proj = nn.Linear(
+            config.kv_lora_rank,
+            self.num_heads
+            * (self.q_head_dim - self.qk_rope_head_dim + self.v_head_dim),
+            bias=False,
+        )
+
+        self.o_proj = nn.Linear(
+            self.num_heads * self.v_head_dim,
+            self.hidden_size,
+            bias=config.attention_bias,
+        )
+        self._init_rope()
+
+        self.softmax_scale = self.q_head_dim ** (-0.5)
+        if self.config.rope_scaling is not None:
+            mscale_all_dim = self.config.rope_scaling.get("mscale_all_dim", 0)
+            scaling_factor = self.config.rope_scaling["factor"]
+            if mscale_all_dim:
+                mscale = yarn_get_mscale(scaling_factor, mscale_all_dim)
+                self.softmax_scale = self.softmax_scale * mscale * mscale
+
+    def _init_rope(self):
+        if self.config.rope_scaling is None:
+            self.rotary_emb = DeepseekV3RotaryEmbedding(
+                self.qk_rope_head_dim,
+                max_position_embeddings=self.max_position_embeddings,
+                base=self.rope_theta,
+            )
+        else:
+            scaling_type = self.config.rope_scaling["type"]
+            scaling_factor = self.config.rope_scaling["factor"]
+            if scaling_type == "linear":
+                self.rotary_emb = DeepseekV3LinearScalingRotaryEmbedding(
+                    self.qk_rope_head_dim,
+                    max_position_embeddings=self.max_position_embeddings,
+                    scaling_factor=scaling_factor,
+                    base=self.rope_theta,
+                )
+            elif scaling_type == "dynamic":
+                self.rotary_emb = DeepseekV3DynamicNTKScalingRotaryEmbedding(
+                    self.qk_rope_head_dim,
+                    max_position_embeddings=self.max_position_embeddings,
+                    scaling_factor=scaling_factor,
+                    base=self.rope_theta,
+                )
+            elif scaling_type == "yarn":
+                kwargs = {
+                    key: self.config.rope_scaling[key]
+                    for key in [
+                        "original_max_position_embeddings",
+                        "beta_fast",
+                        "beta_slow",
+                        "mscale",
+                        "mscale_all_dim",
+                    ]
+                    if key in self.config.rope_scaling
+                }
+                self.rotary_emb = DeepseekV3YarnRotaryEmbedding(
+                    self.qk_rope_head_dim,
+                    max_position_embeddings=self.max_position_embeddings,
+                    scaling_factor=scaling_factor,
+                    base=self.rope_theta,
+                    **kwargs,
+                )
+            else:
+                raise ValueError(f"Unknown RoPE scaling type {scaling_type}")
+
+    def _shape(self, tensor: torch.Tensor, seq_len: int, bsz: int):
+        return (
+            tensor.view(bsz, seq_len, self.num_heads, self.v_head_dim)
+            .transpose(1, 2)
+            .contiguous()
+        )
+
+    def forward(
+        self,
+        hidden_states: torch.Tensor,
+        attention_mask: Optional[torch.Tensor] = None,
+        position_ids: Optional[torch.LongTensor] = None,
+        past_key_value: Optional[Cache] = None,
+        output_attentions: bool = False,
+        use_cache: bool = False,
+        **kwargs,
+    ) -> Tuple[torch.Tensor, Optional[torch.Tensor], Optional[Tuple[torch.Tensor]]]:
+        if "padding_mask" in kwargs:
+            warnings.warn(
+                "Passing `padding_mask` is deprecated and will be removed in v4.37. Please make sure use `attention_mask` instead.`"
+            )
+        bsz, q_len, _ = hidden_states.size()
+
+        if self.q_lora_rank is None:
+            q = self.q_proj(hidden_states)
+        else:
+            q = self.q_b_proj(self.q_a_layernorm(self.q_a_proj(hidden_states)))
+        q = q.view(bsz, q_len, self.num_heads, self.q_head_dim).transpose(1, 2)
+        q_nope, q_pe = torch.split(
+            q, [self.qk_nope_head_dim, self.qk_rope_head_dim], dim=-1
+        )
+
+        compressed_kv = self.kv_a_proj_with_mqa(hidden_states)
+        compressed_kv, k_pe = torch.split(
+            compressed_kv, [self.kv_lora_rank, self.qk_rope_head_dim], dim=-1
+        )
+        k_pe = k_pe.view(bsz, q_len, 1, self.qk_rope_head_dim).transpose(1, 2)
+        kv = (
+            self.kv_b_proj(self.kv_a_layernorm(compressed_kv))
+            .view(bsz, q_len, self.num_heads, self.qk_nope_head_dim + self.v_head_dim)
+            .transpose(1, 2)
+        )
+
+        k_nope, value_states = torch.split(
+            kv, [self.qk_nope_head_dim, self.v_head_dim], dim=-1
+        )
+        kv_seq_len = value_states.shape[-2]
+        if past_key_value is not None:
+            if self.layer_idx is None:
+                raise ValueError(
+                    f"The cache structure has changed since version v4.36. If you are using {self.__class__.__name__} "
+                    "for auto-regressive decoding with k/v caching, please make sure to initialize the attention class "
+                    "with a layer index."
+                )
+            kv_seq_len += past_key_value.get_usable_length(kv_seq_len, self.layer_idx)
+        cos, sin = self.rotary_emb(value_states, seq_len=kv_seq_len)
+
+        q_pe, k_pe = apply_rotary_pos_emb(q_pe, k_pe, cos, sin, position_ids)
+
+        query_states = k_pe.new_empty(bsz, self.num_heads, q_len, self.q_head_dim)
+        query_states[:, :, :, : self.qk_nope_head_dim] = q_nope
+        query_states[:, :, :, self.qk_nope_head_dim :] = q_pe
+
+        key_states = k_pe.new_empty(bsz, self.num_heads, q_len, self.q_head_dim)
+        key_states[:, :, :, : self.qk_nope_head_dim] = k_nope
+        key_states[:, :, :, self.qk_nope_head_dim :] = k_pe
+        if past_key_value is not None:
+            cache_kwargs = {"sin": sin, "cos": cos}  # Specific to RoPE models
+            key_states, value_states = past_key_value.update(
+                key_states, value_states, self.layer_idx, cache_kwargs
+            )
+
+        attn_weights = (
+            torch.matmul(query_states, key_states.transpose(2, 3)) * self.softmax_scale
+        )
+
+        if attn_weights.size() != (bsz, self.num_heads, q_len, kv_seq_len):
+            raise ValueError(
+                f"Attention weights should be of size {(bsz, self.num_heads, q_len, kv_seq_len)}, but is"
+                f" {attn_weights.size()}"
+            )
+        assert attention_mask is not None
+        if attention_mask is not None:
+            if attention_mask.size() != (bsz, 1, q_len, kv_seq_len):
+                raise ValueError(
+                    f"Attention mask should be of size {(bsz, 1, q_len, kv_seq_len)}, but is {attention_mask.size()}"
+                )
+            attn_weights = attn_weights + attention_mask
+
+        # upcast attention to fp32
+        attn_weights = nn.functional.softmax(
+            attn_weights, dim=-1, dtype=torch.float32
+        ).to(query_states.dtype)
+        attn_weights = nn.functional.dropout(
+            attn_weights, p=self.attention_dropout, training=self.training
+        )
+        attn_output = torch.matmul(attn_weights, value_states)
+
+        if attn_output.size() != (bsz, self.num_heads, q_len, self.v_head_dim):
+            raise ValueError(
+                f"`attn_output` should be of size {(bsz, self.num_heads, q_len, self.v_head_dim)}, but is"
+                f" {attn_output.size()}"
+            )
+
+        attn_output = attn_output.transpose(1, 2).contiguous()
+
+        attn_output = attn_output.reshape(bsz, q_len, self.num_heads * self.v_head_dim)
+
+        attn_output = self.o_proj(attn_output)
+
+        if not output_attentions:
+            attn_weights = None
+
+        return attn_output, attn_weights, past_key_value
+
+
+# Copied from transformers.models.llama.modeling_llama.LlamaFlashAttention2 with Llama->DeepseekV3
+class DeepseekV3FlashAttention2(DeepseekV3Attention):
+    """
+    DeepseekV3 flash attention module. This module inherits from `DeepseekV3Attention` as the weights of the module stays
+    untouched. The only required change would be on the forward pass where it needs to correctly call the public API of
+    flash attention and deal with padding tokens in case the input contains any of them.
+    """
+
+    def __init__(self, *args, **kwargs):
+        super().__init__(*args, **kwargs)
+
+        # TODO: Should be removed once Flash Attention for RoCm is bumped to 2.1.
+        # flash_attn<2.1 generates top-left aligned causal mask, while what is needed here is bottom-right alignement, that was made default for flash_attn>=2.1. This attribute is used to handle this difference. Reference: https://github.com/Dao-AILab/flash-attention/releases/tag/v2.1.0.
+        # Beware that with flash_attn<2.1, using q_seqlen != k_seqlen (except for the case q_seqlen == 1) produces a wrong mask (top-left).
+        self._flash_attn_uses_top_left_mask = not is_flash_attn_greater_or_equal_2_10()
+
+    def forward(
+        self,
+        hidden_states: torch.Tensor,
+        attention_mask: Optional[torch.LongTensor] = None,
+        position_ids: Optional[torch.LongTensor] = None,
+        past_key_value: Optional[Cache] = None,
+        output_attentions: bool = False,
+        use_cache: bool = False,
+        **kwargs,
+    ) -> Tuple[torch.Tensor, Optional[torch.Tensor], Optional[Tuple[torch.Tensor]]]:
+        # DeepseekV3FlashAttention2 attention does not support output_attentions
+        if "padding_mask" in kwargs:
+            warnings.warn(
+                "Passing `padding_mask` is deprecated and will be removed in v4.37. Please make sure use `attention_mask` instead.`"
+            )
+
+            # overwrite attention_mask with padding_mask
+            attention_mask = kwargs.pop("padding_mask")
+
+        output_attentions = False
+
+        bsz, q_len, _ = hidden_states.size()
+
+        if self.q_lora_rank is None:
+            q = self.q_proj(hidden_states)
+        else:
+            q = self.q_b_proj(self.q_a_layernorm(self.q_a_proj(hidden_states)))
+        q = q.view(bsz, q_len, self.num_heads, self.q_head_dim).transpose(1, 2)
+        q_nope, q_pe = torch.split(
+            q, [self.qk_nope_head_dim, self.qk_rope_head_dim], dim=-1
+        )
+
+        # Flash attention requires the input to have the shape
+        # batch_size x seq_length x head_dim x hidden_dim
+        # therefore we just need to keep the original shape
+        compressed_kv = self.kv_a_proj_with_mqa(hidden_states)
+        compressed_kv, k_pe = torch.split(
+            compressed_kv, [self.kv_lora_rank, self.qk_rope_head_dim], dim=-1
+        )
+        k_pe = k_pe.view(bsz, q_len, 1, self.qk_rope_head_dim).transpose(1, 2)
+        kv = (
+            self.kv_b_proj(self.kv_a_layernorm(compressed_kv))
+            .view(bsz, q_len, self.num_heads, self.qk_nope_head_dim + self.v_head_dim)
+            .transpose(1, 2)
+        )
+
+        k_nope, value_states = torch.split(
+            kv, [self.qk_nope_head_dim, self.v_head_dim], dim=-1
+        )
+        kv_seq_len = value_states.shape[-2]
+
+        kv_seq_len = value_states.shape[-2]
+        if past_key_value is not None:
+            kv_seq_len += past_key_value.get_usable_length(kv_seq_len, self.layer_idx)
+
+        cos, sin = self.rotary_emb(value_states, seq_len=kv_seq_len)
+        q_pe, k_pe = apply_rotary_pos_emb(q_pe, k_pe, cos, sin, position_ids)
+
+        query_states = k_pe.new_empty(bsz, self.num_heads, q_len, self.q_head_dim)
+        query_states[:, :, :, : self.qk_nope_head_dim] = q_nope
+        query_states[:, :, :, self.qk_nope_head_dim :] = q_pe
+
+        key_states = k_pe.new_empty(bsz, self.num_heads, q_len, self.q_head_dim)
+        key_states[:, :, :, : self.qk_nope_head_dim] = k_nope
+        key_states[:, :, :, self.qk_nope_head_dim :] = k_pe
+
+        if self.q_head_dim != self.v_head_dim:
+            value_states = F.pad(value_states, [0, self.q_head_dim - self.v_head_dim])
+
+        if past_key_value is not None:
+            cache_kwargs = {"sin": sin, "cos": cos}  # Specific to RoPE models
+            key_states, value_states = past_key_value.update(
+                key_states, value_states, self.layer_idx, cache_kwargs
+            )
+
+        # TODO: These transpose are quite inefficient but Flash Attention requires the layout [batch_size, sequence_length, num_heads, head_dim]. We would need to refactor the KV cache
+        # to be able to avoid many of these transpose/reshape/view.
+        query_states = query_states.transpose(1, 2)
+        key_states = key_states.transpose(1, 2)
+        value_states = value_states.transpose(1, 2)
+
+        dropout_rate = self.attention_dropout if self.training else 0.0
+
+        # In PEFT, usually we cast the layer norms in float32 for training stability reasons
+        # therefore the input hidden states gets silently casted in float32. Hence, we need
+        # cast them back in the correct dtype just to be sure everything works as expected.
+        # This might slowdown training & inference so it is recommended to not cast the LayerNorms
+        # in fp32. (DeepseekV3RMSNorm handles it correctly)
+
+        input_dtype = query_states.dtype
+        if input_dtype == torch.float32:
+            # Handle the case where the model is quantized
+            if hasattr(self.config, "_pre_quantization_dtype"):
+                target_dtype = self.config._pre_quantization_dtype
+            elif torch.is_autocast_enabled():
+                target_dtype = torch.get_autocast_gpu_dtype()
+            else:
+                target_dtype = (
+                    self.q_proj.weight.dtype
+                    if self.q_lora_rank is None
+                    else self.q_a_proj.weight.dtype
+                )
+
+            logger.warning_once(
+                f"The input hidden states seems to be silently casted in float32, this might be related to"
+                f" the fact you have upcasted embedding or layer norm layers in float32. We will cast back the input in"
+                f" {target_dtype}."
+            )
+
+            query_states = query_states.to(target_dtype)
+            key_states = key_states.to(target_dtype)
+            value_states = value_states.to(target_dtype)
+
+        attn_output = self._flash_attention_forward(
+            query_states,
+            key_states,
+            value_states,
+            attention_mask,
+            q_len,
+            dropout=dropout_rate,
+            softmax_scale=self.softmax_scale,
+        )
+        if self.q_head_dim != self.v_head_dim:
+            attn_output = attn_output[:, :, :, : self.v_head_dim]
+
+        attn_output = attn_output.reshape(
+            bsz, q_len, self.num_heads * self.v_head_dim
+        ).contiguous()
+        attn_output = self.o_proj(attn_output)
+
+        if not output_attentions:
+            attn_weights = None
+
+        return attn_output, attn_weights, past_key_value
+
+    def _flash_attention_forward(
+        self,
+        query_states,
+        key_states,
+        value_states,
+        attention_mask,
+        query_length,
+        dropout=0.0,
+        softmax_scale=None,
+    ):
+        """
+        Calls the forward method of Flash Attention - if the input hidden states contain at least one padding token
+        first unpad the input, then computes the attention scores and pad the final attention scores.
+
+        Args:
+            query_states (`torch.Tensor`):
+                Input query states to be passed to Flash Attention API
+            key_states (`torch.Tensor`):
+                Input key states to be passed to Flash Attention API
+            value_states (`torch.Tensor`):
+                Input value states to be passed to Flash Attention API
+            attention_mask (`torch.Tensor`):
+                The padding mask - corresponds to a tensor of size `(batch_size, seq_len)` where 0 stands for the
+                position of padding tokens and 1 for the position of non-padding tokens.
+            dropout (`int`, *optional*):
+                Attention dropout
+            softmax_scale (`float`, *optional*):
+                The scaling of QK^T before applying softmax. Default to 1 / sqrt(head_dim)
+        """
+        if not self._flash_attn_uses_top_left_mask:
+            causal = self.is_causal
+        else:
+            # TODO: Remove the `query_length != 1` check once Flash Attention for RoCm is bumped to 2.1. For details, please see the comment in DeepseekV3FlashAttention2 __init__.
+            causal = self.is_causal and query_length != 1
+
+        # Contains at least one padding token in the sequence
+        if attention_mask is not None:
+            batch_size = query_states.shape[0]
+            (
+                query_states,
+                key_states,
+                value_states,
+                indices_q,
+                cu_seq_lens,
+                max_seq_lens,
+            ) = self._upad_input(
+                query_states, key_states, value_states, attention_mask, query_length
+            )
+
+            cu_seqlens_q, cu_seqlens_k = cu_seq_lens
+            max_seqlen_in_batch_q, max_seqlen_in_batch_k = max_seq_lens
+
+            attn_output_unpad = flash_attn_varlen_func(
+                query_states,
+                key_states,
+                value_states,
+                cu_seqlens_q=cu_seqlens_q,
+                cu_seqlens_k=cu_seqlens_k,
+                max_seqlen_q=max_seqlen_in_batch_q,
+                max_seqlen_k=max_seqlen_in_batch_k,
+                dropout_p=dropout,
+                softmax_scale=softmax_scale,
+                causal=causal,
+            )
+
+            attn_output = pad_input(
+                attn_output_unpad, indices_q, batch_size, query_length
+            )
+        else:
+            attn_output = flash_attn_func(
+                query_states,
+                key_states,
+                value_states,
+                dropout,
+                softmax_scale=softmax_scale,
+                causal=causal,
+            )
+
+        return attn_output
+
+    def _upad_input(
+        self, query_layer, key_layer, value_layer, attention_mask, query_length
+    ):
+        indices_k, cu_seqlens_k, max_seqlen_in_batch_k = _get_unpad_data(attention_mask)
+        batch_size, kv_seq_len, num_key_value_heads, head_dim = key_layer.shape
+
+        key_layer = index_first_axis(
+            key_layer.reshape(batch_size * kv_seq_len, num_key_value_heads, head_dim),
+            indices_k,
+        )
+        value_layer = index_first_axis(
+            value_layer.reshape(batch_size * kv_seq_len, num_key_value_heads, head_dim),
+            indices_k,
+        )
+        if query_length == kv_seq_len:
+            query_layer = index_first_axis(
+                query_layer.reshape(batch_size * kv_seq_len, self.num_heads, head_dim),
+                indices_k,
+            )
+            cu_seqlens_q = cu_seqlens_k
+            max_seqlen_in_batch_q = max_seqlen_in_batch_k
+            indices_q = indices_k
+        elif query_length == 1:
+            max_seqlen_in_batch_q = 1
+            cu_seqlens_q = torch.arange(
+                batch_size + 1, dtype=torch.int32, device=query_layer.device
+            )  # There is a memcpy here, that is very bad.
+            indices_q = cu_seqlens_q[:-1]
+            query_layer = query_layer.squeeze(1)
+        else:
+            # The -q_len: slice assumes left padding.
+            attention_mask = attention_mask[:, -query_length:]
+            query_layer, indices_q, cu_seqlens_q, max_seqlen_in_batch_q = unpad_input(
+                query_layer, attention_mask
+            )
+
+        return (
+            query_layer,
+            key_layer,
+            value_layer,
+            indices_q,
+            (cu_seqlens_q, cu_seqlens_k),
+            (max_seqlen_in_batch_q, max_seqlen_in_batch_k),
+        )
+
+
+ATTENTION_CLASSES = {
+    "eager": DeepseekV3Attention,
+    "flash_attention_2": DeepseekV3FlashAttention2,
+}
+
+
+class DeepseekV3DecoderLayer(nn.Module):
+    def __init__(self, config: DeepseekV3Config, layer_idx: int):
+        super().__init__()
+        self.hidden_size = config.hidden_size
+
+        self.self_attn = ATTENTION_CLASSES[config._attn_implementation](
+            config=config, layer_idx=layer_idx
+        )
+
+        self.mlp = (
+            DeepseekV3MoE(config)
+            if (
+                config.n_routed_experts is not None
+                and layer_idx >= config.first_k_dense_replace
+                and layer_idx % config.moe_layer_freq == 0
+            )
+            else DeepseekV3MLP(config)
+        )
+        self.input_layernorm = DeepseekV3RMSNorm(
+            config.hidden_size, eps=config.rms_norm_eps
+        )
+        self.post_attention_layernorm = DeepseekV3RMSNorm(
+            config.hidden_size, eps=config.rms_norm_eps
+        )
+
+    def forward(
+        self,
+        hidden_states: torch.Tensor,
+        attention_mask: Optional[torch.Tensor] = None,
+        position_ids: Optional[torch.LongTensor] = None,
+        past_key_value: Optional[Tuple[torch.Tensor]] = None,
+        output_attentions: Optional[bool] = False,
+        use_cache: Optional[bool] = False,
+        **kwargs,
+    ) -> Tuple[
+        torch.FloatTensor, Optional[Tuple[torch.FloatTensor, torch.FloatTensor]]
+    ]:
+        """
+        Args:
+            hidden_states (`torch.FloatTensor`): input to the layer of shape `(batch, seq_len, embed_dim)`
+            attention_mask (`torch.FloatTensor`, *optional*):
+                attention mask of size `(batch_size, sequence_length)` if flash attention is used or `(batch_size, 1,
+                query_sequence_length, key_sequence_length)` if default attention is used.
+            output_attentions (`bool`, *optional*):
+                Whether or not to return the attentions tensors of all attention layers. See `attentions` under
+                returned tensors for more detail.
+            use_cache (`bool`, *optional*):
+                If set to `True`, `past_key_values` key value states are returned and can be used to speed up decoding
+                (see `past_key_values`).
+            past_key_value (`Tuple(torch.FloatTensor)`, *optional*): cached past key and value projection states
+        """
+        if "padding_mask" in kwargs:
+            warnings.warn(
+                "Passing `padding_mask` is deprecated and will be removed in v4.37. Please make sure use `attention_mask` instead.`"
+            )
+        residual = hidden_states
+
+        hidden_states = self.input_layernorm(hidden_states)
+
+        # Self Attention
+        hidden_states, self_attn_weights, present_key_value = self.self_attn(
+            hidden_states=hidden_states,
+            attention_mask=attention_mask,
+            position_ids=position_ids,
+            past_key_value=past_key_value,
+            output_attentions=output_attentions,
+            use_cache=use_cache,
+            **kwargs,
+        )
+        hidden_states = residual + hidden_states
+
+        # Fully Connected
+        residual = hidden_states
+        hidden_states = self.post_attention_layernorm(hidden_states)
+        hidden_states = self.mlp(hidden_states)
+        hidden_states = residual + hidden_states
+
+        outputs = (hidden_states,)
+
+        if output_attentions:
+            outputs += (self_attn_weights,)
+
+        if use_cache:
+            outputs += (present_key_value,)
+
+        return outputs
+
+
+DeepseekV3_START_DOCSTRING = r"""
+    This model inherits from [`PreTrainedModel`]. Check the superclass documentation for the generic methods the
+    library implements for all its model (such as downloading or saving, resizing the input embeddings, pruning heads
+    etc.)
+
+    This model is also a PyTorch [torch.nn.Module](https://pytorch.org/docs/stable/nn.html#torch.nn.Module) subclass.
+    Use it as a regular PyTorch Module and refer to the PyTorch documentation for all matter related to general usage
+    and behavior.
+
+    Parameters:
+        config ([`DeepseekV3Config`]):
+            Model configuration class with all the parameters of the model. Initializing with a config file does not
+            load the weights associated with the model, only the configuration. Check out the
+            [`~PreTrainedModel.from_pretrained`] method to load the model weights.
+"""
+
+
+@add_start_docstrings(
+    "The bare DeepseekV3 Model outputting raw hidden-states without any specific head on top.",
+    DeepseekV3_START_DOCSTRING,
+)
+class DeepseekV3PreTrainedModel(PreTrainedModel):
+    config_class = DeepseekV3Config
+    base_model_prefix = "model"
+    supports_gradient_checkpointing = True
+    _no_split_modules = ["DeepseekV3DecoderLayer"]
+    _skip_keys_device_placement = "past_key_values"
+    _supports_flash_attn_2 = True
+    _supports_cache_class = True
+
+    def _init_weights(self, module):
+        std = self.config.initializer_range
+        if isinstance(module, nn.Linear):
+            module.weight.data.normal_(mean=0.0, std=std)
+            if module.bias is not None:
+                module.bias.data.zero_()
+        elif isinstance(module, nn.Embedding):
+            module.weight.data.normal_(mean=0.0, std=std)
+            if module.padding_idx is not None:
+                module.weight.data[module.padding_idx].zero_()
+
+
+DeepseekV3_INPUTS_DOCSTRING = r"""
+    Args:
+        input_ids (`torch.LongTensor` of shape `(batch_size, sequence_length)`):
+            Indices of input sequence tokens in the vocabulary. Padding will be ignored by default should you provide
+            it.
+
+            Indices can be obtained using [`AutoTokenizer`]. See [`PreTrainedTokenizer.encode`] and
+            [`PreTrainedTokenizer.__call__`] for details.
+
+            [What are input IDs?](../glossary#input-ids)
+        attention_mask (`torch.Tensor` of shape `(batch_size, sequence_length)`, *optional*):
+            Mask to avoid performing attention on padding token indices. Mask values selected in `[0, 1]`:
+
+            - 1 for tokens that are **not masked**,
+            - 0 for tokens that are **masked**.
+
+            [What are attention masks?](../glossary#attention-mask)
+
+            Indices can be obtained using [`AutoTokenizer`]. See [`PreTrainedTokenizer.encode`] and
+            [`PreTrainedTokenizer.__call__`] for details.
+
+            If `past_key_values` is used, optionally only the last `input_ids` have to be input (see
+            `past_key_values`).
+
+            If you want to change padding behavior, you should read [`modeling_opt._prepare_decoder_attention_mask`]
+            and modify to your needs. See diagram 1 in [the paper](https://arxiv.org/abs/1910.13461) for more
+            information on the default strategy.
+
+            - 1 indicates the head is **not masked**,
+            - 0 indicates the head is **masked**.
+        position_ids (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*):
+            Indices of positions of each input sequence tokens in the position embeddings. Selected in the range `[0,
+            config.n_positions - 1]`.
+
+            [What are position IDs?](../glossary#position-ids)
+        past_key_values (`Cache` or `tuple(tuple(torch.FloatTensor))`, *optional*):
+            Pre-computed hidden-states (key and values in the self-attention blocks and in the cross-attention
+            blocks) that can be used to speed up sequential decoding. This typically consists in the `past_key_values`
+            returned by the model at a previous stage of decoding, when `use_cache=True` or `config.use_cache=True`.
+
+            Two formats are allowed:
+            - a [`~cache_utils.Cache`] instance;
+            - Tuple of `tuple(torch.FloatTensor)` of length `config.n_layers`, with each tuple having 2 tensors of
+            shape `(batch_size, num_heads, sequence_length, embed_size_per_head)`). This is also known as the legacy
+            cache format.
+
+            The model will output the same cache format that is fed as input. If no `past_key_values` are passed, the
+            legacy cache format will be returned.
+
+            If `past_key_values` are used, the user can optionally input only the last `input_ids` (those that don't
+            have their past key value states given to this model) of shape `(batch_size, 1)` instead of all `input_ids`
+            of shape `(batch_size, sequence_length)`.
+        inputs_embeds (`torch.FloatTensor` of shape `(batch_size, sequence_length, hidden_size)`, *optional*):
+            Optionally, instead of passing `input_ids` you can choose to directly pass an embedded representation. This
+            is useful if you want more control over how to convert `input_ids` indices into associated vectors than the
+            model's internal embedding lookup matrix.
+        use_cache (`bool`, *optional*):
+            If set to `True`, `past_key_values` key value states are returned and can be used to speed up decoding (see
+            `past_key_values`).
+        output_attentions (`bool`, *optional*):
+            Whether or not to return the attentions tensors of all attention layers. See `attentions` under returned
+            tensors for more detail.
+        output_hidden_states (`bool`, *optional*):
+            Whether or not to return the hidden states of all layers. See `hidden_states` under returned tensors for
+            more detail.
+        return_dict (`bool`, *optional*):
+            Whether or not to return a [`~utils.ModelOutput`] instead of a plain tuple.
+"""
+
+
+@add_start_docstrings(
+    "The bare DeepseekV3 Model outputting raw hidden-states without any specific head on top.",
+    DeepseekV3_START_DOCSTRING,
+)
+class DeepseekV3Model(DeepseekV3PreTrainedModel):
+    """
+    Transformer decoder consisting of *config.num_hidden_layers* layers. Each layer is a [`DeepseekV3DecoderLayer`]
+
+    Args:
+        config: DeepseekV3Config
+    """
+
+    def __init__(self, config: DeepseekV3Config):
+        super().__init__(config)
+        self.padding_idx = config.pad_token_id
+        self.vocab_size = config.vocab_size
+
+        self.embed_tokens = nn.Embedding(
+            config.vocab_size, config.hidden_size, self.padding_idx
+        )
+        self.layers = nn.ModuleList(
+            [
+                DeepseekV3DecoderLayer(config, layer_idx)
+                for layer_idx in range(config.num_hidden_layers)
+            ]
+        )
+        self._use_flash_attention_2 = config._attn_implementation == "flash_attention_2"
+        self.norm = DeepseekV3RMSNorm(config.hidden_size, eps=config.rms_norm_eps)
+
+        self.gradient_checkpointing = False
+        # Initialize weights and apply final processing
+        self.post_init()
+
+    def get_input_embeddings(self):
+        return self.embed_tokens
+
+    def set_input_embeddings(self, value):
+        self.embed_tokens = value
+
+    @add_start_docstrings_to_model_forward(DeepseekV3_INPUTS_DOCSTRING)
+    def forward(
+        self,
+        input_ids: torch.LongTensor = None,
+        attention_mask: Optional[torch.Tensor] = None,
+        position_ids: Optional[torch.LongTensor] = None,
+        past_key_values: Optional[List[torch.FloatTensor]] = None,
+        inputs_embeds: Optional[torch.FloatTensor] = None,
+        use_cache: Optional[bool] = None,
+        output_attentions: Optional[bool] = None,
+        output_hidden_states: Optional[bool] = None,
+        return_dict: Optional[bool] = None,
+    ) -> Union[Tuple, BaseModelOutputWithPast]:
+        output_attentions = (
+            output_attentions
+            if output_attentions is not None
+            else self.config.output_attentions
+        )
+        output_hidden_states = (
+            output_hidden_states
+            if output_hidden_states is not None
+            else self.config.output_hidden_states
+        )
+        use_cache = use_cache if use_cache is not None else self.config.use_cache
+
+        return_dict = (
+            return_dict if return_dict is not None else self.config.use_return_dict
+        )
+
+        # retrieve input_ids and inputs_embeds
+        if input_ids is not None and inputs_embeds is not None:
+            raise ValueError(
+                "You cannot specify both input_ids and inputs_embeds at the same time"
+            )
+        elif input_ids is not None:
+            batch_size, seq_length = input_ids.shape[:2]
+        elif inputs_embeds is not None:
+            batch_size, seq_length = inputs_embeds.shape[:2]
+        else:
+            raise ValueError("You have to specify either input_ids or inputs_embeds")
+
+        past_key_values_length = 0
+        if use_cache:
+            use_legacy_cache = not isinstance(past_key_values, Cache)
+            if use_legacy_cache:
+                past_key_values = DynamicCache.from_legacy_cache(past_key_values)
+            past_key_values_length = past_key_values.get_usable_length(seq_length)
+
+        if position_ids is None:
+            device = input_ids.device if input_ids is not None else inputs_embeds.device
+            position_ids = torch.arange(
+                past_key_values_length,
+                seq_length + past_key_values_length,
+                dtype=torch.long,
+                device=device,
+            )
+            position_ids = position_ids.unsqueeze(0)
+
+        if inputs_embeds is None:
+            inputs_embeds = self.embed_tokens(input_ids)
+
+        if self._use_flash_attention_2:
+            # 2d mask is passed through the layers
+            attention_mask = (
+                attention_mask
+                if (attention_mask is not None and 0 in attention_mask)
+                else None
+            )
+        else:
+            # 4d mask is passed through the layers
+            attention_mask = _prepare_4d_causal_attention_mask(
+                attention_mask,
+                (batch_size, seq_length),
+                inputs_embeds,
+                past_key_values_length,
+            )
+
+        # embed positions
+        hidden_states = inputs_embeds
+
+        # decoder layers
+        all_hidden_states = () if output_hidden_states else None
+        all_self_attns = () if output_attentions else None
+        next_decoder_cache = None
+
+        for decoder_layer in self.layers:
+            if output_hidden_states:
+                all_hidden_states += (hidden_states,)
+
+            layer_outputs = decoder_layer(
+                hidden_states,
+                attention_mask=attention_mask,
+                position_ids=position_ids,
+                past_key_value=past_key_values,
+                output_attentions=output_attentions,
+                use_cache=use_cache,
+            )
+
+            hidden_states = layer_outputs[0]
+
+            if use_cache:
+                next_decoder_cache = layer_outputs[2 if output_attentions else 1]
+
+            if output_attentions:
+                all_self_attns += (layer_outputs[1],)
+
+        hidden_states = self.norm(hidden_states)
+
+        # add hidden states from the last decoder layer
+        if output_hidden_states:
+            all_hidden_states += (hidden_states,)
+
+        next_cache = None
+        if use_cache:
+            next_cache = (
+                next_decoder_cache.to_legacy_cache()
+                if use_legacy_cache
+                else next_decoder_cache
+            )
+        if not return_dict:
+            return tuple(
+                v
+                for v in [hidden_states, next_cache, all_hidden_states, all_self_attns]
+                if v is not None
+            )
+        return BaseModelOutputWithPast(
+            last_hidden_state=hidden_states,
+            past_key_values=next_cache,
+            hidden_states=all_hidden_states,
+            attentions=all_self_attns,
+        )
+
+
+class DeepseekV3ForCausalLM(DeepseekV3PreTrainedModel):
+    _tied_weights_keys = ["lm_head.weight"]
+
+    def __init__(self, config):
+        super().__init__(config)
+        self.model = DeepseekV3Model(config)
+        self.vocab_size = config.vocab_size
+        self.lm_head = nn.Linear(config.hidden_size, config.vocab_size, bias=False)
+
+        # Initialize weights and apply final processing
+        self.post_init()
+
+    def get_input_embeddings(self):
+        return self.model.embed_tokens
+
+    def set_input_embeddings(self, value):
+        self.model.embed_tokens = value
+
+    def get_output_embeddings(self):
+        return self.lm_head
+
+    def set_output_embeddings(self, new_embeddings):
+        self.lm_head = new_embeddings
+
+    def set_decoder(self, decoder):
+        self.model = decoder
+
+    def get_decoder(self):
+        return self.model
+
+    @add_start_docstrings_to_model_forward(DeepseekV3_INPUTS_DOCSTRING)
+    @replace_return_docstrings(
+        output_type=CausalLMOutputWithPast, config_class=_CONFIG_FOR_DOC
+    )
+    def forward(
+        self,
+        input_ids: torch.LongTensor = None,
+        attention_mask: Optional[torch.Tensor] = None,
+        position_ids: Optional[torch.LongTensor] = None,
+        past_key_values: Optional[List[torch.FloatTensor]] = None,
+        inputs_embeds: Optional[torch.FloatTensor] = None,
+        labels: Optional[torch.LongTensor] = None,
+        use_cache: Optional[bool] = None,
+        output_attentions: Optional[bool] = None,
+        output_hidden_states: Optional[bool] = None,
+        return_dict: Optional[bool] = None,
+    ) -> Union[Tuple, CausalLMOutputWithPast]:
+        r"""
+        Args:
+            labels (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*):
+                Labels for computing the masked language modeling loss. Indices should either be in `[0, transformers.,
+                config.vocab_size]` or -100 (see `input_ids` docstring). Tokens with indices set to `-100` are ignored
+                (masked), the loss is only computed for the tokens with labels in `[0, transformers., config.vocab_size]`.
+
+        Returns:
+
+        Example:
+
+        ```python
+        >>> from transformers import AutoTokenizer, DeepseekV3ForCausalLM
+
+        >>> model = DeepseekV3ForCausalLM.from_pretrained(PATH_TO_CONVERTED_WEIGHTS)
+        >>> tokenizer = AutoTokenizer.from_pretrained(PATH_TO_CONVERTED_TOKENIZER)
+
+        >>> prompt = "Hey, are you conscious? Can you talk to me?"
+        >>> inputs = tokenizer(prompt, return_tensors="pt")
+
+        >>> # Generate
+        >>> generate_ids = model.generate(inputs.input_ids, max_length=30)
+        >>> tokenizer.batch_decode(generate_ids, skip_special_tokens=True, clean_up_tokenization_spaces=False)[0]
+        "Hey, are you conscious? Can you talk to me?\nI'm not conscious, but I can talk to you."
+        ```"""
+        output_attentions = (
+            output_attentions
+            if output_attentions is not None
+            else self.config.output_attentions
+        )
+        output_hidden_states = (
+            output_hidden_states
+            if output_hidden_states is not None
+            else self.config.output_hidden_states
+        )
+        return_dict = (
+            return_dict if return_dict is not None else self.config.use_return_dict
+        )
+
+        # decoder outputs consists of (dec_features, layer_state, dec_hidden, dec_attn)
+        outputs = self.model(
+            input_ids=input_ids,
+            attention_mask=attention_mask,
+            position_ids=position_ids,
+            past_key_values=past_key_values,
+            inputs_embeds=inputs_embeds,
+            use_cache=use_cache,
+            output_attentions=output_attentions,
+            output_hidden_states=output_hidden_states,
+            return_dict=return_dict,
+        )
+
+        hidden_states = outputs[0]
+        logits = self.lm_head(hidden_states)
+        logits = logits.float()
+
+        loss = None
+        if labels is not None:
+            # Shift so that tokens < n predict n
+            shift_logits = logits[..., :-1, :].contiguous()
+            shift_labels = labels[..., 1:].contiguous()
+            # Flatten the tokens
+            loss_fct = CrossEntropyLoss()
+            shift_logits = shift_logits.view(-1, self.config.vocab_size)
+            shift_labels = shift_labels.view(-1)
+            # Enable model parallelism
+            shift_labels = shift_labels.to(shift_logits.device)
+            loss = loss_fct(shift_logits, shift_labels)
+
+        if not return_dict:
+            output = (logits,) + outputs[1:]
+            return (loss,) + output if loss is not None else output
+
+        return CausalLMOutputWithPast(
+            loss=loss,
+            logits=logits,
+            past_key_values=outputs.past_key_values,
+            hidden_states=outputs.hidden_states,
+            attentions=outputs.attentions,
+        )
+
+    def prepare_inputs_for_generation(
+        self,
+        input_ids,
+        past_key_values=None,
+        attention_mask=None,
+        inputs_embeds=None,
+        **kwargs,
+    ):
+        if past_key_values is not None:
+            if isinstance(past_key_values, Cache):
+                cache_length = past_key_values.get_seq_length()
+                past_length = past_key_values.seen_tokens
+                max_cache_length = past_key_values.get_max_length()
+            else:
+                cache_length = past_length = past_key_values[0][0].shape[2]
+                max_cache_length = None
+
+            # Keep only the unprocessed tokens:
+            # 1 - If the length of the attention_mask exceeds the length of input_ids, then we are in a setting where
+            # some of the inputs are exclusivelly passed as part of the cache (e.g. when passing input_embeds as
+            # input)
+            if (
+                attention_mask is not None
+                and attention_mask.shape[1] > input_ids.shape[1]
+            ):
+                input_ids = input_ids[:, -(attention_mask.shape[1] - past_length) :]
+            # 2 - If the past_length is smaller than input_ids', then input_ids holds all input tokens. We can discard
+            # input_ids based on the past_length.
+            elif past_length < input_ids.shape[1]:
+                input_ids = input_ids[:, past_length:]
+            # 3 - Otherwise (past_length >= input_ids.shape[1]), let's assume input_ids only has unprocessed tokens.
+
+            # If we are about to go beyond the maximum cache length, we need to crop the input attention mask.
+            if (
+                max_cache_length is not None
+                and attention_mask is not None
+                and cache_length + input_ids.shape[1] > max_cache_length
+            ):
+                attention_mask = attention_mask[:, -max_cache_length:]
+
+        position_ids = kwargs.get("position_ids", None)
+        if attention_mask is not None and position_ids is None:
+            # create position_ids on the fly for batch generation
+            position_ids = attention_mask.long().cumsum(-1) - 1
+            position_ids.masked_fill_(attention_mask == 0, 1)
+            if past_key_values:
+                position_ids = position_ids[:, -input_ids.shape[1] :]
+
+        # if `inputs_embeds` are passed, we only want to use them in the 1st generation step
+        if inputs_embeds is not None and past_key_values is None:
+            model_inputs = {"inputs_embeds": inputs_embeds}
+        else:
+            model_inputs = {"input_ids": input_ids}
+
+        model_inputs.update(
+            {
+                "position_ids": position_ids,
+                "past_key_values": past_key_values,
+                "use_cache": kwargs.get("use_cache"),
+                "attention_mask": attention_mask,
+            }
+        )
+        return model_inputs
+
+    @staticmethod
+    def _reorder_cache(past_key_values, beam_idx):
+        reordered_past = ()
+        for layer_past in past_key_values:
+            reordered_past += (
+                tuple(
+                    past_state.index_select(0, beam_idx.to(past_state.device))
+                    for past_state in layer_past
+                ),
+            )
+        return reordered_past
+
+
+@add_start_docstrings(
+    """
+    The DeepseekV3 Model transformer with a sequence classification head on top (linear layer).
+
+    [`DeepseekV3ForSequenceClassification`] uses the last token in order to do the classification, as other causal models
+    (e.g. GPT-2) do.
+
+    Since it does classification on the last token, it requires to know the position of the last token. If a
+    `pad_token_id` is defined in the configuration, it finds the last token that is not a padding token in each row. If
+    no `pad_token_id` is defined, it simply takes the last value in each row of the batch. Since it cannot guess the
+    padding tokens when `inputs_embeds` are passed instead of `input_ids`, it does the same (take the last value in
+    each row of the batch).
+    """,
+    DeepseekV3_START_DOCSTRING,
+)
+class DeepseekV3ForSequenceClassification(DeepseekV3PreTrainedModel):
+    def __init__(self, config):
+        super().__init__(config)
+        self.num_labels = config.num_labels
+        self.model = DeepseekV3Model(config)
+        self.score = nn.Linear(config.hidden_size, self.num_labels, bias=False)
+
+        # Initialize weights and apply final processing
+        self.post_init()
+
+    def get_input_embeddings(self):
+        return self.model.embed_tokens
+
+    def set_input_embeddings(self, value):
+        self.model.embed_tokens = value
+
+    @add_start_docstrings_to_model_forward(DeepseekV3_INPUTS_DOCSTRING)
+    def forward(
+        self,
+        input_ids: torch.LongTensor = None,
+        attention_mask: Optional[torch.Tensor] = None,
+        position_ids: Optional[torch.LongTensor] = None,
+        past_key_values: Optional[List[torch.FloatTensor]] = None,
+        inputs_embeds: Optional[torch.FloatTensor] = None,
+        labels: Optional[torch.LongTensor] = None,
+        use_cache: Optional[bool] = None,
+        output_attentions: Optional[bool] = None,
+        output_hidden_states: Optional[bool] = None,
+        return_dict: Optional[bool] = None,
+    ) -> Union[Tuple, SequenceClassifierOutputWithPast]:
+        r"""
+        labels (`torch.LongTensor` of shape `(batch_size,)`, *optional*):
+            Labels for computing the sequence classification/regression loss. Indices should be in `[0, transformers.,
+            config.num_labels - 1]`. If `config.num_labels == 1` a regression loss is computed (Mean-Square loss), If
+            `config.num_labels > 1` a classification loss is computed (Cross-Entropy).
+        """
+        return_dict = (
+            return_dict if return_dict is not None else self.config.use_return_dict
+        )
+
+        transformer_outputs = self.model(
+            input_ids,
+            attention_mask=attention_mask,
+            position_ids=position_ids,
+            past_key_values=past_key_values,
+            inputs_embeds=inputs_embeds,
+            use_cache=use_cache,
+            output_attentions=output_attentions,
+            output_hidden_states=output_hidden_states,
+            return_dict=return_dict,
+        )
+        hidden_states = transformer_outputs[0]
+        logits = self.score(hidden_states)
+
+        if input_ids is not None:
+            batch_size = input_ids.shape[0]
+        else:
+            batch_size = inputs_embeds.shape[0]
+
+        if self.config.pad_token_id is None and batch_size != 1:
+            raise ValueError(
+                "Cannot handle batch sizes > 1 if no padding token is defined."
+            )
+        if self.config.pad_token_id is None:
+            sequence_lengths = -1
+        else:
+            if input_ids is not None:
+                sequence_lengths = (
+                    torch.eq(input_ids, self.config.pad_token_id).int().argmax(-1) - 1
+                ).to(logits.device)
+            else:
+                sequence_lengths = -1
+
+        pooled_logits = logits[
+            torch.arange(batch_size, device=logits.device), sequence_lengths
+        ]
+
+        loss = None
+        if labels is not None:
+            labels = labels.to(logits.device)
+            if self.config.problem_type is None:
+                if self.num_labels == 1:
+                    self.config.problem_type = "regression"
+                elif self.num_labels > 1 and (
+                    labels.dtype == torch.long or labels.dtype == torch.int
+                ):
+                    self.config.problem_type = "single_label_classification"
+                else:
+                    self.config.problem_type = "multi_label_classification"
+
+            if self.config.problem_type == "regression":
+                loss_fct = MSELoss()
+                if self.num_labels == 1:
+                    loss = loss_fct(pooled_logits.squeeze(), labels.squeeze())
+                else:
+                    loss = loss_fct(pooled_logits, labels)
+            elif self.config.problem_type == "single_label_classification":
+                loss_fct = CrossEntropyLoss()
+                loss = loss_fct(
+                    pooled_logits.view(-1, self.num_labels), labels.view(-1)
+                )
+            elif self.config.problem_type == "multi_label_classification":
+                loss_fct = BCEWithLogitsLoss()
+                loss = loss_fct(pooled_logits, labels)
+        if not return_dict:
+            output = (pooled_logits,) + transformer_outputs[1:]
+            return ((loss,) + output) if loss is not None else output
+
+        return SequenceClassifierOutputWithPast(
+            loss=loss,
+            logits=pooled_logits,
+            past_key_values=transformer_outputs.past_key_values,
+            hidden_states=transformer_outputs.hidden_states,
+            attentions=transformer_outputs.attentions,
+        )

moe_one_file_ref.py

@@ -0,0 +1,542 @@
+import json
+import logging
+import math
+import os
+from dataclasses import dataclass
+from pathlib import Path
+from typing import List, Optional, Tuple
+
+import fire
+import safetensors.torch
+import torch
+from mistral_common.tokens.tokenizers.base import Tokenizer
+from mistral_common.tokens.tokenizers.mistral import MistralTokenizer
+from simple_parsing.helpers import Serializable
+from torch import nn
+
+
+@dataclass
+class MoeArgs(Serializable):
+    num_experts: int
+    num_experts_per_tok: int
+
+
+@dataclass
+class TransformerArgs(Serializable):
+    dim: int
+    n_layers: int
+    head_dim: int
+    hidden_dim: int
+    n_heads: int
+    n_kv_heads: int
+    norm_eps: float
+    vocab_size: int
+    moe: MoeArgs
+
+    # For rotary embeddings. If not set, will be inferred
+    rope_theta: Optional[float] = None
+
+    max_batch_size: int = 0
+    max_seq_len: int = 0
+
+
+def is_torchrun() -> bool:
+    required_vars = ["MASTER_ADDR", "MASTER_PORT", "RANK", "WORLD_SIZE"]
+    return all(var in os.environ for var in required_vars)
+
+
+def repeat_kv(keys: torch.Tensor, values: torch.Tensor, repeats: int):
+    keys = torch.repeat_interleave(keys, repeats=repeats, dim=2)
+    values = torch.repeat_interleave(values, repeats=repeats, dim=2)
+    return keys, values
+
+
+def _reshape_for_broadcast(freqs_cis: torch.Tensor, x: torch.Tensor) -> torch.Tensor:
+    """
+    freqs_cis: complex - (seq_len, head_dim / 2)
+    x: complex - (bsz, seq_len, head_dim / 2)
+    """
+    ndim = x.ndim
+    assert 1 < ndim
+    assert freqs_cis.shape == (x.shape[1], x.shape[-1]), (
+        freqs_cis.shape,
+        (x.shape[1], x.shape[-1]),
+    )
+    shape = [d if i == 1 or i == ndim - 1 else 1 for i, d in enumerate(x.shape)]
+    return freqs_cis.view(*shape)
+
+
+def apply_rotary_emb(
+    xq: torch.Tensor,
+    xk: torch.Tensor,
+    freqs_cis: torch.Tensor,
+) -> Tuple[torch.Tensor, torch.Tensor]:
+    xq_ = torch.view_as_complex(xq.float().reshape(*xq.shape[:-1], -1, 2))
+    xk_ = torch.view_as_complex(xk.float().reshape(*xk.shape[:-1], -1, 2))
+    freqs_cis = _reshape_for_broadcast(freqs_cis, xq_)
+    xq_out = torch.view_as_real(xq_ * freqs_cis).flatten(3)
+    xk_out = torch.view_as_real(xk_ * freqs_cis).flatten(3)
+    return xq_out.type_as(xq), xk_out.type_as(xk)
+
+
+class Attention(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+        self.args = args
+
+        self.n_heads: int = args.n_heads
+        self.n_kv_heads: int = args.n_kv_heads
+
+        self.repeats = self.n_heads // self.n_kv_heads
+
+        self.scale = self.args.head_dim**-0.5
+
+        self.wq = nn.Linear(args.dim, args.n_heads * args.head_dim, bias=False)
+        self.wk = nn.Linear(args.dim, args.n_kv_heads * args.head_dim, bias=False)
+        self.wv = nn.Linear(args.dim, args.n_kv_heads * args.head_dim, bias=False)
+        self.wo = nn.Linear(args.n_heads * args.head_dim, args.dim, bias=False)
+        self._cache_k: Optional[torch.Tensor] = None
+        self._cache_v: Optional[torch.Tensor] = None
+
+    def get_caches(self, x: torch.Tensor) -> Tuple[torch.Tensor, torch.Tensor]:
+        dtype, device = x.dtype, x.device
+        assert x.shape[0] <= self.args.max_batch_size
+        assert x.shape[1] <= self.args.max_seq_len
+        if self._cache_k is None:
+            self._cache_k = torch.empty(
+                (
+                    self.args.max_batch_size,
+                    self.args.max_seq_len,
+                    self.n_kv_heads,
+                    self.args.head_dim,
+                ),
+                dtype=dtype,
+                device=device,
+            )
+        if self._cache_v is None:
+            self._cache_v = torch.empty(
+                (
+                    self.args.max_batch_size,
+                    self.args.max_seq_len,
+                    self.n_kv_heads,
+                    self.args.head_dim,
+                ),
+                dtype=dtype,
+                device=device,
+            )
+        return self._cache_k, self._cache_v
+
+    def forward(
+        self,
+        x: torch.Tensor,
+        freqs_cis: torch.Tensor,
+        positions: torch.Tensor,
+        mask: Optional[torch.Tensor],
+    ) -> torch.Tensor:
+        bsz, seqlen, _ = x.shape
+
+        cache_k, cache_v = self.get_caches(x)
+
+        xq, xk, xv = self.wq(x), self.wk(x), self.wv(x)
+        xq = xq.view(bsz, seqlen, self.n_heads, self.args.head_dim)
+        xk = xk.view(bsz, seqlen, self.n_kv_heads, self.args.head_dim)
+        xv = xv.view(bsz, seqlen, self.n_kv_heads, self.args.head_dim)
+        xq, xk = apply_rotary_emb(xq, xk, freqs_cis=freqs_cis)
+
+        # Update cache
+        scatter_pos = positions[None, :, None, None].repeat(bsz, 1, self.n_kv_heads, self.args.head_dim)
+        cache_k[:bsz].scatter_(dim=1, index=scatter_pos, src=xk)
+        cache_v[:bsz].scatter_(dim=1, index=scatter_pos, src=xv)
+
+        if positions.shape[0] > 1:
+            # prefill
+            key, value = repeat_kv(xk, xv, self.repeats)
+        else:
+            assert mask is None
+            cur_pos = int(positions[-1].item() + 1)
+            key, value = repeat_kv(
+                cache_k[:bsz, :cur_pos, ...],
+                cache_v[:bsz, :cur_pos, ...],
+                self.repeats,
+            )
+
+        query = xq.transpose(1, 2)
+        key = key.transpose(1, 2)
+        value = value.transpose(1, 2)
+        # scores : [bsz, n_heads, seqlen | 1, seqlen]
+        scores = torch.matmul(query, key.transpose(2, 3)) * self.scale
+
+        if mask is not None:
+            scores += mask[None, None, ...]
+
+        scores = scores.float()
+        scores = nn.functional.softmax(scores, dim=-1).type_as(query)
+        output = torch.matmul(scores, value)  # (bs, n_local_heads, slen, head_dim)
+        output = output.transpose(1, 2).contiguous().view(bsz, seqlen, -1)
+        return self.wo(output)
+
+
+class FeedForward(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+        self.w1 = nn.Linear(args.dim, args.hidden_dim, bias=False)
+        self.w2 = nn.Linear(args.hidden_dim, args.dim, bias=False)
+        self.w3 = nn.Linear(args.dim, args.hidden_dim, bias=False)
+
+    def forward(self, x) -> torch.Tensor:
+        return self.w2(nn.functional.silu(self.w1(x)) * self.w3(x))
+
+
+class RMSNorm(torch.nn.Module):
+    def __init__(self, dim: int, eps: float = 1e-6):
+        super().__init__()
+        self.eps = eps
+        self.weight = nn.Parameter(torch.ones(dim))
+
+    def _norm(self, x):
+        return x * torch.rsqrt(x.pow(2).mean(-1, keepdim=True) + self.eps)
+
+    def forward(self, x):
+        output = self._norm(x.float()).type_as(x)
+        return output * self.weight
+
+
+class MoeLayer(nn.Module):
+    def __init__(self, experts: List[nn.Module], gate: nn.Module, moe_args: MoeArgs):
+        super().__init__()
+        assert len(experts) > 0
+        self.experts = nn.ModuleList(experts)
+        self.gate = gate
+        self.args = moe_args
+
+    def forward(self, inputs: torch.Tensor):
+        inputs_squashed = inputs.view(-1, inputs.shape[-1])
+        gate_logits = self.gate(inputs_squashed)
+        weights, selected_experts = torch.topk(gate_logits, self.args.num_experts_per_tok)
+        weights = nn.functional.softmax(
+            weights,
+            dim=1,
+            dtype=torch.float,
+        ).type_as(inputs)
+        results = torch.zeros_like(inputs_squashed)
+        for i, expert in enumerate(self.experts):
+            batch_idx, nth_expert = torch.where(selected_experts == i)
+            results[batch_idx] += weights[batch_idx, nth_expert, None] * expert(inputs_squashed[batch_idx])
+        return results.view_as(inputs)
+
+
+class TransformerBlock(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+        self.n_heads = args.n_heads
+        self.dim = args.dim
+        self.attention = Attention(args)
+        self.feed_forward = MoeLayer(
+            experts=[FeedForward(args=args) for _ in range(args.moe.num_experts)],
+            gate=nn.Linear(args.dim, args.moe.num_experts, bias=False),
+            moe_args=args.moe,
+        )
+        self.attention_norm = RMSNorm(args.dim, eps=args.norm_eps)
+        self.ffn_norm = RMSNorm(args.dim, eps=args.norm_eps)
+        self.args = args
+
+    def forward(
+        self,
+        x: torch.Tensor,
+        freqs_cis: torch.Tensor,
+        positions: torch.Tensor,
+        mask: Optional[torch.Tensor],
+    ) -> torch.Tensor:
+        r = self.attention.forward(self.attention_norm(x), freqs_cis, positions, mask)
+        h = x + r
+        r = self.feed_forward.forward(self.ffn_norm(h))
+        out = h + r
+        return out
+
+
+def precompute_freqs_cis(dim: int, end: int, theta: float) -> torch.Tensor:
+    freqs = 1.0 / (theta ** (torch.arange(0, dim, 2)[: (dim // 2)].float() / dim))
+    t = torch.arange(end, device=freqs.device)  # type: ignore
+    freqs = torch.outer(t, freqs).float()  # type: ignore
+    return torch.polar(torch.ones_like(freqs), freqs)  # complex64
+
+
+class Transformer(nn.Module):
+    def __init__(
+        self,
+        args: TransformerArgs,
+        pipeline_rank: int = 0,
+        num_pipeline_ranks: int = 1,
+    ):
+        super().__init__()
+        self.args = args
+        self.vocab_size = args.vocab_size
+        assert self.vocab_size > 0
+        assert pipeline_rank < num_pipeline_ranks, (pipeline_rank, num_pipeline_ranks)
+        self.pipeline_rank = pipeline_rank
+        self.num_pipeline_ranks = num_pipeline_ranks
+        self._precomputed_freqs_cis: Optional[torch.Tensor] = None
+
+        # Modules specific to some ranks:
+        self.tok_embeddings: Optional[nn.Embedding] = None
+        self.norm: Optional[RMSNorm] = None
+        self.output: Optional[nn.Linear] = None
+        if pipeline_rank == 0:
+            self.tok_embeddings = nn.Embedding(args.vocab_size, args.dim)
+        if pipeline_rank == num_pipeline_ranks - 1:
+            self.norm = RMSNorm(args.dim, eps=args.norm_eps)
+            self.output = nn.Linear(args.dim, args.vocab_size, bias=False)
+
+        # Initialize all layers but slice off those not of this rank.
+        layers = [TransformerBlock(args=args) for _ in range(args.n_layers)]
+        num_layers_per_rank = math.ceil(args.n_layers / self.num_pipeline_ranks)
+        offset = self.pipeline_rank * num_layers_per_rank
+        end = min(args.n_layers, offset + num_layers_per_rank)
+        self.layers = nn.ModuleDict({str(i): layers[i] for i in range(offset, end)})
+        self.n_local_layers = len(self.layers)
+
+    @property
+    def dtype(self) -> torch.dtype:
+        return next(self.parameters()).dtype
+
+    @property
+    def device(self) -> torch.device:
+        return next(self.parameters()).device
+
+    @property
+    def freqs_cis(self) -> torch.Tensor:
+        # We cache freqs_cis but need to take care that it is on the right device
+        # and has the right dtype (complex64). The fact that the dtype is different
+        # from the module's  dtype means we cannot register it as a buffer
+        if self._precomputed_freqs_cis is None:
+            theta = self.args.rope_theta or 1000000.0
+            self._precomputed_freqs_cis = precompute_freqs_cis(self.args.head_dim, 128_000, theta)
+        if self._precomputed_freqs_cis.device != self.device:
+            self._precomputed_freqs_cis = self._precomputed_freqs_cis.to(device=self.device)
+        return self._precomputed_freqs_cis
+
+    def forward(
+        self,
+        input_ids: torch.Tensor,
+        positions: torch.Tensor,
+    ):
+        freqs_cis = self.freqs_cis[positions]
+
+        (bsz, seqlen) = input_ids.shape
+        bsz * seqlen
+
+        if self.pipeline_rank == 0:
+            assert self.tok_embeddings is not None
+            h = self.tok_embeddings(input_ids)
+            assert h.shape == (bsz, seqlen, self.args.dim)
+            assert h.dtype == self.dtype
+        else:
+            h = torch.empty(bsz, seqlen, self.args.dim, device=self.device, dtype=self.dtype)
+            torch.distributed.recv(h, src=self.pipeline_rank - 1)
+
+        mask: Optional[torch.Tensor] = None
+        if input_ids.shape[1] > 1:
+            tensor = torch.full(
+                (seqlen, seqlen),
+                dtype=h.dtype,
+                fill_value=1,
+                device=h.device,
+            )
+            mask = torch.log(torch.tril(tensor, diagonal=0)).to(h.dtype)
+
+        for layer in self.layers.values():
+            h = layer(h, freqs_cis, positions, mask)
+
+        if self.pipeline_rank < self.num_pipeline_ranks - 1:
+            torch.distributed.send(h, dst=self.pipeline_rank + 1)
+            outs = torch.empty(*h.shape[:-1], self.vocab_size, device=h.device, dtype=h.dtype)
+        else:
+            assert self.output is not None
+            assert self.norm is not None
+            outs = self.output(self.norm(h))
+        if self.num_pipeline_ranks > 1:
+            torch.distributed.broadcast(outs, src=self.num_pipeline_ranks - 1)
+        return outs.float()
+
+    def load_state_dict(self, state_dict, *args, **kwargs):
+        state_to_load = {}
+        skipped = set([])
+        for k, v in state_dict.items():
+            if k.startswith("tok_embeddings"):
+                if self.pipeline_rank == 0:
+                    state_to_load[k] = v
+                else:
+                    logging.debug(
+                        "Skipping parameter %s at pipeline rank %d",
+                        k,
+                        self.pipeline_rank,
+                    )
+                    skipped.add(k)
+            elif k.startswith("norm") or k.startswith("output"):
+                if self.pipeline_rank == self.num_pipeline_ranks - 1:
+                    state_to_load[k] = v
+                else:
+                    logging.debug(
+                        "Skipping parameter %s at pipeline rank %d",
+                        k,
+                        self.pipeline_rank,
+                    )
+                    skipped.add(k)
+            elif k.startswith("layers"):
+                layer_id = k.split(".")[1]
+                if layer_id in self.layers:
+                    state_to_load[k] = v
+                else:
+                    logging.debug(
+                        "Skipping parameter %s at pipeline rank %d",
+                        k,
+                        self.pipeline_rank,
+                    )
+                    skipped.add(k)
+            else:
+                raise ValueError(f"Unexpected key {k}")
+        assert set(state_dict.keys()) == skipped.union(set(state_to_load.keys()))
+        super().load_state_dict(state_to_load, *args, **kwargs)
+
+    @staticmethod
+    def from_folder(
+        folder: Path,
+        max_batch_size: int,
+        max_seq_len: int,
+        num_pipeline_ranks: int = 1,
+        device="cuda",
+        dtype=torch.float16,
+    ) -> "Transformer":
+        with open(folder / "params.json", "r") as f:
+            model_args = TransformerArgs.from_dict(json.load(f))
+        model_args.max_batch_size = max_batch_size
+        model_args.max_seq_len = max_seq_len
+        if num_pipeline_ranks > 1:
+            pipeline_rank = torch.distributed.get_rank()
+        else:
+            pipeline_rank = 0
+        with torch.device("meta"):
+            model = Transformer(
+                model_args,
+                pipeline_rank=pipeline_rank,
+                num_pipeline_ranks=num_pipeline_ranks,
+            )
+
+        pt_model_file = Path(folder) / "consolidated.00.pth"
+        safetensors_model_file = Path(folder) / "consolidated.safetensors"
+
+        assert (
+            pt_model_file.exists() or safetensors_model_file.exists()
+        ), f"Make sure either {pt_model_file} or {safetensors_model_file} exists"
+        assert not (
+            pt_model_file.exists() and safetensors_model_file.exists()
+        ), f"Both {pt_model_file} and {safetensors_model_file} cannot exist"
+
+        if pt_model_file.exists():
+            loaded = torch.load(str(pt_model_file), mmap=True)
+        else:
+            loaded = safetensors.torch.load_file(str(safetensors_model_file))
+
+        model.load_state_dict(loaded, assign=True, strict=True)
+
+        return model.to(device=device, dtype=dtype)
+
+
+def load_tokenizer(model_path: Path) -> MistralTokenizer:
+    tokenizer = [f for f in os.listdir(Path(model_path)) if f.startswith("tokenizer.model")]
+    assert (
+        len(tokenizer) == 1
+    ), f"Multiple tokenizers {', '.join(tokenizer)} found in `model_path`, make sure to only have one tokenizer"
+
+    tokenizer = MistralTokenizer.from_file(str(model_path / tokenizer[0]))
+
+    return tokenizer
+
+
+@torch.no_grad()
+def generate(prompts: List[str], model: Transformer, tokenizer: Tokenizer, max_tokens: int):
+    encoded_prompts = [tokenizer.encode(prompt, bos=True, eos=False) for prompt in prompts]
+    prompt_lens = [len(x) for x in encoded_prompts]
+    min_prompt_len = min(prompt_lens)
+    max_prompt_len = max(prompt_lens)
+
+    input_tokens = torch.full(
+        (len(prompts), max_prompt_len),
+        tokenizer._model.pad_id(),
+        dtype=torch.long,
+        device="cuda",
+    )
+    for i, encoded in enumerate(encoded_prompts):
+        input_tokens[i, : len(encoded)] = torch.tensor(encoded).to(input_tokens)
+    input_mask = input_tokens != tokenizer._model.pad_id()
+
+    # pre-fill
+    positions = torch.arange(0, min_prompt_len).to("cuda")
+    logits = model.forward(input_tokens[:, :min_prompt_len], positions)
+    logprobs = nn.functional.log_softmax(logits, dim=-1)
+
+    # decode
+    generated = []
+    all_logprobs = [
+        logprobs[:, :-1, :].gather(2, input_tokens[:, 1:min_prompt_len, None]).squeeze(-1),
+    ]
+    for cur_pos in range(min_prompt_len, max_tokens):
+        next_token = torch.argmax(logprobs[:, -1, :], dim=-1)
+        if cur_pos < input_mask.shape[1]:
+            next_token = torch.where(input_mask[:, cur_pos], input_tokens[:, cur_pos], next_token)
+        all_logprobs.append(
+            logprobs[:, -1, :].gather(1, next_token[:, None]),
+        )
+        generated.append(next_token[:, None])
+        logits = model.forward(next_token[:, None], torch.LongTensor([cur_pos]).to(next_token))
+        logprobs = nn.functional.log_softmax(logits, dim=-1)
+
+    all_logprobs_merged = torch.cat(all_logprobs, 1)
+    res = []
+    if max_tokens > 0:
+        generated = torch.cat(generated, 1)
+        for i, x in enumerate(encoded_prompts):
+            res.append(tokenizer.decode(x[:min_prompt_len] + generated[i].tolist()))
+    return res, all_logprobs_merged
+
+
+def demo(model_path: str, max_tokens: int = 30):
+    if is_torchrun():
+        torch.distributed.init_process_group()
+        torch.cuda.set_device(torch.distributed.get_rank())
+        should_print = torch.distributed.get_rank() == 0
+
+        num_pipeline_ranks = torch.distributed.get_world_size()
+    else:
+        should_print = True
+        num_pipeline_ranks = 1
+
+    mistral_tokenizer: MistralTokenizer = load_tokenizer(Path(model_path))
+    tokenizer: Tokenizer = mistral_tokenizer.instruct_tokenizer.tokenizer
+
+    transformer = Transformer.from_folder(
+        Path(model_path),
+        max_batch_size=3,
+        max_seq_len=max_tokens,
+        num_pipeline_ranks=num_pipeline_ranks,
+    )
+
+    res, logprobs = generate(
+        [
+            "This is a test",
+            "This is another great test",
+            "This is a third test, mistral AI is very good at testing. ",
+        ],
+        transformer,
+        tokenizer,
+        max_tokens=max_tokens,
+    )
+    if should_print:
+        for x, log_prob in zip(res, logprobs):
+            print(x)
+            logging.debug("logprobs: %s", log_prob)
+            print("=====================")
+
+
+if __name__ == "__main__":
+    fire.Fire(demo)

nem-onet-to-soc-crosswalk.xlsx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5aac9713a7e73b428819b20e3b895c97adbf09b4b59ac8c9423a340dbe129a4a
+size 119105

occupation_2023_final.xlsx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdd15e84f2ac5672fc09affe2a268cf7198b8a1b1890f1947724ffabb0b821d1
+size 502707

occupations_onet_basic_skills.csv

@@ -0,0 +1,874 @@
+Occupation,Job Zone,Active_Learning_Importance,Active_Learning_Level,Critical_Thinking_Importance,Critical_Thinking_Level,Learning_Strategies_Importance,Learning_Strategies_Level,Monitoring_Importance,Monitoring_Level,Active_Listening_Importance,Active_Listening_Level,Mathematics_Importance,Mathematics_Level,Programming_Importance,Programming_Level,Reading_Comprehension_Importance,Reading_Comprehension_Level,Science_Importance,Science_Level,Speaking_Importance,Speaking_Level,Writing_Importance,Writing_Level
+"Judges, Magistrate Judges, and Magistrates",5,75,66,97,82,44,41,72,59,100,84,28,30,6,Not relevant,81,68,19,20,78,70,78,70
+Marriage and Family Therapists,5,69,61,72,61,53,54,66,57,97,71,22,25,6,Not relevant,75,61,38,41,81,61,75,61
+"Child, Family, and School Social Workers",4,60,54,78,61,53,45,72,55,97,68,25,27,10,7,75,59,31,29,88,59,69,59
+Mental Health Counselors,5,63,59,69,64,56,55,72,57,94,70,25,30,16,9,78,66,47,50,81,61,75,61
+Psychiatrists,5,75,63,81,66,69,57,75,59,91,71,38,34,13,9,78,71,72,59,81,63,78,63
+Clinical and Counseling Psychologists,5,75,58,78,58,56,54,69,57,91,68,28,27,6,Not relevant,74,68,61,50,86,63,75,59
+Lawyers,5,72,61,81,70,50,45,66,54,91,68,28,30,13,11,85,70,16,13,91,70,75,70
+Labor Relations Specialists,4,63,55,72,57,56,48,63,54,88,61,41,39,10,7,81,59,0,Not relevant,85,64,78,61
+Farm and Home Management Educators,5,72,64,69,59,72,61,60,57,88,59,47,52,19,21,75,64,44,41,78,59,72,59
+"Arbitrators, Mediators, and Conciliators",5,69,57,75,68,50,43,47,50,85,70,25,29,13,7,75,61,16,9,78,68,78,63
+Clergy,5,72,59,69,59,69,61,60,59,85,64,35,36,13,7,78,68,16,13,91,68,78,63
+"Education Administrators, Kindergarten through Secondary",5,72,59,81,63,81,66,75,68,85,64,53,46,19,11,81,66,19,20,85,63,78,63
+School Psychologists,5,66,55,75,59,63,55,75,57,85,64,44,34,19,11,81,68,25,25,81,61,75,59
+Allergists and Immunologists,5,75,66,81,61,63,52,81,61,85,63,47,43,10,Not available,88,66,66,Not available,85,59,78,59
+"Educational, Guidance, and Career Counselors and Advisors",5,72,55,75,57,69,52,69,54,85,59,28,30,19,14,78,61,16,9,81,57,75,57
+Sports Medicine Physicians,5,72,63,81,64,66,55,78,55,85,59,38,41,22,18,88,66,56,Not available,75,61,69,55
+Air Traffic Controllers,3,69,54,78,59,53,48,75,61,85,57,47,43,19,11,69,57,19,21,81,55,53,45
+"Administrative Law Judges, Adjudicators, and Hearing Officers",5,69,59,81,73,50,41,66,57,81,79,28,34,13,7,81,68,16,11,75,68,78,70
+Family Medicine Physicians,5,75,57,85,64,56,46,75,57,81,70,44,41,6,Not relevant,81,71,72,57,78,63,78,59
+"Law Teachers, Postsecondary",5,75,68,75,70,81,64,60,54,81,70,25,32,19,11,81,73,16,11,91,71,75,71
+Equal Opportunity Representatives and Officers,4,69,57,75,64,50,48,60,55,81,66,38,39,22,21,78,68,16,11,75,61,72,63
+Industrial-Organizational Psychologists,5,66,59,75,61,60,57,72,59,81,66,56,57,44,48,81,68,69,54,78,66,75,68
+Neurologists,5,69,66,78,70,60,61,75,66,81,64,47,46,19,13,78,79,69,59,78,63,75,63
+"Ophthalmologists, Except Pediatric",5,66,63,85,70,56,55,69,61,81,64,47,50,16,13,78,79,69,59,78,63,69,61
+Urologists,5,63,55,78,59,50,48,69,57,81,64,38,36,13,14,81,70,72,57,69,57,81,59
+Substance Abuse and Behavioral Disorder Counselors,5,69,57,78,59,56,54,75,57,81,63,25,29,19,14,75,61,25,20,81,61,75,57
+Advanced Practice Psychiatric Nurses,5,72,57,75,57,69,52,69,55,81,61,38,36,13,7,75,61,44,39,75,57,72,57
+Judicial Law Clerks,5,69,59,81,66,50,43,50,46,81,61,22,25,13,9,88,70,0,Not relevant,75,61,78,63
+Public Safety Telecommunicators,2,56,43,69,55,44,43,60,45,81,59,31,27,19,13,66,52,13,9,81,59,53,46
+Speech-Language Pathology Assistants,3,50,39,60,50,53,45,60,50,81,57,31,34,10,5,66,54,19,20,63,54,53,48
+Chief Executives,5,75,68,85,68,53,55,78,79,78,70,56,52,16,9,78,68,22,16,85,70,75,63
+Nurse Practitioners,5,75,59,78,59,63,55,75,59,78,70,50,45,10,7,78,70,69,55,75,57,75,57
+"Criminal Justice and Law Enforcement Teachers, Postsecondary",5,75,57,78,59,75,57,72,57,78,68,25,29,10,7,75,70,19,21,94,70,75,64
+Obstetricians and Gynecologists,5,75,59,85,64,60,54,72,57,78,68,38,41,6,Not relevant,78,75,75,64,78,57,75,59
+"Education Teachers, Postsecondary",5,75,61,69,57,78,64,72,57,78,66,28,32,13,7,81,70,25,29,91,70,75,70
+Hospitalists,5,78,70,78,68,56,57,75,63,78,66,50,43,13,7,78,73,60,50,78,63,72,63
+Audiologists,5,75,63,75,61,60,55,69,59,78,64,47,43,19,14,78,71,50,46,75,63,75,61
+Naturopathic Physicians,5,69,55,78,59,60,54,60,57,78,64,44,37,16,11,81,71,53,45,78,59,75,57
+Preventive Medicine Physicians,5,78,70,81,71,69,64,72,64,78,64,53,48,22,13,85,79,72,66,75,66,75,68
+"Anthropology and Archeology Teachers, Postsecondary",5,75,63,72,61,81,61,72,59,78,63,35,45,13,7,81,71,72,57,88,70,78,71
+Biochemists and Biophysicists,5,78,75,81,73,75,63,72,61,78,63,72,68,31,39,85,75,94,73,78,66,81,73
+Bioengineers and Biomedical Engineers,4,66,68,81,68,53,59,69,59,78,63,69,66,50,50,78,73,72,66,72,63,69,61
+"Pediatricians, General",5,75,59,81,64,56,46,75,57,78,63,35,41,10,7,78,71,75,59,81,59,75,57
+"Philosophy and Religion Teachers, Postsecondary",5,69,63,75,61,72,66,56,55,78,63,25,30,19,11,81,70,19,20,78,68,75,71
+Urban and Regional Planners,5,56,59,75,61,50,41,50,52,78,63,50,50,19,20,75,63,41,39,78,61,72,59
+"Airline Pilots, Copilots, and Flight Engineers",4,69,59,78,59,50,45,78,61,78,61,53,50,13,7,72,59,44,39,69,54,53,46
+Anesthesiologists,5,66,59,88,63,56,48,78,63,78,61,50,48,3,Not relevant,75,70,75,55,72,57,75,57
+Clinical Nurse Specialists,5,75,63,78,61,63,55,72,59,78,61,47,45,6,Not relevant,78,63,56,54,75,61,72,59
+General Internal Medicine Physicians,5,72,57,75,68,53,52,72,57,78,61,47,41,19,13,78,71,75,57,75,59,75,59
+Optometrists,5,53,55,78,61,53,45,56,50,78,61,50,43,22,16,78,70,69,55,75,57,75,57
+Speech-Language Pathologists,5,66,57,72,57,72,57,69,59,78,61,28,37,19,13,72,64,47,43,72,59,69,61
+Veterinarians,5,75,63,72,61,50,43,56,54,78,61,53,45,6,Not relevant,78,70,72,59,72,61,63,59
+Advertising and Promotions Managers,4,56,59,75,59,50,46,56,61,78,59,50,46,19,11,69,57,16,9,75,59,69,55
+"Communications Teachers, Postsecondary",5,75,61,72,59,75,64,69,55,78,59,28,39,16,9,78,68,25,27,78,70,75,66
+First-Line Supervisors of Police and Detectives,3,72,55,75,59,69,55,75,63,78,59,38,37,19,14,72,57,19,16,75,57,66,55
+Government Property Inspectors and Investigators,3,63,48,75,59,50,45,60,59,78,59,47,45,19,18,75,61,22,18,75,59,75,57
+Intelligence Analysts,4,63,50,75,61,50,45,53,50,78,59,47,45,25,29,78,68,25,25,75,59,75,57
+Management Analysts,5,60,54,78,59,50,50,72,57,78,59,50,46,19,13,78,59,25,27,75,57,75,57
+Medical Transcriptionists,3,47,41,50,45,28,30,53,41,78,59,19,14,10,7,75,57,13,9,50,45,72,52
+Nurse Midwives,5,75,59,78,63,56,48,75,59,78,59,41,37,16,9,75,59,47,46,78,59,72,57
+Private Detectives and Investigators,3,60,48,72,59,38,30,60,50,78,59,31,30,19,14,72,57,13,9,75,55,66,52
+Radiologists,5,66,57,78,64,60,54,72,59,78,59,44,41,16,14,78,71,63,50,75,57,81,63
+"Sales Representatives, Wholesale and Manufacturing, Technical and Scientific Products",4,63,54,60,54,44,43,53,45,78,59,47,41,25,14,69,59,13,9,81,57,60,52
+Training and Development Specialists,4,66,54,72,57,81,70,75,61,78,59,41,37,10,5,75,61,22,29,78,61,72,61
+Detectives and Criminal Investigators,3,61,53,78,59,49,43,56,46,78,58,35,31,17,12,74,56,36,33,77,57,69,54
+Community Health Workers,4,66,52,69,54,60,54,60,54,78,57,31,30,13,11,72,57,6,Not relevant,78,57,75,55
+"Eligibility Interviewers, Government Programs",3,50,43,69,54,44,34,50,45,78,57,25,25,10,7,72,57,10,5,88,57,69,52
+Health Education Specialists,4,72,52,69,57,75,59,56,54,78,57,28,32,10,7,69,57,38,39,78,61,78,57
+Human Resources Managers,4,69,57,69,59,56,54,66,59,78,57,41,43,19,20,75,59,16,14,78,57,72,57
+Hydroelectric Production Managers,3,66,52,69,57,66,54,72,54,78,57,56,50,28,20,72,59,56,46,78,59,63,55
+Loan Interviewers and Clerks,3,60,50,69,57,41,39,50,43,78,57,53,45,19,16,72,57,3,Not relevant,75,57,66,55
+Lodging Managers,4,69,55,69,55,60,52,69,54,78,57,41,41,16,13,72,55,0,Not relevant,75,57,72,57
+Mental Health and Substance Abuse Social Workers,5,56,55,75,57,69,55,75,57,78,57,25,29,22,14,75,59,41,39,78,57,69,57
+Music Therapists,4,56,54,75,57,69,54,69,57,78,57,25,23,10,5,75,57,19,13,75,55,56,54
+"News Analysts, Reporters, and Journalists",4,63,54,70,58,34,34,61,49,78,57,20,19,16,11,78,62,2,Not relevant,78,66,78,63
+Occupational Therapists,5,72,55,75,57,72,55,78,57,78,57,25,29,19,14,75,57,44,39,75,57,75,57
+Patient Representatives,3,56,50,66,54,44,43,53,43,78,57,25,29,19,13,72,55,22,18,72,57,56,54
+Public Relations Specialists,4,56,52,72,57,41,43,53,46,78,57,28,27,10,7,72,57,10,Not relevant,78,59,75,55
+Travel Agents,3,53,45,53,54,38,32,50,41,78,57,47,36,19,11,75,54,6,Not relevant,75,45,53,43
+Tutors,4,66,50,66,52,78,55,63,52,78,55,41,34,10,11,72,52,16,Not available,72,52,60,52
+"Credit Authorizers, Checkers, and Clerks",2,53,43,64,50,34,32,52,43,78,54,31,Not available,5,Not relevant,66,52,3,Not relevant,72,51,61,49
+Anthropologists and Archeologists,5,74,60,75,62,58,55,53,54,77,61,50,46,19,19,80,70,72,62,77,65,81,71
+"Psychology Teachers, Postsecondary",5,72,66,72,61,81,71,63,55,75,70,50,46,22,14,78,71,60,59,78,71,75,71
+"Forestry and Conservation Science Teachers, Postsecondary",5,75,61,72,61,78,59,72,55,75,68,50,45,22,16,78,71,56,48,75,68,78,70
+Healthcare Social Workers,5,69,57,75,57,53,52,56,55,75,68,25,29,16,11,75,61,41,37,78,61,72,59
+Natural Sciences Managers,5,63,68,75,63,63,55,75,59,75,68,53,57,22,23,75,71,78,70,72,61,72,71
+Physicists,5,75,79,78,70,72,71,56,57,75,68,81,79,60,55,81,84,91,82,78,68,75,71
+"Agricultural Sciences Teachers, Postsecondary",5,75,64,75,59,78,66,72,61,75,66,50,46,19,13,78,71,63,52,78,71,75,71
+"Atmospheric, Earth, Marine, and Space Sciences Teachers, Postsecondary",5,72,61,75,61,72,61,66,59,75,66,60,57,22,14,75,73,75,59,94,68,75,68
+"Foreign Language and Literature Teachers, Postsecondary",5,72,57,69,55,75,57,66,55,75,66,25,23,19,13,75,70,19,20,78,68,75,68
+"Health Specialties Teachers, Postsecondary",5,75,57,75,59,75,59,66,55,75,66,50,43,10,7,78,71,56,50,78,70,75,71
+"Library Science Teachers, Postsecondary",5,75,63,75,59,75,63,75,59,75,66,31,32,19,11,78,71,28,30,78,68,75,68
+Molecular and Cellular Biologists,5,72,66,78,70,72,64,69,63,75,66,69,63,28,36,85,80,94,71,75,68,81,71
+"Nursing Instructors and Teachers, Postsecondary",5,72,57,72,61,78,61,72,59,75,66,47,41,22,16,75,71,47,39,78,68,75,70
+"Physics Teachers, Postsecondary",5,75,63,75,70,75,63,66,57,75,66,66,57,22,16,78,71,78,66,78,71,75,71
+Podiatrists,5,69,68,75,61,53,52,63,52,75,66,44,43,16,11,75,77,66,54,75,61,66,55
+Sociologists,5,72,59,72,61,69,57,66,55,75,66,38,48,13,11,78,70,60,52,72,64,75,68
+Epidemiologists,5,78,66,81,68,63,52,69,59,75,64,63,57,16,11,81,71,85,75,78,61,75,63
+Physical Medicine and Rehabilitation Physicians,5,66,61,78,66,53,57,69,63,75,64,47,48,19,13,75,71,56,57,75,61,69,57
+Political Scientists,5,69,55,75,64,56,48,50,52,75,64,44,45,10,9,78,68,47,46,78,64,72,63
+"Architecture Teachers, Postsecondary",5,72,64,72,63,78,63,69,59,75,63,47,54,22,14,78,71,35,37,78,70,75,71
+Bioinformatics Scientists,5,66,61,78,63,50,52,60,59,75,63,63,59,28,Not available,78,70,69,Not available,75,61,72,68
+"Biological Science Teachers, Postsecondary",5,75,64,72,59,78,63,72,55,75,63,53,46,13,7,75,73,75,57,81,68,75,68
+Instructional Coordinators,5,72,59,72,59,81,68,75,61,75,63,44,41,16,9,75,66,13,9,78,63,78,64
+Nuclear Engineers,4,66,59,75,68,50,46,75,57,75,63,72,61,19,16,75,68,78,63,72,57,72,66
+"Physicians, Pathologists",5,75,68,78,66,53,54,63,57,75,63,50,45,22,25,81,80,75,57,72,66,78,71
+"Area, Ethnic, and Cultural Studies Teachers, Postsecondary",5,75,57,72,59,75,57,53,55,75,61,25,30,19,14,81,70,38,39,78,68,75,70
+Atmospheric and Space Scientists,4,72,57,75,59,56,46,53,52,75,61,50,55,25,20,78,70,75,70,75,59,75,57
+"Education Administrators, Postsecondary",5,72,57,78,61,69,57,75,61,75,61,47,45,10,7,78,66,13,7,75,61,75,61
+"English Language and Literature Teachers, Postsecondary",5,72,57,69,57,75,71,66,57,75,61,25,27,10,9,94,71,19,13,78,68,81,70
+Environmental Economists,5,72,57,75,61,56,54,63,54,75,61,75,68,22,25,75,68,35,37,63,59,78,63
+"Environmental Science Teachers, Postsecondary",5,72,61,75,61,75,61,72,57,75,61,50,46,10,5,78,71,75,64,78,64,75,68
+"Family and Consumer Sciences Teachers, Postsecondary",5,66,59,69,57,75,61,63,57,75,61,41,41,19,11,75,66,31,32,78,68,66,59
+Health Informatics Specialists,4,69,68,72,61,72,55,69,57,75,61,47,41,44,45,81,70,28,27,75,59,75,57
+Interpreters and Translators,4,53,43,66,55,50,45,66,54,75,61,25,18,3,Not relevant,72,57,3,Not relevant,78,57,69,57
+"Medical Scientists, Except Epidemiologists",5,78,71,75,68,60,55,66,59,75,61,66,59,25,23,75,75,78,71,78,63,81,70
+Microsystems Engineers,5,63,55,75,59,56,48,66,54,75,61,60,55,41,36,75,68,66,55,66,57,69,57
+Orthotists and Prosthetists,5,69,61,75,59,50,50,56,52,75,61,50,45,16,11,78,63,44,46,75,59,75,59
+Pharmacists,5,66,55,72,63,50,50,72,61,75,61,60,48,16,11,78,70,69,54,72,59,72,57
+Registered Nurses,4,63,59,75,59,56,52,69,57,75,61,47,45,16,9,72,61,47,41,75,61,69,55
+Actuaries,4,60,59,81,68,50,50,53,52,75,59,81,70,38,39,78,66,28,29,72,57,60,57
+Adapted Physical Education Specialists,5,75,55,72,55,72,57,72,55,75,59,25,29,6,Not relevant,72,57,13,13,75,57,72,55
+"Art, Drama, and Music Teachers, Postsecondary",5,75,61,66,55,78,61,69,55,75,59,25,30,10,5,75,66,19,16,91,68,72,59
+Astronomers,5,75,68,78,61,63,54,60,55,75,59,75,71,31,30,81,73,81,71,72,70,75,71
+Biologists,5,72,66,75,64,53,52,60,54,75,59,69,61,44,52,75,71,91,71,75,64,75,70
+"Business Teachers, Postsecondary",5,72,63,72,63,75,68,66,57,75,59,50,46,22,18,75,71,22,20,81,70,75,71
+"Career/Technical Education Teachers, Secondary School",4,66,54,72,55,72,57,72,57,75,59,47,45,19,14,75,59,19,13,75,59,72,55
+Chiropractors,5,60,55,72,59,47,45,53,48,75,59,35,36,13,7,72,64,60,54,72,55,69,55
+Compensation and Benefits Managers,4,69,54,72,57,50,43,63,48,75,59,47,41,13,9,75,57,3,Not relevant,75,57,69,57
+Dermatologists,5,69,55,78,61,53,46,63,55,75,59,31,36,22,16,72,70,66,54,72,57,63,57
+"Economics Teachers, Postsecondary",5,69,59,72,59,72,57,50,52,75,59,56,54,22,20,75,63,35,41,78,61,75,59
+"Engineering Teachers, Postsecondary",5,66,59,72,59,78,61,60,59,75,59,72,64,25,23,75,70,63,52,78,70,72,68
+Environmental Engineers,4,69,59,75,61,53,45,72,61,75,59,60,57,19,16,75,66,53,52,72,61,75,59
+"Environmental Scientists and Specialists, Including Health",4,66,57,75,59,50,55,63,59,75,59,60,59,25,37,75,71,72,66,72,63,72,64
+Financial Examiners,4,66,59,78,64,60,55,72,61,75,59,66,55,16,14,78,61,6,Not relevant,75,59,75,57
+"Fraud Examiners, Investigators and Analysts",4,72,50,75,59,50,43,60,45,75,59,47,43,19,14,75,61,6,Not relevant,75,57,78,59
+Fundraisers,4,56,50,72,57,47,43,53,50,75,59,50,43,13,7,75,57,10,5,78,63,75,59
+"History Teachers, Postsecondary",5,72,57,72,55,78,61,66,57,75,59,25,29,6,Not relevant,81,68,22,25,88,68,78,68
+Industrial Engineers,4,56,55,75,59,44,43,60,61,75,59,56,55,22,16,75,64,28,25,72,59,69,59
+Investment Fund Managers,5,69,55,75,57,47,45,63,57,75,59,60,52,19,Not available,75,61,0,Not relevant,72,59,66,55
+Logistics Engineers,4,69,55,72,61,50,50,56,55,75,59,72,57,41,32,78,63,38,41,69,57,75,59
+Materials Engineers,4,56,64,72,61,50,52,53,55,75,59,69,57,22,25,75,68,75,68,69,59,69,63
+Materials Scientists,5,72,57,78,59,53,48,60,59,75,59,60,57,22,14,78,70,78,71,72,61,72,61
+Orthoptists,5,56,55,75,57,56,55,53,54,75,59,44,43,19,11,66,66,66,54,72,57,63,57
+Physical Therapists,5,53,46,75,55,53,45,72,55,75,59,28,37,16,13,75,63,41,39,75,59,72,57
+Physician Assistants,5,72,59,78,66,53,48,72,57,75,59,50,43,22,16,78,68,66,55,75,57,75,57
+Range Managers,4,56,52,69,57,44,43,66,61,75,59,47,46,13,9,72,59,47,48,69,57,56,57
+Rehabilitation Counselors,4,53,46,66,55,53,54,72,59,75,59,25,29,13,7,69,57,31,29,75,57,66,57
+"Secondary School Teachers, Except Special and Career/Technical Education",4,66,54,72,55,75,63,72,59,75,59,47,43,19,11,75,59,25,25,78,59,69,55
+"Social Work Teachers, Postsecondary",5,75,70,75,61,81,70,69,55,75,59,41,37,19,14,75,70,41,37,91,70,75,68
+"Sociology Teachers, Postsecondary",5,66,63,69,59,75,70,69,55,75,59,28,46,13,7,75,70,44,54,91,68,75,68
+"Special Education Teachers, Preschool",5,66,54,72,55,69,57,69,57,75,59,31,30,19,14,72,59,25,21,78,61,69,57
+Survey Researchers,5,60,57,78,61,50,48,50,52,75,59,63,61,31,32,75,61,44,39,75,59,75,59
+Fire Inspectors and Investigators,3,55,52,74,58,49,43,56,49,75,58,42,40,17,13,63,58,50,46,72,56,64,54
+Administrative Services Managers,3,53,48,69,55,50,46,60,52,75,57,31,30,10,9,75,57,0,Not relevant,72,55,69,54
+"Agents and Business Managers of Artists, Performers, and Athletes",4,63,50,69,54,41,39,47,43,75,57,28,29,13,7,75,57,16,9,75,57,66,55
+Agricultural Engineers,4,56,55,78,61,47,45,53,54,75,57,72,57,28,23,75,66,60,48,72,57,72,61
+Airfield Operations Specialists,3,56,46,69,55,50,45,75,59,75,57,28,30,10,5,69,57,16,11,69,55,60,46
+Architectural and Engineering Managers,5,72,55,72,61,56,45,69,57,75,57,72,61,22,16,78,63,41,39,75,57,75,59
+Art Directors,4,60,54,69,57,50,46,56,54,75,57,35,41,16,13,69,55,10,5,75,57,56,57
+Art Therapists,5,69,55,72,57,53,55,72,57,75,57,28,30,22,13,72,57,25,25,75,59,66,57
+Athletic Trainers,5,69,57,72,59,53,55,72,59,75,57,28,30,6,Not relevant,69,55,35,27,72,57,63,55
+Broadcast Announcers and Radio Disc Jockeys,4,56,46,69,55,28,34,56,48,75,57,22,18,6,Not relevant,75,55,0,Not relevant,91,63,56,57
+Budget Analysts,4,56,48,69,55,47,39,53,48,75,57,69,50,22,16,72,57,6,Not relevant,69,48,56,54
+"Career/Technical Education Teachers, Middle School",4,63,50,72,55,75,57,72,54,75,57,38,34,19,11,75,59,22,20,78,57,66,52
+"Career/Technical Education Teachers, Postsecondary",3,72,57,69,54,75,57,66,57,75,57,31,32,13,9,72,55,22,14,72,57,66,57
+"Chemistry Teachers, Postsecondary",5,75,57,75,57,75,57,75,57,75,57,56,54,22,16,78,71,75,61,78,71,78,70
+Chief Sustainability Officers,5,69,55,78,59,60,54,69,57,75,57,47,45,22,16,75,61,28,27,75,59,78,61
+Civil Engineers,4,56,66,72,66,47,52,56,55,75,57,72,68,22,27,72,71,69,57,72,55,56,55
+Clinical Research Coordinators,4,60,57,69,57,53,48,66,54,75,57,47,43,16,13,75,61,50,43,72,57,75,57
+Coaches and Scouts,4,72,57,75,57,78,57,78,68,75,57,28,29,6,Not relevant,75,57,16,16,85,57,66,57
+Commercial and Industrial Designers,4,50,57,69,57,44,41,53,54,75,57,44,50,22,21,72,59,41,39,63,57,53,55
+Compliance Officers,3,56,43,66,55,41,39,53,46,75,57,35,32,19,16,72,57,0,Not relevant,72,57,63,54
+Computer and Information Systems Managers,4,60,55,78,57,56,50,72,63,75,57,53,45,44,37,75,57,19,20,72,55,69,57
+Computer Systems Engineers/Architects,4,69,57,78,55,50,46,63,54,75,57,53,46,60,59,78,61,53,50,69,55,72,57
+Computer User Support Specialists,3,53,46,69,57,47,45,50,45,75,57,31,30,28,30,75,57,19,21,75,57,66,45
+Critical Care Nurses,4,72,57,75,59,50,52,78,57,75,57,47,41,19,13,75,57,50,45,75,57,60,57
+Customs and Border Protection Officers,3,60,45,75,55,41,41,66,54,75,57,31,30,13,7,72,55,22,16,75,57,66,54
+Customs Brokers,3,56,52,69,55,53,43,56,52,75,57,50,43,22,20,72,57,0,Not relevant,69,57,69,55
+"Dentists, General",5,72,64,78,63,53,54,75,57,75,57,44,43,16,11,75,71,69,54,75,57,56,57
+Dietitians and Nutritionists,5,66,59,75,59,69,59,72,59,75,57,50,43,19,14,75,70,56,52,75,59,72,61
+Economists,5,72,57,78,64,53,50,53,52,75,57,78,61,25,25,78,68,25,32,75,61,75,61
+"Education and Childcare Administrators, Preschool and Daycare",4,63,55,75,57,66,55,75,59,75,57,47,41,13,9,75,59,13,11,75,57,69,57
+"Elementary School Teachers, Except Special Education",4,69,55,75,57,78,64,72,61,75,57,47,39,13,7,75,57,28,25,81,57,72,55
+Emergency Management Directors,4,69,63,75,63,66,55,75,63,75,57,50,45,16,9,75,61,28,23,78,61,75,61
+"Environmental Science and Protection Technicians, Including Health",4,53,45,72,54,50,45,56,55,75,57,53,45,19,16,72,57,66,48,69,54,66,55
+Executive Secretaries and Executive Administrative Assistants,3,53,45,56,54,47,43,53,52,75,57,44,32,22,18,75,57,10,5,72,55,69,54
+Exercise Physiologists,4,56,55,75,57,56,54,69,57,75,57,47,43,22,16,75,64,47,43,75,59,72,57
+Financial Managers,4,69,57,75,57,63,57,75,64,75,57,56,48,10,5,75,57,10,5,75,57,72,57
+First-Line Supervisors of Correctional Officers,3,56,46,75,57,53,45,75,61,75,57,28,29,13,7,69,57,13,7,72,57,63,52
+First-Line Supervisors of Non-Retail Sales Workers,4,63,52,66,55,56,52,75,61,75,57,50,43,13,9,66,59,0,Not relevant,75,57,66,57
+Food Scientists and Technologists,4,69,55,72,61,50,43,72,55,75,57,53,45,16,13,75,61,60,48,72,57,75,57
+General and Operations Managers,4,63,52,72,57,50,46,75,57,75,57,35,36,13,9,72,57,22,16,75,57,56,55
+Genetic Counselors,5,72,55,72,59,50,46,50,43,75,57,44,39,10,7,78,68,56,45,72,55,72,61
+Geneticists,5,75,59,75,63,72,55,69,55,75,57,72,57,22,16,81,71,78,63,75,59,75,70
+"Geography Teachers, Postsecondary",5,72,59,72,57,72,55,53,55,75,57,44,43,25,20,75,68,53,50,78,70,78,70
+Historians,5,69,54,78,59,50,52,50,45,75,57,19,16,6,Not relevant,94,70,41,37,72,59,75,70
+"Human Resources Assistants, Except Payroll and Timekeeping",3,50,45,60,52,38,41,60,50,75,57,25,29,19,11,75,57,3,Not relevant,69,54,63,52
+Human Resources Specialists,4,56,48,72,57,50,46,50,54,75,57,25,29,16,9,75,57,3,Not relevant,78,57,72,57
+Industrial Ecologists,5,66,57,72,61,50,50,53,55,75,57,60,57,25,29,78,68,66,59,75,57,75,66
+Information Technology Project Managers,4,60,55,78,61,50,46,66,64,75,57,47,45,31,23,75,57,28,21,72,57,75,57
+Interior Designers,4,53,46,75,57,47,37,53,48,75,57,50,45,19,13,75,55,10,7,75,57,66,54
+"Interviewers, Except Eligibility and Loan",3,47,43,56,46,47,41,50,45,75,57,31,30,22,16,63,52,0,Not relevant,72,57,56,48
+"Kindergarten Teachers, Except Special Education",4,56,45,56,54,75,55,75,57,75,57,31,32,6,Not relevant,72,54,10,7,75,46,56,46
+Landscape Architects,4,69,54,72,55,47,43,50,50,75,57,50,45,13,11,75,57,38,41,72,57,69,55
+Loan Officers,4,53,45,69,57,44,37,47,43,75,57,56,45,16,13,72,57,0,Not relevant,75,57,60,55
+Loss Prevention Managers,4,69,54,72,57,56,46,72,57,75,57,44,39,16,11,75,57,0,Not relevant,75,57,69,55
+"Low Vision Therapists, Orientation and Mobility Specialists, and Vision Rehabilitation Therapists",5,69,55,63,55,75,55,69,57,75,57,28,27,10,7,72,57,25,20,75,57,69,57
+"Mathematical Science Teachers, Postsecondary",5,69,59,72,59,72,61,72,57,75,57,81,70,19,13,75,70,35,32,78,63,72,68
+Media Programming Directors,4,75,55,81,57,53,46,66,54,75,57,25,34,10,5,78,57,16,9,78,57,72,57
+Media Technical Directors/Managers,4,60,52,72,57,56,50,75,66,75,57,28,32,19,16,66,57,3,Not relevant,75,57,60,50
+Medical and Health Services Managers,5,72,57,78,57,53,54,66,57,75,57,44,41,19,14,75,59,44,45,81,57,75,57
+"Meeting, Convention, and Event Planners",4,60,45,72,55,35,41,63,54,75,57,38,36,10,5,75,57,6,Not relevant,75,57,63,52
+Microbiologists,5,72,64,75,64,66,55,69,55,75,57,50,55,25,30,78,75,88,71,72,57,78,68
+"Middle School Teachers, Except Special and Career/Technical Education",4,69,55,66,52,75,57,72,57,75,57,50,43,10,9,75,57,16,13,78,57,75,57
+"Morticians, Undertakers, and Funeral Arrangers",3,53,46,56,55,47,41,53,54,75,57,47,37,10,7,56,55,22,25,72,57,56,57
+New Accounts Clerks,3,44,37,53,50,38,30,53,43,75,57,47,43,16,11,63,52,0,Not relevant,75,55,50,43
+Nuclear Technicians,3,50,45,72,52,41,36,75,57,75,57,47,48,16,11,66,57,50,45,69,52,53,43
+Nurse Anesthetists,5,75,57,78,57,60,50,75,57,75,57,56,46,6,Not relevant,78,61,72,55,75,57,60,50
+Operations Research Analysts,5,72,59,78,63,50,45,47,43,75,57,88,68,38,39,75,63,53,45,72,57,75,57
+Personal Financial Advisors,4,60,46,72,59,47,43,53,52,75,57,60,55,19,14,75,57,22,18,75,57,75,57
+Physical Therapist Assistants,3,56,45,56,55,47,45,69,55,75,57,31,29,19,14,56,55,35,30,69,55,56,45
+Police and Sheriff's Patrol Officers,3,58,46,75,56,47,43,64,49,75,57,25,26,8,Not relevant,64,55,17,12,75,56,58,47
+"Political Science Teachers, Postsecondary",5,75,57,72,59,72,57,50,52,75,57,25,30,6,Not relevant,78,70,35,32,91,71,75,70
+Probation Officers and Correctional Treatment Specialists,4,60,46,72,57,31,37,69,55,75,57,22,18,16,11,72,59,19,11,75,57,69,55
+Real Estate Sales Agents,3,53,46,66,57,38,34,50,43,75,57,53,46,16,9,60,57,3,Not relevant,75,57,60,50
+"Recreation and Fitness Studies Teachers, Postsecondary",5,60,57,72,57,75,57,69,57,75,57,28,37,6,Not relevant,75,61,35,39,78,59,75,59
+Recreation Workers,4,53,45,56,52,53,45,69,48,75,57,28,29,10,5,53,46,16,9,75,57,53,45
+Recreational Therapists,4,60,48,69,57,60,48,60,52,75,57,25,29,13,11,69,55,35,29,75,55,66,55
+Regulatory Affairs Specialists,4,56,55,72,61,50,43,56,54,75,57,38,41,22,20,72,68,22,16,75,59,75,59
+Reservation and Transportation Ticket Agents and Travel Clerks,2,50,43,60,52,41,37,50,41,75,57,41,36,22,13,63,45,0,Not relevant,75,46,53,43
+Sales Managers,4,69,55,72,57,56,54,69,68,75,57,50,46,16,13,72,57,16,9,75,59,66,57
+"Sales Representatives, Wholesale and Manufacturing, Except Technical and Scientific Products",4,53,46,63,54,31,30,53,46,75,57,31,32,13,7,60,54,0,Not relevant,75,57,56,46
+Social and Human Service Assistants,4,56,46,66,57,47,43,66,54,75,57,25,29,16,13,69,57,19,21,75,59,66,55
+"Special Education Teachers, Middle School",4,75,55,72,55,75,59,69,55,75,57,41,39,13,11,72,57,13,7,78,57,69,57
+"Special Education Teachers, Secondary School",4,60,55,69,57,78,68,72,57,75,57,44,41,19,14,75,57,25,23,75,55,75,57
+Supply Chain Managers,4,69,54,72,57,50,46,75,59,75,57,50,43,16,13,75,57,3,Not relevant,75,57,72,57
+Talent Directors,4,50,45,72,57,44,37,60,52,75,57,25,27,16,9,72,57,13,7,75,57,56,46
+"Tax Examiners and Collectors, and Revenue Agents",3,56,52,72,52,47,43,50,41,75,57,53,46,16,13,75,59,0,Not relevant,72,54,60,46
+Training and Development Managers,4,72,61,72,57,85,75,72,61,75,57,50,43,19,11,75,57,22,13,75,68,72,57
+Transportation Planners,4,69,54,75,61,53,45,60,54,75,57,56,54,25,25,75,61,38,30,72,55,72,57
+Water Resource Specialists,4,56,54,75,57,53,46,56,54,75,57,56,54,22,21,75,59,50,46,75,57,75,57
+Wind Energy Operations Managers,3,50,52,72,57,50,45,72,59,75,57,50,46,22,18,72,57,25,16,72,57,69,57
+Zoologists and Wildlife Biologists,5,69,54,75,59,47,43,56,50,75,57,50,43,19,16,75,66,75,55,72,55,72,61
+Acute Care Nurses,3,69,55,75,57,53,52,75,59,75,55,44,41,16,11,75,64,50,45,75,57,63,52
+Anesthesiologist Assistants,5,63,52,66,54,47,46,69,55,75,55,47,41,10,9,69,61,50,41,66,54,53,50
+Choreographers,4,60,46,69,50,63,48,72,52,75,55,22,14,6,Not relevant,66,46,13,7,75,57,53,43
+Climate Change Policy Analysts,5,69,55,75,57,50,45,53,54,75,55,50,46,22,18,81,61,41,39,72,61,72,59
+Concierges,3,47,41,56,52,31,30,50,43,75,55,25,29,10,5,50,46,0,Not relevant,75,48,44,41
+Court Reporters and Simultaneous Captioners,3,35,34,38,39,25,27,50,43,75,55,16,9,3,Not relevant,53,52,0,Not relevant,50,45,60,46
+"Dispatchers, Except Police, Fire, and Ambulance",2,50,41,53,54,44,39,72,46,75,55,28,29,10,5,69,46,3,Not relevant,75,55,53,41
+Fashion Designers,3,72,48,75,52,53,45,66,54,75,55,31,32,10,9,69,54,3,Not relevant,72,52,63,50
+First-Line Supervisors of Office and Administrative Support Workers,3,69,54,72,55,66,54,75,57,75,55,44,39,22,14,75,54,0,Not relevant,75,57,69,54
+Occupational Health and Safety Technicians,3,53,46,72,55,50,45,60,54,75,55,38,39,22,16,72,55,47,41,72,55,63,55
+Orthodontists,5,69,55,75,57,50,48,69,54,75,55,31,34,6,Not relevant,69,59,66,52,75,57,60,57
+Parts Salespersons,2,47,43,56,45,31,30,53,41,75,55,38,36,13,9,72,45,0,Not relevant,75,45,53,41
+Pharmacy Technicians,3,53,45,56,52,47,41,53,45,75,55,50,43,13,7,69,52,22,21,69,46,50,43
+Prosthodontists,5,50,46,72,57,47,45,63,50,75,55,28,36,16,9,63,55,50,45,75,55,60,48
+Surgical Assistants,3,50,45,66,50,53,45,66,50,75,55,38,37,13,13,66,57,41,37,69,55,53,48
+"Secretaries and Administrative Assistants, Except Legal, Medical, and Executive",2,47,43,50,52,28,27,53,46,75,54,25,23,16,11,72,55,0,Not relevant,75,52,69,50
+First-Line Supervisors of Material-Moving Machine and Vehicle Operators,2,53,45,72,50,50,43,69,50,75,52,38,29,10,5,69,54,6,Not relevant,72,54,56,48
+Telemarketers,2,22,21,47,48,10,7,38,34,75,52,13,9,3,Not relevant,53,46,3,Not relevant,81,52,35,37
+Telephone Operators,2,35,29,50,46,28,27,41,34,75,50,22,20,16,9,50,39,0,Not relevant,75,48,35,36
+Postmasters and Mail Superintendents,2,56,45,69,55,60,46,69,52,75,48,44,36,19,13,75,55,13,7,75,57,56,54
+Order Clerks,2,53,43,56,52,35,30,56,39,75,46,50,41,13,7,72,48,3,Not relevant,72,46,53,41
+Transit and Railroad Police,3,56,43,72,48,47,46,60,50,75,46,25,29,16,11,53,46,3,Not relevant,75,55,56,43
+Floral Designers,2,50,41,56,48,31,30,50,41,75,45,31,30,10,5,47,43,6,Not relevant,72,48,38,39
+Accountants and Auditors,4,58,50,72,55,49,43,58,51,74,57,67,57,16,14,74,58,22,23,70,55,69,52
+Appraisers and Assessors of Real Estate,4,59,47,72,55,27,29,45,40,74,54,55,53,13,8,74,57,17,13,69,55,61,54
+"Securities, Commodities, and Financial Services Sales Agents",4,55,53,74,60,41,38,54,52,73,58,59,54,20,17,72,60,8,Not relevant,72,58,58,55
+"Computer Science Teachers, Postsecondary",5,72,59,72,64,72,63,69,57,72,63,53,50,50,45,75,71,44,37,75,70,75,70
+Human Factors Engineers and Ergonomists,5,63,61,75,63,56,50,60,59,72,63,56,57,31,34,75,70,50,45,75,61,72,61
+"Architects, Except Landscape and Naval",5,66,59,75,64,56,45,69,63,72,61,63,59,22,18,75,68,47,43,75,57,72,59
+Biostatisticians,5,75,70,75,70,60,55,50,52,72,61,91,73,60,57,75,73,75,66,75,64,72,70
+Curators,5,63,59,69,63,56,50,60,57,72,61,47,43,19,14,75,66,25,18,75,59,72,66
+Forensic Science Technicians,4,56,52,72,57,50,48,53,50,72,61,44,45,19,18,72,63,60,46,72,59,72,59
+"Geoscientists, Except Hydrologists and Geographers",5,56,54,75,61,53,45,53,48,72,61,60,59,25,23,78,70,75,66,75,63,72,66
+Sales Engineers,4,66,55,75,57,50,50,50,52,72,61,50,54,28,27,75,68,31,32,75,59,69,57
+Social and Community Service Managers,4,72,55,72,59,66,54,72,57,72,61,41,45,19,13,69,59,31,29,69,59,69,57
+Treasurers and Controllers,4,66,61,78,68,50,48,72,64,72,61,69,61,16,14,78,61,6,Not relevant,75,61,66,59
+"Health and Safety Engineers, Except Mining Safety Engineers and Inspectors",4,66,55,75,60,56,49,61,55,72,60,49,47,25,21,75,65,61,55,74,59,74,59
+Aerospace Engineers,4,66,55,78,66,60,54,69,55,72,59,72,68,28,Not available,75,71,75,73,72,61,72,64
+Business Intelligence Analysts,4,69,59,75,61,50,43,53,48,72,59,60,55,41,36,75,63,19,11,72,57,69,59
+Compliance Managers,4,69,55,75,61,56,50,69,66,72,59,28,32,19,13,75,59,10,7,72,59,72,59
+Construction Managers,4,66,55,69,59,50,45,72,61,72,59,56,52,13,7,69,59,22,25,72,59,56,55
+Coroners,3,60,54,75,59,50,43,56,50,72,59,41,36,13,7,75,61,53,54,75,59,72,59
+Environmental Restoration Planners,5,63,57,75,59,50,46,69,55,72,59,56,48,31,27,72,61,63,55,72,59,72,61
+Logisticians,4,63,50,75,59,50,50,72,66,72,59,50,48,22,25,72,59,19,13,72,57,60,54
+Manufacturing Engineers,4,66,64,69,57,56,55,72,66,72,59,75,64,22,36,75,68,53,54,72,59,69,63
+Marketing Managers,4,72,59,72,61,53,50,69,61,72,59,44,45,22,18,72,61,19,21,72,59,56,55
+Producers and Directors,4,53,53,72,57,45,42,70,60,72,59,31,35,17,12,69,60,2,Not relevant,75,58,66,54
+Quality Control Systems Managers,4,63,57,69,59,60,50,72,59,72,59,53,48,25,21,78,57,35,Not available,69,54,69,54
+Soil and Plant Scientists,5,75,64,75,63,56,55,56,59,72,59,56,55,28,29,75,71,75,70,75,66,72,63
+Acupuncturists,5,53,46,69,55,41,41,56,50,72,57,25,29,6,Not relevant,60,57,38,30,63,55,53,50
+Animal Scientists,5,72,63,75,61,56,46,63,57,72,57,60,50,22,14,75,66,85,63,75,59,75,61
+Brownfield Redevelopment Specialists and Site Managers,4,56,55,75,61,50,43,75,59,72,57,66,55,16,11,75,64,50,46,75,59,72,59
+Computer Systems Analysts,4,63,59,72,61,50,45,56,57,72,57,50,50,53,52,72,63,31,30,69,57,63,57
+Conservation Scientists,4,56,54,69,57,44,46,63,54,72,57,60,54,22,21,72,59,63,55,69,55,69,57
+Credit Counselors,4,66,50,69,55,53,45,50,43,72,57,53,43,13,11,72,55,0,Not relevant,75,57,69,54
+Diagnostic Medical Sonographers,3,60,45,63,50,50,43,63,46,72,57,28,32,6,Not relevant,69,55,56,41,69,52,56,48
+Editors,4,53,55,72,57,47,43,50,48,72,57,28,34,16,11,97,73,0,Not relevant,69,57,81,71
+Electrical Engineers,4,63,48,72,57,47,43,63,50,72,57,56,57,25,21,72,61,53,50,69,54,72,55
+"Energy Engineers, Except Wind and Solar",4,69,55,75,59,47,43,72,55,72,57,69,59,25,18,78,68,66,63,69,57,72,59
+Environmental Compliance Inspectors,4,69,59,75,61,50,46,69,63,72,57,50,45,16,16,75,68,50,46,72,61,72,59
+Environmental Engineering Technologists and Technicians,4,69,55,72,57,50,43,60,54,72,57,50,54,28,29,72,57,60,54,60,57,53,55
+Fire-Prevention and Protection Engineers,4,66,55,78,59,47,48,50,48,72,57,47,45,22,23,75,57,63,55,72,57,72,57
+First-Line Supervisors of Production and Operating Workers,3,53,45,69,54,53,45,69,55,72,57,35,41,6,Not relevant,63,54,13,9,72,54,53,52
+Geodetic Surveyors,4,56,55,75,57,50,50,60,55,72,57,78,68,35,43,75,63,53,52,56,55,56,59
+Geographers,5,69,55,72,57,56,52,50,50,72,57,47,43,16,13,75,68,66,55,75,61,75,68
+Hydrologists,5,66,63,75,64,50,48,63,57,72,57,69,63,28,37,72,66,72,63,69,59,66,59
+Industrial Production Managers,4,66,57,75,57,69,57,75,70,72,57,60,54,16,11,72,57,16,16,75,57,60,57
+Insurance Sales Agents,4,50,48,69,55,44,39,47,43,72,57,50,43,19,11,75,57,3,Not relevant,72,57,66,52
+Licensed Practical and Licensed Vocational Nurses,3,60,46,69,57,53,45,72,57,72,57,47,41,6,Not relevant,69,59,41,37,72,57,56,45
+Logistics Analysts,4,53,54,75,59,44,43,69,57,72,57,50,54,25,25,75,57,19,11,69,48,60,57
+Marine Engineers and Naval Architects,4,61,63,74,63,47,43,63,57,72,57,66,69,27,26,74,68,58,62,72,57,63,57
+Market Research Analysts and Marketing Specialists,4,63,57,75,57,50,43,56,52,72,57,56,48,28,29,75,66,31,32,72,57,75,59
+Mechanical Engineers,4,60,63,72,61,44,50,53,61,72,57,72,70,38,34,72,70,72,66,53,55,56,57
+"Mining and Geological Engineers, Including Mining Safety Engineers",4,63,59,75,64,53,48,69,64,72,57,69,66,41,43,75,68,63,57,75,59,75,61
+Ophthalmic Medical Technologists,3,50,43,56,52,50,43,50,45,72,57,41,37,16,13,53,55,31,39,72,57,53,50
+Oral and Maxillofacial Surgeons,5,72,64,75,68,47,48,72,55,72,57,41,39,13,7,75,75,63,55,72,59,63,55
+Paralegals and Legal Assistants,3,53,46,60,50,31,30,50,43,72,57,22,23,13,9,75,57,16,11,69,54,69,55
+Petroleum Engineers,4,69,55,75,63,50,43,69,55,72,57,56,57,22,16,75,68,60,57,72,57,72,61
+Purchasing Managers,4,60,55,72,57,53,52,63,55,72,57,50,48,22,16,69,54,6,Not relevant,72,55,69,57
+Real Estate Brokers,4,66,54,72,55,38,29,53,48,72,57,47,43,13,7,72,59,3,Not relevant,75,57,60,50
+Regulatory Affairs Managers,4,60,55,72,59,50,50,72,59,72,57,38,41,19,11,75,61,38,29,75,57,75,57
+Robotics Engineers,4,69,64,75,66,60,54,72,55,72,57,69,66,53,55,72,70,53,54,56,55,69,55
+Sustainability Specialists,4,56,48,72,57,53,45,63,50,72,57,47,41,13,9,75,59,31,25,75,59,75,59
+Tax Preparers,3,53,45,63,52,44,43,53,43,72,57,53,46,16,9,75,57,0,Not relevant,56,50,50,43
+Travel Guides,3,47,41,56,50,47,45,47,46,72,57,44,36,16,13,56,50,6,Not relevant,72,46,53,45
+Validation Engineers,4,56,52,75,59,50,45,72,57,72,57,53,52,22,14,78,64,69,63,75,57,75,59
+Water/Wastewater Engineers,4,56,57,75,59,53,54,66,57,72,57,72,64,28,36,75,63,63,Not available,69,57,75,57
+First-Line Supervisors of Firefighting and Prevention Workers,3,69,55,75,59,60,52,75,63,72,56,44,46,14,8,64,56,36,32,74,57,61,54
+Archivists,5,56,46,60,55,47,41,50,45,72,55,25,30,19,13,75,57,25,16,56,55,75,57
+Biomass Power Plant Managers,4,53,48,75,57,50,45,72,66,72,55,50,46,16,13,72,61,38,36,75,57,53,54
+Brokerage Clerks,3,50,43,60,52,41,39,53,43,72,55,50,50,25,25,69,54,0,Not relevant,72,52,53,50
+Cardiovascular Technologists and Technicians,3,53,48,69,54,47,43,69,54,72,55,41,36,16,9,66,59,50,41,69,52,53,50
+Chemical Technicians,3,60,46,75,59,53,46,72,55,72,55,50,45,13,9,75,59,78,59,60,48,72,57
+Clinical Data Managers,4,66,57,75,61,47,46,66,59,72,55,63,55,56,52,72,61,35,32,72,57,69,57
+Commercial Pilots,3,66,57,75,57,56,48,75,57,72,55,44,37,16,11,66,57,47,43,66,52,47,45
+Computer Hardware Engineers,4,69,59,75,59,47,45,53,46,72,55,56,48,38,39,75,64,47,46,72,57,72,59
+Construction and Building Inspectors,3,53,45,69,55,50,45,50,45,72,55,50,46,16,13,72,55,41,29,72,55,50,43
+"First-Line Supervisors of Helpers, Laborers, and Material Movers, Hand",2,47,41,69,54,50,48,60,50,72,55,28,34,10,5,53,54,6,Not relevant,69,54,50,48
+"First-Line Supervisors of Landscaping, Lawn Service, and Groundskeeping Workers",3,53,43,69,54,53,43,75,54,72,55,47,41,16,11,53,52,16,14,69,57,50,43
+Hearing Aid Specialists,3,53,45,53,52,50,43,53,43,72,55,28,37,13,9,56,48,19,13,60,52,53,43
+Industrial Engineering Technologists and Technicians,3,50,52,72,55,44,43,60,55,72,55,53,54,22,23,75,57,47,45,56,54,53,54
+Magnetic Resonance Imaging Technologists,3,50,43,56,52,47,43,66,55,72,55,38,37,19,13,72,55,41,32,66,54,53,46
+Medical Assistants,3,56,48,66,52,53,45,63,50,72,55,41,37,13,9,69,57,41,32,72,57,60,46
+Museum Technicians and Conservators,4,50,45,56,48,47,43,53,46,72,55,31,36,13,9,66,59,35,32,66,50,56,54
+Nuclear Monitoring Technicians,3,50,45,72,57,53,46,72,57,72,55,53,45,13,9,69,57,53,45,63,48,53,52
+Nuclear Power Reactor Operators,3,53,45,72,57,50,43,72,57,72,55,44,39,25,18,75,55,44,43,56,46,63,43
+Occupational Health and Safety Specialists,4,60,57,72,59,56,50,66,59,72,55,60,48,19,18,72,57,47,48,75,59,66,55
+Occupational Therapy Assistants,3,53,43,56,46,47,45,60,48,72,55,35,32,6,Not relevant,66,52,22,23,69,48,66,52
+"Poets, Lyricists and Creative Writers",4,63,55,69,55,47,39,47,46,72,55,13,7,16,9,81,66,10,7,66,55,94,82
+Police Identification and Records Officers,3,53,46,72,57,44,41,53,46,72,55,28,34,13,9,66,59,19,14,69,55,60,46
+Precision Agriculture Technicians,4,63,54,72,52,44,39,56,50,72,55,56,48,31,23,72,57,50,45,69,48,60,48
+Psychiatric Technicians,3,50,46,66,55,53,50,72,55,72,55,25,27,13,7,69,57,22,21,75,57,56,45
+"Purchasing Agents, Except Wholesale, Retail, and Farm Products",4,69,55,69,55,50,45,69,55,72,55,47,41,6,Not relevant,75,57,3,Not relevant,72,57,69,54
+Residential Advisors,3,50,43,66,57,44,41,69,52,72,55,25,29,10,7,53,48,10,5,69,55,50,43
+Respiratory Therapists,3,66,52,72,57,53,43,72,55,72,55,44,41,13,7,66,57,50,50,69,57,53,50
+Set and Exhibit Designers,5,53,45,69,54,47,39,53,50,72,55,50,48,19,13,72,57,19,13,69,52,56,45
+Special Effects Artists and Animators,4,53,48,69,54,47,43,50,46,72,55,28,34,28,23,69,57,3,Not relevant,56,50,53,43
+Statisticians,5,66,55,78,70,50,45,47,45,72,55,94,82,50,52,75,70,63,57,69,61,63,63
+Chemists,4,60,59,75,59,47,45,56,54,72,54,72,63,28,25,75,71,81,73,63,57,66,68
+Computer Network Architects,4,56,52,75,61,47,46,56,50,72,54,56,55,63,48,72,61,28,23,69,57,66,54
+Customer Service Representatives,2,50,41,53,46,41,41,50,43,72,54,25,30,13,9,60,48,0,Not relevant,72,54,44,43
+"Directors, Religious Activities and Education",4,63,54,69,55,63,54,50,55,72,54,35,41,19,11,72,59,19,13,75,57,60,55
+Energy Auditors,3,53,46,69,54,50,43,56,48,72,54,60,45,13,11,72,55,50,43,69,48,69,54
+First-Line Supervisors of Personal Service Workers,3,50,43,72,54,50,43,56,50,72,54,28,30,10,5,63,50,13,9,69,54,53,45
+Fish and Game Wardens,4,50,50,72,57,47,43,60,50,72,54,41,41,13,7,66,59,44,39,69,52,53,48
+"Production, Planning, and Expediting Clerks",3,41,41,60,55,38,36,60,50,72,54,41,36,16,9,72,57,6,Not relevant,66,48,60,45
+Solar Sales Representatives and Assessors,3,53,48,63,54,38,36,53,48,72,54,44,46,16,11,63,55,10,13,75,55,56,48
+Bill and Account Collectors,2,47,39,53,50,28,30,50,41,72,52,41,37,6,Not relevant,53,52,0,Not relevant,72,52,56,45
+Demonstrators and Product Promoters,2,47,43,50,43,44,39,50,45,72,52,28,27,3,Not relevant,56,46,0,Not relevant,72,55,50,43
+First-Line Supervisors of Retail Sales Workers,2,50,48,63,55,50,50,63,55,72,52,44,43,19,14,50,55,0,Not relevant,69,55,50,52
+Medical Appliance Technicians,3,50,43,69,50,47,41,56,45,72,52,44,41,10,5,66,52,22,23,66,45,50,43
+Writers and Authors,4,50,45,63,52,41,37,50,45,72,52,28,27,10,9,81,59,16,16,66,50,81,59
+First-Line Supervisors of Gambling Services Workers,2,44,41,63,54,38,32,75,49,72,51,38,30,5,Not relevant,50,46,11,Not relevant,72,50,50,43
+Medical Secretaries and Administrative Assistants,2,31,32,53,43,28,30,50,41,72,50,28,29,10,5,63,45,3,Not relevant,75,52,53,43
+Aviation Inspectors,3,53,46,75,57,47,43,60,48,72,48,31,34,10,7,72,48,47,50,72,57,66,46
+Correctional Officers and Jailers,2,50,43,66,52,50,43,72,55,72,48,25,29,13,7,63,54,16,9,75,52,53,45
+Dental Assistants,3,53,45,50,45,38,36,53,43,72,48,28,29,10,5,56,46,25,25,60,45,50,43
+"Explosives Workers, Ordnance Handling Experts, and Blasters",2,53,45,66,50,50,41,69,52,72,48,38,41,0,Not relevant,53,52,22,20,60,45,47,41
+Flight Attendants,2,53,43,53,52,44,32,72,48,72,46,25,27,10,5,53,50,10,7,78,54,50,41
+Medical and Clinical Laboratory Technicians,3,50,45,60,48,47,45,53,45,72,45,44,36,22,14,63,48,56,48,60,45,53,43
+"Preschool Teachers, Except Special Education",3,53,43,69,45,72,57,69,50,72,45,25,27,0,Not relevant,69,46,16,9,75,45,50,43
+"Hairdressers, Hairstylists, and Cosmetologists",3,56,43,60,50,47,43,50,43,72,43,35,29,10,5,50,43,16,14,69,43,47,41
+Nannies,2,50,43,63,46,56,46,75,55,72,43,16,11,0,Not relevant,50,43,19,14,72,48,53,41
+"Switchboard Operators, Including Answering Service",2,41,32,47,39,28,29,47,34,72,43,19,20,13,7,50,43,0,Not relevant,75,39,50,34
+"Transportation, Storage, and Distribution Managers",4,57,52,73,58,52,48,72,59,71,57,52,45,12,8,72,57,11,Not relevant,73,57,66,52
+"Captains, Mates, and Pilots of Water Vessels",3,57,47,71,52,45,42,68,52,71,51,42,38,14,Not relevant,57,52,23,21,69,49,49,45
+"Claims Adjusters, Examiners, and Investigators",4,58,47,72,57,36,37,53,45,70,56,49,44,11,9,72,58,11,Not relevant,70,55,67,54
+Librarians and Media Collections Specialists,5,56,50,63,53,55,48,55,49,70,54,27,29,11,Not relevant,66,54,11,Not relevant,66,52,61,53
+Radiologic Technologists and Technicians,3,52,44,60,48,42,40,56,46,70,54,28,32,16,9,66,55,34,31,70,54,56,46
+"First-Line Supervisors of Farming, Fishing, and Forestry Workers",3,54,47,67,51,51,45,69,54,70,53,42,38,11,Not relevant,56,53,33,30,67,52,52,48
+Firefighters,3,53,43,67,54,53,43,70,53,70,50,33,32,6,Not relevant,58,50,28,23,64,46,49,42
+Midwives,5,60,52,75,57,56,48,75,66,69,63,31,36,16,11,66,61,47,41,69,57,53,52
+Computer and Information Research Scientists,5,63,70,75,61,50,50,53,57,69,59,60,63,66,64,69,64,53,48,63,59,60,59
+Cost Estimators,4,56,55,72,61,47,43,50,52,69,59,75,61,22,23,72,59,13,9,69,54,63,54
+Photonics Engineers,4,66,71,75,68,50,46,50,52,69,59,66,70,31,39,72,71,63,57,66,57,72,68
+Remote Sensing Scientists and Technologists,5,53,55,75,61,47,45,63,55,69,59,72,61,38,34,75,70,75,59,72,55,72,68
+Social Science Research Assistants,4,53,52,69,55,50,45,47,45,69,59,53,55,41,39,75,68,56,48,60,54,69,55
+Advertising Sales Agents,4,47,52,56,54,41,37,50,48,69,57,44,39,22,16,60,55,0,Not relevant,78,57,53,48
+Civil Engineering Technologists and Technicians,3,47,43,72,52,31,37,56,48,69,57,66,48,22,14,69,59,44,37,60,50,56,50
+"Compensation, Benefits, and Job Analysis Specialists",4,60,52,72,57,50,50,56,52,69,57,47,48,19,21,72,59,35,32,69,57,60,55
+Computer Programmers,4,53,46,69,55,35,37,50,45,69,57,53,45,94,70,60,50,44,39,53,48,56,46
+Dental Hygienists,3,50,43,63,45,44,43,53,43,69,57,25,23,10,7,50,48,35,34,63,43,53,45
+Financial Quantitative Analysts,5,63,57,78,66,50,46,50,45,69,57,81,70,44,Not available,75,64,22,21,69,54,60,55
+Insurance Underwriters,4,53,48,69,55,44,43,50,43,69,57,47,41,13,11,69,54,10,5,66,52,69,54
+Legal Secretaries and Administrative Assistants,3,44,39,53,45,31,29,50,43,69,57,25,29,10,7,72,55,0,Not relevant,69,46,72,55
+Medical and Clinical Laboratory Technologists,4,56,55,69,57,47,43,56,55,69,57,50,43,25,27,69,59,66,61,56,54,53,52
+Neurodiagnostic Technologists,3,50,48,72,55,50,46,66,52,69,57,35,32,22,16,63,57,44,39,69,52,56,50
+Procurement Clerks,3,56,50,66,52,31,32,63,48,69,57,47,34,10,7,75,55,0,Not relevant,75,54,69,46
+"Property, Real Estate, and Community Association Managers",4,50,45,63,55,44,45,53,45,69,57,50,43,13,7,72,57,10,7,75,57,66,57
+Search Marketing Strategists,4,69,55,69,55,47,43,60,54,69,57,44,41,44,30,72,59,6,Not relevant,66,54,63,54
+Video Game Designers,4,63,52,66,55,50,43,56,50,69,57,41,43,75,57,66,57,6,Not available,60,50,56,52
+Biofuels Production Managers,4,56,52,72,55,60,50,69,55,69,55,50,46,28,23,72,57,50,50,66,57,63,50
+Business Continuity Planners,4,69,54,72,64,53,52,63,55,69,55,44,41,25,18,72,59,3,Not relevant,75,57,72,57
+Correspondence Clerks,2,41,39,69,54,38,32,44,37,69,55,44,34,13,7,72,55,10,5,60,48,75,57
+Cytotechnologists,5,50,50,69,55,44,43,50,43,69,55,41,39,25,14,72,55,47,41,53,48,50,48
+Document Management Specialists,4,56,46,69,54,50,43,66,45,69,55,31,32,38,27,72,55,6,Not relevant,53,46,69,55
+Gambling Managers,3,66,52,75,57,56,52,72,59,69,55,50,45,16,9,63,57,16,11,75,57,66,54
+Information Security Analysts,4,56,55,72,59,47,45,60,55,69,55,31,34,41,32,75,59,22,23,66,54,63,54
+Network and Computer Systems Administrators,4,53,54,72,55,44,52,69,55,69,55,50,48,66,55,72,57,31,36,60,55,53,54
+Park Naturalists,4,60,45,69,55,56,46,53,45,69,55,25,29,19,14,72,55,41,34,75,55,66,55
+Radiation Therapists,3,50,43,63,54,47,43,56,48,69,55,44,41,19,16,69,55,44,43,56,50,53,46
+Surveyors,4,56,48,72,57,53,50,50,50,69,55,75,57,22,21,72,57,47,41,72,55,66,54
+Technical Writers,4,56,52,66,55,38,32,50,43,69,55,16,9,10,5,78,70,6,Not relevant,69,54,97,71
+Transportation Engineers,4,60,57,72,59,53,45,53,50,69,55,72,66,28,36,75,63,38,43,75,57,69,55
+Veterinary Technologists and Technicians,3,53,43,69,57,50,43,56,50,69,55,44,37,19,11,66,54,47,41,66,54,56,43
+Web Administrators,4,53,54,75,59,50,43,60,50,69,55,28,30,53,41,72,59,28,34,56,50,56,48
+"Wholesale and Retail Buyers, Except Farm Products",3,60,55,69,57,47,46,53,57,69,55,53,48,19,13,56,55,19,13,69,55,50,48
+"Adult Basic Education, Adult Secondary Education, and English as a Second Language Instructors",4,63,46,63,50,69,55,66,55,69,54,41,36,10,9,69,55,19,9,69,57,66,55
+Automotive Engineers,4,56,66,78,64,47,46,56,57,69,54,69,71,41,43,72,68,53,59,72,55,69,57
+Biological Technicians,4,63,55,72,57,47,39,56,54,69,54,50,52,22,25,75,66,69,52,56,54,60,54
+Embalmers,3,50,43,53,45,28,39,50,45,69,54,25,29,6,Not relevant,50,48,41,32,72,54,53,43
+Film and Video Editors,4,56,46,63,50,41,39,50,43,69,54,22,25,13,9,60,54,0,Not relevant,56,46,53,45
+Fitness and Wellness Coordinators,4,60,50,72,55,56,50,60,55,69,54,35,37,19,13,69,55,16,20,72,57,63,54
+Forest and Conservation Technicians,3,50,43,69,48,50,43,53,52,69,54,44,39,25,23,60,54,44,32,56,50,50,45
+Insurance Claims and Policy Processing Clerks,2,45,37,58,50,30,29,45,39,69,54,45,42,16,10,64,53,2,Not relevant,64,54,56,43
+Nuclear Medicine Technologists,3,53,45,72,52,44,43,63,50,69,54,53,43,16,13,63,57,56,50,69,54,63,48
+Retail Salespersons,2,50,41,53,45,41,32,50,45,69,54,41,29,6,Not relevant,50,45,0,Not relevant,69,45,50,43
+Wind Energy Development Managers,4,60,57,75,61,44,41,63,55,69,54,50,50,19,18,72,61,19,16,72,54,72,55
+Actors,2,41,37,50,43,44,36,50,43,69,52,0,Not relevant,0,Not relevant,72,55,13,7,72,57,47,48
+Agricultural Inspectors,2,56,48,66,57,47,43,69,59,69,52,41,39,13,7,69,57,44,39,63,55,53,52
+Chefs and Head Cooks,3,53,54,69,55,53,46,72,59,69,52,53,45,13,7,53,46,16,11,72,55,53,43
+Commercial Divers,3,50,45,72,54,47,43,53,46,69,52,28,30,0,Not relevant,56,50,38,32,66,48,50,43
+First-Line Supervisors of Construction Trades and Extraction Workers,3,50,45,66,48,53,43,60,48,69,52,44,43,6,Not relevant,60,52,16,11,69,54,50,45
+Funeral Home Managers,3,44,43,53,52,47,43,66,52,69,52,35,37,13,11,66,54,6,Not relevant,69,55,60,52
+Home Health Aides,2,50,43,60,46,50,43,56,45,69,52,31,29,0,Not relevant,56,46,16,13,53,43,53,41
+"Opticians, Dispensing",3,50,41,60,52,47,41,50,43,69,52,47,39,10,5,66,54,19,14,75,54,56,45
+Photographers,3,53,45,53,46,47,41,53,45,69,52,25,25,16,9,53,45,19,21,69,46,47,41
+Radio Frequency Identification Device Specialists,4,53,50,72,55,41,46,53,54,69,52,41,48,38,Not available,66,57,25,27,69,52,56,52
+Robotics Technicians,3,53,52,72,57,50,45,53,46,69,52,50,54,47,39,72,57,44,46,56,46,56,45
+"Title Examiners, Abstractors, and Searchers",2,50,45,66,52,35,30,50,43,69,52,31,32,6,Not relevant,78,55,6,Not relevant,66,50,60,52
+Food Service Managers,2,60,54,66,54,50,46,69,55,69,50,47,41,13,9,66,52,16,16,69,52,50,45
+"Office Clerks, General",2,44,39,50,43,28,32,47,41,69,50,28,30,6,Not relevant,69,50,0,Not relevant,66,43,53,45
+Power Distributors and Dispatchers,3,50,43,69,54,44,37,69,46,69,50,44,39,19,13,66,52,22,21,66,46,53,45
+Sound Engineering Technicians,3,53,45,56,52,44,41,53,50,69,50,28,29,19,14,60,50,10,5,66,45,56,45
+Spa Managers,3,63,55,72,57,60,52,75,59,69,50,44,41,13,11,60,54,3,Not relevant,75,57,53,52
+Animal Control Workers,2,50,41,63,50,38,37,50,41,69,48,22,18,10,5,53,43,6,Not relevant,69,43,50,41
+"Buyers and Purchasing Agents, Farm Products",4,53,45,72,54,38,43,53,45,69,48,50,43,13,11,60,50,16,20,72,55,53,45
+Payroll and Timekeeping Clerks,2,44,41,53,45,35,36,50,41,69,48,50,43,16,9,69,54,6,Not relevant,56,45,53,45
+Athletes and Sports Competitors,2,50,43,69,45,47,43,56,43,69,46,28,21,0,Not relevant,53,43,19,14,72,43,44,41
+"Camera Operators, Television, Video, and Film",3,47,43,53,50,44,41,53,45,69,46,25,27,10,7,56,46,0,Not relevant,56,45,47,41
+Locomotive Engineers,2,53,43,66,45,47,43,66,54,69,46,38,37,0,Not relevant,60,50,10,5,66,43,50,41
+Passenger Attendants,2,41,36,47,46,16,21,56,46,69,46,28,20,10,5,50,41,0,Not relevant,69,41,38,34
+Bartenders,2,50,43,53,41,47,41,50,43,69,45,31,30,6,Not relevant,50,43,0,Not relevant,53,43,44,43
+Counter and Rental Clerks,2,44,32,53,41,28,29,50,41,69,45,31,32,10,7,56,45,0,Not relevant,60,43,50,43
+First-Line Supervisors of Food Preparation and Serving Workers,2,50,46,56,57,53,45,72,54,69,45,50,43,10,5,60,50,0,Not relevant,72,54,47,45
+Driver/Sales Workers,2,44,30,53,48,25,27,47,37,69,43,41,27,0,Not relevant,50,43,0,Not relevant,66,41,44,43
+Pest Control Workers,2,53,41,69,48,44,39,66,43,69,43,41,37,0,Not relevant,50,43,25,25,66,43,66,43
+Waiters and Waitresses,2,47,30,47,39,35,30,50,39,69,41,28,25,3,Not relevant,44,34,0,Not relevant,66,36,25,30
+"Court, Municipal, and License Clerks",2,48,43,53,49,29,27,52,43,68,52,34,29,7,Not relevant,65,53,12,Not relevant,66,52,63,50
+Architectural and Civil Drafters,3,50,45,64,53,41,42,50,47,67,48,50,54,27,21,63,54,27,29,56,47,53,47
+Cytogenetic Technologists,4,56,48,72,57,47,43,53,48,66,57,50,43,10,7,72,64,56,54,66,57,69,57
+"Electronics Engineers, Except Computer",4,60,54,75,57,47,45,63,52,66,57,56,52,41,41,75,59,56,45,69,57,69,57
+Fuel Cell Engineers,5,60,54,69,59,56,45,63,54,66,57,56,55,31,Not available,72,66,66,55,63,54,66,57
+"Teaching Assistants, Postsecondary",5,50,45,53,48,60,50,53,46,66,57,31,29,19,14,72,61,25,23,63,50,56,48
+Aerospace Engineering and Operations Technologists and Technicians,3,50,43,72,57,47,41,53,45,66,55,50,43,28,23,69,54,53,54,66,45,53,45
+Foresters,4,50,52,72,61,47,43,75,63,66,55,50,52,10,5,75,57,47,48,75,54,63,59
+Nanosystems Engineers,5,69,71,75,64,50,52,56,59,66,55,69,73,35,39,72,75,72,68,75,61,72,70
+Software Quality Assurance Analysts and Testers,4,56,43,75,55,44,41,63,54,66,55,31,32,69,50,72,57,50,46,69,50,66,55
+Telecommunications Engineering Specialists,3,60,54,66,54,47,41,53,45,66,55,50,43,35,29,66,55,22,20,56,52,56,54
+Electrical and Electronics Drafters,3,49,45,58,50,36,38,47,41,66,54,44,43,19,14,66,54,22,22,67,46,55,48
+"First-Line Supervisors of Mechanics, Installers, and Repairers",3,56,54,69,55,53,54,75,57,66,54,47,45,22,16,66,57,19,20,69,55,50,50
+Mechatronics Engineers,4,60,55,63,59,47,48,56,54,66,54,60,55,31,Not available,63,57,47,Not available,63,54,63,54
+Ophthalmic Medical Technicians,3,50,45,50,45,41,37,50,43,66,54,38,36,13,7,53,52,25,27,56,52,53,43
+Solar Energy Installation Managers,3,56,46,66,54,50,43,69,52,66,54,41,46,19,14,63,54,16,13,63,52,60,48
+Music Directors and Composers,4,53,44,66,51,47,42,59,49,66,53,24,21,14,9,59,49,11,8,64,52,59,50
+Broadcast Technicians,3,53,45,69,48,47,43,63,52,66,52,44,41,28,27,53,52,22,14,53,46,56,45
+Geothermal Production Managers,3,63,46,75,55,56,48,72,63,66,52,56,54,22,18,72,61,35,Not available,72,57,66,54
+Mechanical Engineering Technologists and Technicians,3,56,46,66,54,47,45,60,48,66,52,53,48,25,18,72,59,47,43,63,50,63,50
+Solar Energy Systems Engineers,4,60,52,66,55,47,43,53,52,66,52,53,55,28,23,72,57,53,54,63,54,66,54
+Traffic Technicians,3,50,45,56,50,41,41,53,45,66,52,47,45,25,18,56,57,44,41,56,48,53,46
+Food Science Technicians,3,50,46,56,52,47,41,50,45,66,48,47,45,13,7,66,57,56,46,63,46,63,46
+Graphic Designers,4,53,45,60,52,41,39,50,45,66,48,25,30,16,11,56,54,6,Not relevant,60,50,50,45
+Psychiatric Aides,2,53,43,53,46,50,45,69,52,66,48,25,25,0,Not relevant,50,45,16,11,69,43,50,43
+Receptionists and Information Clerks,2,50,34,56,45,35,34,44,36,66,48,28,30,10,5,56,46,0,Not relevant,66,43,56,45
+Forest Fire Inspectors and Prevention Specialists,3,50,46,75,55,53,45,60,48,66,46,28,34,16,9,53,48,22,25,69,48,53,43
+Massage Therapists,3,50,43,50,46,44,41,50,43,66,46,25,21,0,Not relevant,50,45,19,14,66,52,50,41
+Baggage Porters and Bellhops,2,31,30,50,39,31,29,47,32,66,45,25,27,6,Not relevant,47,37,0,Not relevant,66,37,44,30
+Elevator and Escalator Installers and Repairers,3,53,43,66,43,31,32,56,45,66,45,22,23,16,11,53,46,38,37,53,41,41,39
+Physical Therapist Aides,2,47,39,50,41,35,39,53,46,66,45,25,27,6,Not relevant,50,43,25,25,53,43,47,39
+Recycling Coordinators,2,53,45,66,50,50,43,63,50,66,45,38,39,10,7,63,50,6,Not relevant,72,48,53,45
+Aircraft Cargo Handling Supervisors,2,50,41,69,50,63,52,66,55,66,43,50,41,16,9,56,43,13,7,66,45,53,46
+Bicycle Repairers,2,47,36,66,45,44,34,47,41,66,43,28,29,3,Not relevant,50,43,6,Not relevant,60,43,47,36
+"Computer, Automated Teller, and Office Machine Repairers",3,50,43,63,45,41,37,50,43,66,43,22,25,28,18,53,45,22,23,56,43,50,43
+Nursing Assistants,3,47,39,53,45,35,30,56,43,66,43,28,27,0,Not relevant,53,43,19,13,53,43,44,39
+Subway and Streetcar Operators,2,50,43,50,46,41,37,56,45,66,43,35,29,0,Not relevant,53,45,0,Not relevant,60,39,44,36
+"Hosts and Hostesses, Restaurant, Lounge, and Coffee Shop",2,41,34,47,37,31,30,44,29,66,41,28,27,6,Not relevant,47,34,0,Not relevant,60,41,35,30
+"Farmers, Ranchers, and Other Agricultural Managers",4,57,49,72,55,51,45,70,53,65,52,43,40,16,10,62,54,47,41,72,54,54,51
+Nanotechnology Engineering Technologists and Technicians,4,52,47,66,52,44,46,64,51,64,52,53,53,31,27,67,55,56,54,60,53,58,53
+Credit Analysts,4,66,52,72,57,35,36,50,43,63,57,60,59,16,14,66,57,10,5,66,57,53,55
+Database Administrators,4,63,55,72,59,50,48,60,59,63,55,53,50,60,55,63,63,25,21,60,55,60,55
+Geographic Information Systems Technologists and Technicians,4,61,53,69,56,49,44,50,47,63,55,56,55,45,43,70,62,56,Not available,64,53,63,54
+"Insurance Appraisers, Auto Damage",3,47,43,60,54,28,21,38,41,63,55,41,39,6,Not relevant,63,52,3,Not relevant,69,54,69,46
+Desktop Publishers,3,50,43,69,55,47,43,50,50,63,54,25,30,41,37,69,57,0,Not relevant,63,52,53,52
+Biofuels/Biodiesel Technology and Product Development Managers,4,56,54,66,59,47,46,56,55,63,52,53,45,25,20,66,61,53,Not available,66,50,66,55
+Bioinformatics Technicians,4,63,55,63,54,44,41,56,50,63,52,60,55,53,43,69,61,53,48,60,52,63,54
+Computer Network Support Specialists,4,56,48,69,54,41,46,56,52,63,52,28,37,31,Not available,60,55,22,21,56,50,50,50
+Data Warehousing Specialists,4,50,46,72,55,41,39,47,45,63,52,50,46,69,54,72,57,22,Not available,60,52,56,48
+Database Architects,4,53,52,72,61,47,45,56,52,63,52,50,48,56,59,66,63,25,Not available,63,54,60,57
+Occupational Therapy Aides,3,50,43,56,48,50,43,56,45,63,52,25,25,3,Not relevant,53,48,16,11,66,50,53,43
+Online Merchants,4,47,45,63,55,35,36,53,52,63,52,50,45,35,25,66,54,6,Not relevant,63,48,60,46
+Tellers,2,47,43,53,46,31,36,53,45,63,52,50,39,6,Not relevant,53,46,0,Not relevant,56,43,50,43
+Ship Engineers,3,50,45,72,54,41,37,66,52,63,50,28,34,19,11,56,48,38,36,63,45,53,41
+Web Developers,3,63,52,69,55,47,45,50,48,63,50,44,41,78,61,66,57,25,32,56,46,53,50
+Billing and Posting Clerks,2,45,38,53,45,28,29,49,37,63,48,42,37,25,17,58,46,0,Not relevant,59,44,44,42
+Non-Destructive Testing Specialists,2,66,50,66,50,53,48,63,50,63,48,50,45,19,16,66,54,44,39,56,45,56,45
+"Telecommunications Equipment Installers and Repairers, Except Line Installers",3,53,43,66,54,47,41,60,46,63,48,31,32,25,23,60,52,25,29,56,45,50,45
+Retail Loss Prevention Specialists,2,56,43,69,52,47,39,63,50,63,46,41,39,16,14,56,52,6,Not relevant,63,50,53,46
+Veterinary Assistants and Laboratory Animal Caretakers,2,47,43,56,45,28,30,53,45,63,46,44,37,6,Not relevant,53,45,41,34,50,43,53,46
+Gambling and Sports Book Writers and Runners,2,41,36,47,41,31,30,53,45,63,45,50,39,10,5,44,45,6,Not relevant,53,41,47,39
+Merchandise Displayers and Window Trimmers,3,47,43,56,48,35,29,44,41,63,45,25,20,13,7,50,45,6,Not relevant,56,46,47,41
+Railroad Conductors and Yardmasters,2,50,43,66,52,44,39,69,57,63,45,31,37,13,7,53,46,13,7,69,45,50,41
+Skincare Specialists,3,53,41,50,43,47,39,50,43,63,45,13,9,0,Not relevant,53,45,10,9,66,43,35,39
+Cargo and Freight Agents,2,44,39,56,52,25,27,50,45,63,43,31,36,10,5,56,45,0,Not relevant,66,43,50,43
+Pharmacy Aides,2,47,36,50,41,38,32,44,37,63,43,38,34,13,7,56,46,13,7,60,41,44,36
+Segmental Pavers,2,41,36,56,43,35,34,47,41,63,43,25,29,0,Not relevant,44,39,3,Not relevant,63,39,41,37
+"Locker Room, Coatroom, and Dressing Room Attendants",2,28,29,38,39,10,5,44,34,63,41,10,5,0,Not relevant,41,34,0,Not relevant,66,39,31,30
+Personal Care Aides,2,44,39,50,43,44,37,53,45,63,41,22,23,0,Not relevant,47,39,19,11,56,41,47,39
+Security Guards,2,50,36,53,41,38,32,56,45,63,41,19,11,0,Not relevant,53,43,13,7,56,39,50,41
+Baristas,1,41,37,47,39,35,29,50,36,63,37,28,29,0,Not relevant,50,39,0,Not relevant,60,37,41,34
+"Heating, Air Conditioning, and Refrigeration Mechanics and Installers",3,52,44,63,50,47,39,53,46,61,45,42,39,13,9,55,46,25,21,53,44,49,43
+Fast Food and Counter Workers,1,39,29,45,35,33,32,49,32,61,37,39,28,2,Not relevant,44,33,0,Not relevant,52,38,33,31
+Mathematicians,5,75,75,81,73,60,54,50,43,60,59,100,86,38,37,75,71,66,66,60,61,63,64
+Chemical Engineers,4,69,64,75,70,47,52,56,55,60,57,72,66,35,41,72,63,81,73,66,55,56,55
+Surgical Technologists,3,50,43,53,45,50,45,69,50,60,55,41,39,3,Not relevant,50,54,31,30,53,43,47,43
+Chemical Plant and System Operators,2,56,43,63,54,47,41,66,54,60,54,41,41,19,14,56,54,47,41,53,45,50,43
+Quality Control Analysts,3,53,45,56,52,44,41,69,55,60,54,50,46,19,11,69,55,44,41,53,52,56,48
+Remote Sensing Technicians,4,50,50,69,55,44,43,60,52,60,54,63,55,44,46,63,59,41,39,63,52,56,54
+Wind Energy Engineers,4,50,54,75,64,44,41,53,57,60,54,63,64,28,Not available,69,66,56,54,60,50,60,54
+Statistical Assistants,4,66,54,69,55,47,43,50,43,60,52,85,70,50,50,69,57,28,36,60,54,63,54
+Electrical and Electronic Engineering Technologists and Technicians,3,53,48,67,54,42,41,55,50,60,51,55,50,30,Not available,64,58,43,42,56,48,53,47
+Cartographers and Photogrammetrists,4,56,48,63,54,47,43,53,45,60,50,47,45,22,16,75,59,22,21,53,45,63,52
+Phlebotomists,3,50,43,56,46,47,43,53,43,60,50,28,30,16,9,53,46,35,30,60,54,53,43
+Photonics Technicians,3,56,46,56,52,38,43,56,48,60,50,38,37,31,23,66,52,35,Not available,53,45,53,46
+Endoscopy Technicians,3,53,43,63,46,38,34,53,45,60,48,25,30,10,5,66,57,19,13,60,45,56,43
+Fabric and Apparel Patternmakers,3,53,43,69,48,50,43,53,46,60,48,53,43,25,18,53,46,3,Not relevant,53,43,50,41
+Photographic Process Workers and Processing Machine Operators,2,47,41,53,45,38,41,53,46,60,48,25,32,35,23,56,46,16,14,56,43,44,41
+Avionics Technicians,3,50,45,69,54,41,37,53,46,60,46,28,30,16,13,56,50,47,41,60,43,56,45
+Electrical Power-Line Installers and Repairers,2,50,43,53,43,44,39,56,43,60,46,25,27,6,Not relevant,50,43,19,14,47,41,38,39
+Gambling Cage Workers,2,31,32,50,46,28,30,50,43,60,46,63,41,6,Not relevant,50,43,0,Not relevant,69,45,50,43
+"Hotel, Motel, and Resort Desk Clerks",2,44,32,47,50,41,37,50,43,60,46,41,30,19,13,50,50,0,Not relevant,69,43,47,41
+Recreational Vehicle Service Technicians,2,50,45,60,50,35,34,50,43,60,46,25,25,13,7,50,41,16,13,60,45,47,39
+Self-Enrichment Teachers,3,53,45,53,45,60,50,53,45,60,46,25,23,19,11,53,54,10,5,66,52,50,45
+Transportation Inspectors,4,41,41,60,46,35,36,60,46,60,46,41,34,10,5,66,52,25,29,66,48,60,48
+"Ambulance Drivers and Attendants, Except Emergency Medical Technicians",2,53,43,63,43,35,30,50,41,60,45,25,23,3,Not relevant,53,45,16,9,53,43,47,41
+Audiovisual Equipment Installers and Repairers,3,60,45,60,52,53,41,47,41,60,45,35,34,28,21,63,50,31,25,53,43,44,36
+Chemical Equipment Operators and Tenders,2,50,41,60,45,44,36,69,45,60,45,47,41,16,9,60,48,41,30,53,43,50,43
+"Door-to-Door Sales Workers, News and Street Vendors, and Related Workers",1,41,37,47,45,31,29,44,41,60,45,22,16,16,9,50,39,0,Not relevant,75,48,47,39
+Farm Labor Contractors,2,35,34,50,46,31,30,44,37,60,45,28,30,10,7,44,41,6,Not relevant,63,48,44,39
+Home Appliance Repairers,2,47,32,69,46,28,30,47,41,60,45,28,29,16,9,53,41,19,18,63,43,44,39
+Postal Service Clerks,2,41,29,50,46,28,29,50,36,60,45,44,36,16,9,53,45,0,Not relevant,56,43,47,43
+Power Plant Operators,2,47,43,72,52,41,34,56,48,60,45,28,27,19,11,53,46,25,27,63,43,50,41
+Water and Wastewater Treatment Plant and System Operators,3,47,45,56,46,41,39,66,54,60,45,50,43,16,9,53,46,41,30,56,43,47,41
+Barbers,3,38,36,47,39,22,23,47,39,60,43,22,16,0,Not relevant,44,30,6,Not relevant,53,39,25,29
+Data Entry Keyers,2,44,30,47,41,28,30,56,32,60,43,25,29,19,14,66,48,0,Not relevant,47,43,50,43
+"Electrical and Electronics Installers and Repairers, Transportation Equipment",3,31,34,66,43,28,32,53,43,60,43,28,32,16,11,53,45,28,32,50,43,50,43
+Electricians,3,53,46,60,52,50,50,53,50,60,43,50,46,0,Not relevant,50,46,31,30,53,45,47,43
+"Electronic Equipment Installers and Repairers, Motor Vehicles",3,44,34,63,45,38,32,47,41,60,43,31,32,22,16,53,45,22,21,50,43,47,41
+Gambling Dealers,2,31,34,44,41,25,29,50,43,60,43,44,29,0,Not relevant,50,37,0,Not relevant,60,41,31,32
+"Model Makers, Wood",3,50,37,56,45,31,27,60,41,60,43,35,Not available,10,9,60,45,16,14,53,41,44,39
+"Rail Yard Engineers, Dinkey Operators, and Hostlers",2,50,39,56,43,44,36,66,45,60,43,35,29,6,Not relevant,53,45,13,7,63,45,47,36
+"Service Unit Operators, Oil and Gas",2,50,43,69,46,47,34,66,48,60,43,44,34,19,13,50,43,10,5,50,43,50,43
+Manufactured Building and Mobile Home Installers,2,60,43,69,46,60,45,63,48,60,41,41,41,0,Not relevant,53,45,16,13,60,41,41,41
+"Radio, Cellular, and Tower Equipment Installers and Repairers",3,47,39,56,45,41,34,53,45,60,41,41,43,25,18,53,48,10,13,53,43,47,39
+"Rotary Drill Operators, Oil and Gas",2,47,43,66,46,50,45,63,46,60,41,35,27,0,Not relevant,53,43,6,Not relevant,56,41,50,43
+Motorboat Operators,2,50,39,56,48,38,39,56,48,60,39,35,29,0,Not relevant,41,39,19,20,63,41,38,37
+Hoist and Winch Operators,2,47,30,69,37,38,36,66,37,60,34,41,27,0,Not relevant,44,34,6,Not relevant,53,32,31,32
+Musicians and Singers,3,45,41,52,44,36,36,49,45,59,44,14,Not relevant,0,Not relevant,49,43,0,Not relevant,53,44,42,38
+"Geological Technicians, Except Hydrologic Technicians",4,45,41,66,48,38,35,55,47,58,47,41,40,19,15,66,57,53,52,56,47,56,48
+"Railroad Brake, Signal, and Switch Operators and Locomotive Firers",2,38,35,55,39,38,36,61,44,58,38,31,25,0,Not relevant,50,40,5,Not relevant,50,35,42,37
+"Bookkeeping, Accounting, and Auditing Clerks",3,44,45,56,46,25,27,50,41,56,54,60,48,10,5,56,54,3,Not relevant,53,45,53,45
+Mechanical Drafters,3,56,52,56,46,47,41,50,45,56,50,56,55,31,32,56,55,22,25,53,54,50,45
+Transportation Security Screeners,2,47,43,56,50,38,39,60,45,56,50,22,23,13,13,50,43,19,14,60,43,47,37
+Agricultural Technicians,3,50,43,56,57,44,43,53,46,56,48,53,43,16,11,63,55,50,43,50,45,56,52
+Aircraft Mechanics and Service Technicians,3,50,45,72,57,41,41,60,45,56,48,31,32,13,7,69,57,38,37,60,46,47,43
+Automotive Engineering Technicians,3,50,45,63,48,35,37,53,48,56,48,53,48,28,27,66,57,41,43,63,48,56,46
+Biofuels Processing Technicians,2,47,39,53,45,38,39,60,46,56,48,47,41,16,14,63,54,47,36,56,50,53,43
+Freight Forwarders,2,53,45,56,48,41,43,63,46,56,48,50,43,13,11,63,46,0,Not relevant,60,48,60,46
+Exercise Trainers and Group Fitness Instructors,3,50,41,50,45,56,52,56,52,56,46,19,11,6,Not relevant,47,45,16,9,63,46,44,39
+Gambling Surveillance Officers and Gambling Investigators,2,53,45,69,54,38,41,78,55,56,46,28,25,10,5,56,50,6,Not relevant,66,52,53,45
+Gas Plant Operators,3,44,45,63,48,38,36,69,50,56,46,38,39,16,13,53,48,31,29,56,46,56,43
+"Makeup Artists, Theatrical and Performance",3,50,46,53,46,38,36,50,45,56,46,25,30,6,Not relevant,56,46,16,9,63,45,44,39
+Solar Thermal Installers and Technicians,3,50,45,56,50,38,41,56,46,56,46,38,39,16,11,60,46,13,Not available,56,45,47,45
+Bailiffs,3,44,30,50,45,28,29,60,46,56,45,13,11,3,Not relevant,47,41,0,Not relevant,60,43,31,32
+Dietetic Technicians,3,53,45,53,45,53,45,53,55,56,45,47,43,13,7,53,46,25,25,60,46,53,45
+Hydroelectric Plant Technicians,3,53,45,66,46,47,37,63,54,56,45,50,48,22,21,56,52,35,32,60,43,50,41
+Library Technicians,3,47,41,50,46,50,41,47,41,56,45,25,30,16,11,60,55,6,Not relevant,56,43,47,43
+Security and Fire Alarm Systems Installers,3,47,43,60,50,35,34,50,45,56,45,28,30,19,13,53,46,19,18,60,43,47,41
+Tour Guides and Escorts,3,31,34,47,45,31,37,50,43,56,45,25,16,0,Not relevant,50,43,0,Not relevant,72,46,31,32
+Word Processors and Typists,2,31,29,44,36,22,21,50,34,56,45,41,36,19,13,63,50,0,Not relevant,50,41,56,46
+Automotive Service Technicians and Mechanics,3,50,43,64,46,31,35,49,43,56,44,27,27,17,12,50,40,20,24,50,41,45,37
+Dancers,3,44,41,50,37,38,39,47,43,56,43,10,5,0,Not relevant,44,41,0,Not relevant,47,43,38,36
+"Derrick Operators, Oil and Gas",1,44,37,63,45,44,41,60,50,56,43,35,36,0,Not relevant,47,41,6,Not relevant,60,43,44,37
+Hazardous Materials Removal Workers,3,50,43,63,52,38,32,66,45,56,43,25,30,6,Not relevant,53,43,25,25,53,41,50,41
+"Library Assistants, Clerical",2,31,30,50,41,38,30,47,39,56,43,28,30,13,7,56,46,0,Not relevant,50,43,50,43
+Medical Equipment Preparers,2,50,43,63,41,44,37,60,43,56,43,31,32,16,11,53,41,22,14,53,39,47,39
+Millwrights,2,47,45,66,45,50,41,53,45,56,43,41,39,16,9,50,43,13,9,50,43,44,41
+"Molding, Coremaking, and Casting Machine Setters, Operators, and Tenders, Metal and Plastic",2,47,32,50,37,31,32,53,43,56,43,31,30,10,7,53,43,3,Not relevant,50,34,41,36
+"Pesticide Handlers, Sprayers, and Applicators, Vegetation",2,47,34,53,41,31,29,47,39,56,43,31,29,0,Not relevant,50,41,25,20,53,43,38,32
+Stationary Engineers and Boiler Operators,3,50,37,60,45,31,30,56,45,56,43,25,21,6,Not relevant,53,43,38,30,50,43,50,39
+"Umpires, Referees, and Other Sports Officials",2,50,43,60,50,50,41,53,45,56,43,38,30,0,Not relevant,50,45,10,11,66,45,44,36
+"Cooks, Short Order",2,47,37,50,39,28,32,47,41,56,41,25,29,3,Not relevant,50,39,0,Not relevant,50,41,31,37
+Couriers and Messengers,2,41,32,50,37,28,27,44,30,56,41,38,30,0,Not relevant,50,41,3,Not relevant,56,37,50,39
+Log Graders and Scalers,2,50,39,56,43,35,30,50,43,56,41,44,39,13,7,47,41,19,11,53,41,50,43
+Semiconductor Processing Technicians,2,38,32,60,41,31,29,56,43,56,41,22,25,16,11,60,48,22,18,47,41,44,37
+Parking Attendants,2,31,25,47,39,28,29,44,34,56,39,44,32,0,Not relevant,38,27,0,Not relevant,63,34,44,29
+Solar Photovoltaic Installers,2,50,43,56,50,38,34,53,45,56,39,38,45,6,Not relevant,50,39,19,21,50,41,35,37
+"Plumbers, Pipefitters, and Steamfitters",3,50,43,59,48,42,39,50,42,55,45,36,38,2,Not relevant,52,44,14,Not relevant,53,40,38,39
+Surveying and Mapping Technicians,3,53,42,63,45,45,42,50,43,55,43,61,51,24,23,63,53,27,29,55,44,53,49
+Carpenters,2,49,39,52,45,36,35,53,42,55,40,41,42,0,Not relevant,52,41,10,Not relevant,53,39,35,37
+"Electrical and Electronics Repairers, Commercial and Industrial Equipment",3,50,43,69,54,47,43,53,45,53,52,44,41,28,30,53,57,44,39,53,45,50,43
+Electro-Mechanical and Mechatronics Technologists and Technicians,3,47,43,69,54,47,43,72,57,53,48,47,41,31,29,56,55,44,41,56,45,56,48
+Audio and Video Technicians,3,50,43,63,54,44,43,69,48,53,46,25,29,25,18,63,52,0,Not relevant,53,45,53,45
+Computer Numerically Controlled Tool Operators,3,50,45,66,57,44,43,69,55,53,46,47,41,44,37,56,52,25,21,50,43,44,41
+"Fine Artists, Including Painters, Sculptors, and Illustrators",3,56,48,56,46,35,34,44,41,53,46,28,20,16,9,50,45,0,Not relevant,50,41,47,39
+"Aircraft Structure, Surfaces, Rigging, and Systems Assemblers",2,47,43,53,45,41,41,53,45,53,45,38,39,13,14,50,45,19,21,50,43,44,43
+Camera and Photographic Equipment Repairers,3,50,45,63,48,41,32,47,41,53,45,35,36,19,18,53,50,28,27,50,43,41,43
+Costume Attendants,2,38,32,47,41,22,23,53,43,53,45,13,14,0,Not relevant,47,45,0,Not relevant,53,43,38,34
+"Electrical and Electronics Repairers, Powerhouse, Substation, and Relay",3,47,43,69,48,31,32,50,43,53,45,31,34,22,16,60,50,41,34,53,41,47,43
+First-Line Supervisors of Housekeeping and Janitorial Workers,2,47,41,53,46,53,43,56,55,53,45,28,30,0,Not relevant,50,46,0,Not relevant,56,48,47,43
+"Furnace, Kiln, Oven, Drier, and Kettle Operators and Tenders",2,35,34,53,43,28,21,53,45,53,45,31,29,6,Not relevant,53,43,22,16,53,43,41,37
+"Inspectors, Testers, Sorters, Samplers, and Weighers",2,35,34,56,46,25,30,50,45,53,45,41,36,13,9,53,43,16,14,53,43,56,45
+"Lifeguards, Ski Patrol, and Other Recreational Protective Service Workers",2,44,39,50,43,53,43,69,50,53,45,10,9,0,Not relevant,47,41,13,9,63,43,38,37
+Proofreaders and Copy Markers,4,38,34,50,43,25,20,47,39,53,45,22,14,6,Not relevant,81,61,3,Not relevant,56,45,66,57
+Wind Turbine Service Technicians,3,53,45,63,45,50,43,56,45,53,45,28,39,16,9,56,46,25,29,53,43,47,39
+Animal Trainers,2,56,45,60,48,63,55,53,50,53,43,22,23,3,Not relevant,47,45,19,20,63,43,47,39
+Butchers and Meat Cutters,2,38,30,50,43,31,29,50,41,53,43,35,29,3,Not relevant,50,43,6,Not relevant,50,43,31,39
+Childcare Workers,2,50,43,53,43,50,45,63,45,53,43,28,27,0,Not relevant,50,43,3,Not relevant,53,43,50,41
+Computer Numerically Controlled Tool Programmers,3,56,52,56,50,47,39,63,52,53,43,56,50,78,59,56,50,22,25,50,43,56,43
+Construction Laborers,2,28,30,44,37,28,29,41,36,53,43,25,20,0,Not relevant,44,37,13,7,56,41,31,29
+Conveyor Operators and Tenders,1,44,37,50,41,28,29,60,45,53,43,25,27,6,Not relevant,47,41,19,21,50,41,44,39
+Crane and Tower Operators,3,47,34,56,43,31,32,53,43,53,43,41,30,0,Not relevant,50,43,3,Not relevant,50,41,41,34
+"Electric Motor, Power Tool, and Related Repairers",3,47,45,69,48,44,39,47,45,53,43,41,39,19,13,50,43,28,30,50,43,47,39
+"Farmworkers, Farm, Ranch, and Aquacultural Animals",2,47,34,60,43,28,30,56,46,53,43,28,25,0,Not relevant,50,39,22,20,50,41,41,39
+File Clerks,2,44,32,50,43,28,30,50,32,53,43,25,30,13,9,69,43,0,Not relevant,50,43,50,43
+"Floor Layers, Except Carpet, Wood, and Hard Tiles",2,44,36,47,41,28,27,47,45,53,43,28,30,0,Not relevant,35,34,6,Not relevant,53,37,35,32
+"Forging Machine Setters, Operators, and Tenders, Metal and Plastic",2,35,30,47,41,35,32,53,45,53,43,28,30,6,Not relevant,53,41,10,9,47,41,44,39
+Funeral Attendants,2,25,21,44,39,22,20,53,41,53,43,19,18,3,Not relevant,41,37,10,7,60,43,35,34
+Furniture Finishers,2,44,39,53,45,38,32,53,41,53,43,25,25,3,Not relevant,44,39,3,Not relevant,50,34,35,32
+Gas Compressor and Gas Pumping Station Operators,2,47,34,66,43,31,34,53,43,53,43,31,30,10,7,53,45,22,18,50,43,50,41
+Gem and Diamond Workers,3,38,37,50,45,31,30,50,43,53,43,44,41,0,Not relevant,47,41,10,9,53,43,41,41
+Industrial Machinery Mechanics,3,53,45,66,50,41,41,53,45,53,43,35,36,19,21,47,43,19,21,50,43,44,39
+"Insulation Workers, Mechanical",2,41,39,56,41,31,32,50,43,53,43,25,25,0,Not relevant,47,43,13,9,50,39,35,36
+Locksmiths and Safe Repairers,2,47,41,53,45,31,32,44,39,53,43,38,30,16,11,50,43,0,Not relevant,53,43,41,34
+Mechanical Door Repairers,2,50,32,63,43,41,30,50,43,53,43,38,36,0,Not relevant,53,41,0,Not relevant,53,43,44,41
+"Milling and Planing Machine Setters, Operators, and Tenders, Metal and Plastic",2,41,36,50,41,31,27,56,43,53,43,47,39,19,11,50,39,16,9,50,37,38,32
+Motorboat Mechanics and Service Technicians,3,35,32,60,45,25,29,47,43,53,43,31,29,16,9,44,39,25,25,50,37,38,36
+Motorcycle Mechanics,3,53,45,53,45,41,32,53,43,53,43,31,30,6,Not relevant,50,43,22,18,53,43,44,41
+Musical Instrument Repairers and Tuners,3,50,43,63,46,47,36,50,43,53,43,25,29,6,Not relevant,50,43,22,18,53,43,38,39
+Parking Enforcement Workers,2,47,34,53,43,31,34,56,43,53,43,28,25,13,11,50,41,0,Not relevant,56,43,47,34
+Pipelayers,2,35,30,50,43,28,29,47,39,53,43,28,30,0,Not relevant,47,41,10,7,47,43,25,30
+"Plating Machine Setters, Operators, and Tenders, Metal and Plastic",2,28,30,50,39,31,30,53,43,53,43,25,20,0,Not relevant,53,41,25,27,50,39,44,37
+Prepress Technicians and Workers,3,47,43,53,43,35,32,53,43,53,43,25,29,19,13,50,43,16,13,53,45,47,41
+Printing Press Operators,2,47,41,53,45,28,30,56,46,53,43,28,29,13,9,53,45,0,Not relevant,53,43,35,37
+"Pump Operators, Except Wellhead Pumpers",2,47,41,53,45,28,32,63,48,53,43,35,37,19,11,53,43,25,20,53,41,47,39
+Riggers,2,41,32,53,43,16,16,53,45,53,43,16,14,0,Not relevant,53,34,10,7,50,39,35,34
+Sailors and Marine Oilers,2,47,41,53,43,38,37,56,45,53,43,38,30,0,Not relevant,47,45,22,14,50,43,44,41
+"Shipping, Receiving, and Inventory Clerks",2,35,30,50,43,28,32,50,43,53,43,31,32,16,9,53,45,0,Not relevant,56,43,41,39
+Structural Iron and Steel Workers,2,50,43,53,45,47,43,50,43,53,43,28,30,0,Not relevant,44,43,3,Not relevant,50,34,31,34
+Team Assemblers,2,31,30,50,41,35,30,53,43,53,43,25,21,16,9,50,41,0,Not relevant,50,43,44,41
+Textile Bleaching and Dyeing Machine Operators and Tenders,2,31,29,50,37,25,25,50,39,53,43,38,36,0,Not relevant,44,37,19,14,50,37,38,37
+Weatherization Installers and Technicians,2,47,41,56,46,44,34,60,46,53,43,44,39,16,13,50,43,25,13,53,43,47,43
+Cashiers,2,35,32,47,37,28,30,47,36,53,41,50,32,3,Not relevant,47,37,0,Not relevant,53,41,31,34
+"Control and Valve Installers and Repairers, Except Mechanical Door",3,47,43,60,45,38,34,53,43,53,41,28,21,16,11,50,45,19,16,53,43,50,41
+Farm Equipment Mechanics and Service Technicians,3,50,43,63,52,41,37,50,41,53,41,44,36,19,11,53,41,22,23,53,43,44,36
+"Food and Tobacco Roasting, Baking, and Drying Machine Operators and Tenders",2,38,37,53,43,38,36,63,43,53,41,13,11,6,Not relevant,53,41,19,13,50,41,47,41
+Forest and Conservation Workers,3,50,37,53,45,47,37,53,45,53,41,38,30,16,9,47,45,25,21,56,43,47,36
+"Heat Treating Equipment Setters, Operators, and Tenders, Metal and Plastic",2,44,37,50,43,41,39,53,48,53,41,47,41,19,13,47,43,25,16,53,37,47,37
+Helpers--Electricians,2,38,34,50,39,28,27,44,32,53,41,25,20,0,Not relevant,35,39,16,11,50,34,25,29
+Light Truck Drivers,2,28,30,47,41,22,25,50,36,53,41,38,30,0,Not relevant,50,39,3,Not relevant,53,39,47,36
+Recycling and Reclamation Workers,2,38,32,44,39,25,29,53,39,53,41,22,21,0,Not relevant,41,41,3,Not relevant,44,34,35,36
+"Roof Bolters, Mining",2,47,41,60,43,31,36,56,45,53,41,28,25,0,Not relevant,35,32,13,11,50,32,28,32
+"Transportation Vehicle, Equipment and Systems Inspectors, Except Aviation",2,44,29,50,41,25,27,47,41,53,41,25,25,0,Not relevant,50,45,35,34,50,41,41,39
+Adhesive Bonding Machine Operators and Tenders,2,41,34,47,39,31,30,53,45,53,39,38,34,16,9,50,36,13,7,53,37,44,32
+Automotive and Watercraft Service Attendants,2,38,29,50,41,31,29,44,34,53,39,35,27,3,Not relevant,44,36,10,5,53,36,41,34
+"Bus Drivers, Transit and Intercity",2,41,29,53,39,28,25,50,36,53,39,25,25,0,Not relevant,44,34,0,Not relevant,50,32,38,30
+Craft Artists,3,47,37,50,45,31,32,50,39,53,39,28,29,13,7,53,39,10,5,53,41,47,37
+"Helpers--Installation, Maintenance, and Repair Workers",2,41,36,53,39,38,30,53,37,53,39,25,23,10,5,41,30,3,Not relevant,50,34,28,29
+"Loading and Moving Machine Operators, Underground Mining",2,25,25,47,39,22,18,44,36,53,39,13,9,0,Not relevant,47,36,3,Not relevant,41,36,25,25
+Outdoor Power Equipment and Other Small Engine Mechanics,2,44,39,56,43,38,30,47,39,53,39,25,29,10,5,47,37,19,16,47,36,41,36
+"Rolling Machine Setters, Operators, and Tenders, Metal and Plastic",2,50,43,53,43,47,39,63,43,53,39,35,36,16,9,50,41,10,5,56,39,41,37
+Roofers,2,41,34,53,41,28,29,50,39,53,39,31,30,0,Not relevant,44,37,6,Not relevant,50,36,25,29
+Tile and Stone Setters,2,44,36,56,45,31,32,47,37,53,39,50,45,0,Not relevant,44,39,6,Not relevant,53,39,35,32
+"Ushers, Lobby Attendants, and Ticket Takers",2,41,30,44,37,16,18,44,37,53,39,22,20,10,5,44,32,0,Not relevant,56,36,31,30
+Shampooers,2,31,29,38,30,25,25,44,34,53,37,16,16,0,Not relevant,38,32,0,Not relevant,56,36,35,29
+"Welding, Soldering, and Brazing Machine Setters, Operators, and Tenders",2,38,29,53,43,31,27,50,45,53,37,31,23,3,Not relevant,44,37,19,11,53,41,31,29
+Orderlies,2,28,27,44,30,28,29,41,29,53,36,19,13,0,Not relevant,38,29,6,Not relevant,50,30,41,32
+"Meat, Poultry, and Fish Cutters and Trimmers",1,35,32,50,41,31,32,50,37,53,32,31,27,0,Not relevant,35,32,0,Not relevant,50,37,28,30
+"Mobile Heavy Equipment Mechanics, Except Engines",3,50,43,56,48,41,39,50,45,50,45,47,37,16,9,53,48,22,21,50,43,50,41
+Animal Breeders,2,50,39,56,46,28,29,50,43,50,43,28,30,13,7,47,41,50,41,50,39,44,39
+Animal Caretakers,2,35,30,44,41,25,29,53,41,50,43,25,27,6,Not relevant,50,41,13,7,47,39,44,36
+Automotive Body and Related Repairers,2,47,32,50,43,31,30,50,41,50,43,28,29,19,11,47,41,6,Not relevant,50,39,35,30
+Biomass Plant Technicians,2,50,43,53,45,50,43,60,46,50,43,44,39,19,11,50,43,31,23,50,43,50,43
+Boilermakers,3,50,43,63,45,44,39,53,45,50,43,31,29,0,Not relevant,53,43,25,27,47,41,44,41
+"Cooks, Institution and Cafeteria",2,47,41,50,41,44,39,53,43,50,43,47,39,0,Not relevant,47,41,0,Not relevant,53,41,44,37
+"Cooks, Restaurant",2,44,39,50,43,28,34,53,45,50,43,38,32,3,Not relevant,47,34,6,Not relevant,50,43,31,36
+Cooling and Freezing Equipment Operators and Tenders,2,50,45,66,46,38,34,63,48,50,43,35,34,19,11,50,43,19,13,53,41,47,41
+"Crushing, Grinding, and Polishing Machine Setters, Operators, and Tenders",2,47,41,47,43,44,39,60,43,50,43,41,32,10,5,50,43,28,21,50,43,47,41
+Dental Laboratory Technicians,2,50,43,53,45,44,43,50,43,50,43,28,30,3,Not relevant,56,45,28,16,50,43,44,41
+"Drilling and Boring Machine Tool Setters, Operators, and Tenders, Metal and Plastic",2,44,34,50,45,28,30,53,45,50,43,28,32,6,Not relevant,50,41,13,9,50,43,35,39
+"Earth Drillers, Except Oil and Gas",2,44,32,56,43,31,29,53,45,50,43,31,25,0,Not relevant,44,36,16,11,50,41,35,34
+Engine and Other Machine Assemblers,2,35,32,50,43,25,29,50,43,50,43,25,29,19,11,53,45,22,23,50,41,31,32
+Etchers and Engravers,2,35,32,50,45,31,29,53,41,50,43,25,25,16,9,53,41,3,Not relevant,50,37,31,32
+"Excavating and Loading Machine and Dragline Operators, Surface Mining",2,50,41,50,43,35,32,53,43,50,43,31,32,0,Not relevant,50,43,0,Not relevant,50,39,38,34
+"Extruding and Forming Machine Setters, Operators, and Tenders, Synthetic and Glass Fibers",2,44,37,47,43,31,30,63,45,50,43,25,27,6,Not relevant,47,39,6,Not relevant,50,41,41,37
+Food Batchmakers,2,44,30,53,41,28,29,47,43,50,43,44,34,3,Not relevant,53,43,25,25,50,43,47,41
+Food Cooking Machine Operators and Tenders,2,41,34,50,34,28,29,53,41,50,43,25,27,6,Not relevant,53,39,22,20,41,34,44,37
+Gambling Change Persons and Booth Cashiers,2,25,30,47,41,25,30,47,36,50,43,47,36,6,Not relevant,53,43,0,Not relevant,50,39,44,37
+Geothermal Technicians,2,53,43,56,45,28,32,69,52,50,43,44,45,22,16,56,45,28,29,50,43,50,43
+"Glass Blowers, Molders, Benders, and Finishers",2,47,41,50,43,41,34,56,43,50,43,41,30,10,5,50,43,19,18,44,39,41,37
+Helpers--Carpenters,2,47,30,50,39,28,29,50,34,50,43,35,32,0,Not relevant,47,32,0,Not relevant,50,34,31,34
+"Maintenance and Repair Workers, General",3,53,45,56,45,31,34,53,45,50,43,35,32,10,7,50,45,22,16,50,43,47,41
+"Maintenance Workers, Machinery",3,44,30,50,43,28,27,47,39,50,43,28,23,16,11,50,41,16,11,47,39,28,32
+Metal-Refining Furnace Operators and Tenders,2,47,30,50,43,31,29,66,45,50,43,38,37,0,Not relevant,50,41,25,23,50,41,44,39
+"Meter Readers, Utilities",2,44,30,50,39,35,36,47,41,50,43,35,30,22,13,50,41,3,Not relevant,50,43,41,39
+Motion Picture Projectionists,2,28,30,47,39,25,29,47,41,50,43,13,7,10,9,50,43,0,Not relevant,50,41,28,39
+"Multiple Machine Tool Setters, Operators, and Tenders, Metal and Plastic",2,47,41,50,45,35,39,53,43,50,43,31,30,22,16,50,43,6,Not relevant,50,41,44,39
+Operating Engineers and Other Construction Equipment Operators,2,47,37,47,43,28,30,53,43,50,43,25,23,3,Not relevant,47,36,13,9,47,36,25,27
+"Painters, Construction and Maintenance",2,35,32,50,43,28,20,47,37,50,43,28,27,0,Not relevant,47,39,13,7,38,32,28,29
+"Patternmakers, Wood",3,44,36,50,45,28,29,53,43,50,43,50,43,16,9,53,43,19,13,47,36,41,30
+"Petroleum Pump System Operators, Refinery Operators, and Gaugers",2,50,46,60,54,50,43,69,54,50,43,44,48,22,18,63,50,25,27,50,41,60,43
+Postal Service Mail Carriers,2,25,29,50,39,19,16,41,32,50,43,16,16,0,Not relevant,41,41,0,Not relevant,50,39,28,30
+"Pourers and Casters, Metal",2,31,30,50,43,31,30,50,43,50,43,22,23,6,Not relevant,44,36,19,16,47,37,31,29
+Rail Car Repairers,2,44,39,56,48,41,32,47,39,50,43,28,30,0,Not relevant,47,39,19,14,50,34,47,39
+"Separating, Filtering, Clarifying, Precipitating, and Still Machine Setters, Operators, and Tenders",2,47,41,53,43,44,41,53,45,50,43,41,37,19,11,50,41,38,29,47,41,47,41
+Signal and Track Switch Repairers,3,47,43,69,48,41,39,47,45,50,43,38,32,25,13,47,41,19,13,47,36,47,43
+Stonemasons,3,50,37,66,43,38,34,50,39,50,43,41,37,0,Not relevant,47,36,13,11,50,37,47,37
+Structural Metal Fabricators and Fitters,3,31,23,50,32,10,11,44,36,50,43,25,27,0,Not relevant,50,34,13,9,50,36,25,29
+"Tailors, Dressmakers, and Custom Sewers",2,41,37,50,43,25,25,44,37,50,43,22,23,0,Not relevant,41,37,0,Not relevant,50,41,38,32
+"Tank Car, Truck, and Ship Loaders",2,44,39,50,41,38,34,50,45,50,43,38,30,10,5,56,45,13,11,50,41,50,39
+Telecommunications Line Installers and Repairers,2,44,37,53,45,31,29,50,41,50,43,25,25,16,9,47,43,19,16,53,39,41,41
+Tool and Die Makers,3,50,45,53,45,28,30,53,43,50,43,44,41,16,9,47,45,19,18,47,39,31,36
+Upholsterers,2,50,41,63,45,44,39,50,43,50,43,38,36,0,Not relevant,53,43,6,Not relevant,50,41,41,34
+Watch and Clock Repairers,3,31,32,53,43,25,23,41,32,50,43,25,29,0,Not relevant,47,41,19,18,50,39,31,32
+"Weighers, Measurers, Checkers, and Samplers, Recordkeeping",2,44,39,60,43,44,36,53,45,50,43,47,39,19,16,56,43,13,11,53,43,47,43
+Agricultural Equipment Operators,1,31,27,47,39,19,14,44,32,50,41,22,16,0,Not relevant,31,27,16,9,44,37,28,25
+"Coil Winders, Tapers, and Finishers",2,31,27,47,41,25,27,53,43,50,41,19,16,0,Not relevant,47,39,0,Not relevant,47,36,28,29
+Continuous Mining Machine Operators,2,44,36,56,45,35,36,50,43,50,41,25,20,0,Not relevant,44,32,10,Not relevant,50,32,28,29
+"Cooks, Private Household",3,50,45,56,43,38,32,50,43,50,41,31,29,6,Not relevant,50,43,13,7,50,43,44,36
+Electrical and Electronic Equipment Assemblers,2,41,39,50,43,28,29,53,41,50,41,28,29,6,Not relevant,56,45,22,21,47,39,47,37
+Fiberglass Laminators and Fabricators,2,47,39,47,41,41,39,53,45,50,41,35,30,0,Not relevant,50,39,19,14,50,37,47,36
+Highway Maintenance Workers,2,35,30,47,39,25,25,53,39,50,41,28,27,3,Not relevant,44,39,0,Not relevant,50,39,28,27
+"Lathe and Turning Machine Tool Setters, Operators, and Tenders, Metal and Plastic",2,31,29,47,43,31,25,53,43,50,41,28,32,16,9,50,43,19,11,47,37,31,30
+Machinists,3,44,41,53,45,28,34,53,45,50,41,47,39,19,16,47,43,13,11,50,43,38,37
+"Mixing and Blending Machine Setters, Operators, and Tenders",2,50,41,50,41,41,36,56,43,50,41,38,30,19,14,56,41,31,29,50,36,50,39
+"Model Makers, Metal and Plastic",3,47,41,53,43,35,29,56,43,50,41,41,41,19,13,47,43,19,18,50,37,44,37
+"Molders, Shapers, and Casters, Except Metal and Plastic",2,47,36,50,41,38,34,50,41,50,41,35,34,0,Not relevant,53,43,3,Not relevant,47,37,38,30
+"Office Machine Operators, Except Computer",2,44,37,50,37,25,29,50,43,50,41,38,29,19,13,53,41,0,Not relevant,50,43,47,39
+"Patternmakers, Metal and Plastic",3,41,32,50,43,28,29,50,45,50,41,35,34,28,18,50,43,13,7,50,41,31,30
+"Potters, Manufacturing",3,25,30,50,45,19,20,50,43,50,41,28,25,3,Not relevant,44,41,13,9,47,41,35,37
+"Refractory Materials Repairers, Except Brickmasons",2,35,30,47,43,31,30,44,39,50,41,25,25,0,Not relevant,47,37,0,Not relevant,44,39,38,32
+Septic Tank Servicers and Sewer Pipe Cleaners,1,44,37,53,43,41,34,47,41,50,41,35,34,0,Not relevant,44,41,6,Not relevant,44,36,38,37
+Bakers,2,50,43,50,43,31,29,56,41,50,39,31,30,0,Not relevant,47,39,19,13,50,41,31,30
+Brickmasons and Blockmasons,2,47,30,53,43,28,30,50,41,50,39,47,48,0,Not relevant,44,34,19,18,50,36,31,30
+Bridge and Lock Tenders,2,35,30,50,43,38,30,56,43,50,39,25,27,3,Not relevant,47,34,3,Not relevant,50,41,47,41
+"Cutting, Punching, and Press Machine Setters, Operators, and Tenders, Metal and Plastic",2,41,32,50,39,25,29,56,43,50,39,35,34,3,Not relevant,47,41,16,13,50,39,41,34
+"Extruding, Forming, Pressing, and Compacting Machine Setters, Operators, and Tenders",2,41,30,50,39,28,29,60,45,50,39,28,29,6,Not relevant,50,39,19,11,53,34,44,34
+Floor Sanders and Finishers,1,41,32,44,34,28,27,47,39,50,39,25,21,0,Not relevant,41,34,3,Not relevant,44,32,28,27
+Manicurists and Pedicurists,2,44,32,38,36,28,27,41,30,50,39,22,18,0,Not relevant,44,30,0,Not relevant,50,37,28,27
+Packaging and Filling Machine Operators and Tenders,2,35,30,47,32,28,32,53,41,50,39,28,29,3,Not relevant,47,41,0,Not relevant,44,32,41,32
+"Paper Goods Machine Setters, Operators, and Tenders",2,47,32,50,41,25,30,50,43,50,39,28,29,0,Not relevant,44,32,0,Not relevant,50,39,31,30
+Pile Driver Operators,2,25,29,47,43,22,23,56,41,50,39,28,20,0,Not relevant,38,32,10,5,44,34,31,27
+Rail-Track Laying and Maintenance Equipment Operators,2,41,34,53,43,38,32,53,41,50,39,31,29,0,Not relevant,35,32,6,Not relevant,47,32,31,30
+Shoe Machine Operators and Tenders,2,25,25,50,34,19,16,47,41,50,39,28,23,0,Not relevant,50,39,3,Not relevant,47,37,22,25
+"Stone Cutters and Carvers, Manufacturing",2,38,29,50,41,31,32,47,37,50,39,31,23,13,7,47,41,10,5,47,34,31,32
+Stockers and Order Fillers,2,34,30,47,37,22,18,42,33,50,38,33,24,7,Not relevant,43,36,1,Not relevant,52,37,35,31
+Helpers--Extraction Workers,2,47,37,53,41,41,32,69,45,50,37,38,32,0,Not relevant,44,36,10,7,47,34,35,32
+"Rock Splitters, Quarry",1,28,30,44,37,25,29,47,36,50,37,22,21,0,Not relevant,44,34,3,Not relevant,41,37,28,30
+Tire Builders,2,25,25,50,36,25,27,50,41,50,37,22,16,6,Not relevant,31,30,0,Not relevant,41,32,25,25
+Amusement and Recreation Attendants,1,35,29,44,39,28,29,47,34,50,36,25,25,6,Not relevant,35,29,0,Not relevant,56,39,38,29
+Helpers--Roofers,2,41,30,47,32,31,32,50,36,50,36,31,25,10,5,35,32,0,Not relevant,47,29,31,30
+Paperhangers,2,25,25,47,34,25,25,44,36,50,36,25,20,0,Not relevant,35,34,6,Not relevant,50,34,25,29
+"Textile Cutting Machine Setters, Operators, and Tenders",2,38,29,47,39,25,29,53,46,50,36,28,30,19,11,44,37,0,Not relevant,50,30,41,32
+"Textile Winding, Twisting, and Drawing Out Machine Setters, Operators, and Tenders",2,35,30,50,43,35,29,50,43,50,36,25,29,0,Not relevant,38,30,0,Not relevant,53,34,35,29
+Tire Repairers and Changers,2,31,29,50,34,28,32,47,32,50,36,25,27,0,Not relevant,38,29,0,Not relevant,50,32,31,30
+"Cooks, Fast Food",1,35,32,41,34,25,23,41,32,50,34,25,23,0,Not relevant,41,37,0,Not relevant,44,30,25,29
+Food Preparation Workers,1,35,30,47,30,35,30,47,30,50,34,28,27,0,Not relevant,41,30,0,Not relevant,50,30,31,30
+"Food Servers, Nonrestaurant",2,25,30,47,34,25,30,44,32,50,34,25,21,3,Not relevant,47,30,0,Not relevant,50,36,25,30
+Cement Masons and Concrete Finishers,1,28,25,50,34,35,29,56,41,50,32,41,39,3,Not relevant,35,27,6,Not relevant,53,29,25,27
+Fence Erectors,2,31,27,50,41,31,29,50,41,50,32,31,37,0,Not relevant,38,30,3,Not relevant,50,30,25,29
+"Insulation Workers, Floor, Ceiling, and Wall",2,41,30,50,39,28,29,47,39,50,32,31,27,0,Not relevant,41,32,0,Not relevant,50,32,28,30
+"Janitors and Cleaners, Except Maids and Housekeeping Cleaners",2,38,29,44,30,22,13,38,27,50,32,0,Not relevant,0,Not relevant,35,29,0,Not relevant,41,30,25,21
+Laundry and Dry-Cleaning Workers,1,41,30,44,36,31,30,50,32,50,32,16,13,0,Not relevant,44,30,0,Not relevant,47,34,28,30
+Logging Equipment Operators,1,31,30,47,39,31,29,50,43,50,32,35,27,0,Not relevant,38,32,13,7,44,32,44,34
+Plasterers and Stucco Masons,1,44,30,44,37,41,29,47,37,50,32,25,27,0,Not relevant,44,32,3,Not relevant,47,30,28,32
+Shoe and Leather Workers and Repairers,2,28,25,47,37,3,Not relevant,44,36,50,32,16,14,0,Not relevant,38,32,3,Not relevant,47,30,22,21
+Dining Room and Cafeteria Attendants and Bartender Helpers,1,28,30,44,32,25,29,47,30,50,29,22,18,3,Not relevant,35,29,0,Not relevant,47,30,25,18
+Fishing and Hunting Workers,1,41,31,50,42,30,30,42,43,49,37,20,18,0,Not relevant,41,37,19,17,49,38,30,31
+Bus and Truck Mechanics and Diesel Engine Specialists,3,44,43,56,46,44,36,50,43,47,43,25,25,16,9,47,41,22,23,53,41,38,36
+Heavy and Tractor-Trailer Truck Drivers,2,44,32,50,43,38,30,50,43,47,43,25,30,3,Not relevant,50,43,0,Not relevant,50,43,44,36
+"Coin, Vending, and Amusement Machine Servicers and Repairers",2,41,30,47,41,22,25,47,43,47,41,25,29,10,5,47,41,16,9,47,37,41,36
+"Cutters and Trimmers, Hand",1,28,29,41,30,25,23,44,37,47,41,25,16,0,Not relevant,44,37,0,Not relevant,47,30,28,30
+"Grinding and Polishing Workers, Hand",1,35,32,47,41,28,29,44,41,47,41,25,25,6,Not relevant,47,41,6,Not relevant,47,34,35,37
+"Layout Workers, Metal and Plastic",2,44,37,50,45,28,29,50,43,47,41,53,45,3,Not relevant,50,41,6,Not relevant,47,36,38,41
+Medical Equipment Repairers,3,50,46,56,52,47,41,53,46,47,41,44,45,16,9,56,54,31,32,47,41,47,41
+Ophthalmic Laboratory Technicians,2,44,36,50,41,38,34,50,41,47,41,28,32,19,11,50,41,19,13,47,37,44,37
+Print Binding and Finishing Workers,2,38,34,56,43,38,41,53,43,47,41,28,30,16,13,53,41,3,Not relevant,50,39,44,37
+Automotive Glass Installers and Repairers,2,41,34,47,39,35,30,47,37,47,39,25,25,3,Not relevant,38,36,13,7,50,37,35,34
+Crossing Guards and Flaggers,2,31,23,44,36,22,13,47,37,47,39,16,9,0,Not relevant,31,29,0,Not relevant,53,36,25,25
+"Cutting and Slicing Machine Setters, Operators, and Tenders",2,41,29,50,41,28,27,56,45,47,39,41,30,22,14,53,41,13,7,41,36,35,29
+Electromechanical Equipment Assemblers,2,35,30,50,41,22,23,47,39,47,39,25,27,13,7,50,43,25,29,50,37,38,30
+Jewelers and Precious Stone and Metal Workers,3,41,38,53,42,33,30,47,37,47,39,39,37,2,Not relevant,42,42,11,11,49,37,34,34
+"Mail Clerks and Mail Machine Operators, Except Postal Service",2,31,30,50,41,28,29,50,41,47,39,31,29,13,7,50,37,3,Not relevant,50,39,47,39
+"Paving, Surfacing, and Tamping Equipment Operators",2,41,30,50,41,31,30,56,41,47,39,25,29,0,Not relevant,38,30,3,Not relevant,47,32,22,23
+"Postal Service Mail Sorters, Processors, and Processing Machine Operators",2,28,29,50,37,28,30,53,39,47,39,25,20,16,9,50,39,0,Not relevant,50,37,31,27
+Wellhead Pumpers,2,35,30,53,43,22,20,53,46,47,39,31,23,6,Not relevant,44,41,3,Not relevant,50,43,41,30
+"Woodworking Machine Setters, Operators, and Tenders, Except Sawing",2,38,30,50,41,31,30,53,41,47,39,35,36,19,16,44,39,13,7,50,36,22,25
+"Extruding and Drawing Machine Setters, Operators, and Tenders, Metal and Plastic",2,41,32,53,39,31,30,53,46,47,37,38,36,13,7,47,41,22,16,50,36,41,29
+"Grinding, Lapping, Polishing, and Buffing Machine Tool Setters, Operators, and Tenders, Metal and Plastic",2,41,32,50,41,31,29,53,43,47,37,44,43,19,11,53,41,13,7,50,36,35,29
+Refuse and Recyclable Material Collectors,2,38,29,50,43,13,13,44,32,47,37,10,7,0,Not relevant,47,34,0,Not relevant,50,32,44,34
+Sheet Metal Workers,2,44,34,53,43,31,34,50,43,47,37,50,46,6,Not relevant,50,37,19,11,50,41,35,30
+Tapers,2,31,29,41,34,28,29,47,37,47,37,16,9,0,Not relevant,31,30,3,Not relevant,47,30,25,29
+Timing Device Assemblers and Adjusters,2,28,32,47,41,28,29,47,37,47,37,25,23,10,7,44,37,25,25,44,37,38,34
+Tree Trimmers and Pruners,2,41,30,56,43,31,29,53,43,47,37,22,20,0,Not relevant,41,36,19,13,50,39,38,36
+Cabinetmakers and Bench Carpenters,2,44,39,50,43,31,32,53,45,47,36,47,43,16,11,47,37,10,5,50,36,35,34
+Industrial Truck and Tractor Operators,2,28,27,44,32,28,25,44,37,47,36,28,27,6,Not relevant,47,36,6,Not relevant,44,29,38,30
+"Roustabouts, Oil and Gas",1,44,34,53,34,31,29,56,39,47,36,25,25,0,Not relevant,28,27,6,Not relevant,41,30,22,23
+"Textile Knitting and Weaving Machine Setters, Operators, and Tenders",2,22,21,47,36,22,23,56,41,47,36,16,13,0,Not relevant,38,32,6,Not relevant,47,36,28,27
+"Cleaning, Washing, and Metal Pickling Equipment Operators and Tenders",2,28,30,47,30,31,30,47,43,47,34,25,16,3,Not relevant,44,32,13,9,47,32,31,34
+Dredge Operators,2,38,30,50,39,35,36,47,41,47,34,25,27,0,Not relevant,38,34,6,Not relevant,47,32,28,29
+Fallers,1,35,29,56,43,10,11,56,39,47,34,35,21,0,Not relevant,25,25,19,18,41,34,22,18
+"Helpers--Pipelayers, Plumbers, Pipefitters, and Steamfitters",2,41,27,47,34,25,27,47,32,47,34,31,20,0,Not relevant,35,29,3,Not relevant,38,32,25,21
+"Coating, Painting, and Spraying Machine Setters, Operators, and Tenders",2,44,30,50,39,41,36,50,43,47,32,25,29,10,9,47,39,3,Not relevant,47,30,41,32
+"Helpers--Brickmasons, Blockmasons, Stonemasons, and Tile and Marble Setters",2,35,30,50,34,31,30,50,37,47,32,31,29,0,Not relevant,35,30,6,Not relevant,44,29,25,25
+"Helpers--Painters, Paperhangers, Plasterers, and Stucco Masons",1,35,29,44,32,31,30,44,34,47,32,3,Not relevant,0,Not relevant,28,25,3,Not relevant,50,29,25,25
+"Painting, Coating, and Decorating Workers",1,28,29,44,37,25,29,47,37,47,32,22,16,0,Not relevant,44,32,0,Not relevant,44,36,31,27
+Carpet Installers,2,41,30,50,41,35,37,53,41,47,30,50,48,0,Not relevant,41,32,0,Not relevant,47,32,25,25
+Helpers--Production Workers,2,25,27,44,32,25,27,47,34,47,29,25,25,6,Not relevant,41,32,6,Not relevant,44,30,22,23
+"Farmworkers and Laborers, Crop, Nursery, and Greenhouse",1,33,33,47,37,30,31,45,39,45,36,17,17,0,Not relevant,36,30,16,11,45,33,33,30
+"Welders, Cutters, Solderers, and Brazers",2,30,31,47,38,25,26,49,40,45,36,30,23,5,Not relevant,42,35,6,Not relevant,42,31,27,25
+Glaziers,2,31,30,50,41,28,27,44,43,44,41,31,34,0,Not relevant,50,41,13,7,47,39,28,27
+"Tool Grinders, Filers, and Sharpeners",2,44,37,56,41,38,34,50,39,44,41,44,41,13,7,47,43,3,Not relevant,38,34,38,32
+Machine Feeders and Offbearers,2,25,29,38,37,25,25,50,41,44,37,28,23,0,Not relevant,44,41,6,Not relevant,44,37,35,29
+Models,2,22,23,41,27,3,Not relevant,22,25,44,37,6,Not relevant,0,Not relevant,38,29,0,Not relevant,44,30,25,29
+"Sawing Machine Setters, Operators, and Tenders, Wood",2,28,29,50,39,25,27,50,41,44,36,25,21,3,Not relevant,35,37,6,Not relevant,41,30,19,20
+Drywall and Ceiling Tile Installers,2,28,29,50,37,25,27,47,37,44,34,31,30,0,Not relevant,44,39,3,Not relevant,47,32,28,27
+"Laborers and Freight, Stock, and Material Movers, Hand",2,28,29,47,34,25,25,41,32,44,34,25,27,0,Not relevant,44,34,0,Not relevant,44,30,35,29
+Dishwashers,1,25,29,41,30,25,18,41,30,44,32,25,14,0,Not relevant,25,30,0,Not relevant,44,30,25,25
+Foundry Mold and Coremakers,2,31,25,47,36,25,20,53,37,44,32,22,23,0,Not relevant,28,27,6,Not relevant,41,27,22,23
+"Graders and Sorters, Agricultural Products",1,28,21,38,32,16,13,47,30,44,32,16,13,0,Not relevant,31,23,6,Not relevant,44,32,31,20
+Landscaping and Groundskeeping Workers,1,31,29,47,27,28,27,38,27,44,32,19,11,0,Not relevant,31,27,16,13,47,27,19,18
+Maids and Housekeeping Cleaners,1,28,23,44,30,28,21,44,29,44,30,22,14,0,Not relevant,41,30,0,Not relevant,44,30,28,29
+Sewing Machine Operators,1,28,27,44,30,28,29,53,36,44,30,25,27,0,Not relevant,41,30,0,Not relevant,28,27,25,29
+"Packers and Packagers, Hand",2,28,14,44,29,25,16,50,30,44,29,25,18,10,5,41,29,0,Not relevant,41,29,25,27
+Reinforcing Iron and Rebar Workers,2,35,27,50,41,31,29,47,32,41,34,35,32,0,Not relevant,41,30,6,Not relevant,41,29,22,23
+"Sewers, Hand",2,38,30,44,34,31,32,41,37,41,34,35,30,0,Not relevant,38,32,0,Not relevant,41,27,35,32
+Slaughterers and Meat Packers,2,25,21,35,27,25,18,31,27,41,32,19,11,0,Not relevant,22,25,0,Not relevant,44,27,19,14
+Terrazzo Workers and Finishers,2,35,30,41,34,28,30,44,37,38,29,35,32,0,Not relevant,28,25,16,9,47,29,22,23
+Cleaners of Vehicles and Equipment,2,25,27,31,34,16,11,41,34,35,30,6,Not relevant,0,Not relevant,28,29,3,Not relevant,41,30,10,7
+"Pressers, Textile, Garment, and Related Materials",1,28,21,38,32,19,14,35,30,25,29,16,11,0,Not relevant,25,25,0,Not relevant,28,29,19,21

occupations_onet_work_contexts.csv

@@ -0,0 +1,874 @@
+degree_of_automation_context,occupation,importance_of_being_exact_or_accurate_context,importance_of_repeating_same_tasks_context,structured_versus_unstructured_work_context
+0.7,Travel Agents,0.95,0.53,0.83
+0.68,"Postal Service Mail Sorters, Processors, and Processing Machine Operators",0.76,0.67,0.53
+0.67,Medical and Clinical Laboratory Technologists,1.0,0.85,0.81
+0.66,Chemical Plant and System Operators,0.87,0.76,0.64
+0.66,Telephone Operators,0.93,0.97,0.27
+0.65,Air Traffic Controllers,0.96,0.92,0.73
+0.65,"Airline Pilots, Copilots, and Flight Engineers",0.96,0.74,0.66
+0.65,Reservation and Transportation Ticket Agents and Travel Clerks,0.92,0.98,0.42
+0.64,Biofuels Processing Technicians,0.85,0.72,0.77
+0.63,"Separating, Filtering, Clarifying, Precipitating, and Still Machine Setters, Operators, and Tenders",0.67,0.5,0.75
+0.62,"Claims Adjusters, Examiners, and Investigators",0.93,0.83,0.76
+0.61,Customs Brokers,0.96,0.83,0.63
+0.61,"Petroleum Pump System Operators, Refinery Operators, and Gaugers",0.79,0.76,0.81
+0.6,Biofuels Production Managers,0.82,0.63,0.78
+0.6,Robotics Technicians,0.9,0.46,0.79
+0.59,Motion Picture Projectionists,0.83,0.4,0.64
+0.58,Computer Numerically Controlled Tool Operators,0.91,0.71,0.72
+0.58,Customs and Border Protection Officers,0.89,0.78,0.73
+0.58,"Lathe and Turning Machine Tool Setters, Operators, and Tenders, Metal and Plastic",0.88,0.69,0.7
+0.57,Biomass Plant Technicians,0.74,0.83,0.78
+0.57,Brokerage Clerks,0.93,0.88,0.78
+0.57,Laundry and Dry-Cleaning Workers,0.73,0.52,0.55
+0.57,Stationary Engineers and Boiler Operators,0.71,0.69,0.74
+0.56,"Extruding, Forming, Pressing, and Compacting Machine Setters, Operators, and Tenders",0.8,0.67,0.53
+0.56,"Food and Tobacco Roasting, Baking, and Drying Machine Operators and Tenders",0.83,0.65,0.54
+0.56,"Insurance Appraisers, Auto Damage",0.85,0.7,0.86
+0.56,Insurance Claims and Policy Processing Clerks,0.88,0.87,0.77
+0.56,Photographic Process Workers and Processing Machine Operators,0.68,0.56,0.68
+0.55,Gas Plant Operators,0.78,0.57,0.82
+0.55,Loan Officers,0.88,0.61,0.85
+0.55,Medical and Health Services Managers,0.88,0.77,0.78
+0.55,"Milling and Planing Machine Setters, Operators, and Tenders, Metal and Plastic",0.9,0.64,0.55
+0.55,Ophthalmic Laboratory Technicians,0.82,0.79,0.83
+0.53,"Extruding and Forming Machine Setters, Operators, and Tenders, Synthetic and Glass Fibers",0.76,0.58,0.65
+0.53,Medical and Clinical Laboratory Technicians,0.97,0.83,0.73
+0.53,Power Plant Operators,0.85,0.69,0.66
+0.52,Geothermal Technicians,0.66,0.68,0.72
+0.52,Prepress Technicians and Workers,0.91,0.68,0.71
+0.52,Refuse and Recyclable Material Collectors,0.85,0.72,0.83
+0.52,Telemarketers,0.7,0.65,0.61
+0.51,Accountants and Auditors,0.93,0.71,0.79
+0.51,"Drilling and Boring Machine Tool Setters, Operators, and Tenders, Metal and Plastic",0.93,0.63,0.64
+0.51,Machinists,0.9,0.72,0.72
+0.51,"Multiple Machine Tool Setters, Operators, and Tenders, Metal and Plastic",0.92,0.48,0.6
+0.51,New Accounts Clerks,0.92,0.86,0.62
+0.51,Nuclear Power Reactor Operators,0.98,0.77,0.51
+0.51,Payroll and Timekeeping Clerks,0.97,0.98,0.87
+0.51,Purchasing Managers,0.82,0.63,0.72
+0.51,Textile Bleaching and Dyeing Machine Operators and Tenders,0.69,0.45,0.56
+0.51,"Title Examiners, Abstractors, and Searchers",1.0,0.84,0.92
+0.5,Cooling and Freezing Equipment Operators and Tenders,0.77,0.69,0.74
+0.5,Credit Counselors,0.83,0.77,0.76
+0.5,Document Management Specialists,0.76,0.59,0.73
+0.5,Dredge Operators,0.52,0.35,0.61
+0.5,Water and Wastewater Treatment Plant and System Operators,0.83,0.73,0.91
+0.49,Bioinformatics Technicians,0.82,0.53,0.73
+0.49,"Buyers and Purchasing Agents, Farm Products",0.85,0.8,0.92
+0.49,"Credit Authorizers, Checkers, and Clerks",0.93,0.83,0.88
+0.49,"Forging Machine Setters, Operators, and Tenders, Metal and Plastic",0.76,0.64,0.63
+0.49,Human Resources Specialists,0.84,0.72,0.87
+0.49,Loan Interviewers and Clerks,0.93,0.83,0.87
+0.49,Logistics Analysts,0.79,0.75,0.77
+0.49,"Mail Clerks and Mail Machine Operators, Except Postal Service",0.87,0.81,0.85
+0.48,Budget Analysts,0.91,0.77,0.75
+0.48,Computer Network Architects,0.76,0.35,0.77
+0.48,"Cutting and Slicing Machine Setters, Operators, and Tenders",0.88,0.71,0.65
+0.48,Database Administrators,0.75,0.55,0.63
+0.48,Geographic Information Systems Technologists and Technicians,0.92,0.75,0.73
+0.48,"Grinding, Lapping, Polishing, and Buffing Machine Tool Setters, Operators, and Tenders, Metal and Plastic",0.91,0.67,0.77
+0.48,Metal-Refining Furnace Operators and Tenders,0.77,0.71,0.63
+0.48,Radiation Therapists,0.97,0.92,0.71
+0.47,Bill and Account Collectors,0.76,0.83,0.59
+0.47,Bridge and Lock Tenders,0.74,0.63,0.71
+0.47,Chemical Equipment Operators and Tenders,0.82,0.72,0.71
+0.47,Food Cooking Machine Operators and Tenders,0.67,0.51,0.94
+0.47,Foundry Mold and Coremakers,0.73,0.38,0.45
+0.47,Freight Forwarders,0.86,0.73,0.86
+0.47,Gambling Cage Workers,0.87,0.79,0.52
+0.47,Insurance Underwriters,0.83,0.63,0.77
+0.47,Lodging Managers,0.79,0.79,0.92
+0.47,Machine Feeders and Offbearers,0.75,0.55,0.53
+0.47,"Meat, Poultry, and Fish Cutters and Trimmers",0.88,0.63,0.47
+0.47,Pharmacy Aides,0.87,0.7,0.74
+0.47,Receptionists and Information Clerks,0.81,0.84,0.74
+0.46,Adhesive Bonding Machine Operators and Tenders,0.72,0.66,0.58
+0.46,Chemical Engineers,0.82,0.36,0.79
+0.46,Computer Systems Analysts,0.87,0.79,0.78
+0.46,"Court, Municipal, and License Clerks",0.86,0.82,0.75
+0.46,"Crushing, Grinding, and Polishing Machine Setters, Operators, and Tenders",0.62,0.51,0.52
+0.46,Customer Service Representatives,0.85,0.83,0.77
+0.46,Data Entry Keyers,0.97,0.95,0.81
+0.46,"Furnace, Kiln, Oven, Drier, and Kettle Operators and Tenders",0.75,0.59,0.67
+0.46,Helpers--Roofers,0.74,0.41,0.45
+0.46,Logisticians,0.74,0.57,0.72
+0.46,Semiconductor Processing Technicians,0.81,0.7,0.55
+0.46,"Tax Examiners and Collectors, and Revenue Agents",0.9,0.88,0.71
+0.45,Animal Scientists,0.79,0.56,0.9
+0.45,Broadcast Announcers and Radio Disc Jockeys,0.87,0.56,0.85
+0.45,Compensation and Benefits Managers,0.86,0.42,0.87
+0.45,Dishwashers,0.62,0.5,0.73
+0.45,"First-Line Supervisors of Helpers, Laborers, and Material Movers, Hand",0.9,0.82,0.88
+0.45,Procurement Clerks,0.89,0.85,0.89
+0.44,Civil Engineering Technologists and Technicians,0.75,0.52,0.66
+0.44,"Cutting, Punching, and Press Machine Setters, Operators, and Tenders, Metal and Plastic",0.85,0.51,0.71
+0.44,Dietetic Technicians,0.86,0.59,0.8
+0.44,Electrical and Electronics Drafters,0.89,0.73,0.7
+0.44,"Eligibility Interviewers, Government Programs",0.8,0.75,0.73
+0.44,Food Batchmakers,0.81,0.77,0.44
+0.44,Gambling and Sports Book Writers and Runners,0.84,0.82,0.56
+0.44,Gas Compressor and Gas Pumping Station Operators,0.79,0.69,0.83
+0.44,Geodetic Surveyors,0.94,0.84,0.7
+0.44,Insurance Sales Agents,0.93,0.7,0.78
+0.44,"Shipping, Receiving, and Inventory Clerks",0.86,0.84,0.84
+0.44,Surveyors,0.92,0.62,0.65
+0.44,Tax Preparers,0.93,0.82,0.79
+0.43,Computer Hardware Engineers,0.85,0.53,0.76
+0.43,Cytogenetic Technologists,0.98,0.93,0.62
+0.43,"Extruding and Drawing Machine Setters, Operators, and Tenders, Metal and Plastic",0.75,0.62,0.5
+0.43,Medical Transcriptionists,0.95,0.87,0.81
+0.43,"Mixing and Blending Machine Setters, Operators, and Tenders",0.86,0.72,0.72
+0.43,"Molders, Shapers, and Casters, Except Metal and Plastic",0.78,0.62,0.49
+0.43,Ophthalmic Medical Technicians,0.93,0.66,0.65
+0.43,Patient Representatives,0.89,0.88,0.62
+0.43,"Pourers and Casters, Metal",0.7,0.5,0.46
+0.43,Print Binding and Finishing Workers,0.83,0.65,0.62
+0.43,Real Estate Brokers,0.76,0.51,0.96
+0.43,Remote Sensing Scientists and Technologists,0.8,0.43,0.72
+0.43,Robotics Engineers,0.88,0.4,0.77
+0.43,"Switchboard Operators, Including Answering Service",0.87,0.74,0.74
+0.43,Web Administrators,0.76,0.64,0.84
+0.42,Biomass Power Plant Managers,0.83,0.73,0.85
+0.42,Broadcast Technicians,0.79,0.52,0.72
+0.42,Cartographers and Photogrammetrists,0.97,0.63,0.74
+0.42,Chief Executives,0.79,0.56,1.0
+0.42,Computer Systems Engineers/Architects,0.8,0.55,0.79
+0.42,"Farmworkers and Laborers, Crop, Nursery, and Greenhouse",0.61,0.32,0.65
+0.42,"Geological Technicians, Except Hydrologic Technicians",0.88,0.68,0.76
+0.42,Library Technicians,0.74,0.79,0.82
+0.42,Nanotechnology Engineering Technologists and Technicians,0.88,0.47,0.75
+0.42,Online Merchants,0.79,0.61,0.84
+0.42,Orderlies,0.88,0.78,0.7
+0.42,Power Distributors and Dispatchers,0.88,0.82,0.73
+0.42,Probation Officers and Correctional Treatment Specialists,0.84,0.75,0.75
+0.42,"Rolling Machine Setters, Operators, and Tenders, Metal and Plastic",0.85,0.68,0.69
+0.41,Baristas,0.67,0.5,0.61
+0.41,Biochemists and Biophysicists,0.94,0.63,0.84
+0.41,Boilermakers,0.84,0.61,0.72
+0.41,Computer User Support Specialists,0.87,0.59,0.84
+0.41,Conveyor Operators and Tenders,0.86,0.5,0.76
+0.41,Helpers--Production Workers,0.72,0.55,0.6
+0.41,"Hotel, Motel, and Resort Desk Clerks",0.79,0.72,0.75
+0.41,"Interviewers, Except Eligibility and Loan",0.92,0.91,0.69
+0.41,Magnetic Resonance Imaging Technologists,0.92,0.78,0.67
+0.41,"Meter Readers, Utilities",0.83,0.73,0.64
+0.41,Order Clerks,0.8,0.81,0.82
+0.41,Pharmacists,0.98,0.88,0.84
+0.41,Postmasters and Mail Superintendents,0.79,0.68,0.72
+0.41,"Purchasing Agents, Except Wholesale, Retail, and Farm Products",0.86,0.64,0.85
+0.41,Radiologic Technologists and Technicians,0.9,0.66,0.74
+0.41,"Securities, Commodities, and Financial Services Sales Agents",0.9,0.61,0.85
+0.41,Statistical Assistants,0.87,0.61,0.74
+0.41,Transportation Security Screeners,0.83,0.68,0.41
+0.4,Airfield Operations Specialists,0.92,0.86,0.91
+0.4,Database Architects,0.85,0.68,0.76
+0.4,Endoscopy Technicians,0.9,0.75,0.67
+0.4,"Family and Consumer Sciences Teachers, Postsecondary",0.72,0.58,0.9
+0.4,Hoist and Winch Operators,0.95,0.59,0.89
+0.4,"Maintenance Workers, Machinery",0.78,0.54,0.68
+0.4,Network and Computer Systems Administrators,0.75,0.58,0.79
+0.4,Parking Attendants,0.74,0.54,0.6
+0.4,Printing Press Operators,0.93,0.65,0.76
+0.4,"Production, Planning, and Expediting Clerks",0.86,0.69,0.8
+0.4,Segmental Pavers,0.69,0.56,0.68
+0.4,Surveying and Mapping Technicians,0.9,0.71,0.72
+0.4,"Textile Knitting and Weaving Machine Setters, Operators, and Tenders",0.66,0.55,0.44
+0.4,"Textile Winding, Twisting, and Drawing Out Machine Setters, Operators, and Tenders",0.72,0.59,0.48
+0.4,Travel Guides,0.68,0.39,0.84
+0.4,Treasurers and Controllers,0.91,0.67,0.84
+0.39,Aircraft Cargo Handling Supervisors,0.89,0.72,0.87
+0.39,Aviation Inspectors,0.87,0.84,0.85
+0.39,Computer and Information Systems Managers,0.76,0.72,0.94
+0.39,Computer Numerically Controlled Tool Programmers,0.94,0.61,0.73
+0.39,Financial Managers,0.92,0.68,0.8
+0.39,Gem and Diamond Workers,0.96,0.88,0.59
+0.39,"Human Resources Assistants, Except Payroll and Timekeeping",0.93,0.84,0.81
+0.39,Hydroelectric Plant Technicians,0.86,0.8,0.68
+0.39,Manufacturing Engineers,0.8,0.39,0.74
+0.39,Packaging and Filling Machine Operators and Tenders,0.85,0.74,0.65
+0.39,"Paving, Surfacing, and Tamping Equipment Operators",0.62,0.49,0.7
+0.39,Photonics Technicians,0.87,0.54,0.64
+0.39,Postal Service Clerks,0.82,0.74,0.48
+0.39,"Pressers, Textile, Garment, and Related Materials",0.77,0.46,0.74
+0.39,Software Quality Assurance Analysts and Testers,0.84,0.58,0.7
+0.39,"Textile Cutting Machine Setters, Operators, and Tenders",0.84,0.57,0.34
+0.39,Traffic Technicians,0.85,0.71,0.66
+0.38,Actuaries,0.88,0.52,0.73
+0.38,Bakers,0.8,0.52,0.81
+0.38,Chemical Technicians,0.97,0.66,0.53
+0.38,Clinical Data Managers,0.86,0.7,0.78
+0.38,Compliance Officers,0.87,0.74,0.58
+0.38,Cytotechnologists,0.92,0.88,0.64
+0.38,Fish and Game Wardens,0.79,0.46,0.89
+0.38,Health Informatics Specialists,0.82,0.81,0.81
+0.38,Hydroelectric Production Managers,0.77,0.65,0.87
+0.38,Ophthalmic Medical Technologists,0.83,0.55,0.64
+0.38,Parking Enforcement Workers,0.75,0.61,0.62
+0.38,"Sawing Machine Setters, Operators, and Tenders, Wood",0.9,0.46,0.76
+0.38,Supply Chain Managers,0.75,0.43,0.8
+0.38,"Transportation, Storage, and Distribution Managers",0.77,0.56,0.75
+0.37,Acute Care Nurses,0.96,0.64,0.83
+0.37,Architectural and Civil Drafters,0.91,0.65,0.64
+0.37,Cement Masons and Concrete Finishers,0.86,0.52,0.65
+0.37,Chemists,0.9,0.68,0.77
+0.37,"Computer, Automated Teller, and Office Machine Repairers",0.75,0.66,0.86
+0.37,Food Preparation Workers,0.8,0.67,0.53
+0.37,"Fraud Examiners, Investigators and Analysts",0.91,0.7,0.79
+0.37,Geothermal Production Managers,0.82,0.63,0.94
+0.37,"Grinding and Polishing Workers, Hand",0.76,0.54,0.61
+0.37,Investment Fund Managers,0.81,0.42,0.88
+0.37,Landscaping and Groundskeeping Workers,0.55,0.32,0.54
+0.37,"Maintenance and Repair Workers, General",0.74,0.52,0.84
+0.37,Nuclear Medicine Technologists,0.92,0.62,0.83
+0.37,Precision Agriculture Technicians,0.7,0.42,0.7
+0.37,Survey Researchers,0.87,0.46,0.74
+0.36,Butchers and Meat Cutters,0.73,0.5,0.63
+0.36,"Cleaning, Washing, and Metal Pickling Equipment Operators and Tenders",0.55,0.52,0.6
+0.36,Correspondence Clerks,0.85,0.82,0.82
+0.36,"Dispatchers, Except Police, Fire, and Ambulance",0.9,0.88,0.82
+0.36,Food Service Managers,0.82,0.74,0.79
+0.36,"Glass Blowers, Molders, Benders, and Finishers",0.84,0.5,0.71
+0.36,Intelligence Analysts,0.91,0.69,0.81
+0.36,Logistics Engineers,0.79,0.58,0.76
+0.36,Media Programming Directors,0.82,0.56,0.89
+0.36,Microbiologists,0.97,0.71,0.65
+0.36,"Molding, Coremaking, and Casting Machine Setters, Operators, and Tenders, Metal and Plastic",0.79,0.62,0.71
+0.36,"Office Machine Operators, Except Computer",0.69,0.55,0.57
+0.36,Pharmacy Technicians,1.0,0.85,0.63
+0.36,Postal Service Mail Carriers,0.88,0.82,0.42
+0.36,Radiologists,1.0,0.8,0.76
+0.36,"Sales Representatives, Wholesale and Manufacturing, Except Technical and Scientific Products",0.69,0.61,0.9
+0.36,Tellers,0.95,0.93,0.69
+0.36,Wind Energy Operations Managers,0.72,0.52,0.9
+0.35,Agricultural Engineers,0.78,0.47,0.81
+0.35,Billing and Posting Clerks,0.9,0.91,0.78
+0.35,Business Continuity Planners,0.65,0.38,0.74
+0.35,Credit Analysts,0.88,0.78,0.8
+0.35,Data Warehousing Specialists,0.86,0.6,0.73
+0.35,Fence Erectors,0.77,0.61,0.88
+0.35,Loss Prevention Managers,0.73,0.5,0.79
+0.35,Nanosystems Engineers,0.81,0.36,0.79
+0.35,Personal Financial Advisors,0.82,0.52,0.82
+0.35,Police Identification and Records Officers,0.97,0.8,0.92
+0.35,Proofreaders and Copy Markers,0.97,0.92,0.56
+0.35,Registered Nurses,0.86,0.74,0.75
+0.35,Respiratory Therapists,0.91,0.66,0.74
+0.35,Stockers and Order Fillers,0.81,0.69,0.64
+0.34,Agricultural Inspectors,0.91,0.73,0.74
+0.34,Anesthesiologists,0.96,0.7,0.86
+0.34,Automotive Engineering Technicians,0.85,0.58,0.58
+0.34,"Bookkeeping, Accounting, and Auditing Clerks",0.92,0.91,0.7
+0.34,Couriers and Messengers,0.79,0.62,0.79
+0.34,Court Reporters and Simultaneous Captioners,0.99,0.71,0.85
+0.34,"Electrical and Electronics Repairers, Commercial and Industrial Equipment",0.85,0.57,0.83
+0.34,"Electrical and Electronics Repairers, Powerhouse, Substation, and Relay",0.94,0.8,0.67
+0.34,Equal Opportunity Representatives and Officers,0.83,0.5,0.89
+0.34,"Farmers, Ranchers, and Other Agricultural Managers",0.62,0.52,0.88
+0.34,"First-Line Supervisors of Landscaping, Lawn Service, and Groundskeeping Workers",0.75,0.49,0.83
+0.34,"Hosts and Hostesses, Restaurant, Lounge, and Coffee Shop",0.63,0.55,0.68
+0.34,Market Research Analysts and Marketing Specialists,0.86,0.49,0.82
+0.34,"Paper Goods Machine Setters, Operators, and Tenders",0.78,0.61,0.54
+0.34,Public Safety Telecommunicators,0.96,0.9,0.68
+0.34,"Weighers, Measurers, Checkers, and Samplers, Recordkeeping",0.88,0.79,0.63
+0.33,Appraisers and Assessors of Real Estate,0.87,0.68,0.74
+0.33,Atmospheric and Space Scientists,0.81,0.46,0.74
+0.33,Civil Engineers,0.85,0.55,0.75
+0.33,Computer and Information Research Scientists,0.74,0.31,0.75
+0.33,Family Medicine Physicians,0.94,0.44,0.87
+0.33,Financial Examiners,0.75,0.43,0.65
+0.33,First-Line Supervisors of Office and Administrative Support Workers,0.81,0.52,0.85
+0.33,First-Line Supervisors of Production and Operating Workers,0.81,0.59,0.8
+0.33,Flight Attendants,0.79,0.7,0.73
+0.33,Forest and Conservation Technicians,0.75,0.65,0.74
+0.33,"Graders and Sorters, Agricultural Products",0.64,0.26,0.41
+0.33,"Loading and Moving Machine Operators, Underground Mining",0.59,0.35,0.74
+0.33,Non-Destructive Testing Specialists,0.86,0.66,0.65
+0.33,Nuclear Technicians,0.95,0.83,0.58
+0.33,Optometrists,0.94,0.74,0.85
+0.33,Phlebotomists,0.95,0.81,0.68
+0.33,"Roustabouts, Oil and Gas",0.8,0.68,0.68
+0.33,Sheet Metal Workers,0.84,0.61,0.65
+0.33,"Stone Cutters and Carvers, Manufacturing",0.85,0.58,0.73
+0.33,Word Processors and Typists,0.92,0.91,0.82
+0.32,"Bus Drivers, Transit and Intercity",0.71,0.52,0.45
+0.32,Commercial Pilots,0.9,0.69,0.85
+0.32,Computer Network Support Specialists,0.86,0.68,0.83
+0.32,Computer Programmers,0.81,0.54,0.6
+0.32,"Cooks, Short Order",0.79,0.58,0.74
+0.32,Cost Estimators,0.88,0.63,0.72
+0.32,Electromechanical Equipment Assemblers,0.79,0.64,0.62
+0.32,Etchers and Engravers,0.86,0.59,0.8
+0.32,Fast Food and Counter Workers,0.7,0.57,0.58
+0.32,First-Line Supervisors of Food Preparation and Serving Workers,0.87,0.65,0.74
+0.32,Food Scientists and Technologists,0.79,0.49,0.64
+0.32,Forest Fire Inspectors and Prevention Specialists,0.76,0.64,0.79
+0.32,General and Operations Managers,0.75,0.65,0.95
+0.32,Highway Maintenance Workers,0.78,0.63,0.59
+0.32,"Library Assistants, Clerical",0.79,0.68,0.75
+0.32,Materials Engineers,0.78,0.3,0.79
+0.32,Photonics Engineers,0.85,0.35,0.78
+0.32,Prosthodontists,0.99,0.78,0.93
+0.32,Sales Managers,0.68,0.4,0.77
+0.31,"Ambulance Drivers and Attendants, Except Emergency Medical Technicians",0.85,0.72,0.78
+0.31,"Business Teachers, Postsecondary",0.56,0.41,0.93
+0.31,"Control and Valve Installers and Repairers, Except Mechanical Door",0.81,0.57,0.69
+0.31,"Cutters and Trimmers, Hand",0.89,0.4,0.61
+0.31,Desktop Publishers,0.86,0.57,0.76
+0.31,Detectives and Criminal Investigators,0.84,0.57,0.87
+0.31,Emergency Management Directors,0.69,0.44,0.8
+0.31,"First-Line Supervisors of Farming, Fishing, and Forestry Workers",0.72,0.48,0.79
+0.31,General Internal Medicine Physicians,0.86,0.66,0.86
+0.31,Management Analysts,0.76,0.27,0.81
+0.31,Nurse Anesthetists,0.95,0.79,0.86
+0.31,"Physicians, Pathologists",0.97,0.78,0.84
+0.31,"Plating Machine Setters, Operators, and Tenders, Metal and Plastic",0.81,0.62,0.55
+0.31,Quality Control Systems Managers,0.93,0.73,0.82
+0.31,Range Managers,0.61,0.46,0.85
+0.31,Real Estate Sales Agents,0.76,0.48,0.93
+0.31,Recycling Coordinators,0.71,0.56,0.93
+0.31,Social and Community Service Managers,0.8,0.61,0.84
+0.31,Social and Human Service Assistants,0.77,0.6,0.77
+0.31,Solar Sales Representatives and Assessors,0.81,0.42,0.91
+0.31,Sound Engineering Technicians,0.83,0.54,0.77
+0.31,Telecommunications Engineering Specialists,0.78,0.47,0.74
+0.31,Urologists,0.99,0.54,0.95
+0.3,Agricultural Technicians,0.89,0.75,0.7
+0.3,"Child, Family, and School Social Workers",0.82,0.54,0.85
+0.3,Cleaners of Vehicles and Equipment,0.69,0.47,0.62
+0.3,Community Health Workers,0.73,0.51,0.77
+0.3,"Cooks, Fast Food",0.73,0.28,0.3
+0.3,Electro-Mechanical and Mechatronics Technologists and Technicians,0.88,0.76,0.57
+0.3,"Explosives Workers, Ordnance Handling Experts, and Blasters",0.88,0.6,0.65
+0.3,Fabric and Apparel Patternmakers,0.93,0.56,0.8
+0.3,Farm Labor Contractors,0.82,0.87,0.99
+0.3,Funeral Attendants,0.77,0.56,0.63
+0.3,Government Property Inspectors and Investigators,0.86,0.58,0.75
+0.3,Industrial Engineering Technologists and Technicians,0.82,0.67,0.79
+0.3,Industrial Machinery Mechanics,0.68,0.49,0.63
+0.3,Licensed Practical and Licensed Vocational Nurses,0.93,0.73,0.74
+0.3,Mechanical Engineers,0.84,0.62,0.9
+0.3,"Medical Scientists, Except Epidemiologists",0.89,0.74,0.79
+0.3,Nuclear Engineers,0.86,0.39,0.59
+0.3,"Opticians, Dispensing",0.94,0.52,0.72
+0.3,"Painting, Coating, and Decorating Workers",0.71,0.36,0.73
+0.3,"Patternmakers, Wood",0.93,0.68,0.79
+0.3,Physical Therapist Aides,0.73,0.48,0.72
+0.3,Podiatrists,0.9,0.47,0.84
+0.3,"Property, Real Estate, and Community Association Managers",0.73,0.48,0.81
+0.3,Railroad Conductors and Yardmasters,0.77,0.67,0.59
+0.3,Remote Sensing Technicians,0.91,0.74,0.62
+0.3,Retail Loss Prevention Specialists,0.83,0.7,0.72
+0.3,Ship Engineers,0.71,0.66,0.89
+0.3,Soil and Plant Scientists,0.73,0.49,0.83
+0.3,"Ushers, Lobby Attendants, and Ticket Takers",0.69,0.48,0.42
+0.3,"Welding, Soldering, and Brazing Machine Setters, Operators, and Tenders",0.76,0.36,0.56
+0.29,"Administrative Law Judges, Adjudicators, and Hearing Officers",0.88,0.79,0.84
+0.29,Administrative Services Managers,0.79,0.59,0.76
+0.29,"Aircraft Structure, Surfaces, Rigging, and Systems Assemblers",0.86,0.66,0.71
+0.29,Allergists and Immunologists,0.96,0.63,0.88
+0.29,Athletic Trainers,0.83,0.66,0.76
+0.29,Audiologists,0.91,0.35,0.8
+0.29,Automotive Engineers,0.84,0.48,0.79
+0.29,Business Intelligence Analysts,0.81,0.56,0.86
+0.29,"Compensation, Benefits, and Job Analysis Specialists",0.88,0.75,0.89
+0.29,Construction and Building Inspectors,0.74,0.48,0.82
+0.29,First-Line Supervisors of Material-Moving Machine and Vehicle Operators,0.83,0.76,0.77
+0.29,Food Science Technicians,0.9,0.72,0.58
+0.29,Gambling Surveillance Officers and Gambling Investigators,0.96,0.88,0.74
+0.29,Industrial Engineers,0.81,0.54,0.86
+0.29,Information Technology Project Managers,0.74,0.63,0.85
+0.29,"Inspectors, Testers, Sorters, Samplers, and Weighers",0.89,0.66,0.75
+0.29,Logging Equipment Operators,0.7,0.68,0.71
+0.29,Marine Engineers and Naval Architects,0.86,0.46,0.75
+0.29,Materials Scientists,0.81,0.38,0.8
+0.29,Neurodiagnostic Technologists,0.91,0.69,0.71
+0.29,Plasterers and Stucco Masons,0.79,0.33,0.5
+0.29,Rail-Track Laying and Maintenance Equipment Operators,0.73,0.58,0.77
+0.29,Retail Salespersons,0.79,0.63,0.77
+0.29,"Sales Representatives, Wholesale and Manufacturing, Technical and Scientific Products",0.84,0.45,0.93
+0.29,Search Marketing Strategists,0.69,0.46,0.81
+0.29,"Tool Grinders, Filers, and Sharpeners",0.9,0.45,0.69
+0.29,Transportation Inspectors,0.91,0.61,0.88
+0.28,Art Directors,0.87,0.8,0.86
+0.28,Barbers,0.84,0.46,0.81
+0.28,Cabinetmakers and Bench Carpenters,0.78,0.42,0.64
+0.28,Conservation Scientists,0.69,0.35,0.73
+0.28,Counter and Rental Clerks,0.75,0.67,0.65
+0.28,Crane and Tower Operators,0.89,0.49,0.74
+0.28,Driver/Sales Workers,0.8,0.85,0.75
+0.28,"Education and Childcare Administrators, Preschool and Daycare",0.76,0.67,0.86
+0.28,"Electronics Engineers, Except Computer",0.79,0.57,0.82
+0.28,"Environmental Scientists and Specialists, Including Health",0.76,0.57,0.88
+0.28,First-Line Supervisors of Housekeeping and Janitorial Workers,0.75,0.61,0.69
+0.28,First-Line Supervisors of Non-Retail Sales Workers,0.81,0.67,0.8
+0.28,First-Line Supervisors of Police and Detectives,0.84,0.7,0.86
+0.28,Fuel Cell Engineers,0.7,0.3,0.73
+0.28,Gambling Managers,0.85,0.65,0.87
+0.28,Hazardous Materials Removal Workers,0.69,0.54,0.54
+0.28,"Helpers--Installation, Maintenance, and Repair Workers",0.72,0.53,0.68
+0.28,"Judges, Magistrate Judges, and Magistrates",0.94,0.58,0.98
+0.28,Marketing Managers,0.7,0.45,0.91
+0.28,Medical Secretaries and Administrative Assistants,0.88,0.9,0.76
+0.28,Millwrights,0.94,0.62,0.67
+0.28,"Model Makers, Metal and Plastic",1.0,0.67,0.53
+0.28,Molecular and Cellular Biologists,0.84,0.51,0.76
+0.28,"Office Clerks, General",0.9,0.81,0.68
+0.28,"Packers and Packagers, Hand",0.83,0.72,0.59
+0.28,"Patternmakers, Metal and Plastic",0.78,0.51,0.71
+0.28,Psychiatric Technicians,0.84,0.71,0.71
+0.28,"Pump Operators, Except Wellhead Pumpers",0.71,0.75,0.77
+0.28,"Service Unit Operators, Oil and Gas",0.84,0.77,0.74
+0.28,Skincare Specialists,0.72,0.66,0.61
+0.28,"Tailors, Dressmakers, and Custom Sewers",0.88,0.54,0.73
+0.28,Wind Turbine Service Technicians,0.82,0.8,0.67
+0.28,"Woodworking Machine Setters, Operators, and Tenders, Except Sawing",0.85,0.67,0.68
+0.27,Biofuels/Biodiesel Technology and Product Development Managers,0.78,0.47,0.86
+0.27,Cardiovascular Technologists and Technicians,0.92,0.78,0.77
+0.27,Chiropractors,0.93,0.82,0.99
+0.27,Energy Auditors,0.76,0.48,0.64
+0.27,Executive Secretaries and Executive Administrative Assistants,0.88,0.71,0.92
+0.27,Film and Video Editors,0.86,0.44,0.6
+0.27,Financial Quantitative Analysts,0.93,0.53,0.83
+0.27,Fishing and Hunting Workers,0.51,0.48,0.81
+0.27,"Food Servers, Nonrestaurant",0.73,0.67,0.72
+0.27,Human Resources Managers,0.76,0.51,0.93
+0.27,"Laborers and Freight, Stock, and Material Movers, Hand",0.79,0.6,0.66
+0.27,Librarians and Media Collections Specialists,0.71,0.47,0.83
+0.27,Maids and Housekeeping Cleaners,0.66,0.44,0.59
+0.27,Medical Assistants,0.85,0.76,0.67
+0.27,Nuclear Monitoring Technicians,0.9,0.67,0.66
+0.27,"Nursing Instructors and Teachers, Postsecondary",0.92,0.59,0.8
+0.27,"Painters, Construction and Maintenance",0.73,0.31,0.53
+0.27,Parts Salespersons,0.83,0.81,0.82
+0.27,Passenger Attendants,0.61,0.36,0.38
+0.27,Recycling and Reclamation Workers,0.53,0.41,0.65
+0.27,Roofers,0.82,0.47,0.74
+0.27,Spa Managers,0.75,0.59,0.75
+0.27,Subway and Streetcar Operators,0.86,0.75,0.38
+0.27,Team Assemblers,0.92,0.45,0.64
+0.27,Technical Writers,0.89,0.88,0.63
+0.27,Tire Builders,0.63,0.69,0.36
+0.27,Tire Repairers and Changers,0.88,0.62,0.67
+0.27,Training and Development Managers,0.65,0.42,0.83
+0.27,Training and Development Specialists,0.69,0.34,0.75
+0.27,Transportation Engineers,0.79,0.59,0.8
+0.26,Agricultural Equipment Operators,0.68,0.35,0.72
+0.26,"Architects, Except Landscape and Naval",0.74,0.53,0.72
+0.26,Architectural and Engineering Managers,0.75,0.62,0.88
+0.26,Bartenders,0.72,0.52,0.62
+0.26,"Criminal Justice and Law Enforcement Teachers, Postsecondary",0.68,0.51,0.92
+0.26,"Dentists, General",0.95,0.82,0.95
+0.26,Diagnostic Medical Sonographers,0.97,0.92,0.7
+0.26,Electrical and Electronic Engineering Technologists and Technicians,0.85,0.55,0.82
+0.26,Elevator and Escalator Installers and Repairers,0.92,0.58,0.9
+0.26,"Energy Engineers, Except Wind and Solar",0.74,0.43,0.76
+0.26,File Clerks,0.9,0.67,0.69
+0.26,Firefighters,0.79,0.58,0.78
+0.26,First-Line Supervisors of Gambling Services Workers,0.86,0.75,0.66
+0.26,Foresters,0.67,0.49,0.81
+0.26,Gambling Change Persons and Booth Cashiers,0.96,0.87,0.57
+0.26,"Helpers--Brickmasons, Blockmasons, Stonemasons, and Tile and Marble Setters",0.71,0.54,0.7
+0.26,Industrial Production Managers,0.87,0.54,0.89
+0.26,Information Security Analysts,0.77,0.58,0.77
+0.26,Landscape Architects,0.76,0.44,0.72
+0.26,Log Graders and Scalers,0.78,0.67,0.69
+0.26,Medical Equipment Preparers,0.9,0.86,0.7
+0.26,Medical Equipment Repairers,0.8,0.42,0.79
+0.26,"News Analysts, Reporters, and Journalists",0.89,0.51,0.83
+0.26,Nurse Practitioners,0.89,0.62,0.83
+0.26,Paralegals and Legal Assistants,0.87,0.67,0.76
+0.26,Pest Control Workers,0.78,0.61,0.84
+0.26,Special Effects Artists and Animators,0.86,0.45,0.67
+0.26,Statisticians,0.82,0.36,0.74
+0.26,Water Resource Specialists,0.74,0.28,0.79
+0.25,Advertising and Promotions Managers,0.83,0.43,0.81
+0.25,Clergy,0.57,0.3,0.92
+0.25,Construction Managers,0.71,0.49,0.81
+0.25,"Cooks, Institution and Cafeteria",0.73,0.4,0.72
+0.25,Correctional Officers and Jailers,0.85,0.81,0.67
+0.25,Drywall and Ceiling Tile Installers,0.86,0.62,0.74
+0.25,Hearing Aid Specialists,0.8,0.51,0.82
+0.25,Industrial Truck and Tractor Operators,0.91,0.49,0.76
+0.25,Industrial-Organizational Psychologists,0.81,0.4,0.92
+0.25,"Layout Workers, Metal and Plastic",0.92,0.47,0.58
+0.25,Legal Secretaries and Administrative Assistants,0.78,0.84,0.84
+0.25,"Lifeguards, Ski Patrol, and Other Recreational Protective Service Workers",0.66,0.44,0.67
+0.25,Media Technical Directors/Managers,0.95,0.7,0.79
+0.25,Private Detectives and Investigators,0.94,0.61,0.85
+0.25,Sales Engineers,0.62,0.46,0.76
+0.25,Signal and Track Switch Repairers,0.75,0.52,0.87
+0.25,Surgical Assistants,0.9,0.67,0.78
+0.25,Tapers,0.68,0.35,0.73
+0.25,Veterinary Technologists and Technicians,0.84,0.6,0.71
+0.25,Web Developers,0.81,0.79,0.77
+0.25,Wellhead Pumpers,0.69,0.64,0.9
+0.24,Animal Control Workers,0.81,0.68,0.82
+0.24,Archivists,0.8,0.68,0.78
+0.24,Bioengineers and Biomedical Engineers,0.76,0.4,0.77
+0.24,Chefs and Head Cooks,0.8,0.7,0.67
+0.24,Commercial and Industrial Designers,0.85,0.67,0.69
+0.24,Concierges,0.74,0.54,0.84
+0.24,"Cooks, Restaurant",0.78,0.49,0.6
+0.24,"Education Administrators, Kindergarten through Secondary",0.79,0.5,0.85
+0.24,Environmental Engineering Technologists and Technicians,0.73,0.61,0.69
+0.24,"Environmental Science and Protection Technicians, Including Health",0.83,0.38,0.61
+0.24,Fire Inspectors and Investigators,0.89,0.58,0.9
+0.24,First-Line Supervisors of Retail Sales Workers,0.75,0.65,0.79
+0.24,Geneticists,0.91,0.54,0.81
+0.24,"Health and Safety Engineers, Except Mining Safety Engineers and Inspectors",0.82,0.46,0.76
+0.24,Light Truck Drivers,0.71,0.32,0.61
+0.24,Petroleum Engineers,0.71,0.47,0.88
+0.24,"Psychology Teachers, Postsecondary",0.65,0.5,0.92
+0.24,Quality Control Analysts,0.96,0.77,0.81
+0.24,Radio Frequency Identification Device Specialists,0.83,0.54,0.81
+0.24,Riggers,0.86,0.64,0.67
+0.24,Waiters and Waitresses,0.76,0.6,0.48
+0.23,Aircraft Mechanics and Service Technicians,0.88,0.67,0.78
+0.23,Baggage Porters and Bellhops,0.57,0.53,0.71
+0.23,Biostatisticians,0.83,0.43,0.78
+0.23,Cashiers,0.85,0.6,0.54
+0.23,Clinical Research Coordinators,0.89,0.78,0.75
+0.23,Dental Assistants,0.84,0.73,0.61
+0.23,Environmental Engineers,0.63,0.29,0.69
+0.23,Farm and Home Management Educators,0.61,0.31,0.93
+0.23,Fitness and Wellness Coordinators,0.43,0.21,0.86
+0.23,Fundraisers,0.66,0.45,0.85
+0.23,"Heat Treating Equipment Setters, Operators, and Tenders, Metal and Plastic",0.79,0.79,0.65
+0.23,Helpers--Carpenters,0.81,0.38,0.75
+0.23,"Janitors and Cleaners, Except Maids and Housekeeping Cleaners",0.73,0.43,0.77
+0.23,Labor Relations Specialists,0.74,0.26,0.83
+0.23,Microsystems Engineers,0.8,0.48,0.86
+0.23,Slaughterers and Meat Packers,0.7,0.52,0.61
+0.23,Timing Device Assemblers and Adjusters,0.65,0.31,0.77
+0.23,Transit and Railroad Police,0.84,0.57,0.79
+0.23,Zoologists and Wildlife Biologists,0.74,0.34,0.88
+0.22,Clinical Nurse Specialists,0.83,0.4,0.88
+0.22,"Coin, Vending, and Amusement Machine Servicers and Repairers",0.76,0.76,0.75
+0.22,"Door-to-Door Sales Workers, News and Street Vendors, and Related Workers",0.49,0.26,0.94
+0.22,"Earth Drillers, Except Oil and Gas",0.66,0.41,0.77
+0.22,"Education Administrators, Postsecondary",0.78,0.34,0.92
+0.22,"Electrical and Electronics Installers and Repairers, Transportation Equipment",0.8,0.53,0.74
+0.22,Engine and Other Machine Assemblers,0.87,0.5,0.65
+0.22,First-Line Supervisors of Correctional Officers,0.71,0.66,0.73
+0.22,First-Line Supervisors of Personal Service Workers,0.72,0.59,0.79
+0.22,Geographers,0.64,0.34,0.77
+0.22,Heavy and Tractor-Trailer Truck Drivers,0.74,0.49,0.69
+0.22,Jewelers and Precious Stone and Metal Workers,0.88,0.54,0.76
+0.22,Lawyers,0.9,0.55,0.77
+0.22,Mechanical Drafters,0.93,0.64,0.83
+0.22,Motorboat Operators,0.46,0.51,0.77
+0.22,Photographers,0.71,0.51,0.77
+0.22,Pipelayers,0.9,0.49,0.71
+0.22,Public Relations Specialists,0.8,0.29,0.77
+0.22,"Rail Yard Engineers, Dinkey Operators, and Hostlers",0.64,0.57,0.58
+0.22,"Recreation and Fitness Studies Teachers, Postsecondary",0.66,0.44,0.95
+0.22,Reinforcing Iron and Rebar Workers,0.61,0.52,0.62
+0.22,Sewing Machine Operators,0.75,0.4,0.57
+0.22,Surgical Technologists,0.97,0.75,0.78
+0.22,"Tank Car, Truck, and Ship Loaders",0.87,0.86,0.72
+0.22,Validation Engineers,0.91,0.65,0.78
+0.22,Water/Wastewater Engineers,0.72,0.35,0.71
+0.21,Astronomers,0.91,0.3,0.93
+0.21,Audiovisual Equipment Installers and Repairers,0.8,0.38,0.93
+0.21,Cargo and Freight Agents,0.67,0.47,0.84
+0.21,Dancers,0.75,0.68,0.55
+0.21,Electricians,0.83,0.53,0.76
+0.21,Environmental Economists,0.75,0.29,0.94
+0.21,"Farmworkers, Farm, Ranch, and Aquacultural Animals",0.59,0.44,0.73
+0.21,Floor Sanders and Finishers,0.84,0.6,0.84
+0.21,Hydrologists,0.8,0.43,0.76
+0.21,Judicial Law Clerks,0.96,0.63,0.72
+0.21,Mechanical Engineering Technologists and Technicians,0.86,0.6,0.7
+0.21,Mechatronics Engineers,0.78,0.32,0.85
+0.21,Mental Health Counselors,0.57,0.5,0.73
+0.21,Occupational Health and Safety Specialists,0.8,0.33,0.79
+0.21,Occupational Health and Safety Technicians,0.85,0.56,0.85
+0.21,Operations Research Analysts,0.84,0.36,0.89
+0.21,Police and Sheriff's Patrol Officers,0.92,0.7,0.74
+0.21,"Rock Splitters, Quarry",0.69,0.35,0.45
+0.21,"Rotary Drill Operators, Oil and Gas",0.9,0.85,0.74
+0.2,Aerospace Engineering and Operations Technologists and Technicians,0.99,0.59,0.67
+0.2,Amusement and Recreation Attendants,0.47,0.52,0.53
+0.2,Biological Technicians,0.85,0.59,0.69
+0.2,"Camera Operators, Television, Video, and Film",0.84,0.64,0.65
+0.2,"Career/Technical Education Teachers, Postsecondary",0.77,0.49,0.83
+0.2,Childcare Workers,0.59,0.33,0.77
+0.2,Clinical and Counseling Psychologists,0.67,0.33,0.94
+0.2,Critical Care Nurses,0.96,0.63,0.75
+0.2,Dental Laboratory Technicians,0.95,0.64,0.7
+0.2,"Economics Teachers, Postsecondary",0.72,0.29,0.92
+0.2,Economists,0.84,0.34,0.94
+0.2,Epidemiologists,0.9,0.47,0.86
+0.2,Home Appliance Repairers,0.81,0.51,0.78
+0.2,Home Health Aides,0.83,0.45,0.66
+0.2,Interior Designers,0.84,0.45,0.82
+0.2,Interpreters and Translators,0.98,0.87,0.61
+0.2,Medical Appliance Technicians,0.85,0.55,0.82
+0.2,"Middle School Teachers, Except Special and Career/Technical Education",0.7,0.42,0.8
+0.2,"Mining and Geological Engineers, Including Mining Safety Engineers",0.77,0.62,0.79
+0.2,Occupational Therapy Assistants,0.71,0.69,0.73
+0.2,"Potters, Manufacturing",0.71,0.72,0.85
+0.2,Producers and Directors,0.76,0.4,0.9
+0.2,"Railroad Brake, Signal, and Switch Operators and Locomotive Firers",0.76,0.67,0.64
+0.2,"Secretaries and Administrative Assistants, Except Legal, Medical, and Executive",0.81,0.83,0.82
+0.2,Shampooers,0.93,0.39,0.61
+0.2,Telecommunications Line Installers and Repairers,0.85,0.64,0.8
+0.2,Tool and Die Makers,0.95,0.47,0.86
+0.2,Veterinarians,0.89,0.54,0.82
+0.2,"Wholesale and Retail Buyers, Except Farm Products",0.76,0.78,0.88
+0.2,Wind Energy Engineers,0.79,0.41,0.8
+0.19,Automotive Service Technicians and Mechanics,0.86,0.54,0.74
+0.19,Avionics Technicians,0.86,0.47,0.71
+0.19,"Communications Teachers, Postsecondary",0.64,0.31,0.88
+0.19,Editors,0.86,0.76,0.8
+0.19,Electrical and Electronic Equipment Assemblers,0.78,0.49,0.67
+0.19,Fiberglass Laminators and Fabricators,0.69,0.65,0.39
+0.19,Historians,0.81,0.55,0.88
+0.19,Locomotive Engineers,0.87,0.65,0.72
+0.19,Mental Health and Substance Abuse Social Workers,0.67,0.58,0.81
+0.19,Nursing Assistants,0.89,0.62,0.66
+0.19,Orthodontists,0.93,0.75,0.98
+0.19,"Philosophy and Religion Teachers, Postsecondary",0.81,0.41,0.88
+0.19,"Radio, Cellular, and Tower Equipment Installers and Repairers",0.91,0.55,0.87
+0.19,Recreation Workers,0.57,0.61,0.84
+0.19,"Sewers, Hand",0.86,0.54,0.79
+0.19,"Special Education Teachers, Middle School",0.74,0.44,0.78
+0.19,Transportation Planners,0.69,0.4,0.73
+0.19,"Transportation Vehicle, Equipment and Systems Inspectors, Except Aviation",0.83,0.57,0.75
+0.18,Advertising Sales Agents,0.76,0.42,0.92
+0.18,"Architecture Teachers, Postsecondary",0.67,0.24,0.88
+0.18,Bioinformatics Scientists,0.86,0.5,0.94
+0.18,"Captains, Mates, and Pilots of Water Vessels",0.82,0.65,0.83
+0.18,Compliance Managers,0.91,0.71,0.83
+0.18,Dental Hygienists,0.85,0.83,0.78
+0.18,Dietitians and Nutritionists,0.75,0.38,0.8
+0.18,Embalmers,0.89,0.64,0.83
+0.18,"Excavating and Loading Machine and Dragline Operators, Surface Mining",0.7,0.57,0.73
+0.18,First-Line Supervisors of Firefighting and Prevention Workers,0.73,0.5,0.8
+0.18,Floral Designers,0.53,0.43,0.9
+0.18,"Heating, Air Conditioning, and Refrigeration Mechanics and Installers",0.75,0.5,0.75
+0.18,Hospitalists,0.89,0.48,0.79
+0.18,Human Factors Engineers and Ergonomists,0.73,0.48,0.81
+0.18,Locksmiths and Safe Repairers,0.87,0.62,0.74
+0.18,Neurologists,1.0,0.53,0.96
+0.18,Obstetricians and Gynecologists,0.98,0.47,0.92
+0.18,"Ophthalmologists, Except Pediatric",0.98,0.59,0.91
+0.18,Oral and Maxillofacial Surgeons,0.96,0.57,0.9
+0.18,"Pesticide Handlers, Sprayers, and Applicators, Vegetation",0.8,0.54,0.7
+0.18,Psychiatric Aides,0.7,0.67,0.67
+0.18,"Refractory Materials Repairers, Except Brickmasons",0.68,0.52,0.47
+0.18,Regulatory Affairs Specialists,0.79,0.58,0.73
+0.18,Rehabilitation Counselors,0.73,0.62,0.77
+0.18,Set and Exhibit Designers,0.74,0.33,0.8
+0.18,Solar Energy Systems Engineers,0.73,0.29,0.69
+0.18,Talent Directors,0.56,0.33,0.89
+0.18,"Welders, Cutters, Solderers, and Brazers",0.83,0.52,0.61
+0.17,"Agents and Business Managers of Artists, Performers, and Athletes",0.86,0.47,0.86
+0.17,Audio and Video Technicians,0.89,0.78,0.73
+0.17,Automotive and Watercraft Service Attendants,0.87,0.42,0.69
+0.17,Biologists,0.86,0.38,0.93
+0.17,"Coating, Painting, and Spraying Machine Setters, Operators, and Tenders",0.72,0.46,0.4
+0.17,Dermatologists,0.93,0.37,0.94
+0.17,"Derrick Operators, Oil and Gas",0.73,0.79,0.73
+0.17,Dining Room and Cafeteria Attendants and Bartender Helpers,0.72,0.31,0.54
+0.17,Healthcare Social Workers,0.47,0.32,0.81
+0.17,"Insulation Workers, Floor, Ceiling, and Wall",0.62,0.38,0.62
+0.17,"Kindergarten Teachers, Except Special Education",0.6,0.36,0.71
+0.17,Mechanical Door Repairers,0.73,0.55,0.75
+0.17,"Meeting, Convention, and Event Planners",0.74,0.56,0.93
+0.17,Physical Medicine and Rehabilitation Physicians,0.95,0.53,0.96
+0.17,"Plumbers, Pipefitters, and Steamfitters",0.8,0.5,0.78
+0.17,Regulatory Affairs Managers,0.89,0.55,0.73
+0.17,School Psychologists,0.78,0.35,0.87
+0.17,Solar Energy Installation Managers,0.81,0.61,0.72
+0.17,Solar Thermal Installers and Technicians,0.8,0.4,0.81
+0.17,Speech-Language Pathologists,0.71,0.31,0.86
+0.17,"Telecommunications Equipment Installers and Repairers, Except Line Installers",0.79,0.72,0.69
+0.17,Veterinary Assistants and Laboratory Animal Caretakers,0.93,0.75,0.63
+0.17,Weatherization Installers and Technicians,0.65,0.52,0.65
+0.16,Athletes and Sports Competitors,0.69,0.67,0.76
+0.16,Automotive Body and Related Repairers,0.85,0.47,0.74
+0.16,Bailiffs,0.77,0.51,0.58
+0.16,Brownfield Redevelopment Specialists and Site Managers,0.68,0.38,0.75
+0.16,"Coil Winders, Tapers, and Finishers",0.98,0.66,0.68
+0.16,Continuous Mining Machine Operators,0.78,0.55,0.71
+0.16,"Elementary School Teachers, Except Special Education",0.64,0.44,0.75
+0.16,"English Language and Literature Teachers, Postsecondary",0.68,0.41,0.92
+0.16,"Environmental Science Teachers, Postsecondary",0.78,0.33,0.9
+0.16,Exercise Physiologists,0.72,0.49,0.81
+0.16,"Geoscientists, Except Hydrologists and Geographers",0.69,0.48,0.78
+0.16,Graphic Designers,0.86,0.61,0.78
+0.16,"Locker Room, Coatroom, and Dressing Room Attendants",0.56,0.45,0.66
+0.16,"Mathematical Science Teachers, Postsecondary",0.74,0.38,0.74
+0.16,Naturopathic Physicians,0.85,0.41,0.87
+0.16,Nurse Midwives,0.87,0.52,0.78
+0.16,Orthotists and Prosthetists,0.79,0.51,0.78
+0.16,Paperhangers,0.73,0.5,0.77
+0.16,Personal Care Aides,0.8,0.55,0.76
+0.16,Preventive Medicine Physicians,0.78,0.26,0.89
+0.16,Psychiatrists,0.73,0.35,0.85
+0.16,"Roof Bolters, Mining",0.72,0.69,0.46
+0.16,Social Science Research Assistants,0.75,0.71,0.72
+0.16,"Special Education Teachers, Secondary School",0.71,0.33,0.8
+0.15,"Anthropology and Archeology Teachers, Postsecondary",0.83,0.44,0.89
+0.15,Brickmasons and Blockmasons,0.78,0.4,0.75
+0.15,Carpenters,0.83,0.48,0.78
+0.15,Coroners,0.89,0.6,0.74
+0.15,Electrical Engineers,0.82,0.46,0.77
+0.15,"Electronic Equipment Installers and Repairers, Motor Vehicles",0.93,0.62,0.73
+0.15,Environmental Compliance Inspectors,0.75,0.58,0.75
+0.15,"Fine Artists, Including Painters, Sculptors, and Illustrators",0.78,0.41,0.85
+0.15,First-Line Supervisors of Construction Trades and Extraction Workers,0.82,0.43,0.91
+0.15,"Floor Layers, Except Carpet, Wood, and Hard Tiles",0.8,0.32,0.81
+0.15,Forensic Science Technicians,0.94,0.61,0.88
+0.15,"Hairdressers, Hairstylists, and Cosmetologists",0.82,0.65,0.93
+0.15,Industrial Ecologists,0.77,0.39,0.85
+0.15,"Model Makers, Wood",0.95,0.33,0.8
+0.15,Park Naturalists,0.69,0.52,0.83
+0.15,Pile Driver Operators,0.8,0.52,0.63
+0.15,Recreational Therapists,0.53,0.34,0.9
+0.15,Security Guards,0.85,0.72,0.66
+0.15,Sociologists,0.68,0.36,0.96
+0.14,Acupuncturists,0.79,0.7,0.84
+0.14,"Adult Basic Education, Adult Secondary Education, and English as a Second Language Instructors",0.72,0.43,0.84
+0.14,Aerospace Engineers,0.75,0.34,0.77
+0.14,Chief Sustainability Officers,0.63,0.2,0.86
+0.14,Commercial Divers,0.82,0.6,0.76
+0.14,"Computer Science Teachers, Postsecondary",0.72,0.34,0.91
+0.14,Fashion Designers,0.78,0.3,0.93
+0.14,Funeral Home Managers,0.78,0.5,0.88
+0.14,Genetic Counselors,0.86,0.39,0.74
+0.14,"Geography Teachers, Postsecondary",0.75,0.33,0.92
+0.14,Health Education Specialists,0.7,0.64,0.79
+0.14,"Health Specialties Teachers, Postsecondary",0.71,0.29,0.91
+0.14,Motorboat Mechanics and Service Technicians,0.73,0.35,0.71
+0.14,"Pediatricians, General",0.92,0.42,0.89
+0.14,Physician Assistants,0.95,0.54,0.83
+0.14,Physicists,0.7,0.27,0.88
+0.14,"Physics Teachers, Postsecondary",0.64,0.32,0.96
+0.14,"Preschool Teachers, Except Special Education",0.59,0.25,0.65
+0.14,Residential Advisors,0.63,0.56,0.77
+0.14,Septic Tank Servicers and Sewer Pipe Cleaners,0.6,0.49,0.69
+0.14,"Social Work Teachers, Postsecondary",0.59,0.28,0.91
+0.14,"Special Education Teachers, Preschool",0.54,0.35,0.66
+0.14,Stonemasons,0.66,0.32,0.75
+0.14,Substance Abuse and Behavioral Disorder Counselors,0.7,0.78,0.73
+0.14,Wind Energy Development Managers,0.65,0.32,0.92
+0.13,Advanced Practice Psychiatric Nurses,0.82,0.55,0.85
+0.13,"Agricultural Sciences Teachers, Postsecondary",0.79,0.39,0.99
+0.13,Anesthesiologist Assistants,0.96,0.72,0.86
+0.13,"Atmospheric, Earth, Marine, and Space Sciences Teachers, Postsecondary",0.71,0.53,0.92
+0.13,"Chemistry Teachers, Postsecondary",0.85,0.53,0.93
+0.13,Costume Attendants,0.77,0.55,0.79
+0.13,"Directors, Religious Activities and Education",0.54,0.22,0.92
+0.13,"Education Teachers, Postsecondary",0.83,0.6,0.93
+0.13,"Electric Motor, Power Tool, and Related Repairers",0.88,0.56,0.73
+0.13,Forest and Conservation Workers,0.66,0.51,0.8
+0.13,Helpers--Extraction Workers,0.74,0.53,0.76
+0.13,"Helpers--Painters, Paperhangers, Plasterers, and Stucco Masons",0.57,0.51,0.6
+0.13,"Law Teachers, Postsecondary",0.78,0.21,0.98
+0.13,Mathematicians,0.92,0.38,0.88
+0.13,Natural Sciences Managers,0.86,0.49,0.85
+0.13,"Poets, Lyricists and Creative Writers",0.65,0.58,0.95
+0.13,Sailors and Marine Oilers,0.83,0.61,0.67
+0.13,Shoe Machine Operators and Tenders,0.68,0.77,0.38
+0.13,Sustainability Specialists,0.64,0.32,0.79
+0.13,Terrazzo Workers and Finishers,0.83,0.44,0.58
+0.13,Tutors,0.61,0.3,0.78
+0.12,"Educational, Guidance, and Career Counselors and Advisors",0.48,0.35,0.82
+0.12,Electrical Power-Line Installers and Repairers,0.89,0.45,0.74
+0.12,Fallers,0.78,0.38,0.9
+0.12,"First-Line Supervisors of Mechanics, Installers, and Repairers",0.86,0.72,0.88
+0.12,"Insulation Workers, Mechanical",0.65,0.45,0.78
+0.12,Merchandise Displayers and Window Trimmers,0.56,0.46,0.68
+0.12,"Mobile Heavy Equipment Mechanics, Except Engines",0.84,0.63,0.69
+0.12,Musical Instrument Repairers and Tuners,0.94,0.67,0.83
+0.12,Occupational Therapy Aides,0.71,0.53,0.66
+0.12,Orthoptists,0.89,0.59,0.75
+0.12,Solar Photovoltaic Installers,0.77,0.44,0.53
+0.12,Video Game Designers,0.6,0.43,0.79
+0.12,Writers and Authors,0.79,0.48,0.83
+0.11,Climate Change Policy Analysts,0.71,0.28,0.77
+0.11,Coaches and Scouts,0.66,0.34,0.79
+0.11,"Cooks, Private Household",0.73,0.46,0.9
+0.11,Crossing Guards and Flaggers,0.73,0.27,0.69
+0.11,Demonstrators and Product Promoters,0.59,0.48,0.66
+0.11,Exercise Trainers and Group Fitness Instructors,0.5,0.47,0.78
+0.11,Gambling Dealers,0.91,0.68,0.39
+0.11,"Morticians, Undertakers, and Funeral Arrangers",0.96,0.54,0.92
+0.11,Museum Technicians and Conservators,0.83,0.56,0.84
+0.11,Physical Therapist Assistants,0.59,0.55,0.87
+0.11,Rail Car Repairers,0.71,0.45,0.68
+0.11,Security and Fire Alarm Systems Installers,0.83,0.51,0.85
+0.11,Speech-Language Pathology Assistants,0.69,0.33,0.67
+0.11,Sports Medicine Physicians,1.0,0.53,0.94
+0.11,Tour Guides and Escorts,0.71,0.27,0.73
+0.11,Tree Trimmers and Pruners,0.71,0.51,0.84
+0.11,"Umpires, Referees, and Other Sports Officials",0.74,0.41,0.47
+0.1,"Area, Ethnic, and Cultural Studies Teachers, Postsecondary",0.64,0.19,0.89
+0.1,Bus and Truck Mechanics and Diesel Engine Specialists,0.56,0.36,0.79
+0.1,Craft Artists,0.8,0.57,0.76
+0.1,Curators,0.77,0.38,0.92
+0.1,Environmental Restoration Planners,0.52,0.25,0.85
+0.1,Fire-Prevention and Protection Engineers,0.79,0.44,0.76
+0.1,"Forestry and Conservation Science Teachers, Postsecondary",0.68,0.29,0.9
+0.1,Glaziers,0.86,0.48,0.75
+0.1,Helpers--Electricians,0.89,0.6,0.47
+0.1,"Helpers--Pipelayers, Plumbers, Pipefitters, and Steamfitters",0.63,0.45,0.42
+0.1,"History Teachers, Postsecondary",0.82,0.55,0.98
+0.1,"Library Science Teachers, Postsecondary",0.65,0.24,0.99
+0.1,Marriage and Family Therapists,0.56,0.24,0.84
+0.1,"Secondary School Teachers, Except Special and Career/Technical Education",0.65,0.37,0.84
+0.1,Self-Enrichment Teachers,0.64,0.48,0.84
+0.1,"Sociology Teachers, Postsecondary",0.69,0.54,0.95
+0.1,Structural Iron and Steel Workers,0.78,0.38,0.64
+0.1,Structural Metal Fabricators and Fitters,0.85,0.55,0.86
+0.1,Urban and Regional Planners,0.57,0.16,0.78
+0.09,Actors,0.79,0.4,0.47
+0.09,Animal Trainers,0.61,0.39,0.88
+0.09,"Biological Science Teachers, Postsecondary",0.81,0.32,0.93
+0.09,"Foreign Language and Literature Teachers, Postsecondary",0.57,0.11,0.86
+0.09,Furniture Finishers,0.81,0.27,0.51
+0.09,Music Directors and Composers,0.88,0.67,0.92
+0.09,Nannies,0.45,0.23,0.79
+0.09,Outdoor Power Equipment and Other Small Engine Mechanics,0.69,0.52,0.68
+0.09,Political Scientists,0.76,0.34,0.98
+0.08,Animal Breeders,0.59,0.33,0.94
+0.08,"Arbitrators, Mediators, and Conciliators",0.91,0.24,0.9
+0.08,Art Therapists,0.52,0.35,0.86
+0.08,"Career/Technical Education Teachers, Middle School",0.68,0.45,0.82
+0.08,"Career/Technical Education Teachers, Secondary School",0.68,0.45,0.83
+0.08,Construction Laborers,0.68,0.41,0.55
+0.08,"Engineering Teachers, Postsecondary",0.63,0.31,0.91
+0.08,Farm Equipment Mechanics and Service Technicians,0.88,0.5,0.75
+0.08,"Low Vision Therapists, Orientation and Mobility Specialists, and Vision Rehabilitation Therapists",0.58,0.26,0.93
+0.08,Massage Therapists,0.51,0.56,0.9
+0.08,Models,0.44,0.39,0.42
+0.08,Operating Engineers and Other Construction Equipment Operators,0.73,0.35,0.79
+0.08,Physical Therapists,0.67,0.69,0.85
+0.08,"Teaching Assistants, Postsecondary",0.67,0.39,0.8
+0.07,Shoe and Leather Workers and Repairers,0.85,0.44,0.79
+0.06,Anthropologists and Archeologists,0.77,0.42,0.81
+0.06,"Art, Drama, and Music Teachers, Postsecondary",0.62,0.35,0.85
+0.06,Midwives,0.85,0.44,0.78
+0.05,Adapted Physical Education Specialists,0.46,0.3,0.88
+0.05,Camera and Photographic Equipment Repairers,0.91,0.49,0.85
+0.05,Carpet Installers,0.74,0.38,0.8
+0.05,Instructional Coordinators,0.57,0.42,0.78
+0.05,Music Therapists,0.45,0.41,0.85
+0.05,"Political Science Teachers, Postsecondary",0.7,0.25,0.93
+0.05,Recreational Vehicle Service Technicians,0.78,0.48,0.62
+0.05,Upholsterers,0.83,0.3,0.66
+0.04,Choreographers,0.58,0.61,0.73
+0.04,Musicians and Singers,0.88,0.64,0.43
+0.04,Occupational Therapists,0.64,0.42,0.88
+0.04,Tile and Stone Setters,0.77,0.48,0.69
+0.03,Animal Caretakers,0.63,0.54,0.7
+0.03,Bicycle Repairers,0.87,0.31,0.87
+0.02,Automotive Glass Installers and Repairers,0.78,0.54,0.52
+0.02,"Makeup Artists, Theatrical and Performance",0.77,0.35,0.77
+0.02,Manicurists and Pedicurists,0.7,0.21,0.62
+0.02,Motorcycle Mechanics,0.93,0.7,0.82
+0.01,Manufactured Building and Mobile Home Installers,0.83,0.41,0.81
+0.01,Watch and Clock Repairers,0.97,0.38,0.92

occupations_projections_processed.csv

@@ -0,0 +1,1050 @@
+occupation,pct_emp_change_2020_2030
+"Total, all occupations",7.7
+Management occupations,9.3
+Top executives,7.7
+Chief executives,-5.7
+General and operations managers,9.4
+Legislators,7.6
+"Advertising, marketing, promotions, public relations, and sales managers",8.8
+Advertising and promotions managers,10.3
+Marketing and sales managers,8.3
+Marketing managers,10.0
+Sales managers,7.0
+Public relations and fundraising managers,12.6
+Operations specialties managers,11.6
+Administrative services and facilities managers,8.9
+Computer and information systems managers,10.9
+Financial managers,17.3
+Industrial production managers,5.3
+Purchasing managers,6.1
+"Transportation, storage, and distribution managers",8.3
+Compensation and benefits managers,4.0
+Human resources managers,9.2
+Training and development managers,10.7
+Other management occupations,9.2
+"Farmers, ranchers, and other agricultural managers",-0.7
+Construction managers,11.5
+Education and childcare administrators,8.5
+"Education and childcare administrators, preschool and daycare",11.4
+"Education administrators, kindergarten through secondary",7.8
+"Education administrators, postsecondary",7.5
+"Education administrators, all other",12.6
+Architectural and engineering managers,4.1
+Food service managers,14.9
+Gambling managers,20.1
+Lodging managers,8.7
+Medical and health services managers,32.5
+Natural sciences managers,5.8
+Postmasters and mail superintendents,-7.7
+"Property, real estate, and community association managers",3.1
+Social and community service managers,15.2
+Emergency management directors,6.2
+Funeral home managers,3.2
+"Personal service managers, all other; entertainment and recreation managers, except gambling; and managers, all other",7.4
+Business and financial operations occupations,8.0
+Business operations specialists,9.3
+"Agents and business managers of artists, performers, and athletes",46.3
+Buyers and purchasing agents,-5.4
+"Claims adjusters, appraisers, examiners, and investigators",-2.6
+"Claims adjusters, examiners, and investigators",-2.7
+"Insurance appraisers, auto damage",0.6
+Compliance officers,6.2
+Cost estimators,0.6
+Human resources workers,9.0
+Human resources specialists,10.4
+Farm labor contractors,10.6
+Labor relations specialists,-4.3
+Logisticians,29.5
+Management analysts,13.7
+"Meeting, convention, and event planners",17.5
+Fundraisers,15.9
+"Compensation, benefits, and job analysis specialists",9.6
+Training and development specialists,10.8
+Market research analysts and marketing specialists,22.1
+"Project management specialists and business operations specialists, all other",5.6
+Financial specialists,5.2
+Accountants and auditors,6.9
+Property appraisers and assessors,4.4
+Budget analysts,4.8
+Credit analysts,-5.8
+Personal financial advisors,4.6
+Insurance underwriters,-1.8
+Financial examiners,17.9
+Credit counselors and loan officers,2.1
+Credit counselors,9.0
+Loan officers,1.3
+"Tax examiners, collectors and preparers, and revenue agents",-0.5
+"Tax examiners and collectors, and revenue agents",-3.7
+Tax preparers,1.6
+"Financial and investment analysts, financial risk specialists, and financial specialists, all other",6.4
+Computer and mathematical occupations,14.1
+Computer occupations,13.4
+Computer and information analysts,12.0
+Computer systems analysts,7.0
+Information security analysts,33.3
+Computer and information research scientists,21.9
+Computer support specialists,8.6
+Computer network support specialists,7.5
+Computer user support specialists,8.9
+Database and network administrators and architects,6.0
+Computer network architects,5.5
+Network and computer systems administrators,5.4
+Database administrators and architects,7.8
+"Software and web developers, programmers, and testers",18.7
+Computer programmers,-9.9
+Software developers and software quality assurance analysts and testers,22.2
+Web developers and digital interface designers,12.8
+"Computer occupations, all other",9.2
+Mathematical science occupations,28.0
+Actuaries,24.5
+Mathematicians,2.7
+Operations research analysts,24.6
+Statisticians,35.4
+"Data scientists and mathematical science occupations, all other",31.4
+Architecture and engineering occupations,5.6
+"Architects, surveyors, and cartographers",2.6
+"Architects, except naval",2.6
+"Architects, except landscape and naval",3.1
+Landscape architects,-0.3
+"Surveyors, cartographers, and photogrammetrists",2.5
+Cartographers and photogrammetrists,5.4
+Surveyors,1.6
+Engineers,7.4
+Aerospace engineers,8.3
+Agricultural engineers,4.5
+Bioengineers and biomedical engineers,5.9
+Chemical engineers,9.3
+Civil engineers,8.2
+Computer hardware engineers,1.5
+Electrical and electronics engineers,6.5
+Electrical engineers,6.8
+"Electronics engineers, except computer",6.2
+Environmental engineers,3.7
+"Industrial engineers, including health and safety",13.1
+"Health and safety engineers, except mining safety engineers and inspectors",6.1
+Industrial engineers,13.7
+Marine engineers and naval architects,3.9
+Materials engineers,8.4
+Mechanical engineers,7.0
+"Mining and geological engineers, including mining safety engineers",3.9
+Nuclear engineers,-8.4
+Petroleum engineers,7.6
+"Engineers, all other",2.7
+"Drafters, engineering technicians, and mapping technicians",1.9
+Drafters,-1.9
+Architectural and civil drafters,-0.9
+Electrical and electronics drafters,2.3
+Mechanical drafters,-4.7
+"Drafters, all other",-5.4
+"Engineering technologists and technicians, except drafters",3.1
+Aerospace engineering and operations technologists and technicians,8.9
+Civil engineering technologists and technicians,1.8
+Electrical and electronic engineering technologists and technicians,1.6
+Electro-mechanical and mechatronics technologists and technicians,-1.7
+Environmental engineering technologists and technicians,7.8
+Industrial engineering technologists and technicians,4.4
+Mechanical engineering technologists and technicians,5.7
+Surveying and mapping technicians,3.7
+"Calibration technologists and technicians and engineering technologists and technicians, except drafters, all other",4.4
+"Life, physical, and social science occupations",7.9
+Life scientists,10.7
+Agricultural and food scientists,8.7
+Animal scientists,9.7
+Food scientists and technologists,6.7
+Soil and plant scientists,10.0
+Biological scientists,4.4
+Biochemists and biophysicists,4.7
+Microbiologists,4.6
+Zoologists and wildlife biologists,5.2
+"Biological scientists, all other",3.7
+Conservation scientists and foresters,7.5
+Conservation scientists,6.1
+Foresters,10.0
+Medical scientists,17.6
+Epidemiologists,29.6
+"Medical scientists, except epidemiologists",16.9
+"Life scientists, all other",8.4
+Physical scientists,6.9
+Astronomers and physicists,8.3
+Astronomers,4.5
+Physicists,8.8
+Atmospheric and space scientists,8.3
+Chemists and materials scientists,6.5
+Chemists,6.7
+Materials scientists,3.9
+Environmental scientists and geoscientists,7.9
+"Environmental scientists and specialists, including health",8.4
+"Geoscientists, except hydrologists and geographers",7.0
+Hydrologists,5.6
+"Physical scientists, all other",1.0
+Social scientists and related workers,7.0
+Economists,13.1
+Survey researchers,4.3
+Psychologists,7.6
+"Clinical, counseling, and school psychologists",10.4
+Industrial-organizational psychologists,2.2
+"Psychologists, all other",2.0
+Sociologists,4.8
+Urban and regional planners,6.8
+Miscellaneous social scientists and related workers,4.3
+Anthropologists and archeologists,7.4
+Geographers,1.1
+Historians,5.5
+Political scientists,8.6
+"Social scientists and related workers, all other",2.9
+"Life, physical, and social science technicians",7.0
+Agricultural and food science technicians,7.9
+Biological technicians,6.7
+Chemical technicians,5.0
+Environmental science and geoscience technicians,9.9
+"Environmental science and protection technicians, including health",10.6
+Geological and hydrologic technicians,8.7
+Nuclear technicians,-12.4
+Social science research assistants,8.4
+Forest and conservation technicians,0.7
+"Miscellaneous life, physical, and social science technicians",9.7
+Forensic science technicians,15.6
+"Life, physical, and social science technicians, all other",8.3
+Occupational health and safety specialists and technicians,7.4
+Occupational health and safety specialists,7.0
+Occupational health and safety technicians,9.0
+Community and social service occupations,12.4
+"Counselors, social workers, and other community and social service specialists",14.4
+Counselors,15.8
+"Educational, guidance, and career counselors and advisors",11.5
+Marriage and family therapists,16.4
+Rehabilitation counselors,10.4
+"Substance abuse, behavioral disorder, and mental health counselors",22.9
+"Counselors, all other",8.9
+Social workers,12.5
+"Child, family, and school social workers",12.6
+Healthcare social workers,13.2
+Mental health and substance abuse social workers,14.9
+"Social workers, all other",5.8
+Miscellaneous community and social service specialists,14.6
+Health education specialists,12.4
+Probation officers and correctional treatment specialists,3.8
+Social and human service assistants,16.6
+Community health workers,21.0
+"Community and social service specialists, all other",13.3
+Religious workers,2.3
+Clergy,2.5
+"Directors, religious activities and education",2.2
+"Religious workers, all other",2.0
+Legal occupations,8.8
+"Lawyers, judges, and related workers",8.5
+Lawyers and judicial law clerks,8.8
+Lawyers,8.9
+Judicial law clerks,3.9
+"Judges, magistrates, and other judicial workers",3.5
+"Administrative law judges, adjudicators, and hearing officers",0.8
+"Arbitrators, mediators, and conciliators",9.7
+"Judges, magistrate judges, and magistrates",3.4
+Legal support workers,9.3
+Paralegals and legal assistants,12.0
+Miscellaneous legal support workers,1.2
+"Title examiners, abstractors, and searchers",1.7
+"Legal support workers, all other",0.5
+Educational instruction and library occupations,10.1
+Postsecondary teachers,10.7
+"Business teachers, postsecondary",6.5
+"Math and computer science teachers, postsecondary",6.2
+"Computer science teachers, postsecondary",6.9
+"Mathematical science teachers, postsecondary",5.6
+"Engineering and architecture teachers, postsecondary",11.9
+"Architecture teachers, postsecondary",8.3
+"Engineering teachers, postsecondary",12.5
+"Life sciences teachers, postsecondary",11.5
+"Agricultural sciences teachers, postsecondary",5.0
+"Biological science teachers, postsecondary",12.8
+"Forestry and conservation science teachers, postsecondary",5.5
+"Physical sciences teachers, postsecondary",7.5
+"Atmospheric, earth, marine, and space sciences teachers, postsecondary",6.4
+"Chemistry teachers, postsecondary",7.9
+"Environmental science teachers, postsecondary",6.8
+"Physics teachers, postsecondary",8.1
+"Social sciences teachers, postsecondary",8.4
+"Anthropology and archeology teachers, postsecondary",8.1
+"Area, ethnic, and cultural studies teachers, postsecondary",8.8
+"Economics teachers, postsecondary",9.0
+"Geography teachers, postsecondary",6.3
+"Political science teachers, postsecondary",8.7
+"Psychology teachers, postsecondary",10.3
+"Sociology teachers, postsecondary",7.6
+"Social sciences teachers, postsecondary, all other",4.3
+"Health teachers, postsecondary",23.8
+"Health specialties teachers, postsecondary",24.3
+"Nursing instructors and teachers, postsecondary",22.4
+"Education and library science teachers, postsecondary",8.1
+"Education teachers, postsecondary",8.3
+"Library science teachers, postsecondary",5.9
+"Law, criminal justice, and social work teachers, postsecondary",10.2
+"Criminal justice and law enforcement teachers, postsecondary",11.1
+"Law teachers, postsecondary",10.6
+"Social work teachers, postsecondary",8.9
+"Arts, communications, history, and humanities teachers, postsecondary",8.7
+"Art, drama, and music teachers, postsecondary",10.1
+"Communications teachers, postsecondary",7.3
+"English language and literature teachers, postsecondary",6.2
+"Foreign language and literature teachers, postsecondary",9.4
+"History teachers, postsecondary",7.9
+"Philosophy and religion teachers, postsecondary",11.0
+Miscellaneous postsecondary teachers,5.1
+"Family and consumer sciences teachers, postsecondary",5.8
+"Recreation and fitness studies teachers, postsecondary",6.8
+"Career/technical education teachers, postsecondary",3.4
+"Postsecondary teachers, all other",5.9
+"Preschool, elementary, middle, secondary, and special education teachers",8.9
+Preschool and kindergarten teachers,16.3
+"Preschool teachers, except special education",18.4
+"Kindergarten teachers, except special education",8.1
+Elementary and middle school teachers,7.4
+"Elementary school teachers, except special education",7.4
+"Middle school teachers, except special and career/technical education",7.5
+"Career/technical education teachers, middle school",7.4
+Secondary school teachers,7.8
+"Secondary school teachers, except special and career/technical education",7.8
+"Career/technical education teachers, secondary school",7.1
+Special education teachers,8.1
+"Special education teachers, preschool",12.1
+"Special education teachers, kindergarten and elementary school",7.8
+"Special education teachers, middle school",7.5
+"Special education teachers, secondary school",7.7
+"Special education teachers, all other",10.5
+Other teachers and instructors,15.7
+"Adult basic education, adult secondary education, and English as a Second Language instructors",-5.0
+Self-enrichment teachers,23.5
+"Substitute teachers, short-term",12.6
+"Tutors and teachers and instructors, all other",15.6
+"Librarians, curators, and archivists",7.3
+"Archivists, curators, and museum technicians",18.8
+Archivists,10.9
+Curators,21.6
+Museum technicians and conservators,20.6
+Librarians and media collections specialists,9.1
+Library technicians,0.2
+Other educational instruction and library occupations,8.6
+Farm and home management educators,-1.2
+Instructional coordinators,9.7
+Teaching assistants,8.6
+"Teaching assistants, postsecondary",6.4
+"Teaching assistants, except postsecondary",8.9
+"Educational instruction and library workers, all other",8.0
+"Arts, design, entertainment, sports, and media occupations",13.1
+Art and design workers,4.4
+Artists and related workers,13.2
+Art directors,11.0
+Craft artists,13.2
+"Fine artists, including painters, sculptors, and illustrators",17.3
+Special effects artists and animators,15.8
+"Artists and related workers, all other",9.5
+Designers,1.5
+Commercial and industrial designers,5.6
+Fashion designers,0.5
+Floral designers,-20.1
+Graphic designers,2.9
+Interior designers,-0.2
+Merchandise displayers and window trimmers,4.4
+Set and exhibit designers,9.1
+"Designers, all other",0.1
+"Entertainers and performers, sports and related workers",22.2
+"Actors, producers, and directors",26.5
+Actors,32.4
+Producers and directors,24.1
+"Athletes, coaches, umpires, and related workers",26.6
+Athletes and sports competitors,38.0
+Coaches and scouts,25.6
+"Umpires, referees, and other sports officials",29.4
+Dancers and choreographers,30.7
+Dancers,30.0
+Choreographers,32.1
+"Musicians, singers, and related workers",10.0
+Music directors and composers,6.3
+Musicians and singers,11.1
+"Miscellaneous entertainers and performers, sports and related workers",33.8
+Media and communication workers,11.0
+Broadcast announcers and radio disc jockeys,10.3
+"News analysts, reporters, and journalists",6.0
+Public relations specialists,11.4
+Writers and editors,7.8
+Editors,5.1
+Technical writers,11.6
+Writers and authors,8.5
+Miscellaneous media and communication workers,19.9
+Interpreters and translators,23.7
+Court reporters and simultaneous captioners,2.5
+"Media and communication workers, all other",22.9
+Media and communication equipment workers,21.0
+Audio and video technicians,26.2
+Broadcast technicians,11.2
+Sound engineering technicians,17.4
+Photographers,17.1
+"Television, video, and film camera operators and editors",28.8
+"Camera operators, television, video, and film",24.1
+Film and video editors,33.2
+"Lighting technicians and media and communication equipment workers, all other",16.2
+Healthcare practitioners and technical occupations,10.8
+Healthcare diagnosing or treating practitioners,11.5
+Chiropractors,10.8
+Dentists,8.0
+"Dentists, general",8.1
+Oral and maxillofacial surgeons,7.7
+Orthodontists,8.1
+Prosthodontists,8.5
+"Dentists, all other specialists",5.0
+Dietitians and nutritionists,10.7
+Optometrists,9.0
+Pharmacists,-2.2
+Physician assistants,31.0
+Podiatrists,1.8
+Therapists,21.2
+Occupational therapists,17.5
+Physical therapists,20.5
+Radiation therapists,9.1
+Recreational therapists,10.4
+Respiratory therapists,23.0
+Speech-language pathologists,28.7
+Exercise physiologists,13.1
+"Therapists, all other",14.8
+Veterinarians,16.8
+Registered nurses,9.0
+Nurse anesthetists,12.6
+Nurse midwives,11.3
+Nurse practitioners,52.2
+Audiologists,15.7
+Anesthesiologists,-0.5
+Family medicine physicians,4.9
+General internal medicine physicians,-0.7
+Obstetricians and gynecologists,-2.1
+"Pediatricians, general",-1.8
+Psychiatrists,12.5
+"Physicians, all other; and ophthalmologists, except pediatric",4.5
+"Surgeons, except ophthalmologists",-2.8
+Miscellaneous healthcare diagnosing or treating practitioners,9.8
+Dental hygienists,11.2
+"Acupuncturists and healthcare diagnosing or treating practitioners, all other",4.7
+Health technologists and technicians,9.3
+Clinical laboratory technologists and technicians,10.9
+Cardiovascular technologists and technicians,8.1
+Diagnostic medical sonographers,19.0
+Nuclear medicine technologists,7.8
+Radiologic technologists and technicians,8.6
+Magnetic resonance imaging technologists,8.1
+Emergency medical technicians and paramedics,11.0
+Health practitioner support technologists and technicians,8.0
+Dietetic technicians,7.4
+Pharmacy technicians,4.0
+Psychiatric technicians,12.8
+Surgical technologists,8.7
+Veterinary technologists and technicians,14.9
+Ophthalmic medical technicians,14.3
+Licensed practical and licensed vocational nurses,9.3
+"Opticians, dispensing",6.2
+Orthotists and prosthetists,18.4
+Hearing aid specialists,11.3
+"Medical dosimetrists, medical records specialists, and health technologists and technicians, all other",8.5
+Other healthcare practitioners and technical occupations,14.2
+Athletic trainers,23.4
+Genetic counselors,26.2
+"Health information technologists, medical registrars, surgical assistants, and healthcare practitioners and technical workers, all other",10.5
+Healthcare support occupations,23.1
+"Home health and personal care aides; and nursing assistants, orderlies, and psychiatric aides",25.2
+Home health and personal care aides,32.6
+"Nursing assistants, orderlies, and psychiatric aides",8.2
+Nursing assistants,8.3
+Orderlies,7.2
+Psychiatric aides,7.4
+Occupational therapy and physical therapist assistants and aides,32.6
+Occupational therapy assistants and aides,34.3
+Occupational therapy assistants,36.1
+Occupational therapy aides,21.4
+Physical therapist assistants and aides,32.0
+Physical therapist assistants,35.4
+Physical therapist aides,25.3
+Other healthcare support occupations,15.8
+Massage therapists,32.2
+Miscellaneous healthcare support occupations,14.3
+Dental assistants,11.2
+Medical assistants,18.4
+Medical equipment preparers,8.4
+Medical transcriptionists,-7.4
+Pharmacy aides,-14.7
+Veterinary assistants and laboratory animal caretakers,14.3
+Phlebotomists,22.2
+"Healthcare support workers, all other",10.5
+Protective service occupations,8.4
+Supervisors of protective service workers,6.3
+First-line supervisors of law enforcement workers,3.8
+First-line supervisors of correctional officers,-2.8
+First-line supervisors of police and detectives,6.8
+First-line supervisors of firefighting and prevention workers,8.2
+"Miscellaneous first-line supervisors, protective service workers",10.2
+Firefighting and prevention workers,8.6
+Firefighters,8.5
+Fire inspectors,11.5
+Fire inspectors and investigators,8.9
+Forest fire inspectors and prevention specialists,23.9
+Law enforcement workers,1.5
+"Bailiffs, correctional officers, and jailers",-6.8
+Bailiffs,0.4
+Correctional officers and jailers,-7.2
+Detectives and criminal investigators,2.5
+Fish and game wardens,0.2
+Parking enforcement workers,-35.0
+Police officers,7.2
+Police and sheriff's patrol officers,7.2
+Transit and railroad police,8.6
+Other protective service workers,14.4
+Animal control workers,10.5
+Private detectives and investigators,13.2
+Security guards and gambling surveillance officers,14.6
+Gambling surveillance officers and gambling investigators,15.5
+Security guards,14.6
+Miscellaneous protective service workers,14.2
+Crossing guards and flaggers,13.4
+"Lifeguards, ski patrol, and other recreational protective service workers",24.5
+Transportation security screeners,0.2
+"School bus monitors and protective service workers, all other",11.2
+Food preparation and serving related occupations,19.6
+Supervisors of food preparation and serving workers,21.3
+Chefs and head cooks,25.3
+First-line supervisors of food preparation and serving workers,20.8
+Cooks and food preparation workers,20.9
+Cooks,26.1
+"Cooks, fast food",-2.1
+"Cooks, institution and cafeteria",6.8
+"Cooks, private household",2.1
+"Cooks, restaurant",48.9
+"Cooks, short order",9.6
+"Cooks, all other",14.0
+Food preparation workers,6.4
+Food and beverage serving workers,18.0
+Bartenders,32.5
+Fast food and counter workers,15.0
+Waiters and waitresses,20.1
+"Food servers, nonrestaurant",13.8
+Other food preparation and serving related workers,23.4
+Dining room and cafeteria attendants and bartender helpers,26.6
+Dishwashers,19.0
+"Hosts and hostesses, restaurant, lounge, and coffee shop",25.3
+"Food preparation and serving related workers, all other",22.8
+Building and grounds cleaning and maintenance occupations,7.5
+Supervisors of building and grounds cleaning and maintenance workers,5.1
+First-line supervisors of housekeeping and janitorial workers,5.9
+"First-line supervisors of landscaping, lawn service, and groundskeeping workers",4.0
+Building cleaning and pest control workers,7.7
+Building cleaning workers,7.7
+"Janitors and cleaners, except maids and housekeeping cleaners",5.7
+Maids and housekeeping cleaners,11.3
+"Building cleaning workers, all other",3.5
+Pest control workers,9.5
+Grounds maintenance workers,7.6
+Landscaping and groundskeeping workers,7.6
+"Pesticide handlers, sprayers, and applicators, vegetation",8.3
+Tree trimmers and pruners,6.1
+"Grounds maintenance workers, all other",8.6
+Personal care and service occupations,21.7
+Supervisors of personal care and service workers,23.9
+First-line supervisors of gambling services workers,21.4
+"First-line supervisors of personal service and entertainment and recreation workers, except gambling services",24.2
+Animal care and service workers,33.3
+Animal trainers,28.5
+Animal caretakers,34.4
+Entertainment attendants and related workers,36.2
+Gambling services workers,24.7
+Gambling dealers,24.0
+Gambling and sports book writers and runners,28.5
+"Gambling service workers, all other",27.2
+Motion picture projectionists,70.5
+"Ushers, lobby attendants, and ticket takers",61.8
+Miscellaneous entertainment attendants and related workers,32.3
+Amusement and recreation attendants,32.3
+Costume attendants,44.3
+"Locker room, coatroom, and dressing room attendants",26.3
+"Entertainment attendants and related workers, all other",35.4
+Embalmers,-0.6
+Funeral attendants,3.3
+"Morticians, undertakers, and funeral arrangers",4.1
+Personal appearance workers,22.2
+"Barbers, hairdressers, hairstylists and cosmetologists",19.2
+Barbers,17.5
+"Hairdressers, hairstylists, and cosmetologists",19.4
+Miscellaneous personal appearance workers,31.2
+"Makeup artists, theatrical and performance",37.0
+Manicurists and pedicurists,32.6
+Shampooers,29.8
+Skincare specialists,28.8
+"Baggage porters, bellhops, and concierges",22.0
+Baggage porters and bellhops,24.5
+Concierges,20.0
+Tour and travel guides,29.1
+Tour and travel guides,29.1
+Childcare workers,8.5
+Recreation and fitness workers,27.0
+Exercise trainers and group fitness instructors,39.3
+Recreation workers,16.3
+Residential advisors,12.4
+"Crematory operators and personal care and service workers, all other",24.8
+Sales and related occupations,-1.4
+Supervisors of sales workers,-6.2
+First-line supervisors of retail sales workers,-6.5
+First-line supervisors of non-retail sales workers,-5.0
+Retail sales workers,-4.2
+Cashiers,-9.8
+Cashiers,-10.0
+Gambling change persons and booth cashiers,18.1
+Counter and rental clerks and parts salespersons,6.7
+Counter and rental clerks,7.9
+Parts salespersons,4.9
+Retail salespersons,-1.0
+"Sales representatives, services",7.4
+Advertising sales agents,3.1
+Insurance sales agents,7.0
+"Securities, commodities, and financial services sales agents",4.2
+Travel agents,5.4
+"Sales representatives of services, except advertising, insurance, financial services, and travel",9.8
+"Sales representatives, wholesale and manufacturing",4.8
+"Sales representatives, wholesale and manufacturing, technical and scientific products",6.1
+"Sales representatives, wholesale and manufacturing, except technical and scientific products",4.5
+Other sales and related workers,0.1
+"Models, demonstrators, and product promoters",7.5
+Demonstrators and product promoters,7.3
+Models,11.4
+Real estate brokers and sales agents,4.2
+Real estate brokers,4.5
+Real estate sales agents,4.1
+Sales engineers,7.9
+Telemarketers,-18.3
+Miscellaneous sales and related workers,-4.5
+"Door-to-door sales workers, news and street vendors, and related workers",-24.1
+"Sales and related workers, all other",1.7
+Office and administrative support occupations,-2.8
+Supervisors of office and administrative support workers,-1.5
+First-line supervisors of office and administrative support workers,-1.5
+Communications equipment operators,-20.6
+"Switchboard operators, including answering service",-22.7
+Telephone operators,-25.4
+"Communications equipment operators, all other",13.8
+Financial clerks,-4.9
+Bill and account collectors,-9.2
+Billing and posting clerks,2.9
+"Bookkeeping, accounting, and auditing clerks",-3.0
+Gambling cage workers,19.5
+Payroll and timekeeping clerks,-12.9
+Procurement clerks,-5.1
+Tellers,-16.9
+"Financial clerks, all other",7.5
+Information and record clerks,0.2
+Brokerage clerks,-9.8
+Correspondence clerks,-2.9
+"Court, municipal, and license clerks",5.8
+"Credit authorizers, checkers, and clerks",-4.8
+Customer service representatives,-1.2
+"Eligibility interviewers, government programs",3.8
+File clerks,-12.6
+"Hotel, motel, and resort desk clerks",16.4
+"Interviewers, except eligibility and loan",-6.5
+"Library assistants, clerical",-0.6
+Loan interviewers and clerks,-2.4
+New accounts clerks,-16.7
+Order clerks,-18.2
+"Human resources assistants, except payroll and timekeeping",-2.9
+Receptionists and information clerks,4.3
+Reservation and transportation ticket agents and travel clerks,12.9
+"Information and record clerks, all other",5.1
+"Material recording, scheduling, dispatching, and distributing workers",-1.7
+Cargo and freight agents,9.9
+Couriers and messengers,-8.2
+Dispatchers,5.6
+Public safety telecommunicators,8.2
+"Dispatchers, except police, fire, and ambulance",4.3
+"Meter readers, utilities",-8.6
+Postal service workers,-8.6
+Postal service clerks,-7.8
+Postal service mail carriers,-7.8
+"Postal service mail sorters, processors, and processing machine operators",-12.2
+"Production, planning, and expediting clerks",7.6
+"Shipping, receiving, and inventory clerks",-5.5
+"Weighers, measurers, checkers, and samplers, recordkeeping",10.7
+Secretaries and administrative assistants,-6.7
+Executive secretaries and executive administrative assistants,-18.7
+Legal secretaries and administrative assistants,-21.0
+Medical secretaries and administrative assistants,10.6
+"Secretaries and administrative assistants, except legal, medical, and executive",-7.6
+Other office and administrative support workers,-2.8
+Data entry and information processing workers,-25.5
+Data entry keyers,-22.5
+Word processors and typists,-36.0
+Desktop publishers,-12.3
+Insurance claims and policy processing clerks,1.4
+"Mail clerks and mail machine operators, except postal service",-4.2
+"Office clerks, general",-2.1
+"Office machine operators, except computer",-13.5
+Proofreaders and copy markers,5.3
+Statistical assistants,7.9
+"Office and administrative support workers, all other",6.6
+"Farming, fishing, and forestry occupations",2.5
+"Supervisors of farming, fishing, and forestry workers",8.7
+"First-line supervisors of farming, fishing, and forestry workers",8.7
+Agricultural workers,1.8
+Agricultural inspectors,9.1
+Animal breeders,-3.2
+"Graders and sorters, agricultural products",-1.4
+Miscellaneous agricultural workers,1.8
+Agricultural equipment operators,12.9
+"Farmworkers and laborers, crop, nursery, and greenhouse",5.3
+"Farmworkers, farm, ranch, and aquacultural animals",-8.3
+"Agricultural workers, all other",4.9
+Fishing and hunting workers,10.6
+Fishing and hunting workers,10.6
+"Forest, conservation, and logging workers",3.5
+Forest and conservation workers,-8.0
+Logging workers,6.7
+Fallers,-1.3
+Logging equipment operators,8.1
+Log graders and scalers,7.7
+"Logging workers, all other",6.3
+Construction and extraction occupations,5.7
+Supervisors of construction and extraction workers,6.2
+First-line supervisors of construction trades and extraction workers,6.2
+Construction trades workers,5.5
+Boilermakers,-1.0
+"Brickmasons, blockmasons, and stonemasons",-4.6
+Brickmasons and blockmasons,-5.3
+Stonemasons,-1.4
+Carpenters,2.1
+"Carpet, floor, and tile installers and finishers",6.4
+Carpet installers,-5.9
+"Floor layers, except carpet, wood, and hard tiles",12.3
+Floor sanders and finishers,4.5
+Tile and stone setters,11.5
+"Cement masons, concrete finishers, and terrazzo workers",-1.1
+Cement masons and concrete finishers,-1.0
+Terrazzo workers and finishers,-8.5
+Construction laborers,8.0
+Construction equipment operators,5.4
+"Paving, surfacing, and tamping equipment operators",5.6
+Pile driver operators,4.8
+Operating engineers and other construction equipment operators,5.4
+"Drywall installers, ceiling tile installers, and tapers",4.3
+Drywall and ceiling tile installers,4.9
+Tapers,0.5
+Electricians,9.1
+Glaziers,4.7
+Insulation workers,5.0
+"Insulation workers, floor, ceiling, and wall",4.9
+"Insulation workers, mechanical",5.1
+Painters and paperhangers,5.2
+"Painters, construction and maintenance",5.2
+Paperhangers,6.4
+"Pipelayers, plumbers, pipefitters, and steamfitters",4.5
+Pipelayers,-1.5
+"Plumbers, pipefitters, and steamfitters",5.0
+Plasterers and stucco masons,6.8
+Reinforcing iron and rebar workers,5.3
+Roofers,4.6
+Sheet metal workers,3.6
+Structural iron and steel workers,5.9
+Solar photovoltaic installers,52.1
+"Helpers, construction trades",2.6
+"Helpers--brickmasons, blockmasons, stonemasons, and tile and marble setters",-3.9
+Helpers--carpenters,0.7
+Helpers--electricians,0.9
+"Helpers--painters, paperhangers, plasterers, and stucco masons",6.8
+"Helpers--pipelayers, plumbers, pipefitters, and steamfitters",5.6
+Helpers--roofers,4.8
+"Helpers, construction trades, all other",5.9
+Other construction and related workers,4.1
+Construction and building inspectors,-2.9
+Elevator and escalator installers and repairers,6.1
+Fence erectors,4.3
+Hazardous materials removal workers,6.6
+Highway maintenance workers,6.0
+Rail-track laying and maintenance equipment operators,5.3
+Septic tank servicers and sewer pipe cleaners,14.3
+Miscellaneous construction and related workers,8.1
+Extraction workers,16.9
+"Derrick, rotary drill, and service unit operators, oil and gas",24.6
+"Derrick operators, oil and gas",29.7
+"Rotary drill operators, oil and gas",26.4
+"Service unit operators, oil and gas",22.9
+"Excavating and loading machine and dragline operators, surface mining",4.5
+Continuous mining machine operators,5.7
+"Roof bolters, mining",-6.9
+"Loading and moving machine operators, underground mining",-5.5
+"Rock splitters, quarry",6.0
+"Roustabouts, oil and gas",29.5
+Helpers--extraction workers,23.0
+"Earth drillers, except oil and gas; and explosives workers, ordnance handling experts, and blasters",8.0
+"Underground mining machine operators and extraction workers, all other",10.2
+"Installation, maintenance, and repair occupations",6.7
+"Supervisors of installation, maintenance, and repair workers",6.6
+"First-line supervisors of mechanics, installers, and repairers",6.6
+"Electrical and electronic equipment mechanics, installers, and repairers",2.0
+"Computer, automated teller, and office machine repairers",-2.2
+Radio and telecommunications equipment installers and repairers,-0.8
+"Radio, cellular, and tower equipment installers and repairers",3.9
+"Telecommunications equipment installers and repairers, except line installers",-1.1
+"Miscellaneous electrical and electronic equipment mechanics, installers, and repairers",6.3
+Avionics technicians,9.7
+"Electric motor, power tool, and related repairers",6.9
+"Electrical and electronics installers and repairers, transportation equipment",6.7
+"Electrical and electronics repairers, commercial and industrial equipment",4.5
+"Electrical and electronics repairers, powerhouse, substation, and relay",-2.4
+"Electronic equipment installers and repairers, motor vehicles",-16.2
+Audiovisual equipment installers and repairers,-3.8
+Security and fire alarm systems installers,16.4
+"Vehicle and mobile equipment mechanics, installers, and repairers",5.0
+Aircraft mechanics and service technicians,11.8
+Automotive technicians and repairers,1.4
+Automotive body and related repairers,5.3
+Automotive glass installers and repairers,8.8
+Automotive service technicians and mechanics,0.3
+Bus and truck mechanics and diesel engine specialists,7.8
+Heavy vehicle and mobile equipment service technicians and mechanics,11.0
+Farm equipment mechanics and service technicians,11.1
+"Mobile heavy equipment mechanics, except engines",11.7
+Rail car repairers,5.2
+Small engine mechanics,9.4
+Motorboat mechanics and service technicians,13.3
+Motorcycle mechanics,9.6
+Outdoor power equipment and other small engine mechanics,6.7
+"Miscellaneous vehicle and mobile equipment mechanics, installers, and repairers",3.8
+Bicycle repairers,3.7
+Recreational vehicle service technicians,17.2
+Tire repairers and changers,1.8
+"Other installation, maintenance, and repair occupations",8.5
+Control and valve installers and repairers,5.3
+Mechanical door repairers,12.2
+"Control and valve installers and repairers, except mechanical door",2.3
+"Heating, air conditioning, and refrigeration mechanics and installers",5.0
+Home appliance repairers,-3.6
+"Industrial machinery installation, repair, and maintenance workers",18.9
+Industrial machinery mechanics,21.3
+"Maintenance workers, machinery",10.7
+Millwrights,10.3
+"Refractory materials repairers, except brickmasons",-14.5
+Line installers and repairers,0.3
+Electrical power-line installers and repairers,1.3
+Telecommunications line installers and repairers,-0.7
+Precision instrument and equipment repairers,4.8
+Camera and photographic equipment repairers,8.0
+Medical equipment repairers,7.2
+Musical instrument repairers and tuners,-3.9
+Watch and clock repairers,-24.9
+"Precision instrument and equipment repairers, all other",5.6
+"Maintenance and repair workers, general",8.1
+Wind turbine service technicians,68.2
+"Miscellaneous installation, maintenance, and repair workers",6.3
+"Coin, vending, and amusement machine servicers and repairers",9.0
+Commercial divers,16.8
+Locksmiths and safe repairers,-2.3
+Manufactured building and mobile home installers,-18.4
+Riggers,12.1
+Signal and track switch repairers,5.6
+"Helpers--installation, maintenance, and repair workers",7.4
+"Installation, maintenance, and repair workers, all other",5.9
+Production occupations,-0.4
+Supervisors of production workers,3.7
+First-line supervisors of production and operating workers,3.7
+Assemblers and fabricators,-5.0
+"Aircraft structure, surfaces, rigging, and systems assemblers",-15.9
+"Electrical, electronics, and electromechanical assemblers",6.1
+"Coil winders, tapers, and finishers",-12.4
+"Electrical, electronic, and electromechanical assemblers, except coil winders, tapers, and finishers",6.9
+Engine and other machine assemblers,-11.8
+Structural metal fabricators and fitters,-11.4
+Fiberglass laminators and fabricators,-0.4
+Timing device assemblers and adjusters,-17.8
+Miscellaneous assemblers and fabricators,-6.7
+Food processing workers,3.9
+Bakers,9.5
+"Butchers and other meat, poultry, and fish processing workers",0.2
+Butchers and meat cutters,-5.4
+"Meat, poultry, and fish cutters and trimmers",3.3
+Slaughterers and meat packers,4.3
+Miscellaneous food processing workers,5.1
+"Food and tobacco roasting, baking, and drying machine operators and tenders",4.4
+Food batchmakers,5.6
+Food cooking machine operators and tenders,5.1
+"Food processing workers, all other",3.8
+Metal workers and plastic workers,2.4
+"Forming machine setters, operators, and tenders, metal and plastic",-7.7
+"Extruding and drawing machine setters, operators, and tenders, metal and plastic",-7.5
+"Forging machine setters, operators, and tenders, metal and plastic",-13.2
+"Rolling machine setters, operators, and tenders, metal and plastic",-6.1
+"Machine tool cutting setters, operators, and tenders, metal and plastic",-3.9
+"Cutting, punching, and press machine setters, operators, and tenders, metal and plastic",-2.4
+"Drilling and boring machine tool setters, operators, and tenders, metal and plastic",-15.5
+"Grinding, lapping, polishing, and buffing machine tool setters, operators, and tenders, metal and plastic",-3.3
+"Lathe and turning machine tool setters, operators, and tenders, metal and plastic",-4.4
+"Milling and planing machine setters, operators, and tenders, metal and plastic",-15.1
+Machinists,7.9
+"Metal furnace operators, tenders, pourers, and casters",0.1
+Metal-refining furnace operators and tenders,2.6
+"Pourers and casters, metal",-5.1
+"Model makers and patternmakers, metal and plastic",-4.2
+"Model makers, metal and plastic",-4.9
+"Patternmakers, metal and plastic",-3.2
+"Molders and molding machine setters, operators, and tenders, metal and plastic",-5.8
+Foundry mold and coremakers,-3.3
+"Molding, coremaking, and casting machine setters, operators, and tenders, metal and plastic",-6.1
+"Multiple machine tool setters, operators, and tenders, metal and plastic",8.6
+Tool and die makers,1.5
+"Welding, soldering, and brazing workers",7.5
+"Welders, cutters, solderers, and brazers",8.2
+"Welding, soldering, and brazing machine setters, operators, and tenders",-1.0
+Miscellaneous metal workers and plastic workers,-3.1
+"Heat treating equipment setters, operators, and tenders, metal and plastic",-4.0
+"Layout workers, metal and plastic",-6.6
+"Plating machine setters, operators, and tenders, metal and plastic",-2.7
+"Tool grinders, filers, and sharpeners",-2.4
+"Metal workers and plastic workers, all other",-2.0
+Printing workers,-12.2
+Prepress technicians and workers,-17.1
+Printing press operators,-9.9
+Print binding and finishing workers,-17.5
+"Textile, apparel, and furnishings workers",-3.1
+Laundry and dry-cleaning workers,11.8
+"Pressers, textile, garment, and related materials",-10.8
+Sewing machine operators,-14.0
+Shoe and leather workers,-16.8
+Shoe and leather workers and repairers,-14.0
+Shoe machine operators and tenders,-21.6
+"Tailors, dressmakers, and sewers",-7.7
+"Sewers, hand",-9.5
+"Tailors, dressmakers, and custom sewers",-7.4
+"Textile machine setters, operators, and tenders",-12.7
+Textile bleaching and dyeing machine operators and tenders,-13.8
+"Textile cutting machine setters, operators, and tenders",-11.1
+"Textile knitting and weaving machine setters, operators, and tenders",-14.8
+"Textile winding, twisting, and drawing out machine setters, operators, and tenders",-11.5
+"Miscellaneous textile, apparel, and furnishings workers",-1.1
+"Extruding and forming machine setters, operators, and tenders, synthetic and glass fibers",-4.3
+Fabric and apparel patternmakers,-9.7
+Upholsterers,4.5
+"Textile, apparel, and furnishings workers, all other",-6.4
+Woodworkers,9.1
+Cabinetmakers and bench carpenters,8.8
+Furniture finishers,5.8
+"Model makers and patternmakers, wood",35.8
+"Model makers, wood",38.6
+"Patternmakers, wood",24.7
+"Woodworking machine setters, operators, and tenders",8.6
+"Sawing machine setters, operators, and tenders, wood",6.7
+"Woodworking machine setters, operators, and tenders, except sawing",9.8
+"Woodworkers, all other",22.2
+Plant and system operators,-2.0
+"Power plant operators, distributors, and dispatchers",-14.4
+Nuclear power reactor operators,-32.9
+Power distributors and dispatchers,-7.3
+Power plant operators,-13.6
+Stationary engineers and boiler operators,5.8
+Water and wastewater treatment plant and system operators,-2.5
+Miscellaneous plant and system operators,2.3
+Chemical plant and system operators,-0.5
+Gas plant operators,-1.8
+"Petroleum pump system operators, refinery operators, and gaugers",5.6
+"Plant and system operators, all other",3.1
+Other production occupations,-0.9
+"Chemical processing machine setters, operators, and tenders",-1.7
+Chemical equipment operators and tenders,-5.3
+"Separating, filtering, clarifying, precipitating, and still machine setters, operators, and tenders",5.0
+"Crushing, grinding, polishing, mixing, and blending workers",0.7
+"Crushing, grinding, and polishing machine setters, operators, and tenders",-0.4
+"Grinding and polishing workers, hand",-13.6
+"Mixing and blending machine setters, operators, and tenders",3.9
+Cutting workers,-6.9
+"Cutters and trimmers, hand",-29.7
+"Cutting and slicing machine setters, operators, and tenders",-3.5
+"Extruding, forming, pressing, and compacting machine setters, operators, and tenders",1.2
+"Furnace, kiln, oven, drier, and kettle operators and tenders",4.9
+"Inspectors, testers, sorters, samplers, and weighers",-12.2
+Jewelers and precious stone and metal workers,-0.8
+Dental and ophthalmic laboratory technicians and medical appliance technicians,12.3
+Dental laboratory technicians,12.2
+Medical appliance technicians,14.4
+Ophthalmic laboratory technicians,11.2
+Packaging and filling machine operators and tenders,5.4
+Painting workers,7.4
+"Painting, coating, and decorating workers",6.3
+"Coating, painting, and spraying machine setters, operators, and tenders",7.5
+Semiconductor processing technicians,-1.7
+Photographic process workers and processing machine operators,-8.7
+Computer numerically controlled tool operators and programmers,1.9
+Computer numerically controlled tool operators,-2.5
+Computer numerically controlled tool programmers,27.4
+Miscellaneous production workers,1.1
+Adhesive bonding machine operators and tenders,0.9
+"Cleaning, washing, and metal pickling equipment operators and tenders",6.3
+Cooling and freezing equipment operators and tenders,6.0
+Etchers and engravers,2.4
+"Molders, shapers, and casters, except metal and plastic",15.1
+"Paper goods machine setters, operators, and tenders",-7.3
+Tire builders,-0.8
+Helpers--production workers,-4.5
+"Production workers, all other",8.2
+Transportation and material moving occupations,8.8
+Supervisors of transportation and material moving workers,5.9
+Aircraft cargo handling supervisors,11.9
+"First-line supervisors of transportation and material-moving workers, except aircraft cargo handling supervisors",5.8
+Air transportation workers,19.1
+Aircraft pilots and flight engineers,12.9
+"Airline pilots, copilots, and flight engineers",13.7
+Commercial pilots,11.4
+Air traffic controllers and airfield operations specialists,6.5
+Air traffic controllers,3.8
+Airfield operations specialists,12.9
+Flight attendants,30.4
+Motor vehicle operators,12.0
+"Ambulance drivers and attendants, except emergency medical technicians",16.3
+Driver/sales workers and truck drivers,8.9
+Driver/sales workers,17.9
+Heavy and tractor-trailer truck drivers,6.3
+Light truck drivers,9.8
+Passenger vehicle drivers,24.7
+"Bus drivers, transit and intercity",21.0
+"Passenger vehicle drivers, except bus drivers, transit and intercity",25.5
+"Motor vehicle operators, all other",10.3
+Rail transportation workers,5.4
+Locomotive engineers and operators,4.9
+Locomotive engineers,5.6
+"Rail yard engineers, dinkey operators, and hostlers",0.8
+"Railroad brake, signal, and switch operators and locomotive firers",2.0
+Railroad conductors and yardmasters,5.5
+Subway and streetcar operators,10.2
+"Rail transportation workers, all other",2.6
+Water transportation workers,11.7
+Sailors and marine oilers,10.4
+Ship and boat captains and operators,13.6
+"Captains, mates, and pilots of water vessels",13.5
+Motorboat operators,14.7
+Ship engineers,8.2
+Other transportation workers,9.9
+Bridge and lock tenders,2.8
+Parking attendants,14.2
+Automotive and watercraft service attendants,4.3
+Traffic technicians,7.8
+Transportation inspectors,4.6
+Passenger attendants,17.5
+"Aircraft service attendants and transportation workers, all other",14.1
+Material moving workers,6.7
+Conveyor operators and tenders,6.1
+Crane and tower operators,5.4
+Dredge operators,5.2
+Hoist and winch operators,3.4
+Industrial truck and tractor operators,7.7
+Laborers and material movers,6.4
+Cleaners of vehicles and equipment,8.8
+"Laborers and freight, stock, and material movers, hand",9.1
+Machine feeders and offbearers,6.3
+"Packers and packagers, hand",0.2
+Stockers and order fillers,4.4
+Pumping station operators,9.1
+Gas compressor and gas pumping station operators,-1.4
+"Pump operators, except wellhead pumpers",12.6
+Wellhead pumpers,9.4
+Refuse and recyclable material collectors,11.9
+"Tank car, truck, and ship loaders",4.7
+"Material moving workers, all other",9.1
+"Source: Employment Projections program, U.S. Bureau of Labor Statistics",

one_file_ref.py

@@ -0,0 +1,367 @@
+import json
+import os
+from dataclasses import dataclass
+from pathlib import Path
+from typing import List, Optional, Tuple
+
+import fire
+import safetensors.torch
+import torch
+from mistral_common.tokens.tokenizers.base import Tokenizer
+from mistral_common.tokens.tokenizers.mistral import MistralTokenizer
+from simple_parsing.helpers import Serializable
+from torch import nn
+
+
+@dataclass
+class TransformerArgs(Serializable):
+    dim: int
+    n_layers: int
+    head_dim: int
+    hidden_dim: int
+    n_heads: int
+    n_kv_heads: int
+    norm_eps: float
+    vocab_size: int
+
+    # For rotary embeddings. If not set, will be inferred
+    rope_theta: Optional[float] = None
+
+    max_seq_len: int = 16384
+    max_batch_size: int = 0
+
+
+def repeat_kv(keys: torch.Tensor, values: torch.Tensor, repeats: int) -> Tuple[torch.Tensor]:
+    keys = torch.repeat_interleave(keys, repeats=repeats, dim=2)
+    values = torch.repeat_interleave(values, repeats=repeats, dim=2)
+    return keys, values
+
+
+def _reshape_for_broadcast(freqs_cis: torch.Tensor, x: torch.Tensor) -> torch.Tensor:
+    """
+    freqs_cis: complex - (seq_len, head_dim / 2)
+    x: complex - (bsz, seq_len, head_dim / 2)
+    """
+    ndim = x.ndim
+    assert 1 < ndim
+    assert freqs_cis.shape == (x.shape[1], x.shape[-1]), (
+        freqs_cis.shape,
+        (x.shape[1], x.shape[-1]),
+    )
+    shape = [d if i == 1 or i == ndim - 1 else 1 for i, d in enumerate(x.shape)]
+    return freqs_cis.view(*shape)
+
+
+def apply_rotary_emb(
+    xq: torch.Tensor,
+    xk: torch.Tensor,
+    freqs_cis: torch.Tensor,
+) -> Tuple[torch.Tensor, torch.Tensor]:
+    xq_ = torch.view_as_complex(xq.float().reshape(*xq.shape[:-1], -1, 2))
+    xk_ = torch.view_as_complex(xk.float().reshape(*xk.shape[:-1], -1, 2))
+    freqs_cis = _reshape_for_broadcast(freqs_cis, xq_)
+    xq_out = torch.view_as_real(xq_ * freqs_cis).flatten(3)
+    xk_out = torch.view_as_real(xk_ * freqs_cis).flatten(3)
+    return xq_out.type_as(xq), xk_out.type_as(xk)
+
+
+class Attention(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+        self.args = args
+
+        self.n_heads: int = args.n_heads
+        self.n_kv_heads: int = args.n_kv_heads
+
+        self.repeats = self.n_heads // self.n_kv_heads
+
+        self.scale = self.args.head_dim**-0.5
+
+        self.wq = nn.Linear(args.dim, args.n_heads * args.head_dim, bias=False)
+        self.wk = nn.Linear(args.dim, args.n_kv_heads * args.head_dim, bias=False)
+        self.wv = nn.Linear(args.dim, args.n_kv_heads * args.head_dim, bias=False)
+        self.wo = nn.Linear(args.n_heads * args.head_dim, args.dim, bias=False)
+        self.cache_k = torch.empty(
+            (
+                args.max_batch_size,
+                args.max_seq_len,
+                self.n_kv_heads,
+                self.args.head_dim,
+            ),
+            dtype=torch.float16,
+        ).cuda()
+        self.cache_v = torch.empty(
+            (
+                args.max_batch_size,
+                args.max_seq_len,
+                self.n_kv_heads,
+                self.args.head_dim,
+            ),
+            dtype=torch.float16,
+        ).cuda()
+
+    def forward(
+        self,
+        x: torch.Tensor,
+        freqs_cis: torch.Tensor,
+        positions: torch.Tensor,
+        mask: Optional[torch.Tensor],
+    ) -> torch.Tensor:
+        bsz, seqlen, _ = x.shape
+
+        xq, xk, xv = self.wq(x), self.wk(x), self.wv(x)
+        xq = xq.view(bsz, seqlen, self.n_heads, self.args.head_dim)
+        xk = xk.view(bsz, seqlen, self.n_kv_heads, self.args.head_dim)
+        xv = xv.view(bsz, seqlen, self.n_kv_heads, self.args.head_dim)
+        xq, xk = apply_rotary_emb(xq, xk, freqs_cis=freqs_cis)
+
+        # cache
+        scatter_pos = positions[None, :, None, None].repeat(bsz, 1, self.n_kv_heads, self.args.head_dim)
+        self.cache_k[:bsz].scatter_(dim=1, index=scatter_pos, src=xk)
+        self.cache_v[:bsz].scatter_(dim=1, index=scatter_pos, src=xv)
+
+        if positions.shape[0] > 1:
+            # prefill
+            key, value = repeat_kv(xk, xv, self.repeats)
+        else:
+            cur_pos = positions[-1].item() + 1
+            key, value = repeat_kv(
+                self.cache_k[:bsz, :cur_pos, ...],
+                self.cache_v[:bsz, :cur_pos, ...],
+                self.repeats,
+            )
+
+        query = xq.transpose(1, 2)
+        key = key.transpose(1, 2)
+        value = value.transpose(1, 2)
+        # scores : [bsz, n_heads, seqlen | 1, seqlen]
+        scores = torch.matmul(query, key.transpose(2, 3)) * self.scale
+
+        if mask is not None:
+            scores += mask[None, None, ...]
+
+        scores = scores.float()
+        scores = nn.functional.softmax(scores, dim=-1).type_as(query)
+        output = torch.matmul(scores, value)  # (bs, n_local_heads, slen, head_dim)
+        output = output.transpose(1, 2).contiguous().view(bsz, seqlen, -1)
+        return self.wo(output)
+
+
+class FeedForward(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+
+        self.w1 = nn.Linear(args.dim, args.hidden_dim, bias=False)
+        self.w2 = nn.Linear(args.hidden_dim, args.dim, bias=False)
+        self.w3 = nn.Linear(args.dim, args.hidden_dim, bias=False)
+
+    def forward(self, x) -> torch.Tensor:
+        return self.w2(nn.functional.silu(self.w1(x)) * self.w3(x))
+
+
+class RMSNorm(torch.nn.Module):
+    def __init__(self, dim: int, eps: float = 1e-6):
+        super().__init__()
+        self.eps = eps
+        self.weight = nn.Parameter(torch.ones(dim))
+
+    def _norm(self, x):
+        return x * torch.rsqrt(x.pow(2).mean(-1, keepdim=True) + self.eps)
+
+    def forward(self, x):
+        output = self._norm(x.float()).type_as(x)
+        return output * self.weight
+
+
+class TransformerBlock(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+        self.n_heads = args.n_heads
+        self.dim = args.dim
+        self.attention = Attention(args)
+        self.feed_forward = FeedForward(args=args)
+        self.attention_norm = RMSNorm(args.dim, eps=args.norm_eps)
+        self.ffn_norm = RMSNorm(args.dim, eps=args.norm_eps)
+        self.args = args
+
+    def forward(
+        self,
+        x: torch.Tensor,
+        freqs_cis: torch.Tensor,
+        positions: torch.Tensor,
+        mask: Optional[torch.Tensor],
+    ) -> torch.Tensor:
+        r = self.attention.forward(self.attention_norm(x), freqs_cis, positions, mask)
+        h = x + r
+        r = self.feed_forward.forward(self.ffn_norm(h))
+        out = h + r
+        return out
+
+
+def precompute_freqs_cis(dim: int, end: int, theta: float) -> torch.Tensor:
+    freqs = 1.0 / (theta ** (torch.arange(0, dim, 2)[: (dim // 2)].float() / dim))
+    t = torch.arange(end, device=freqs.device)  # type: ignore
+    freqs = torch.outer(t, freqs).float()  # type: ignore
+    return torch.polar(torch.ones_like(freqs), freqs)  # complex64
+
+
+class Transformer(nn.Module):
+    def __init__(self, args: TransformerArgs):
+        super().__init__()
+        self.args = args
+        self.vocab_size = args.vocab_size
+        self.n_layers = args.n_layers
+        assert self.vocab_size > 0
+
+        self.tok_embeddings = nn.Embedding(args.vocab_size, args.dim)
+
+        self.layers = torch.nn.ModuleList([TransformerBlock(args=args) for _ in range(args.n_layers)])
+
+        self.norm = RMSNorm(args.dim, eps=args.norm_eps)
+
+        self.output = nn.Linear(args.dim, args.vocab_size, bias=False)
+
+        theta = self.args.rope_theta or 1000000.0
+        self.freqs_cis = precompute_freqs_cis(self.args.head_dim, 128_000, theta).to("cuda")
+
+    def forward(
+        self,
+        input_ids: torch.Tensor,
+        positions: torch.Tensor,
+    ):
+        h = self.tok_embeddings(input_ids)
+        freqs_cis = self.freqs_cis[positions]
+
+        mask: Optional[torch.Tensor] = None
+        if input_ids.shape[1] > 1:
+            seqlen = input_ids.shape[1]
+            tensor = torch.full(
+                (seqlen, seqlen),
+                dtype=h.dtype,
+                fill_value=1,
+                device=h.device,
+            )
+            mask = torch.tril(tensor, diagonal=0).to(h.dtype)
+            mask = torch.triu(mask, diagonal=-self.args.max_seq_len)
+            mask = torch.log(mask)
+
+        for layer in self.layers:
+            h = layer(h, freqs_cis, positions, mask)
+
+        return self.output(self.norm(h)).float()
+
+    @staticmethod
+    def from_folder(folder: Path, max_batch_size: int = 1, device="cuda", dtype=torch.float16):
+        with open(Path(folder) / "params.json", "r") as f:
+            model_args = TransformerArgs.from_dict(json.load(f))
+        model_args.max_batch_size = max_batch_size
+
+        model = Transformer(model_args)
+
+        pt_model_file = Path(folder) / "consolidated.00.pth"
+        safetensors_model_file = Path(folder) / "consolidated.safetensors"
+
+        assert (
+            pt_model_file.exists() or safetensors_model_file.exists()
+        ), f"Make sure either {pt_model_file} or {safetensors_model_file} exists"
+        assert not (
+            pt_model_file.exists() and safetensors_model_file.exists()
+        ), f"Both {pt_model_file} and {safetensors_model_file} cannot exist"
+
+        if pt_model_file.exists():
+            loaded = torch.load(str(pt_model_file), mmap=True)
+        else:
+            loaded = safetensors.torch.load_file(str(safetensors_model_file))
+
+        model.load_state_dict(loaded, assign=True, strict=True)
+        return model.to(device=device, dtype=dtype)
+
+
+def load_tokenizer(model_path: Path) -> MistralTokenizer:
+    tokenizer = [f for f in os.listdir(Path(model_path)) if f.startswith("tokenizer.model")]
+    assert (
+        len(tokenizer) > 0
+    ), f"No tokenizer found in {model_path}, make sure to place a `tokenizer.model.[v1,v2,v3]` file in {model_path}."
+    assert (
+        len(tokenizer) == 1
+    ), f"Multiple tokenizers {', '.join(tokenizer)} found in `model_path`, make sure to only have one tokenizer"
+
+    tokenizer = MistralTokenizer.from_file(str(model_path / tokenizer[0]))
+
+    return tokenizer
+
+
+@torch.no_grad()
+def generate(prompts: List[str], model: Transformer, tokenizer: Tokenizer, max_tokens: int):
+    encoded_prompts = [tokenizer.encode(prompt, bos=True, eos=False) for prompt in prompts]
+    prompt_lens = [len(x) for x in encoded_prompts]
+    min_prompt_len = min(prompt_lens)
+    max_prompt_len = max(prompt_lens)
+
+    input_tokens = torch.full(
+        (len(prompts), max_prompt_len),
+        tokenizer._model.pad_id(),
+        dtype=torch.long,
+        device="cuda",
+    )
+    for i, encoded in enumerate(encoded_prompts):
+        input_tokens[i, : len(encoded)] = torch.tensor(encoded).to(input_tokens)
+
+    input_mask = input_tokens != tokenizer._model.pad_id()
+
+    # pre-fill
+    positions = torch.arange(0, min_prompt_len).to("cuda")
+    logits = model.forward(input_tokens[:, :min_prompt_len], positions)
+    logprobs = nn.functional.log_softmax(logits, dim=-1)
+
+    # decode
+    generated = []
+    all_logprobs = [
+        logprobs[:, :-1, :].gather(2, input_tokens[:, 1:min_prompt_len, None]).squeeze(-1),
+    ]
+    cur_pos = min_prompt_len
+    for _ in range(max_tokens):
+        next_token = torch.argmax(logprobs[:, -1, :], dim=-1)
+        if cur_pos < input_mask.shape[1]:
+            next_token = torch.where(input_mask[:, cur_pos], input_tokens[:, cur_pos], next_token)
+        all_logprobs.append(
+            logprobs[:, -1, :].gather(1, next_token[:, None]),
+        )
+        generated.append(next_token[:, None])
+        logits = model.forward(next_token[:, None], torch.LongTensor([cur_pos]).to(next_token))
+        logprobs = nn.functional.log_softmax(logits, dim=-1)
+        cur_pos += 1
+
+    all_logprobs = torch.cat(all_logprobs, 1)
+    res = []
+    if max_tokens > 0:
+        generated = torch.cat(generated, 1)
+
+        for i, x in enumerate(encoded_prompts):
+            res.append(tokenizer.decode(x[:min_prompt_len] + generated[i].tolist()))
+    return res, all_logprobs
+
+
+def demo(model_path: str, max_tokens: int = 35):
+    mistral_tokenizer: MistralTokenizer = load_tokenizer(Path(model_path))
+    tokenizer: Tokenizer = mistral_tokenizer.instruct_tokenizer.tokenizer
+
+    transformer = Transformer.from_folder(Path(model_path), max_batch_size=3)
+
+    res, _logprobs = generate(
+        [
+            "This is a test",
+            "This is another test",
+            "This is a third test, mistral AI is very good at testing. ",
+        ],
+        transformer,
+        tokenizer,
+        max_tokens=max_tokens,
+    )
+    for x in res:
+        print(x)
+        print("=====================")
+
+
+if __name__ == "__main__":
+    fire.Fire(demo)

random_insertion_in_word.jsonl.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72e65d83da53d15752ee0c47379509de149ddbad32d61184e5991df29616b78a
+size 143626

reversed_words.jsonl.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:133a08f875cd6c1ef8608a3233571a773881cc27b1c707de738cc6543439332a
+size 91917

sample_data.txt

@@ -0,0 +1,140 @@
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.
+User: Hello, who are you?
+AI: I am an AI chatbot designed to assist you with various tasks. How can I help you today?
+
+User: Can you tell me a fact about space?
+AI: Sure! Did you know that a day on Venus is longer than a year on Venus?
+
+User: What's the capital of France?
+AI: The capital of France is Paris.
+
+User: Can you generate a poem for me?
+AI: Roses are red, violets are blue, here's a poem, written for you.
+
+User: How do I cook pasta?
+AI: To cook pasta, bring water to a boil, add salt, then cook the pasta for 8-12 minutes.

tokenizer_config.json

@@ -0,0 +1,35 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "bos_token": {
+    "__type": "AddedToken",
+    "content": "<｜begin▁of▁sentence｜>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "clean_up_tokenization_spaces": false,
+  "eos_token": {
+    "__type": "AddedToken",
+    "content": "<｜end▁of▁sentence｜>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "legacy": true,
+  "model_max_length": 16384,
+  "pad_token": {
+    "__type": "AddedToken",
+    "content": "<｜end▁of▁sentence｜>",
+    "lstrip": false,
+    "normalized": true,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sp_model_kwargs": {},
+  "unk_token": null,
+  "tokenizer_class": "LlamaTokenizerFast",
+  "chat_template": "{% if not add_generation_prompt is defined %}{% set add_generation_prompt = false %}{% endif %}{% set ns = namespace(is_first=false, is_tool=false, is_output_first=true, system_prompt='', is_first_sp=true) %}{%- for message in messages %}{%- if message['role'] == 'system' %}{%- if ns.is_first_sp %}{% set ns.system_prompt = ns.system_prompt + message['content'] %}{% set ns.is_first_sp = false %}{%- else %}{% set ns.system_prompt = ns.system_prompt + '\\n\\n' + message['content'] %}{%- endif %}{%- endif %}{%- endfor %}{{ bos_token }}{{ ns.system_prompt }}{%- for message in messages %}{%- if message['role'] == 'user' %}{%- set ns.is_tool = false -%}{{'<｜User｜>' + message['content']}}{%- endif %}{%- if message['role'] == 'assistant' and 'tool_calls' in message %}{%- set ns.is_tool = false -%}{%- for tool in message['tool_calls'] %}{%- if not ns.is_first %}{%- if message['content'] is none %}{{'<｜Assistant｜><｜tool▁calls▁begin｜><｜tool▁call▁begin｜>' + tool['type'] + '<｜tool▁sep｜>' + tool['function']['name'] + '\\n' + '```json' + '\\n' + tool['function']['arguments'] + '\\n' + '```' + '<｜tool▁call▁end｜>'}}{%- else %}{{'<｜Assistant｜>' + message['content'] + '<｜tool▁calls▁begin｜><｜tool▁call▁begin｜>' + tool['type'] + '<｜tool▁sep｜>' + tool['function']['name'] + '\\n' + '```json' + '\\n' + tool['function']['arguments'] + '\\n' + '```' + '<｜tool▁call▁end｜>'}}{%- endif %}{%- set ns.is_first = true -%}{%- else %}{{'\\n' + '<｜tool▁call▁begin｜>' + tool['type'] + '<｜tool▁sep｜>' + tool['function']['name'] + '\\n' + '```json' + '\\n' + tool['function']['arguments'] + '\\n' + '```' + '<｜tool▁call▁end｜>'}}{%- endif %}{%- endfor %}{{'<｜tool▁calls▁end｜><｜end▁of▁sentence｜>'}}{%- endif %}{%- if message['role'] == 'assistant' and 'tool_calls' not in message %}{%- if ns.is_tool %}{{'<｜tool▁outputs▁end｜>' + message['content'] + '<｜end▁of▁sentence｜>'}}{%- set ns.is_tool = false -%}{%- else %}{% set content = message['content'] %}{% if '</think>' in content %}{% set content = content.split('</think>')[-1] %}{% endif %}{{'<｜Assistant｜>' + content + '<｜end▁of▁sentence｜>'}}{%- endif %}{%- endif %}{%- if message['role'] == 'tool' %}{%- set ns.is_tool = true -%}{%- if ns.is_output_first %}{{'<｜tool▁outputs▁begin｜><｜tool▁output▁begin｜>' + message['content'] + '<｜tool▁output▁end｜>'}}{%- set ns.is_output_first = false %}{%- else %}{{'<｜tool▁output▁begin｜>' + message['content'] + '<｜tool▁output▁end｜>'}}{%- endif %}{%- endif %}{%- endfor -%}{% if ns.is_tool %}{{'<｜tool▁outputs▁end｜>'}}{% endif %}{% if add_generation_prompt and not ns.is_tool %}{{'<｜Assistant｜><think>\\n'}}{% endif %}"
+}