wasiuddina commited on
Commit
24e3e00
·
verified ·
1 Parent(s): cd6aa96

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -5
README.md CHANGED
@@ -109,7 +109,7 @@ print(pipeline([{"role": "user", "content": "Solve x*(sin(x)+2)=0"}]))
109
 
110
  ## Training Datasets
111
 
112
- This model is trained using [OpenCodeReasoning](https://huggingface.co/datasets/nvidia/OpenCodeReasoning) dataset.
113
 
114
  **Data Collection for Training Datasets:**
115
 
@@ -136,10 +136,9 @@ Data Labeling for Evaluation Datasets:
136
 
137
  ### LiveCodeBench (20240801-20250201)
138
 
139
- | Models | Pass@1 |
140
- |:--------------|:------------|
141
- | R1-Distill-Qwen-7B | 37.6 |
142
- | OpenCodeReasoning-7B | 51.3 |
143
 
144
  User Prompt Template (without starter code):
145
 
@@ -167,6 +166,13 @@ You will use the following starter code to write the solution to the problem and
167
  ```
168
  ````
169
 
 
 
 
 
 
 
 
170
  ## Ethical Considerations:
171
 
172
  NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
 
109
 
110
  ## Training Datasets
111
 
112
+ The training corpus for OpenCodeReasoning-7B is [OpenCodeReasoning](https://huggingface.co/datasets/nvidia/OpenCodeReasoning) dataset, which is composed of competitive programming questions and DeepSeek-R1 generated responses.
113
 
114
  **Data Collection for Training Datasets:**
115
 
 
136
 
137
  ### LiveCodeBench (20240801-20250201)
138
 
139
+ | Easy | Medium | Hard | Avg. |
140
+ |:------|:------|:------|:-----|
141
+ | 95.4 | 64.0| 18.0 | 51.3 |
 
142
 
143
  User Prompt Template (without starter code):
144
 
 
166
  ```
167
  ````
168
 
169
+ ### CodeContests
170
+
171
+ | Public | Private | Generated | All |
172
+ |:--------|:--------|:----------|:----|
173
+ | 46.7 | 29.6 | 32.3 | 18.1|
174
+
175
+
176
  ## Ethical Considerations:
177
 
178
  NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.