Update README.md
Browse files
README.md
CHANGED
@@ -109,7 +109,7 @@ print(pipeline([{"role": "user", "content": "Solve x*(sin(x)+2)=0"}]))
|
|
109 |
|
110 |
## Training Datasets
|
111 |
|
112 |
-
|
113 |
|
114 |
**Data Collection for Training Datasets:**
|
115 |
|
@@ -136,10 +136,9 @@ Data Labeling for Evaluation Datasets:
|
|
136 |
|
137 |
### LiveCodeBench (20240801-20250201)
|
138 |
|
139 |
-
|
|
140 |
-
|
141 |
-
|
|
142 |
-
| OpenCodeReasoning-7B | 51.3 |
|
143 |
|
144 |
User Prompt Template (without starter code):
|
145 |
|
@@ -167,6 +166,13 @@ You will use the following starter code to write the solution to the problem and
|
|
167 |
```
|
168 |
````
|
169 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
170 |
## Ethical Considerations:
|
171 |
|
172 |
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
|
|
|
109 |
|
110 |
## Training Datasets
|
111 |
|
112 |
+
The training corpus for OpenCodeReasoning-7B is [OpenCodeReasoning](https://huggingface.co/datasets/nvidia/OpenCodeReasoning) dataset, which is composed of competitive programming questions and DeepSeek-R1 generated responses.
|
113 |
|
114 |
**Data Collection for Training Datasets:**
|
115 |
|
|
|
136 |
|
137 |
### LiveCodeBench (20240801-20250201)
|
138 |
|
139 |
+
| Easy | Medium | Hard | Avg. |
|
140 |
+
|:------|:------|:------|:-----|
|
141 |
+
| 95.4 | 64.0| 18.0 | 51.3 |
|
|
|
142 |
|
143 |
User Prompt Template (without starter code):
|
144 |
|
|
|
166 |
```
|
167 |
````
|
168 |
|
169 |
+
### CodeContests
|
170 |
+
|
171 |
+
| Public | Private | Generated | All |
|
172 |
+
|:--------|:--------|:----------|:----|
|
173 |
+
| 46.7 | 29.6 | 32.3 | 18.1|
|
174 |
+
|
175 |
+
|
176 |
## Ethical Considerations:
|
177 |
|
178 |
NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse.
|