fyp-buglens commited on
Commit
ac3858a
·
verified ·
1 Parent(s): bd4feb8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +70 -3
README.md CHANGED
@@ -1,3 +1,70 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ metrics:
6
+ - accuracy
7
+ base_model:
8
+ - huawei-noah/TinyBERT_General_4L_312D
9
+ tags:
10
+ - TaxonomyOfVideoGameBugs
11
+ ---
12
+ # Invalid Graphical Representation Bug Detection Model
13
+
14
+ This model is trained to detect **Invalid Graphical Representation** issues in video games. It identifies bugs where aspects of the world state are incorrectly rendered. For example, it can detect when a character is performing a swimming animation while on land, or when a clothing item is not appearing as intended in the game.
15
+
16
+ The model is based on concepts from the paper [_"What went wrong; the taxonomy of video game bugs"_](https://users.soe.ucsc.edu/~ejw/papers/lewis-taxonomy-fdg2010.pdf).
17
+
18
+ ## Model Details
19
+
20
+ - **Model Type**: Classification (Binary)
21
+ - **Training Data**: Trained on a dataset of video game bugs, specifically focused on **Invalid Graphical Representation** as described in the paper _"What went wrong; the taxonomy of video game bugs"_.
22
+ - **Task**: Bug detection in video games.
23
+ - **Intended Use**: This model is designed for game developers and QA teams to automate the detection of rendering issues or animation bugs in video games.
24
+
25
+ ## Training Metrics
26
+
27
+ The model was trained for 4 epochs, with the following performance metrics:
28
+
29
+ | Epoch | Training Loss | Validation Loss | Accuracy | F1 Score | Precision | Recall |
30
+ |-------|---------------|-----------------|----------|----------|-----------|---------|
31
+ | 1 | 0.6919 | 0.6906 | 61.75% | 0.7086 | 0.5688 | 0.9394 |
32
+ | 2 | 0.6707 | 0.6646 | 67.25% | 0.6289 | 0.7161 | 0.5606 |
33
+ | 3 | 0.6181 | 0.5799 | 76.50% | 0.7939 | 0.7016 | 0.9141 |
34
+ | 4 | 0.4611 | 0.4110 | 87.00% | 0.8791 | 0.8147 | 0.9545 |
35
+
36
+ ### Key Metrics:
37
+ - **F1 Score**: Balances precision and recall, with a final value of 0.8791 after 4 epochs.
38
+ - **Precision**: The accuracy of positive predictions.
39
+ - **Recall**: The ability to detect true positives.
40
+
41
+ ## Intended Audience
42
+
43
+ - **Game Developers**: To detect graphical and animation bugs in video games.
44
+ - **Quality Assurance (QA) Teams**: To automate the detection of rendering or animation issues during game testing.
45
+ - **Researchers**: Interested in analyzing or extending bug detection models for video games.
46
+
47
+
48
+ ## Limitations:
49
+ - This model is specifically trained to detect Invalid Graphical Representation bugs, focusing on issues like animation errors and missing rendered items.
50
+ - It may not generalize well to other types of video game bugs outside of this category.
51
+ - Performance can vary depending on the game context and rendering engine. Further fine-tuning may be required for use in different games.
52
+
53
+ ## How to Use
54
+
55
+ You can use the model for **binary classification** to predict whether a given game state exhibits an **Invalid Graphical Representation** bug. Here's an example using the Hugging Face `transformers` library:
56
+
57
+ ```python
58
+ from transformers import pipeline
59
+
60
+ # Load the model from Hugging Face
61
+ bug_detection = pipeline('text-classification', model='fyp-buglens/VideoGameReviews-InvalidGraphicalRepresentation-TinyBERT')
62
+
63
+ # Example usage
64
+ result = bug_detection("A character is swimming on land")
65
+ print(result) # Output: label indicating if it's a bug or not
66
+
67
+
68
+ ---
69
+ license: apache-2.0
70
+ ---