google/vivit-b-16x2-kinetics400
Video Classification
•
Updated
•
419k
•
20
Video Classification
Video classification is the task of assigning a label or class to an entire video. Videos are expected to have only one class for each video. Video classification models take a video as input and return a prediction about which class the video belongs to.
Inputs
Video Classification Model
Output
Playing Guitar
0.514
Playing Tennis
0.193
Cooking
0.068
About Video Classification
Use Cases
Video classification models can be used to categorize what a video is all about.
Activity Recognition
Video classification models are used to perform activity recognition which is useful for fitness applications. Activity recognition is also helpful for vision-impaired individuals especially when they're commuting.
Video Search
Models trained in video classification can improve user experience by organizing and categorizing video galleries on the phone or in the cloud, on multiple keywords or tags.
Inference
Below you can find code for inferring with a pre-trained video classification model.
from transformers import pipeline
pipe = pipeline(task = "video-classification", model="nateraw/videomae-base-finetuned-ucf101-subset")
pipe("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/transformers/basketball.avi?download=true")
#[{'score': 0.90, 'label': 'BasketballDunk'},
# {'score': 0.02, 'label': 'BalanceBeam'},
# ... ]
Useful Resources
- Developing a simple video classification model
- Video classification with Transformers
- Building a video archive
- Video classification task guide
Creating your own video classifier in minutes
Compatible libraries
Video Classification demo
No example widget is defined for this task.
Note Contribute by proposing a widget for this task !
Models for Video Classification
Browse Models (1,208)
Note Strong Video Classification model trained on the Kinetics 400 dataset.
Note Strong Video Classification model trained on the Kinetics 400 dataset.
Datasets for Video Classification
Browse Datasets (115)
No example dataset is defined for this task.
Note Contribute by proposing a dataset for this task !
Spaces using Video Classification
Note An application that classifies video at different timestamps.
Note An application that classifies video.
Metrics for Video Classification
- accuracy
- Accuracy is the proportion of correct predictions among the total number of cases processed. It can be computed with: Accuracy = (TP + TN) / (TP + TN + FP + FN) Where: TP: True positive TN: True negative FP: False positive FN: False negative
- recall
- Recall is the fraction of the positive examples that were correctly labeled by the model as positive. It can be computed with the equation: Recall = TP / (TP + FN) Where TP is the true positives and FN is the false negatives.
- precision
- Precision is the fraction of correctly labeled positive examples out of all of the examples that were labeled as positive. It is computed via the equation: Precision = TP / (TP + FP) where TP is the True positives (i.e. the examples correctly labeled as positive) and FP is the False positive examples (i.e. the examples incorrectly labeled as positive).
- f1
- The F1 score is the harmonic mean of the precision and recall. It can be computed with the equation: F1 = 2 * (precision * recall) / (precision + recall)