Preprocessing Options - MichiganCOG/ViP GitHub Wiki
Preprocessing Options
Video - All frames in a media file
Clip - Sampled number of frames from a video
T - Total number of frames in a video
| Configuration parameters | Definition | Values |
|---|---|---|
clip_length |
Total number of sampled frames in a clip | -1, [1, T] |
clip_offset |
Offset from first sampled frame | [0, T-1] |
clip_stride |
Offset between sampled frames | [0, ?] |
num_clips |
Number of clips to generate from a video | -1, [0, ?] |
More details:
clip_length
- -1: Sample all frames from the video
- >0: Sample N frames from the video
num_clips
- -1: Uniformly sample one clip from the video
- 0: Divide the entire video into x sampled clips
- >0 Sample N clips from the video
Shortcuts:
Generate 1 clip from the beginning of each video, each of length 5
| Config | Value |
|---|---|
clip_length |
5 |
clip_offset |
0 |
clip_stride |
0 |
num_clips |
1 |
Uniformly sample 1 clip from each video, each of length 16
| Config | Value |
|---|---|
clip_length |
16 |
clip_offset |
0 |
clip_stride |
0 |
num_clips |
-1 |
Sample all frames from each video (Suggested batch size of 1. May encounter memory issues and differing sizes within batch.)
| Config | Value |
|---|---|
clip_length |
-1 |
clip_offset |
0 |
clip_stride |
0 |
num_clips |
1 |