Major Description
Currently TIKA supports ObjectRecognition in Images. I am proposing to extend this to support videos.
Idea is -
1. Extract frames from video and run IncV3 to get labels for these frames.
2. We average confidence scores of same labels for each frame.
3. Return results in sorted order of confidence score.
I am writing code for different modes of frame extractions -
1. Extract center image.
2. Extract frames after every fixed interval.
3. Extract N frames equally divided across video.
We used this approach in [0]. Code in [1]
[0] https://github.com/USCDataScience/hadoop-pot
[1] https://github.com/USCDataScience/video-recognition