Uploaded image for project: 'Tika'
  1. Tika
  2. TIKA-2322

Video labeling using existing ObjectRecognition

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.15
    • Component/s: parser
    • Labels:

      Description

      Currently TIKA supports ObjectRecognition in Images. I am proposing to extend this to support videos.

      Idea is -
      1. Extract frames from video and run IncV3 to get labels for these frames.
      2. We average confidence scores of same labels for each frame.
      3. Return results in sorted order of confidence score.

      I am writing code for different modes of frame extractions -
      1. Extract center image.
      2. Extract frames after every fixed interval.
      3. Extract N frames equally divided across video.

      We used this approach in [0]. Code in [1]

      [0] https://github.com/USCDataScience/hadoop-pot
      [1] https://github.com/USCDataScience/video-recognition

        Attachments

          Activity

            People

            • Assignee:
              chrismattmann Chris A. Mattmann
              Reporter:
              msharan@usc.edu Madhav Sharan
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: