[STANBOL-1003] Multimedia Enhancements for Stanbol

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Enhancer
• Labels: gsoc2013 gsoc2014 mentoring
• Assignee: Unassigned
• Reporter: Rupert Westenthaler
• Created: 28/Mar/13 12:24
• Updated: 03/Mar/14 12:35

Description

This issue covers extensions to the Stanbol Enhancer related to the enhancement of multimedia (non-textual) resources.

Goals
====

1. Extend the Stanbol Enhancer to provide better support for multimedia enhancements

This includes possible extensions to deal with large files. Consume media data directly from provided locations instead of loading them to the local machine.
Support for multimedia enhancement will also require extensions to the Stanbol Enhancement Structure. e.g. to support temporal selections in time based media and spatial selection for images - spacia-temporal fragments.

2. Develop Enhancement Engiens for Multimedia Content

Ideas for Engines include

• Audio Analyses: Speach to Text
• Image Analyses: Face Detection, Face Recognition, OCR (optical char recognition)
• Video Analyses: Shot Detection, Moving Object Detection

Issue Links

• incorporates: STANBOL-1291 Phonetic Linking

Sub-Tasks

• Allow ContentItems to retieve content from provided locations: Open
• Extend the Stanbol EnhancementStructure to support multimedia enhancements: Open
• Face Detection Engine based on OpenIMAJ: Open
• Speech to Text Enhancement Engine using CMU Sphinx: Open