Uploaded image for project: 'Hama'
  1. Hama
  2. HAMA-561

Support consuming partitioned files

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • bsp core
    • None

    Description

      Current the input partitioning is done when the job is submitted and the partitioner has been specified. There might be a scenario where the input data has already been partiononed or there might be a better way of partioning of the input data. So, Hama should be made aware that the files are already partitioned files and the messages should only be sent to the appropriate bsp task.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HAMA-531 Data re-partitioning in BSPJobClient

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HAMA-700 BSPPartitioner should be configurable to be optional and allow input format conversion

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              praveensripati praveen sripati
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: