Uploaded image for project: 'Crunch'
  1. Crunch
  2. CRUNCH-689

Allow override of of partitions for writeToHFilesForIncrementalLoad

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.14.0
    • Fix Version/s: None
    • Component/s: Core
    • Labels:
      None

      Description

      writeToHFilesForIncrementLoad supports an option to limit the partitions to affected regions currently by inspecting the input to determine the impacted partitions.  While this works in some cases there is overhead in this approach.  There are other use cases where the affected regions are known or predictable ahead of time.   This enhancement request is to add support for a new  writeToHFilesForIncrementLoad() that accepts a boolean filter function to allow the consumer to determine which regions are affected and determine the partitions from those.

       

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jwills Josh Wills
                Reporter:
                rfarrjr Robert Farr
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: