Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2574

Make reducer estimator plugable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11
    • None
    • None
    • Support for custom PigReducerEstimator class via pig.exec.reducer.estimator and pig.exec.reducer.estimator.args.

    Description

      I'd like to refactor the logic contained in this method into a pluggable interface:

      static int JobControlCompiler.estimateNumberOfReducers(Configuration conf, List<POLoad> lds);
      

      Attachments

        1. pig-2574_1.patch
          17 kB
          William W. Graham Jr
        2. pig-2574_2.patch
          17 kB
          William W. Graham Jr
        3. pig-2574_3.patch
          19 kB
          William W. Graham Jr
        4. pig-2574_4.patch
          26 kB
          William W. Graham Jr
        5. pig-2574_5.patch
          27 kB
          William W. Graham Jr
        6. pig-2574_6.patch
          28 kB
          William W. Graham Jr
        7. pig-2574_7.patch
          28 kB
          William W. Graham Jr

        Issue Links

          Activity

            People

              billgraham William W. Graham Jr
              billgraham William W. Graham Jr
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: