Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-856

PERFORMANCE: reduce number of replicas

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 0.3.0
    • None
    • None
    • None

    Description

      Currently Pig uses the default number of replicas between MR jobs. Currently, the number is 3. Given the temp nature of the data, we should never need more than 2 and should explicitely set it to improve performance and to be nicer to the name node.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              olgan Olga Natkovich
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: