Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4424

Different configurations for different stages of script

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      From a user:
      I have a pig script which runs multiple map reduce jobs. (Ex: 'group by' and 'order by' which will be executed as 2 different map reduce jobs)
      Is there a way to specify different map reduce configuration options for different stages instead of specifying them for the whole script (Ex: different values for mapred.min.split.size for different stages)?

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: