Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-2702

Make Pig local mode (and tests) faster by working around the hard coded sleep(5000) in hadoop's JobControl

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.11
    • None
    • None
    • Patch Available

    Description

      the JobControl class polls the jobs statuses with a hard coded sleep(5000) making every job take a minimum of 5 seconds.
      Since the local mode uses the same code path this makes local mode (and unit tests) extremely slow.

      Attachments

        1. PIG-2702_a.patch
          23 kB
          Julien Le Dem
        2. PIG-2702.patch
          20 kB
          Julien Le Dem

        Activity

          People

            julienledem Julien Le Dem
            julienledem Julien Le Dem
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: