Pig
  1. Pig
  2. PIG-120

support hadoop map reduce in loal mode

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.1.0
    • Component/s: None
    • Labels:
      None
    • Patch Info:
      Patch Available

      Description

      Currently pig support mapreduce and local as execution modes. LocalExecutionEngine is used for local and HExecutionEngine for map reduce. HExecutionEngine always expect that hadoop runs as cluster with a name node and jobtracker listing on a port.
      Though, hadoop can also run in a local mode (LocalJobRunner) this would give several advantages.
      First it would speed up the test suite significant. Second it would be possible to debug map reduce plans easily.
      For example we was able to debug and reproduce PIG-110 with this method.

      1. PIG-120_v_1.patch
        5 kB
        Stefan Groschupf

        Issue Links

          Activity

          Stefan Groschupf created issue -
          Stefan Groschupf made changes -
          Field Original Value New Value
          Attachment PIG-120_v_1.patch [ 12376385 ]
          Olga Natkovich made changes -
          Patch Info [Patch Available]
          Benjamin Francisoud made changes -
          Link This issue is related to PIG-119 [ PIG-119 ]
          Alan Gates made changes -
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          Fix Version/s 0.1.0 [ 12312848 ]
          Owen O'Malley made changes -
          Workflow jira [ 12424344 ] no-reopen-closed, patch-avail [ 12425420 ]
          Alan Gates made changes -
          Assignee Stefan Groschupf [ joa23 ]
          Alan Gates made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Stefan Groschupf
              Reporter:
              Stefan Groschupf
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development