Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4059 Pig on Spark
  3. PIG-4236

Avoid packaging spark specific jars into pig fat jar

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: spark-branch
    • Component/s: spark
    • Labels:
      None

      Description

      Spark and its dependencies jars shouldn't be packaged into the pig jar as it would be redundant to do so.

      Pig dependencies should be either added from lib directory or use the legacy jar which contains pig along with its dependencies.

      Please refer to PIG-4047 for more info.

        Attachments

          Issue Links

          is related to

          Sub-task - The sub-task of the issue PIG-4667 Enable Pig on Spark to run on Yarn Client mode

          • Major - Major loss of function.
          • Closed

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                praveenr019 Praveen Rachabattuni
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: