Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-5283

Configuration is not passed to SparkPigSplits on the backend

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.18.0
    • spark
    • None

    Description

      When a Hadoop ObjectWritable is created during a Spark job, the instantiated PigSplit (wrapped into a SparkPigSplit) is given an empty Configuration instance.
      This happens here

      Attachments

        1. PIG-5283.1.patch
          3 kB
          Ádám Szita
        2. PIG-5283.0.patch
          1 kB
          Ádám Szita

        Activity

          People

            szita Ádám Szita
            szita Ádám Szita
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: