Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4856 Optimization for pig on spark
  3. PIG-4858

Implement Skewed join for spark engine

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • spark-branch
    • spark
    • None

    Description

      Now we use regular join to replace skewed join. Need implement it

      Attachments

        1. PIG-4858_2.patch
          63 kB
          Xianda Ke
        2. PIG-4858_3.patch
          62 kB
          Xianda Ke
        3. PIG-4858_4.patch
          45 kB
          Xianda Ke
        4. PIG-4858_6.patch
          55 kB
          Xianda Ke
        5. PIG-4858_7.patch
          56 kB
          Xianda Ke
        6. PIG-4858_8.patch
          42 kB
          Xianda Ke
        7. PIG-4858.patch
          63 kB
          Xianda Ke
        8. SkewedJoinInSparkMode.pdf
          405 kB
          Xianda Ke

        Issue Links

          links to

          Web Link RB

          Activity

            People

              kexianda Xianda Ke
              kellyzly liyunzhang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: