Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4059 Pig on Spark
  3. PIG-5197

Replace IndexedKey with PigNullableWritable in spark branch

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: spark-branch
    • Component/s: spark
    • Labels:
      None

      Description

      The function of IndexedKey and PigNullableWritable is similar.
      The difference between these two is IndexedKey contains Index,key while PigNullableWritable contains index,key,value.
      Besides,the comparators for PigNullableWritable have lot of conditions for the different data types taken care of and IndexedKey can miss some of that. We can try to replace IndexedKey with PigNullableWritable.

        Attachments

        1. PIG-5197.patch
          32 kB
          liyunzhang

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kellyzly liyunzhang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: