Pig
  1. Pig
  2. PIG-1870

HBaseStorage doesn't project correctly

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1
    • Fix Version/s: 0.8.1, 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      Projecting columns after LOAD via HBaseStorage produces unexpected results. This is related to the loadKey functionality and how the pushProjection method in HBaseStorage has to offset to build a column list that aligns with the tuple (the column list doesn't contain the row key).

      This shift appears to create an inconsistency with the FieldSchema for the tuple which results in the wrong tuple value being fetched for a given column. I'll attach a patch with unit tests that illustrate the problem.

      1. PIG_1870_1.patch
        10 kB
        Bill Graham
      2. PIG_1870_for0.8.2.patch
        27 kB
        Dmitriy V. Ryaboy
      3. PIG_1870_for0.8.final.patch
        26 kB
        Dmitriy V. Ryaboy
      4. PIG_1870_for0.8.patch
        27 kB
        Dmitriy V. Ryaboy
      5. PIG_1870.2.patch
        26 kB
        Dmitriy V. Ryaboy
      6. PIG_1870.3.patch
        26 kB
        Dmitriy V. Ryaboy
      7. PIG_1870.4.patch
        27 kB
        Dmitriy V. Ryaboy
      8. PIG_1870.patch
        26 kB
        Dmitriy V. Ryaboy

        Activity

        Bill Graham created issue -
        Bill Graham made changes -
        Field Original Value New Value
        Attachment PIG_1870_1.patch [ 12471977 ]
        Dmitriy V. Ryaboy made changes -
        Assignee Dmitriy V. Ryaboy [ dvryaboy ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870_for0.8.patch [ 12475955 ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870.patch [ 12475979 ]
        Dmitriy V. Ryaboy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s 0.9.0 [ 12315191 ]
        Dmitriy V. Ryaboy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870.2.patch [ 12476069 ]
        Dmitriy V. Ryaboy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Dmitriy V. Ryaboy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870_for0.8.2.patch [ 12476095 ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870.3.patch [ 12476096 ]
        Dmitriy V. Ryaboy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Dmitriy V. Ryaboy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870.4.patch [ 12476215 ]
        Dmitriy V. Ryaboy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Dmitriy V. Ryaboy made changes -
        Attachment PIG_1870_for0.8.final.patch [ 12476537 ]
        Dmitriy V. Ryaboy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Dmitriy V. Ryaboy made changes -
        Fix Version/s 0.8.1 [ 12316393 ]
        Affects Version/s 0.8.1 [ 12316393 ]
        Affects Version/s 0.8.0 [ 12314562 ]
        Olga Natkovich made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Dmitriy V. Ryaboy
            Reporter:
            Bill Graham
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development