Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1870

HBaseStorage doesn't project correctly

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1
    • Fix Version/s: 0.8.1, 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      Projecting columns after LOAD via HBaseStorage produces unexpected results. This is related to the loadKey functionality and how the pushProjection method in HBaseStorage has to offset to build a column list that aligns with the tuple (the column list doesn't contain the row key).

      This shift appears to create an inconsistency with the FieldSchema for the tuple which results in the wrong tuple value being fetched for a given column. I'll attach a patch with unit tests that illustrate the problem.

        Attachments

        1. PIG_1870.patch
          26 kB
          Dmitriy V. Ryaboy
        2. PIG_1870.4.patch
          27 kB
          Dmitriy V. Ryaboy
        3. PIG_1870.3.patch
          26 kB
          Dmitriy V. Ryaboy
        4. PIG_1870.2.patch
          26 kB
          Dmitriy V. Ryaboy
        5. PIG_1870_for0.8.patch
          27 kB
          Dmitriy V. Ryaboy
        6. PIG_1870_for0.8.final.patch
          26 kB
          Dmitriy V. Ryaboy
        7. PIG_1870_for0.8.2.patch
          27 kB
          Dmitriy V. Ryaboy
        8. PIG_1870_1.patch
          10 kB
          Bill Graham

          Activity

            People

            • Assignee:
              dvryaboy Dmitriy V. Ryaboy
              Reporter:
              billgraham Bill Graham
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: