Pig
  1. Pig
  2. PIG-1870

HBaseStorage doesn't project correctly

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.1
    • Fix Version/s: 0.8.1, 0.9.0
    • Component/s: None
    • Labels:
      None

      Description

      Projecting columns after LOAD via HBaseStorage produces unexpected results. This is related to the loadKey functionality and how the pushProjection method in HBaseStorage has to offset to build a column list that aligns with the tuple (the column list doesn't contain the row key).

      This shift appears to create an inconsistency with the FieldSchema for the tuple which results in the wrong tuple value being fetched for a given column. I'll attach a patch with unit tests that illustrate the problem.

      1. PIG_1870_1.patch
        10 kB
        Bill Graham
      2. PIG_1870_for0.8.2.patch
        27 kB
        Dmitriy V. Ryaboy
      3. PIG_1870_for0.8.final.patch
        26 kB
        Dmitriy V. Ryaboy
      4. PIG_1870_for0.8.patch
        27 kB
        Dmitriy V. Ryaboy
      5. PIG_1870.2.patch
        26 kB
        Dmitriy V. Ryaboy
      6. PIG_1870.3.patch
        26 kB
        Dmitriy V. Ryaboy
      7. PIG_1870.4.patch
        27 kB
        Dmitriy V. Ryaboy
      8. PIG_1870.patch
        26 kB
        Dmitriy V. Ryaboy

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            Dmitriy V. Ryaboy
            Reporter:
            Bill Graham
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development