Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-1870

HBaseStorage doesn't project correctly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.1
    • 0.8.1, 0.9.0
    • None
    • None

    Description

      Projecting columns after LOAD via HBaseStorage produces unexpected results. This is related to the loadKey functionality and how the pushProjection method in HBaseStorage has to offset to build a column list that aligns with the tuple (the column list doesn't contain the row key).

      This shift appears to create an inconsistency with the FieldSchema for the tuple which results in the wrong tuple value being fetched for a given column. I'll attach a patch with unit tests that illustrate the problem.

      Attachments

        1. PIG_1870_1.patch
          10 kB
          William W. Graham Jr
        2. PIG_1870_for0.8.2.patch
          27 kB
          Dmitriy V. Ryaboy
        3. PIG_1870_for0.8.final.patch
          26 kB
          Dmitriy V. Ryaboy
        4. PIG_1870_for0.8.patch
          27 kB
          Dmitriy V. Ryaboy
        5. PIG_1870.2.patch
          26 kB
          Dmitriy V. Ryaboy
        6. PIG_1870.3.patch
          26 kB
          Dmitriy V. Ryaboy
        7. PIG_1870.4.patch
          27 kB
          Dmitriy V. Ryaboy
        8. PIG_1870.patch
          26 kB
          Dmitriy V. Ryaboy

        Activity

          People

            dvryaboy Dmitriy V. Ryaboy
            billgraham William W. Graham Jr
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: