Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-135

Input location is not getting set for the getStatistics in ParquetLoader when using two different loaders within a Pig script.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: None
    • Labels:
      None

      Description

      We have encountered this problem on pig jobs loading two different datasets using different loaders.

      The problem is the input location was not getting set correctly in getStatistics in ParquetLoader which was causing the path for the other loader to be used.

      To fix we need a setInput call in getStatistics in:https://github.com/Parquet/parquet-mr/blob/master/parquet-pig/src/main/java/parquet/pig/ParquetLoader.java#L287

        Attachments

          Activity

            People

            • Assignee:
              elif elif dede
              Reporter:
              elif elif dede
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: