Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-220

Unnecessary warning in ParquetRecordReader.initialize

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.10.0, 1.8.2
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      When reading a parquet file using spark 1.3.0 lots of warnings are printed in the log:

      WARNING: parquet.hadoop.ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
      

      I have checked the source of ParquetRecordReader and found that while it checks for context to be TaskInputOutputContext it seems to never actually rely on this fact.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sircodesalot Reuben Kuhnert
                Reporter:
                k.shaposhnikov@gmail.com Konstantin Shaposhnikov
              • Votes:
                6 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: