Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-142

parquet-tools doesn't filter _SUCCESS file

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      Currently parquet-tools command fails when input is a directory with _SUCCESS file from mapreduce. Filtering those out like ParquetFileReader does fixes the problem.

      parquet-cat /tmp/parquet_write_test
      Could not read footer: java.lang.RuntimeException: file:/tmp/parquet_write_test/_SUCCESS is not a Parquet file (too small)
      
      $ tree /tmp/parquet_write_test
      /tmp/parquet_write_test
      ├── part-m-00000.parquet
      └── _SUCCESS
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sinisa_lyh Neville Li
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: