Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1775

Deprecate AvroParquetWriter Builder Hadoop Path

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.12.0
    • None

    Description

      Trying to write a sample program with Parquet and came across the following quark:

       

      The AvroParquetWriter has no qualms about building one using org.apache.hadoop.fs.Path.  However, doing so in AvroParquetReader is deprecated.  I think it's appropriate to remove all dependencies of Hadoop from this simple reader/writer API.

       

      To make it consistent, also deprecate the use of org.apache.hadoop.fs.Path in the AvroParquetWriter.

       

      https://github.com/apache/parquet-mr/blob/8c1bc9bcdeeac8178fecf61d18dc56913907fd46/parquet-avro/src/main/java/org/apache/parquet/avro/AvroParquetWriter.java#L38

       

      https://github.com/apache/parquet-mr/blob/8c1bc9bcdeeac8178fecf61d18dc56913907fd46/parquet-avro/src/main/java/org/apache/parquet/avro/AvroParquetReader.java#L47

      Attachments

        Issue Links

          Activity

            People

              belugabehr David Mollitor
              belugabehr David Mollitor
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: