Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1142

Avoid leaking Hadoop API to downstream libraries

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.9.0
    • 1.10.0
    • parquet-mr
    • None

    Description

      Parquet currently leaks the Hadoop API by requiring callers to pass Path and Configuration instances, and by using Hadoop codecs. InputFile and SeekableInputStream add alternatives to Hadoop classes in some parts of the read path, but this needs to be extended to the write path and to avoid passing options through Configuration.

      Attachments

        Issue Links

          is part of

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-1126 make it easy to read and write parquet files in java without depending on hadoop

          • Major - Major loss of function.
          • Open
          links to

          Web Link PR #429

          Activity

            People

              rdblue Ryan Blue
              rdblue Ryan Blue
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: