Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1126

make it easy to read and write parquet files in java without depending on hadoop

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      I am happy to help with this but I'd love some guidance on:

      1) likelihood of being accepted as a patch.
      2) how critical it is to maintain backwards compatibility in APIs.

      For instance, we probably want to introduce a new artifact that lives under the existing hadoop depending artifact, and move as much code as possible to that, keeping the hadoop apis in the old artifact.

      Welcome comments on solving this issue.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-4379 Make ParquetIO Read splittable

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          incorporates

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-1142 Avoid leaking Hadoop API to downstream libraries

          • Major - Major loss of function.
          • Resolved
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. PARQUET-1953 hadoop-common is not an optional dependency

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-1776 Add Java NIO Avro OutputFile InputFile

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              Unassigned Unassigned
              posco Oscar Boykin
              Votes:
              14 Vote for this issue
              Watchers:
              19 Start watching this issue

              Dates

                Created:
                Updated: