Uploaded image for project: 'Apache Avro'
  1. Apache Avro
  2. AVRO-806

add a column-major file format

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 1.7.2
    • java, spec
    • None

    Description

      Define a column-major file format. This would permit better compression and also permit efficient skipping of fields that are not of interest.

      Attachments

        1. AVRO-806.patch
          31 kB
          Doug Cutting
        2. AVRO-806-v2.patch
          75 kB
          Thiruvalluvan M. G.
        3. avro-file-columnar.pdf
          61 kB
          Thiruvalluvan M. G.
        4. AVRO-806.patch
          239 kB
          Doug Cutting

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. HIVE-352 Make Hive support column based storage

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-756 performance improvement for RCFile and ColumnarSerDe in Hive

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-3585 Integrate Trevni as another columnar oriented file format

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available
          relates to

          New Feature - A new feature of the product, which has yet to be developed. PIG-3059 Global configurable minimum 'bad record' thresholds

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. PIG-3015 Rewrite of AvroStorage

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cutting Doug Cutting
              cutting Doug Cutting
              Votes:
              6 Vote for this issue
              Watchers:
              33 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: