Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-225

INT64 support for Delta Encoding

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.9.0
    • None
    • None

    Description

      As of now, parquet doesn't support delta encoding for INT64. However it is planned in the format:
      https://github.com/Parquet/parquet-format/blob/master/Encodings.md

      The benefits of this feature are huge. For timestamps it achieves twice better compression than SNAPPY on plain encoding, and the reading is faster. This feature is actually advertised on the home page of Parquet, even though it is not yet implemented:
      http://parquet.incubator.apache.org/
      http://image.slidesharecdn.com/hadoopsummit-140630160016-phpapp01/95/efficient-data-storage-for-analytics-with-apache-parquet-20-30-638.jpg?cb=1404162126

      Attachments

        Issue Links

          blocks

          Task - A task that needs to be done. PARQUET-392 Release Parquet-mr 1.9.0

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link PR #154

          Activity

            People

              vassil@leanplum.com Vassil Lunchev
              lunchev Vassil Lunchev
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: