Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8120

Umbrella JIRA tracking Parquet improvements

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Attachments

      Issue Links

        blocks

        Sub-task - The sub-task of the issue HIVE-8128 Improve Parquet Vectorization

        • Major - Major loss of function.
        • Patch Available
        incorporates

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-10666 Improvement for Parquet Predicate Push down on Hive

        • Major - Major loss of function.
        • Open
        is blocked by

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-7685 Parquet memory manager

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-7858 Parquet compression should be configurable via table property

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HIVE-9442 Make sure all data types work for PARQUET

        • Major - Major loss of function.
        • Resolved

        Task - A task that needs to be done. HIVE-6384 Implement all Hive data types in Parquet

        • Major - Major loss of function.
        • Resolved
        is related to

        Bug - A problem which impairs or prevents the functions of the product. HIVE-6914 parquet-hive cannot write nested map (map value is map)

        • Major - Major loss of function.
        • Resolved

        Bug - A problem which impairs or prevents the functions of the product. HIVE-7800 Parquet Column Index Access Schema Size Checking

        • Critical - Crashes, loss of data, severe memory leak.
        • Closed

        New Feature - A new feature of the product, which has yet to be developed. HIVE-8838 Support Parquet through HCatalog

        • Major - Major loss of function.
        • Closed
        relates to

        Sub-task - The sub-task of the issue HIVE-5998 Add vectorized reader for Parquet files

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Closed

        Bug - A problem which impairs or prevents the functions of the product. HIVE-4329 HCatalog should use getHiveRecordWriter rather than getRecordWriter

        • Major - Major loss of function.
        • Open

        Task - A task that needs to be done. HIVE-11598 Document Configuration for Parquet Files

        • Major - Major loss of function.
        • Open
        1.
        		 Create micro-benchmarks for ParquetSerde and evaluate performance Sub-task Resolved Sergio Peña
        2.
        		 Make use of SearchArgument classes for Parquet SERDE Sub-task Resolved Ferdinand Xu
        3.
        		 Improve Parquet Vectorization Sub-task Patch Available Dong Chen
        4.
        		 NanoTimeUtils performs some work needlessly Sub-task Closed Sergio Peña
        5.
        		 Implement the bloom filter for the ParquetSerde Sub-task Open Ferdinand Xu
        6.
        		 Warn user when parquet mm kicks in Sub-task Open Dong Chen
        7.
        		 Move parquet serialize implementation to DataWritableWriter to improve write speeds Sub-task Closed Sergio Peña
        8.
        		 Improve the speed of select count(*) statement for a parquet table with big input(~1GB) Sub-task Open Ferdinand Xu
        9.
        		 Remove parquet nested objects from wrapper writable objects Sub-task Closed Sergio Peña
        10.
        		 Reduce parquet memory usage by bypassing java primitive objects on ETypeConverter Sub-task Patch Available Sergio Peña
        11.
        		 Avoid reading file footers in ParquetRecordReaderWrapper Sub-task Open Sergio Peña
        12.
        		 Allocate only parquet selected columns in HiveStructConverter class Sub-task Patch Available Sergio Peña
        13.
        		 Turn on Parquet vectorization in parquet branch Sub-task Patch Available Dong Chen
        14.
        		 Remove duplicated Hive table schema parsing in DataWritableReadSupport Sub-task Resolved Dong Chen
        15.
        		 Modify the using of jobConf variable in ParquetRecordReaderWrapper constructor Sub-task Resolved Dong Chen
        16.
        		 Override new init API fom ReadSupport instead of the deprecated one Sub-task Closed Ferdinand Xu
        17.
        		 Clean up ETypeConverter since Parquet supports timestamp type already Sub-task Resolved Ferdinand Xu
        18.
        		 Bump up parquet-hadoop-bundle and parquet-column to the version of 1.6.0rc6 Sub-task Closed Ferdinand Xu
        19.
        		 Use new ParquetInputSplit constructor API Sub-task Patch Available Ferdinand Xu
        20.
        		 Enable parquet column index in HIVE Sub-task Resolved Ferdinand Xu
        21.
        		 Merge master to parquet 05/20/2015 [Parquet branch] Sub-task Resolved Sergio Peña
        22.
        		 Add parquet branch profile to jenkins-submit-build.sh Sub-task Closed Sergio Peña
        23.
        		 Parquet: Bump the parquet version up to 1.8.1 Sub-task Closed Ferdinand Xu
        24.
        		 Get row information on DataWritableWriter once for better writing performance Sub-task Closed Sergio Peña
        25.
        		 Merge master to parquet 06/16/2015 [Parquet branch] Sub-task Resolved Ferdinand Xu
        26.
        		 Predicate pushing down doesn't work for float type for Parquet Sub-task Closed Ferdinand Xu
        27.
        		 A bad performance regression issue with Parquet happens if Hive does not select any columns Sub-task Reopened Ferdinand Xu
        28.
        		 Map instances with null keys are not properly handled for Parquet tables Sub-task Open Unassigned
        29.
        		 Use * instead of sum(hash(*)) on Parquet predicate (PPD) integration tests Sub-task Closed Sergio Peña
        30.
        		 Hive cannot read Parquet decimals backed by INT32 or INT64 Sub-task Resolved Unassigned

        Activity

          People

            brocknoland Brock Noland
            brocknoland Brock Noland
            Votes:
            4 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated: