Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5783

Native Parquet Support in Hive

    XMLWordPrintableJSON

Details

    • Added support for 'STORED AS PARQUET' and for setting parquet as the default storage engine.

    Description

      Problem Statement:

      Hive would be easier to use if it had native Parquet support. Our organization, Criteo, uses Hive extensively. Therefore we built the Parquet Hive integration and would like to now contribute that integration to Hive.

      About Parquet:

      Parquet is a columnar storage format for Hadoop and integrates with many Hadoop ecosystem tools such as Thrift, Avro, Hadoop MapReduce, Cascading, Pig, Drill, Crunch, and Hive. Pig, Crunch, and Drill all contain native Parquet integration.

      Changes Details:

      Parquet was built with dependency management in mind and therefore only a single Parquet jar will be added as a dependency.

      Attachments

        1. HIVE-5783.noprefix.patch
          196 kB
          Brock Noland
        2. HIVE-5783.noprefix.patch
          196 kB
          Brock Noland
        3. HIVE-5783.patch
          196 kB
          Brock Noland
        4. HIVE-5783.patch
          196 kB
          Brock Noland
        5. HIVE-5783.patch
          196 kB
          Brock Noland
        6. HIVE-5783.patch
          196 kB
          Brock Noland
        7. HIVE-5783.patch
          197 kB
          Brock Noland
        8. HIVE-5783.patch
          195 kB
          Brock Noland
        9. HIVE-5783.patch
          194 kB
          Brock Noland
        10. HIVE-5783.patch
          192 kB
          Brock Noland
        11. HIVE-5783.patch
          172 kB
          Brock Noland
        12. HIVE-5783.patch
          173 kB
          Brock Noland
        13. HIVE-5783.patch
          173 kB
          Brock Noland
        14. HIVE-5783.patch
          180 kB
          Justin Coffey
        15. HIVE-5783.patch
          199 kB
          Brock Noland
        16. HIVE-5783.patch
          199 kB
          Brock Noland
        17. HIVE-5783.patch
          171 kB
          Justin Coffey
        18. HIVE-5783.patch
          196 kB
          Brock Noland
        19. HIVE-5783.patch
          9 kB
          Xuefu Zhang

        Issue Links

          Activity

            People

              jcoffey Justin Coffey
              jcoffey Justin Coffey
              Votes:
              1 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: