Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-5783

Native Parquet Support in Hive

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Added support for 'STORED AS PARQUET' and for setting parquet as the default storage engine.

    Description

      Problem Statement:

      Hive would be easier to use if it had native Parquet support. Our organization, Criteo, uses Hive extensively. Therefore we built the Parquet Hive integration and would like to now contribute that integration to Hive.

      About Parquet:

      Parquet is a columnar storage format for Hadoop and integrates with many Hadoop ecosystem tools such as Thrift, Avro, Hadoop MapReduce, Cascading, Pig, Drill, Crunch, and Hive. Pig, Crunch, and Drill all contain native Parquet integration.

      Changes Details:

      Parquet was built with dependency management in mind and therefore only a single Parquet jar will be added as a dependency.

      Attachments

        1. HIVE-5783.noprefix.patch
          196 kB
          Brock Noland
        2. HIVE-5783.noprefix.patch
          196 kB
          Brock Noland
        3. HIVE-5783.patch
          196 kB
          Brock Noland
        4. HIVE-5783.patch
          196 kB
          Brock Noland
        5. HIVE-5783.patch
          196 kB
          Brock Noland
        6. HIVE-5783.patch
          196 kB
          Brock Noland
        7. HIVE-5783.patch
          197 kB
          Brock Noland
        8. HIVE-5783.patch
          195 kB
          Brock Noland
        9. HIVE-5783.patch
          194 kB
          Brock Noland
        10. HIVE-5783.patch
          192 kB
          Brock Noland
        11. HIVE-5783.patch
          172 kB
          Brock Noland
        12. HIVE-5783.patch
          173 kB
          Brock Noland
        13. HIVE-5783.patch
          173 kB
          Brock Noland
        14. HIVE-5783.patch
          180 kB
          Justin Coffey
        15. HIVE-5783.patch
          199 kB
          Brock Noland
        16. HIVE-5783.patch
          199 kB
          Brock Noland
        17. HIVE-5783.patch
          171 kB
          Justin Coffey
        18. HIVE-5783.patch
          196 kB
          Brock Noland
        19. HIVE-5783.patch
          9 kB
          Xuefu Zhang

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jcoffey Justin Coffey Assign to me
            jcoffey Justin Coffey
            Votes:
            1 Vote for this issue
            Watchers:
            29 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment