Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6473

Allow writing HFiles via HBaseStorageHandler table

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • HBase Handler
    • Hide
      Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

      set hive.hbase.generatehfiles=true;
      set hfile.family.path=/tmp/columnfamily_name;

      hfile.family.path can also be set as a table property, HQL value takes precedence.
      Show
      Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL: set hive.hbase.generatehfiles=true; set hfile.family.path=/tmp/columnfamily_name; hfile.family.path can also be set as a table property, HQL value takes precedence.

    Description

      Generating HFiles for bulkload into HBase could be more convenient. Right now we require the user to register a new table with the appropriate output format. This patch allows the exact same functionality, but through an existing table managed by the HBaseStorageHandler.

      Attachments

        1. HIVE-6473.6.patch
          14 kB
          Nick Dimiduk
        2. HIVE-6473.5.patch
          26 kB
          Nick Dimiduk
        3. HIVE-6473.4.patch
          25 kB
          Nick Dimiduk
        4. HIVE-6473.3.patch
          31 kB
          Brock Noland
        5. HIVE-6473.2.patch
          31 kB
          Nick Dimiduk
        6. HIVE-6473.1.patch.txt
          25 kB
          Nick Dimiduk
        7. HIVE-6473.1.patch
          25 kB
          Nick Dimiduk
        8. HIVE-6473.0.patch.txt
          18 kB
          Nick Dimiduk

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            ndimiduk Nick Dimiduk Assign to me
            ndimiduk Nick Dimiduk
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment