Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6473

Allow writing HFiles via HBaseStorageHandler table

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.14.0
    • HBase Handler
    • Hide
      Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

      set hive.hbase.generatehfiles=true;
      set hfile.family.path=/tmp/columnfamily_name;

      hfile.family.path can also be set as a table property, HQL value takes precedence.
      Show
      Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL: set hive.hbase.generatehfiles=true; set hfile.family.path=/tmp/columnfamily_name; hfile.family.path can also be set as a table property, HQL value takes precedence.

    Description

      Generating HFiles for bulkload into HBase could be more convenient. Right now we require the user to register a new table with the appropriate output format. This patch allows the exact same functionality, but through an existing table managed by the HBaseStorageHandler.

      Attachments

        1. HIVE-6473.6.patch
          14 kB
          Nick Dimiduk
        2. HIVE-6473.5.patch
          26 kB
          Nick Dimiduk
        3. HIVE-6473.4.patch
          25 kB
          Nick Dimiduk
        4. HIVE-6473.3.patch
          31 kB
          Brock Noland
        5. HIVE-6473.2.patch
          31 kB
          Nick Dimiduk
        6. HIVE-6473.1.patch.txt
          25 kB
          Nick Dimiduk
        7. HIVE-6473.1.patch
          25 kB
          Nick Dimiduk
        8. HIVE-6473.0.patch.txt
          18 kB
          Nick Dimiduk

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-2365 SQL support for bulk load into HBase

          • Major - Major loss of function.
          • Patch Available
          is related to

          Test - A new unit, integration or system test. HIVE-7197 Enable and address flakiness of hbase_bulk.m

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Activity

            People

              ndimiduk Nick Dimiduk
              ndimiduk Nick Dimiduk
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: