Hive
  1. Hive
  2. HIVE-6473

Allow writing HFiles via HBaseStorageHandler table

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: HBase Handler
    • Labels:
    • Release Note:
      Hide
      Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

      set hive.hbase.generatehfiles=true;
      set hfile.family.path=/tmp/columnfamily_name;

      hfile.family.path can also be set as a table property, HQL value takes precedence.
      Show
      Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL: set hive.hbase.generatehfiles=true; set hfile.family.path=/tmp/columnfamily_name; hfile.family.path can also be set as a table property, HQL value takes precedence.

      Description

      Generating HFiles for bulkload into HBase could be more convenient. Right now we require the user to register a new table with the appropriate output format. This patch allows the exact same functionality, but through an existing table managed by the HBaseStorageHandler.

      1. HIVE-6473.6.patch
        14 kB
        Nick Dimiduk
      2. HIVE-6473.5.patch
        26 kB
        Nick Dimiduk
      3. HIVE-6473.4.patch
        25 kB
        Nick Dimiduk
      4. HIVE-6473.3.patch
        31 kB
        Brock Noland
      5. HIVE-6473.2.patch
        31 kB
        Nick Dimiduk
      6. HIVE-6473.1.patch.txt
        25 kB
        Nick Dimiduk
      7. HIVE-6473.1.patch
        25 kB
        Nick Dimiduk
      8. HIVE-6473.0.patch.txt
        18 kB
        Nick Dimiduk

        Issue Links

          Activity

          Thejas M Nair made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Lefty Leverenz made changes -
          Labels TODOC14
          Nick Dimiduk made changes -
          Release Note Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/columnfamily_name;
          Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/columnfamily_name;

          hfile.family.path can also be set as a table property, HQL value takes precedence.
          Nick Dimiduk made changes -
          Release Note Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/hfilelocn;
          Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/columnfamily_name;
          Sushanth Sowmyan made changes -
          Link This issue is related to HIVE-7197 [ HIVE-7197 ]
          Sushanth Sowmyan made changes -
          Release Note Allows direct creation of HFiles and location for them if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/hfilelocn;
          Allows direct creation of HFiles and location for them as part of HBaseStorageHandler write if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/hfilelocn;
          Sushanth Sowmyan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Release Note Allows direct creation of HFiles and location for them if the following properties are specified in the HQL:

          set hive.hbase.generatehfiles=true;
          set hfile.family.path=/tmp/hfilelocn;
          Resolution Fixed [ 1 ]
          Nick Dimiduk made changes -
          Fix Version/s 0.14.0 [ 12326450 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6473.6.patch [ 12648784 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6473.5.patch [ 12648248 ]
          Nick Dimiduk made changes -
          Link This issue is depended upon by HIVE-2365 [ HIVE-2365 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6473.4.patch [ 12646293 ]
          Brock Noland made changes -
          Attachment HIVE-6473.3.patch [ 12645134 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6473.2.patch [ 12645054 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6473.1.patch [ 12644720 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Nick Dimiduk made changes -
          Attachment HIVE-6473.1.patch.txt [ 12644551 ]
          Nick Dimiduk made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Nick Dimiduk made changes -
          Assignee Nick Dimiduk [ ndimiduk ]
          Nick Dimiduk made changes -
          Field Original Value New Value
          Attachment HIVE-6473.0.patch.txt [ 12630117 ]
          Nick Dimiduk created issue -

            People

            • Assignee:
              Nick Dimiduk
              Reporter:
              Nick Dimiduk
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development