Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-48

[hbase] Bulk load tools

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.20.0
    • 0.20.1, 0.90.0
    • None
    • None
    • Reviewed

    Description

      Hbase needs tools to facilitate bulk upload and possibly dumping. Going via the current APIs, particularly if the dataset is large and cell content is small, uploads can take a long time even when using many concurrent clients.

      PNUTS folks talked of need for a different API to manage bulk upload/dump.

      Another notion would be to somehow have the bulk loader tools somehow write regions directly in hdfs.

      Attachments

        1. 48.patch
          15 kB
          Michael Stack
        2. 48-v2.patch
          17 kB
          Michael Stack
        3. loadtable.rb
          4 kB
          Michael Stack
        4. 48-v3.patch
          21 kB
          Michael Stack
        5. 48-v4.patch
          23 kB
          Michael Stack
        6. 48-v5.patch
          17 kB
          Michael Stack
        7. HBASE-48-v6-branch.patch
          22 kB
          Jonathan Gray
        8. 48-v7.patch
          27 kB
          Michael Stack

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stack Michael Stack
              Votes:
              5 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: