Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-3727

MultiHFileOutputFormat

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • None
    • None
    • Reviewed
    • Hide
      MultiHFileOutputFormat support output of HFiles from multiple tables. It will output directories and hfiles as follow,
           --table1
             --family1
             --family2
               --Hfiles
           --table2
             --family3
               --hfiles
             --family4

      family directory and its hfiles match the output of HFileOutputFormat2
      Show
      MultiHFileOutputFormat support output of HFiles from multiple tables. It will output directories and hfiles as follow,      --table1        --family1        --family2          --Hfiles      --table2        --family3          --hfiles        --family4 family directory and its hfiles match the output of HFileOutputFormat2
    • Phoenix

    Description

      Like MultiTableOutputFormat, but outputting HFiles. Key is tablename as an IBW. Creates sub-writers (code cut and pasted from HFileOutputFormat) on demand that produce HFiles in per-table subdirectories of the configured output path. Does not currently support partitioning for existing tables / incremental update.

      Attachments

        1. HBASE-3727-V3.patch
          35 kB
          Yi Liang
        2. HBASE-3727-V4.patch
          35 kB
          Yi Liang
        3. HBASE-3727-V5.patch
          36 kB
          Yi Liang
        4. MH2.patch
          22 kB
          Yi Liang
        5. MultiHFileOutputFormat.java
          13 kB
          Yi Liang
        6. MultiHFileOutputFormat.java
          7 kB
          Andrew Kyle Purtell
        7. MultiHFileOutputFormat.java
          7 kB
          Andrew Kyle Purtell
        8. TestMultiHFileOutputFormat.java
          8 kB
          Yi Liang

        Activity

          People

            easyliangjob Yi Liang
            apurtell Andrew Kyle Purtell
            Votes:
            4 Vote for this issue
            Watchers:
            18 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: