Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-2216

Support single mapper pass to CSV bulk load table and indexes

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.6.0
    • None
    • None

    Description

      Instead of running separate MR jobs for CSV bulk load: once for the table and then once for each secondary index, generate both the data table HFiles and the index table(s) HFiles in one mapper phase.

      Not sure if we need HBASE-3727 to be implemented for this or if we can do it with existing HBase APIs.

      Attachments

        1. phoenix-tests-split-on.patch
          2 kB
          maghamravikiran
        2. phoenix-multipleoutputs.patch
          44 kB
          maghamravikiran
        3. phoenix-custom-hfileoutputformat-comments.patch
          59 kB
          maghamravikiran
        4. phoenix-custom-hfileoutputformat.patch
          59 kB
          maghamravikiran
        5. mhfileoutput-final.patch
          65 kB
          maghamravikiran

        Activity

          People

            maghamravikiran@gmail.com maghamravikiran
            jamestaylor James R. Taylor
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: