Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-23353

MOB throws FileNotFound

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 2.1.1, 2.2.2
    • Fix Version/s: None
    • Component/s: mob
    • Labels:
      None

      Description

      in PartitionedMobCompactor#bulkloadRefFile

      If region num is changed from 1 to 20

      bulkload will fail and we will get an exception (because the bulkload maxRetries is 10,hbase.bulkload.retries.number)

      and then delete bulkload path and new MobFile,

      old mob file is not deleted. 

      but some hfiles have been successfully loaded through bulkload and not deleted.

      And then,,,, get rowkey,,,,throw filenotfound

      solution : write multiple hfiles and reduce split hfiles. because the data of scanner is ordered,we just need to open a hfile at the same time, when the current data dose not belong to the current hfile, we can close hfile and create new hfile.

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                Bo Cui Bo Cui
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: