HBase
  1. HBase
  2. HBASE-5340

HFile/LoadIncrementalHFiles should specify file name when it fails to load a file.

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.90.5, 0.92.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      I was attempting to do a bulk load and got this error message. Unfortunately it didn't tell me which file had the problem.

      Exception in thread "main" java.io.IOException: Trailer 'header' is wrong; does the trailer size match content?
              at org.apache.hadoop.hbase.io.hfile.HFile$FixedFileTrailer.deserialize(HFile.java:1527)
              at org.apache.hadoop.hbase.io.hfile.HFile$Reader.readTrailer(HFile.java:885)
              at org.apache.hadoop.hbase.io.hfile.HFile$Reader.loadFileInfo(HFile.java:819)
              at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.tryLoad(LoadIncrementalHFiles.java:204)
              at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:173)
              at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.run(LoadIncrementalHFiles.java:452)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
              at org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.main(LoadIncrementalHFiles.java:457)
      

        Activity

        Hide
        Jonathan Hsieh added a comment -

        I'm going to close this since the codebase as moved on (this was likely pre atomic bulk load, 90.5ish era). If I encounter again, I'll open a new issue.

        Show
        Jonathan Hsieh added a comment - I'm going to close this since the codebase as moved on (this was likely pre atomic bulk load, 90.5ish era). If I encounter again, I'll open a new issue.
        Hide
        Ian Varley added a comment -

        Hsieh, does this issue still apply? I did a codebase search and that phrase ("does the trailer size match content") doesn't appear to exist any longer, so I'm assuming HFilev2 might have fixed this.

        Show
        Ian Varley added a comment - Hsieh, does this issue still apply? I did a codebase search and that phrase ("does the trailer size match content") doesn't appear to exist any longer, so I'm assuming HFilev2 might have fixed this.

          People

          • Assignee:
            Unassigned
            Reporter:
            Jonathan Hsieh
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development