HBase
  1. HBase
  2. HBASE-766

FileNotFoundException trying to load HStoreFile 'data'

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.2.0
    • Component/s: None
    • Labels:
      None

      Description

      From Renaud Delbru up on the list:

      Hi,
      
      after our issues ("Replay of HLog required", in a precious thread) with HBase, it seems that HBase has corrupted regions.
      We have, on the three region servers, errors stating that HBase cannot open certain regions because some map files on hdfs are missing (see the log attached).
      
      Do you have any ideas how to fix this ?
      
      Thanks.
      
      java.io.FileNotFoundException: File does not exist: hdfs://hadoop1.sindice.net:54310/hbase/page-repository/1105668475/field/mapfiles/5122893264992435570/data
        at org.apache.hadoop.dfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:369)
        at org.apache.hadoop.hbase.regionserver.HStoreFile.length(HStoreFile.java:464)
        at org.apache.hadoop.hbase.regionserver.HStore.loadHStoreFiles(HStore.java:409)
        at org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:236)
        at org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1575)
        at org.apache.hadoop.hbase.regionserver.HRegion.<init>(HRegion.java:451)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:901)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:876)
        at org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:816)
        at java.lang.Thread.run(Thread.java:619)
      
      

      I'd thought we'd added handling of this kind of event post HDFS crashings but looking in code, it seems that TRUNK may not have been fixed up properly.

      1. 766.patch
        0.7 kB
        stack
      2. hs.patch
        0.7 kB
        stack

        Activity

        Jim Kellerman made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        stack made changes -
        Status Reopened [ 4 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        stack made changes -
        Resolution Fixed [ 1 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        stack made changes -
        Attachment hs.patch [ 12387117 ]
        stack made changes -
        Assignee stack [ stack ]
        stack made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        stack made changes -
        Field Original Value New Value
        Attachment 766.patch [ 12386741 ]
        stack created issue -

          People

          • Assignee:
            stack
            Reporter:
            stack
          • Votes:
            1 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development