HBase
  1. HBase
  2. HBASE-7122

Proper warning message when opening a log file with no entries (idle cluster)

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.2
    • Fix Version/s: 0.98.0, 0.94.8, 0.95.1
    • Component/s: Replication
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In case the cluster is idle and the log has rolled (offset to 0), replicationSource tries to open the log and gets an EOF exception. This gets printed after every 10 sec until an entry is inserted in it.

      2012-11-07 15:47:40,924 DEBUG regionserver.ReplicationSource (ReplicationSource.java:openReader(487)) - Opening log for replication c0315.hal.cloudera.com%2C40020%2C1352324202860.1352327804874 at 0
      2012-11-07 15:47:40,926 WARN  regionserver.ReplicationSource (ReplicationSource.java:openReader(543)) - 1 Got: 
      java.io.EOFException
      	at java.io.DataInputStream.readFully(DataInputStream.java:180)
      	at java.io.DataInputStream.readFully(DataInputStream.java:152)
      	at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
      	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
      	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
      	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
      	at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:55)
      	at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(SequenceFileLogReader.java:175)
      	at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:716)
      	at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.openReader(ReplicationSource.java:491)
      	at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:290)
      2012-11-07 15:47:40,927 WARN  regionserver.ReplicationSource (ReplicationSource.java:openReader(547)) - Waited too long for this file, considering dumping
      2012-11-07 15:47:40,927 DEBUG regionserver.ReplicationSource (ReplicationSource.java:sleepForRetries(562)) - Unable to open a reader, sleeping 1000 times 10
      
      

      We should reduce the log spewing in this case (or some informative message, based on the offset).

      1. HBase-7122.patch
        0.8 kB
        Himanshu Vashishtha
      2. HBASE-7122.v2.patch
        0.7 kB
        Gabriel Reid
      3. HBase-7122-94.patch
        0.8 kB
        Himanshu Vashishtha
      4. HBase-7122-95.patch
        0.8 kB
        Himanshu Vashishtha
      5. HBase-7122-95-v2.patch
        1 kB
        Himanshu Vashishtha
      6. HBase-7122-95-v3.patch
        1 kB
        Himanshu Vashishtha
      7. HBase-7122-95-v4.patch
        1 kB
        Himanshu Vashishtha
      8. HBase-7122-94-v2.patch
        1 kB
        Himanshu Vashishtha

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Himanshu Vashishtha
              Reporter:
              Himanshu Vashishtha
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development