Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-7122

Proper warning message when opening a log file with no entries (idle cluster)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.94.2
    • Fix Version/s: 0.98.0, 0.94.8, 0.95.1
    • Component/s: Replication
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In case the cluster is idle and the log has rolled (offset to 0), replicationSource tries to open the log and gets an EOF exception. This gets printed after every 10 sec until an entry is inserted in it.

      2012-11-07 15:47:40,924 DEBUG regionserver.ReplicationSource (ReplicationSource.java:openReader(487)) - Opening log for replication c0315.hal.cloudera.com%2C40020%2C1352324202860.1352327804874 at 0
      2012-11-07 15:47:40,926 WARN  regionserver.ReplicationSource (ReplicationSource.java:openReader(543)) - 1 Got: 
      java.io.EOFException
      	at java.io.DataInputStream.readFully(DataInputStream.java:180)
      	at java.io.DataInputStream.readFully(DataInputStream.java:152)
      	at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
      	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
      	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
      	at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
      	at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:55)
      	at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(SequenceFileLogReader.java:175)
      	at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:716)
      	at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.openReader(ReplicationSource.java:491)
      	at org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.run(ReplicationSource.java:290)
      2012-11-07 15:47:40,927 WARN  regionserver.ReplicationSource (ReplicationSource.java:openReader(547)) - Waited too long for this file, considering dumping
      2012-11-07 15:47:40,927 DEBUG regionserver.ReplicationSource (ReplicationSource.java:sleepForRetries(562)) - Unable to open a reader, sleeping 1000 times 10
      
      

      We should reduce the log spewing in this case (or some informative message, based on the offset).

        Attachments

        1. HBase-7122.patch
          0.8 kB
          Himanshu Vashishtha
        2. HBASE-7122.v2.patch
          0.7 kB
          Gabriel Reid
        3. HBase-7122-94.patch
          0.8 kB
          Himanshu Vashishtha
        4. HBase-7122-95.patch
          0.8 kB
          Himanshu Vashishtha
        5. HBase-7122-95-v2.patch
          1 kB
          Himanshu Vashishtha
        6. HBase-7122-95-v3.patch
          1 kB
          Himanshu Vashishtha
        7. HBase-7122-95-v4.patch
          1 kB
          Himanshu Vashishtha
        8. HBase-7122-94-v2.patch
          1 kB
          Himanshu Vashishtha

          Issue Links

            Activity

              People

              • Assignee:
                v.himanshu Himanshu Vashishtha
                Reporter:
                v.himanshu Himanshu Vashishtha
              • Votes:
                0 Vote for this issue
                Watchers:
                12 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: