Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1205

NPE related to checkpointing when using FileChannel

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 1.2.0
    • 1.2.0
    • Sinks+Sources
    • None
    • CentOS 5.6 x64

    Description

      I'm seeing NPE when stopping the Flume agent, and then starting it up again. I'm using this config file:

      agent.channels = c1
      agent.sources = r1
      agent.sinks = k1
      #
      agent.channels.c1.type = FILE
      #
      agent.sources.r1.channels = c1
      agent.sources.r1.type = NETCAT
      agent.sources.r1.bind = c1123.hal.cloudera.com
      agent.sources.r1.port = 41414
      #
      agent.sinks.k1.channel = c1
      agent.sinks.k1.type = org.apache.flume.sink.hbase.HBaseSink
      agent.sinks.k1.table = footable5
      agent.sinks.k1.columnFamily = foocol5
      #agent.sinks.k1.batchsize = 100
      #agent.sinks.k1.serializer.rowPrefix = default
      #agent.sinks.k1.serializer.incrementRow = incRow
      #agent.sinks.k1.serializer.suffix = uuid
      agent.sinks.k1.serializer.payloadColumn = paycol
      agent.sinks.k1.serializer.incrementColumn = inccol

      ...and I'm seeing this error:

      2012-05-15 21:40:44,553 ERROR file.Log$BackgroundWorker: General error in checkpoint worker
      java.lang.NullPointerException
      at org.apache.flume.channel.file.Log.getLastCheckpoint(Log.java:529)
      at org.apache.flume.channel.file.Log.access$200(Log.java:53)
      at org.apache.flume.channel.file.Log$BackgroundWorker.run(Log.java:659)
      2012-05-15 21:40:54,706 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x1375308bd090014 after 0ms
      2012-05-15 21:40:59,302 DEBUG source.NetcatSource: Starting connection handler
      2012-05-15 21:40:59,302 DEBUG source.NetcatSource: Chars read = 512
      2012-05-15 21:41:08,041 DEBUG zookeeper.ClientCnxn: Got ping response for sessionid: 0x1375308bd090014 after 0ms
      2012-05-15 21:41:14,531 DEBUG properties.PropertiesFileConfigurationProvider: Checking file:/etc/flume-ng/conf/flume.conf for changes
      2012-05-15 21:41:14,561 ERROR file.Log$BackgroundWorker: General error in checkpoint worker
      java.lang.NullPointerException
      at org.apache.flume.channel.file.Log.getLastCheckpoint(Log.java:529)
      at org.apache.flume.channel.file.Log.access$200(Log.java:53)
      at org.apache.flume.channel.file.Log$BackgroundWorker.run(Log.java:659)

      Attachments

        1. FLUME-1205-2.patch
          3 kB
          Arvind Prabhakar

        Activity

          People

            aprabhakar Arvind Prabhakar
            will@cloudera.com Will McQueen
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: