Flume
  1. Flume
  2. FLUME-2019

(SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)

    Details

    • Type: Question Question
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: v1.3.1
    • Fix Version/s: v1.3.1
    • Component/s: Sinks+Sources
    • Labels:
    • Environment:

      Ubuntu 12.04

    • Release Note:
      Build related issue

      Description

      I am getting the below error, when I try to upload a file into Hadoop HDFS.

      2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
      java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

      Flume.conf is as below
      ----------------------

      a1.sources = r1
      a1.sinks = k1
      a1.channels = c1

      a1.sources.r1.type = netcat
      a1.sources.r1.bind = localhost
      a1.sources.r1.port = 44444

      a1.sinks.k1.type = hdfs
      a1.sinks.k1.channel = c1
      a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
      a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

      a1.channels.c1.type = memory
      a1.channels.c1.capacity = 100000
      a1.channels.c1.transactionCapacity = 100

      a1.sources.r1.channels = c1
      a1.sinks.k1.channel = c1

        Activity

        Kanikkannan made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Release Note Build related issue
        Resolution Fixed [ 1 ]
        Israel Ekpo made changes -
        Issue Type Bug [ 1 ] Question [ 11 ]
        Priority Blocker [ 1 ] Minor [ 4 ]
        Kanikkannan made changes -
        Description I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

         #--- example.conf: A single-node Flume configuration

         #--- Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

         # Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

         # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

         # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

         # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1


        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444


        a1.sinks.k1.type = hdfs
        a1.sinks.k1.channel = c1
        a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
        a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000


        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        Kanikkannan made changes -
        Description I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

         # example.conf: A single-node Flume configuration

         # Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

         # Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

         # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

         # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

         # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

         #--- example.conf: A single-node Flume configuration

         #--- Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

         # Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

         # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

         # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

         # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        Kanikkannan made changes -
        Description I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

        # example.conf: A single-node Flume configuration

        # Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

        #Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

        # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

        # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

        # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

         # example.conf: A single-node Flume configuration

         # Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

         # Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

         # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

         # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

         # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        Kanikkannan made changes -
        Field Original Value New Value
        Description I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

        # example.conf: A single-node Flume configuration

        # Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

        # Avro source
        # a1.sources.r1.type = avro
        # a1.sources.r1.channels = c1
        # a1.sources.r1.bind = localhost
        # a1.sources.r1.port = 44444

        #Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

        # Describe the sink - terminal
        # a1.sinks.k1.type = logger

        # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

        # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

        # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        I am getting the below error, when I try to upload a file into Hadoop HDFS.

        2013-04-23 12:06:39,141 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:460)] process failed
        java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;

        Flume.conf is as below
        ----------------------

        # example.conf: A single-node Flume configuration

        # Name the components on this agent
        a1.sources = r1
        a1.sinks = k1
        a1.channels = c1

        #Describe/configure the Netcat source
        a1.sources.r1.type = netcat
        a1.sources.r1.bind = localhost
        a1.sources.r1.port = 44444

        # Describe the sink
         a1.sinks.k1.type = hdfs
         a1.sinks.k1.channel = c1
         a1.sinks.k1.hdfs.path = hdfs://localhost:8020/projects
         a1.sinks.k1.hdfs.hdfs.maxOpenFiles = 10000

        # Use a channel which buffers events in memory
        a1.channels.c1.type = memory
        a1.channels.c1.capacity = 100000
        a1.channels.c1.transactionCapacity = 100

        # Bind the source and sink to the channel
        a1.sources.r1.channels = c1
        a1.sinks.k1.channel = c1
        Kanikkannan created issue -

          People

          • Assignee:
            Unassigned
            Reporter:
            Kanikkannan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development