Uploaded image for project: 'Flume'
  1. Flume
  2. FLUME-1137

Recoverable Memory channel and File channel require Hadoop classes in classpath

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.2.0
    • None
    • Sinks+Sources
    • None

    Description

      RecoverableMemoryChannel needs Hadoop IO classes in classpath. On a machine where Hadoop isn't on Classpath, Class.forName throws NoClassDefFoundError, which is not caught by the factory class, causing the agent startup to fail. It is not exactly a good idea to expect every machine on which this channel will be used to have Hadoop installed. We currently depend on Hadoop/HDFS only where we are actually writing to HDFS. Even the JDBC channel has an embedded DB, thus not requiring the DB to be available in classpath.

      The same is true for the File Channel as well.

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. FLUME-1285 FileChannel has a dependency on Hadoop IO classes

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. FLUME-1246 FileChannel hangs silently when Hadoop libs not found

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Activity

            People

              Unassigned Unassigned
              hshreedharan Hari Shreedharan
              Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: