Flume
  1. Flume
  2. FLUME-2443

org.apache.hadoop.fs.FSDataOutputStream.sync() is deprecated in hadoop 2.4

    Details

    • Type: Dependency upgrade Dependency upgrade
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.5.0, v1.5.0.1, v1.6.0
    • Fix Version/s: v1.6.0
    • Labels:
      None
    • Environment:

      Linux PPC / x86

      Description

      HDFS sink uses this method, which is deprecated in hadoop 2.4.1, and no longer present in the current hadoop developments:

      java.lang.NoSuchMethodError: org/apache/hadoop/fs/FSDataOutputStream.sync()V
      at org.apache.flume.sink.hdfs.HDFSDataStream.sync(HDFSDataStream.java:131)
      at org.apache.flume.sink.hdfs.BucketWriter$6.call(BucketWriter.java:502)
      at org.apache.flume.sink.hdfs.BucketWriter$6.call(BucketWriter.java:499)
      at org.apache.flume.sink.hdfs.BucketWriter$9$1.run(BucketWriter.java:718)
      at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:183)
      at org.apache.flume.sink.hdfs.BucketWriter.access$1700(BucketWriter.java:59)
      at org.apache.flume.sink.hdfs.BucketWriter$9.call(BucketWriter.java:715)
      at java.util.concurrent.FutureTask.run(FutureTask.java:273)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1176)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
      at java.lang.Thread.run(Thread.java:853)

      1. FLUME-2443.patch
        6 kB
        Hari Shreedharan

        Activity

        Corentin Baron created issue -
        Hari Shreedharan made changes -
        Field Original Value New Value
        Assignee Hari Shreedharan [ hshreedharan ]
        Hari Shreedharan made changes -
        Attachment FLUME-2443.patch [ 12660717 ]
        Hari Shreedharan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Fix Version/s v1.6.0 [ 12327047 ]
        Jarek Jarcec Cecho made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]

          People

          • Assignee:
            Hari Shreedharan
            Reporter:
            Corentin Baron
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development