Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.0
    • Fix Version/s: 1.5.0
    • Component/s: None
    • Labels:
      None
    1. FLUME-2263-1.patch
      2 kB
      Gopinathan A
    2. FLUME-2263-0.patch
      2 kB
      Gopinathan A

      Activity

      Hide
      hudson Hudson added a comment -

      SUCCESS: Integrated in flume-trunk #627 (See https://builds.apache.org/job/flume-trunk/627/)
      FLUME-2263. Bump Hadoop 2 version to 2.3.0 (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo/?p=flume.git&a=commit&h=f4c6c7025e892ecf0d6fac1b72b5806fe7c9cd8d)

      • pom.xml
      • flume-tools/pom.xml
      • flume-ng-sinks/flume-hdfs-sink/pom.xml
      Show
      hudson Hudson added a comment - SUCCESS: Integrated in flume-trunk #627 (See https://builds.apache.org/job/flume-trunk/627/ ) FLUME-2263 . Bump Hadoop 2 version to 2.3.0 (hshreedharan: http://git-wip-us.apache.org/repos/asf/flume/repo/?p=flume.git&a=commit&h=f4c6c7025e892ecf0d6fac1b72b5806fe7c9cd8d ) pom.xml flume-tools/pom.xml flume-ng-sinks/flume-hdfs-sink/pom.xml
      Hide
      jira-bot ASF subversion and git services added a comment -

      Commit 164f28e2b29bee38f4bf24af2d093cc761686d8a in flume's branch refs/heads/flume-1.5 from Hari Shreedharan
      [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=164f28e ]

      FLUME-2263. Bump Hadoop 2 version to 2.3.0

      (Gopinathan A via Hari Shreedharan)

      Show
      jira-bot ASF subversion and git services added a comment - Commit 164f28e2b29bee38f4bf24af2d093cc761686d8a in flume's branch refs/heads/flume-1.5 from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=164f28e ] FLUME-2263 . Bump Hadoop 2 version to 2.3.0 (Gopinathan A via Hari Shreedharan)
      Hide
      jira-bot ASF subversion and git services added a comment -

      Commit f4c6c7025e892ecf0d6fac1b72b5806fe7c9cd8d in flume's branch refs/heads/trunk from Hari Shreedharan
      [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=f4c6c70 ]

      FLUME-2263. Bump Hadoop 2 version to 2.3.0

      (Gopinathan A via Hari Shreedharan)

      Show
      jira-bot ASF subversion and git services added a comment - Commit f4c6c7025e892ecf0d6fac1b72b5806fe7c9cd8d in flume's branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=f4c6c70 ] FLUME-2263 . Bump Hadoop 2 version to 2.3.0 (Gopinathan A via Hari Shreedharan)
      Hide
      hshreedharan Hari Shreedharan added a comment -

      +1

      Show
      hshreedharan Hari Shreedharan added a comment - +1
      Hide
      gopinathan.av Gopinathan A added a comment -

      updated the patch as per comment

      Show
      gopinathan.av Gopinathan A added a comment - updated the patch as per comment
      Hide
      gopinathan.av Gopinathan A added a comment -

      Ok, I will update this patch asap.

      Show
      gopinathan.av Gopinathan A added a comment - Ok, I will update this patch asap.
      Hide
      hshreedharan Hari Shreedharan added a comment -

      Gopinathan A - At this time, it probably makes more sense to upgrade to Hadoop 2.3.0 (http://hadoop.apache.org/releases.html#News)

      Show
      hshreedharan Hari Shreedharan added a comment - Gopinathan A - At this time, it probably makes more sense to upgrade to Hadoop 2.3.0 ( http://hadoop.apache.org/releases.html#News )
      Hide
      gopinathan.av Gopinathan A added a comment -

      Thanks Hari Shreedharan

      I have tested this patch as you mentioned.

      Show
      gopinathan.av Gopinathan A added a comment - Thanks Hari Shreedharan I have tested this patch as you mentioned.
      Hide
      hshreedharan Hari Shreedharan added a comment -

      You would need to check out hbase code (and checkout the hbase-94 release tag) and then build mvn clean install -DskipTests -Dhadoop.profile=2 profile activated.

      Show
      hshreedharan Hari Shreedharan added a comment - You would need to check out hbase code (and checkout the hbase-94 release tag) and then build mvn clean install -DskipTests -Dhadoop.profile=2 profile activated.
      Hide
      gopinathan.av Gopinathan A added a comment -

      I m getting below error while running testcases in hadoop profile 2, i guess its taking hbase jar which is complied with hadoop-1. How to resolve this issue?

      org.apache.flume.sink.hbase.TestHBaseSink  Time elapsed: 579 sec  <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.hdfs.MiniDFSCluster.<init>(ILorg/apache/hadoop/conf/Configuration;IZZZLorg/apache/hadoop/hdfs/server/common/HdfsConstants$StartupOption;[Ljava/lang/String;[Ljava/lang/String;[J)V
      	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:452)
      	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:620)
      	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:576)
      	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:545)
      	at org.apache.flume.sink.hbase.TestHBaseSink.setUp(TestHBaseSink.java:66)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      
      
      Show
      gopinathan.av Gopinathan A added a comment - I m getting below error while running testcases in hadoop profile 2, i guess its taking hbase jar which is complied with hadoop-1. How to resolve this issue? org.apache.flume.sink.hbase.TestHBaseSink Time elapsed: 579 sec <<< ERROR! java.lang.NoSuchMethodError: org.apache.hadoop.hdfs.MiniDFSCluster.<init>(ILorg/apache/hadoop/conf/Configuration;IZZZLorg/apache/hadoop/hdfs/server/common/HdfsConstants$StartupOption;[Ljava/lang/String;[Ljava/lang/String;[J)V at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:452) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:620) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:576) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:545) at org.apache.flume.sink.hbase.TestHBaseSink.setUp(TestHBaseSink.java:66) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      Hide
      gopinathan.av Gopinathan A added a comment -

      This patch contains fix for FLUME-2158 also.

      We can also upgrade hbase to latest stable version.

      Show
      gopinathan.av Gopinathan A added a comment - This patch contains fix for FLUME-2158 also. We can also upgrade hbase to latest stable version.

        People

        • Assignee:
          gopinathan.av Gopinathan A
          Reporter:
          hshreedharan Hari Shreedharan
        • Votes:
          0 Vote for this issue
          Watchers:
          5 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development