Flume
  1. Flume
  2. FLUME-1920

Test case TestFileChannel fails when flume is built from paths containing the string "hadoop"

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: v1.3.0, v1.4.0, v1.3.1, v1.5.0, v1.6.0
    • Fix Version/s: v1.6.0
    • Component/s: Test
    • Labels:
      None

      Description

      When flume is built from a path that contains the string "hadoop" (ie: /home/user/hadoop_components/flume), the test case TestFileChannel fails.

      The reason it fails is because it can't find the correct location of the hadoop jar file - the function findHadoopJar in TestFileChannel.java
      looks for the hadoop jar path by searching for the string "hadoop" in the property java.class.path, and returns the first match of the search.
      This is not necessarily the correct location of the hadoop jar.

      The right thing to do is to look for the name of the hadoop jar in the classpath (ie: hadoop-core-1.1.1.jar), instead of looking for the string "hadoop".

      1. FLUME-1920-2.patch
        4 kB
        li xiang
      2. FLUME-1920-1.patch
        2 kB
        li xiang
      3. FLUME-1920.patch
        2 kB
        Aline Guedes Pinto

        Issue Links

          Activity

          Aline Guedes Pinto created issue -
          Aline Guedes Pinto made changes -
          Field Original Value New Value
          Comment [ When flume is built from a path that contains the string "hadoop" (ie: /home/user/hadoop_components/flume), the test case TestFileChannel fails.

          The reason it fails is because it can't find the correct location of the hadoop jar file - the function findHadoopJar in TestFileChannel.java
          looks for the hadoop jar path by searching for the string "hadoop" in the property java.class.path, and returns the first match of the search.
          This is not necessarily the correct location of the hadoop jar.

          The right thing to do is to look for the name of the hadoop jar in the classpath (ie: hadoop-core-1.1.1.jar), instead of looking for the string "hadoop". ]
          Aline Guedes Pinto made changes -
          Description When flume is built from a path that contains the string "hadoop" (ie: /home/user/hadoop_components/flume), the test case TestFileChannel fails.

          The reason it fails is because it can't find the correct location of the hadoop jar file - the function findHadoopJar in TestFileChannel.java
          looks for the hadoop jar path by searching for the string "hadoop" in the property java.class.path, and returns the first match of the search.
          This is not necessarily the correct location of the hadoop jar.

          The right thing to do is to look for the name of the hadoop jar in the classpath (ie: hadoop-core-1.1.1.jar), instead of looking for the string "hadoop".
          Aline Guedes Pinto made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s v1.3.1 [ 12323879 ]
          Fix Version/s v1.3.0 [ 12322140 ]
          Aline Guedes Pinto made changes -
          Attachment FLUME-1920.patch [ 12570149 ]
          Mike Percy made changes -
          Fix Version/s v1.3.0 [ 12322140 ]
          Fix Version/s v1.3.1 [ 12323879 ]
          Mike Percy made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          li xiang made changes -
          Comment [ Hi, Flume 1.6.0-SNAPSHOT also needs this patch ]
          li xiang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s v1.5.0 [ 12324642 ]
          Affects Version/s v1.6.0 [ 12327047 ]
          li xiang made changes -
          Attachment FLUME-1920-1.patch [ 12650987 ]
          li xiang made changes -
          Attachment FLUME-1920-2.patch [ 12658601 ]
          li xiang made changes -
          Remote Link This issue links to "Review request (Web Link)" [ 16410 ]
          li xiang made changes -
          Remote Link This issue links to "Review request (Web Link)" [ 16410 ]
          li xiang made changes -
          Remote Link This issue links to "Review request 24089 (Web Link)" [ 16411 ]
          Mike Percy made changes -
          Assignee Aline Guedes Pinto [ alinegds ] li xiang [ water ]
          Mike Percy made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s v1.6.0 [ 12327047 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              li xiang
              Reporter:
              Aline Guedes Pinto
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development