Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.18.0
    • Fix Version/s: 0.18.0
    • Component/s: fs
    • Labels:
      None
    • Environment:

      LINUX 2.6.9

    • Hadoop Flags:
      Reviewed

      Description

      TestUrlStreamHandler sets setURLStreamHandlerFactory as

      FsUrlStreamHandlerFactory factory =
              new org.apache.hadoop.fs.FsUrlStreamHandlerFactory();
          java.net.URL.setURLStreamHandlerFactory(factory);
      

      After this, MiniDFSCluster seems to hang while Datanodes tries to register in setNewStorageID, specifically at

      rand = SecureRandom.getInstance("SHA1PRNG").nextInt(Integer.MAX_VALUE);
      

      jstack output shows that the main thread is stuck in RawLocalFileSystem$LocalFSFileInputStream.read

      (Attaching the jstack)

      1. 3348-2nd-option.patch
        0.6 kB
        Raghu Angadi
      2. Datanode_jstack.txt
        23 kB
        Lohit Vijayarenu
      3. HADOOP-3348.patch
        1 kB
        Lohit Vijayarenu

        Activity

        Nigel Daley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Raghu Angadi made changes -
        Resolution Fixed [ 1 ]
        Fix Version/s 0.18.0 [ 12312972 ]
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Assignee lohit vijayarenu [ lohit ]
        Christophe Taton made changes -
        Remaining Estimate 0h [ 0 ]
        Original Estimate 0h [ 0 ]
        Lohit Vijayarenu made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Lohit Vijayarenu made changes -
        Attachment HADOOP-3348.patch [ 12381709 ]
        Raghu Angadi made changes -
        Attachment 3348-2nd-option.patch [ 12381613 ]
        Lohit Vijayarenu made changes -
        Attachment Datanode_jstack.txt [ 12381464 ]
        Lohit Vijayarenu made changes -
        Field Original Value New Value
        Description TestUrlStreamHandler sets setURLStreamHandlerFactory as
        {noformat)
        FsUrlStreamHandlerFactory factory =
                new org.apache.hadoop.fs.FsUrlStreamHandlerFactory();
            java.net.URL.setURLStreamHandlerFactory(factory);
        (noformat}

        After this, MiniDFSCluster seems to hang while Datanodes tries to register in setNewStorageID, specifically at
        {noformat}
        rand = SecureRandom.getInstance("SHA1PRNG").nextInt(Integer.MAX_VALUE);
        {noformat}

        jstack output shows that the main thread is stuck in RawLocalFileSystem$LocalFSFileInputStream.read

        (Attaching the jstack)
        TestUrlStreamHandler sets setURLStreamHandlerFactory as
        {noformat}
        FsUrlStreamHandlerFactory factory =
                new org.apache.hadoop.fs.FsUrlStreamHandlerFactory();
            java.net.URL.setURLStreamHandlerFactory(factory);
        {noformat}

        After this, MiniDFSCluster seems to hang while Datanodes tries to register in setNewStorageID, specifically at
        {noformat}
        rand = SecureRandom.getInstance("SHA1PRNG").nextInt(Integer.MAX_VALUE);
        {noformat}

        jstack output shows that the main thread is stuck in RawLocalFileSystem$LocalFSFileInputStream.read

        (Attaching the jstack)
        Lohit Vijayarenu created issue -

          People

          • Assignee:
            Lohit Vijayarenu
            Reporter:
            Lohit Vijayarenu
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development