Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-481

Bug Fixes + HdfsProxy to use proxy user to impresonate the real user

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.21.0
    • 0.21.0
    • contrib/hdfsproxy
    • None
    • Reviewed

    Description

      Bugs:

      1. hadoop-version is not recognized if run ant command from src/contrib/ or from src/contrib/hdfsproxy
      If running ant command from $HADOOP_HDFS_HOME, hadoop-version will be passed to contrib's build through subant. But if running from src/contrib or src/contrib/hdfsproxy, the hadoop-version will not be recognized.

      2. LdapIpDirFilter.java is not thread safe. userName, Group & Paths are per request and can't be class members.

      3. Addressed the following StackOverflowError.
      ERROR [org.apache.catalina.core.ContainerBase.[Catalina].[localh
      ost].[/].[proxyForward]] Servlet.service() for servlet proxyForward threw exception
      java.lang.StackOverflowError
      at org.apache.catalina.core.ApplicationHttpRequest.getAttribute(ApplicationHttpR
      equest.java:229)
      This is due to when the target war (/target.war) does not exist, the forwarding war will forward to its parent context path /, which defines the forwarding war itself. This cause infinite loop. Added "HDFS Proxy Forward".equals(dstContext.getServletContextName() in the if logic to break the loop.

      4. Kerberos credentials of remote user aren't available. HdfsProxy needs to act on behalf of the real user to service the requests

      Attachments

        1. HDFS-481-NEW.patch
          110 kB
          Srikanth Sundarrajan
        2. HDFS-481-bp-y20s.patch
          130 kB
          Srikanth Sundarrajan
        3. HDFS-481-bp-y20s.patch
          113 kB
          Srikanth Sundarrajan
        4. HDFS-481-bp-y20s.patch
          4 kB
          Srikanth Sundarrajan
        5. HDFS-481-bp-y20.patch
          114 kB
          Srikanth Sundarrajan
        6. HDFS-481-bp-y20.patch
          98 kB
          Srikanth Sundarrajan
        7. HDFS-481.patch
          1 kB
          zhiyong zhang
        8. HDFS-481.patch
          2 kB
          zhiyong zhang
        9. HDFS-481.patch
          5 kB
          zhiyong zhang
        10. HDFS-481.patch
          12 kB
          zhiyong zhang
        11. HDFS-481.patch
          49 kB
          Srikanth Sundarrajan
        12. HDFS-481.patch
          41 kB
          Srikanth Sundarrajan
        13. HDFS-481.patch
          37 kB
          Srikanth Sundarrajan
        14. HDFS-481.patch
          36 kB
          Srikanth Sundarrajan
        15. HDFS-481.out
          1.02 MB
          Srikanth Sundarrajan

        Issue Links

          Activity

            People

              sriksun Srikanth Sundarrajan
              zhiyong1 zhiyong zhang
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: