Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-15198

RBF: Add test for MountTableRefresherService failed to refresh other router MountTableEntries in secure mode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.1, 3.4.0
    • rbf
    • None
    • Reviewed

    Description

      In issue HDFS-13443, update mount table cache imediately. The specified router update their own mount table cache imediately, then update other's by rpc protocol refreshMountTableEntries. But in secure mode, can't refresh other's router's. In specified router's log, error like this

      
      2020-02-27 22:59:07,212 WARN org.apache.hadoop.ipc.Client: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
      2020-02-27 22:59:07,213 ERROR org.apache.hadoop.hdfs.server.federation.router.MountTableRefresherThread: Failed to refresh mount table entries cache at router $host:8111
      java.io.IOException: DestHost:destPort host:8111 , LocalHost:localPort $host/$ip:0. Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
      at org.apache.hadoop.hdfs.protocolPB.RouterAdminProtocolTranslatorPB.refreshMountTableEntries(RouterAdminProtocolTranslatorPB.java:288)
      at org.apache.hadoop.hdfs.server.federation.router.MountTableRefresherThread.run(MountTableRefresherThread.java:65)
      2020-02-27 22:59:07,214 INFO org.apache.hadoop.hdfs.server.federation.resolver.MountTableResolver: Added new mount point /test_11 to resolver
      
      

      Attachments

        1. HDFS-15198.006.patch
          15 kB
          Chenyu Zheng
        2. HDFS-15198.005.patch
          14 kB
          Chenyu Zheng
        3. HDFS-15198.004.patch
          15 kB
          Chenyu Zheng
        4. HDFS-15198.003.patch
          20 kB
          Chenyu Zheng
        5. HDFS-15198.002.patch
          20 kB
          Chenyu Zheng
        6. HDFS-15198.001.patch
          1.0 kB
          Chenyu Zheng

        Issue Links

          Activity

            People

              zhengchenyu Chenyu Zheng
              zhengchenyu Chenyu Zheng
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 48h
                  48h
                  Remaining:
                  Remaining Estimate - 48h
                  48h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified