Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-1128

GetHDFSSequenceFile fails with some secure hdfs configurations

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 0.3.0
    • Fix Version/s: None
    • Component/s: Extensions
    • Labels:
      None

      Description

      hdfs-site.xml snippet

          <property>
              <name>dfs.data.transfer.protection</name>
              <value>privacy</value>
          </property>
          <property>
              <name>dfs.encrypt.data.transfer</name>
              <value>true</value>
          </property>
          <property>
              <name>dfs.encrypt.data.transfer.algorithm</name>
              <value>rc4</value>
          </property>
          </property>
      

      core-site.xml snippet

          <property>
              <name>hadoop.security.authentication</name>
              <value>kerberos</value>
          </property>
             <property>
              <name>hadoop.rpc.protection</name>
              <value>privacy</value>
          </property>
      
      

      GetHDFS works with the same config. I believe the file listing may be working (as evidenced by the filename being read)

      Log messages:

      015-11-07 22:43:18,581 WARN [Timer-Driven Process Thread-8] org.apache.hadoop.ipc.Client Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
      2015-11-07 22:43:18,582 ERROR [Timer-Driven Process Thread-8] o.a.n.p.hadoop.GetHDFSSequenceFile GetHDFSSequenceFile[id=9549891c-ce8f-478b-85a2-eb5bd727ce73] Error retrieving file hdfs://computer1:9000/use/seq/1ad40994-85ca-11e5-b15d-94de80cd2495.sf from HDFS due to java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "computer2/127.0.1.1"; destination host is: "computer1":9000; : java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "computer2/127.0.1.1"; destination host is: "computer1":9000; 
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                tkurc Tony Kurc
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: