Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Cannot Reproduce
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: test
    • Labels:
      None

      Description

      During the 1.6.0-SNAPSHOT with hadoop 1.2 build:

      2014-03-12 06:25:12,847 [metadata.MetadataLocationObtainer] TRACE: tid=1 oid=9019  Looking up in +r row=!0;1;  extent=+r<< tserver=host1:55061
      2014-03-12 06:25:12,848 [impl.ThriftTransportPool] TRACE: Creating new connection to connection to host1:55061
      2014-03-12 06:25:12,856 [impl.ThriftTransportPool] TRACE: Returned connection host1:55061 (120000) ioCount : 920
      2014-03-12 06:25:12,856 [impl.ThriftScanner] WARN : Security Violation in scan request to host1:55061: ThriftSecurityException(user:root, code:null)
      java.lang.RuntimeException: org.apache.accumulo.core.client.AccumuloSecurityException: Error DEFAULT_SECURITY_ERROR for user root - Unknown security exception
      	at org.apache.accumulo.core.client.impl.ScannerIterator.hasNext(ScannerIterator.java:187)
      	at org.apache.accumulo.test.VolumeIT.verifyData(VolumeIT.java:168)
      	at org.apache.accumulo.test.VolumeIT.verifyVolumesUsed(VolumeIT.java:351)
      	at org.apache.accumulo.test.VolumeIT.testReplaceVolume(VolumeIT.java:470)
      	at org.apache.accumulo.test.VolumeIT.testDirtyReplaceVolumes(VolumeIT.java:504)
      

      Farther down, the cause given:

      Caused by: ThriftSecurityException(user:root, code:null)
      	at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startScan_result$startScan_resultStandardScheme.read(TabletClientService.java:5100)
      	at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startScan_result$startScan_resultStandardScheme.read(TabletClientService.java:5077)
      	at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$startScan_result.read(TabletClientService.java:5000)
      	at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
      	at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.recv_startScan(TabletClientService.java:226)
      	at org.apache.accumulo.core.tabletserver.thrift.TabletClientService$Client.startScan(TabletClientService.java:202)
      	at org.apache.accumulo.core.client.impl.ThriftScanner.getBatchFromServer(ThriftScanner.java:99)
      	... 49 more
      

      Prior to getting this security error, it got a connection refused error. 381 times over the course of 23 seconds.

        Activity

        Hide
        Eric Newton added a comment -

        I also verified that the ports opened by the restarted services (gc, master, tservers) did not accidentally pick port #55061.

        Show
        Eric Newton added a comment - I also verified that the ports opened by the restarted services (gc, master, tservers) did not accidentally pick port #55061.
        Hide
        Eric Newton added a comment -

        It looks like the client got a connection to host1:55061. Perhaps it was a conflict with some other process running on the test server. I did verify that there was no other test running at the time, and there were no other users on the system at the time.

        Show
        Eric Newton added a comment - It looks like the client got a connection to host1:55061. Perhaps it was a conflict with some other process running on the test server. I did verify that there was no other test running at the time, and there were no other users on the system at the time.
        Hide
        Eric Newton added a comment -

        Decoding zookeeper responses, the tablet server lock still existed, and was pointed to a dead tablet server. That explains the connection refused exceptions, but not the DEFAULT_SECURITY_ERROR

        Show
        Eric Newton added a comment - Decoding zookeeper responses, the tablet server lock still existed, and was pointed to a dead tablet server. That explains the connection refused exceptions, but not the DEFAULT_SECURITY_ERROR

          People

          • Assignee:
            Eric Newton
            Reporter:
            Eric Newton
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development