Accumulo
  1. Accumulo
  2. ACCUMULO-14

Transition from full Accumulo mocking

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.4.4, 1.5.0
    • Component/s: client
    • Labels:
      None

      Description

      Original discussion present here:http://mail-archives.apache.org/mod_mbox/incubator-accumulo-dev/201110.mbox/%3CCAGUtCHrN3p-7C8Uz7eT0Ze4L0ORzDj1f-x-JWdyrLc=Kx=o8ZQ@mail.gmail.com%3E

      Jesse Yates: "Maintaining a real instance and a mock instance ends up creating a lot of extra work for dev's by ensuring that there impls are kept synchronized....[using a real] instance of Accumulo running on the local file system. This would mean less work in the long run to maintain a separate instance and better testing for users and new features."

      Keith Turner: "its very fast to create a mock instance which means that unit test run very quickly...[and] its all in process which is useful for debugging...making mock leverage more of the actual accumulo code, but possibly keep it in process for speed and debugging."

      This ticket is to track the discussion and development of a less mocked test instance of accumulo, that relies more heavily on the actual implementation, rather than parallel mocking features.

      There are no Sub-Tasks for this issue.

        Activity

        Hide
        Hudson added a comment -

        Integrated in Accumulo-1.4.x #300 (See https://builds.apache.org/job/Accumulo-1.4.x/300/)
        ACCUMULO-14 move MAC to mini package (Revision 1479114)
        ACCUMULO-14 move MAC to server module (Revision 1478977)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/branches/1.4/src/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/branches/1.4/src/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/mini
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java
        • /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/mini
        • /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/test/MiniAccumuloClusterTest.java

        kturner :
        Files :

        • /accumulo/branches/1.4/pom.xml
        • /accumulo/branches/1.4/src/proxy/pom.xml
        • /accumulo/branches/1.4/src/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/branches/1.4/src/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java
        • /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java
        • /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/test/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.4/src/server/src/test/resources
        • /accumulo/branches/1.4/src/server/src/test/resources/log4j.properties
        • /accumulo/branches/1.4/src/test
        Show
        Hudson added a comment - Integrated in Accumulo-1.4.x #300 (See https://builds.apache.org/job/Accumulo-1.4.x/300/ ) ACCUMULO-14 move MAC to mini package (Revision 1479114) ACCUMULO-14 move MAC to server module (Revision 1478977) Result = SUCCESS kturner : Files : /accumulo/branches/1.4/src/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/branches/1.4/src/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/mini /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/mini /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/test/MiniAccumuloClusterTest.java kturner : Files : /accumulo/branches/1.4/pom.xml /accumulo/branches/1.4/src/proxy/pom.xml /accumulo/branches/1.4/src/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/branches/1.4/src/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java /accumulo/branches/1.4/src/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java /accumulo/branches/1.4/src/server/src/test/java/org/apache/accumulo/server/test/MiniAccumuloClusterTest.java /accumulo/branches/1.4/src/server/src/test/resources /accumulo/branches/1.4/src/server/src/test/resources/log4j.properties /accumulo/branches/1.4/src/test
        Hide
        Hudson added a comment -

        Integrated in Accumulo-1.5 #98 (See https://builds.apache.org/job/Accumulo-1.5/98/)
        ACCUMULO-14 move MAC to mini package (Revision 1478988)
        ACCUMULO-14 move MAC to server module (Revision 1478896)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/branches/1.5/server/pom.xml
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini
        • /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/test
        • /accumulo/branches/1.5/server/src/test/resources/FooFilter.jar
        • /accumulo/branches/1.5/server/src/test/resources/log4j.properties
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java

        kturner :
        Files :

        • /accumulo/branches/1.5/proxy/pom.xml
        • /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java
        • /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java
        • /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Show
        Hudson added a comment - Integrated in Accumulo-1.5 #98 (See https://builds.apache.org/job/Accumulo-1.5/98/ ) ACCUMULO-14 move MAC to mini package (Revision 1478988) ACCUMULO-14 move MAC to server module (Revision 1478896) Result = SUCCESS kturner : Files : /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/branches/1.5/server/pom.xml /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/test /accumulo/branches/1.5/server/src/test/resources/FooFilter.jar /accumulo/branches/1.5/server/src/test/resources/log4j.properties /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java kturner : Files : /accumulo/branches/1.5/proxy/pom.xml /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #851 (See https://builds.apache.org/job/Accumulo-Trunk/851/)
        ACCUMULO-1316, ACCUMULO-14 merge to trunk (Revision 1479020)
        ACCUMULO-14 move MAC to server module
        ACCUMULO-1360 added apache header (Revision 1478927)

        Result = SUCCESS
        ctubbsii :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/assemble/pom.xml
        • /accumulo/trunk/core
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/proxy/pom.xml
        • /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/trunk/server
        • /accumulo/trunk/server/pom.xml
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini
        • /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java
        • /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/test
        • /accumulo/trunk/server/src/test/resources/FooFilter.jar
        • /accumulo/trunk/server/src/test/resources/log4j.properties
        • /accumulo/trunk/src
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java

        kturner :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/core
        • /accumulo/trunk/docs/examples/README.classpath
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/proxy/pom.xml
        • /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/trunk/server
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java
        • /accumulo/trunk/src
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #851 (See https://builds.apache.org/job/Accumulo-Trunk/851/ ) ACCUMULO-1316 , ACCUMULO-14 merge to trunk (Revision 1479020) ACCUMULO-14 move MAC to server module ACCUMULO-1360 added apache header (Revision 1478927) Result = SUCCESS ctubbsii : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/assemble/pom.xml /accumulo/trunk/core /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/proxy/pom.xml /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/trunk/server /accumulo/trunk/server/pom.xml /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/test /accumulo/trunk/server/src/test/resources/FooFilter.jar /accumulo/trunk/server/src/test/resources/log4j.properties /accumulo/trunk/src /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java kturner : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/core /accumulo/trunk/docs/examples/README.classpath /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/proxy/pom.xml /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/trunk/server /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java /accumulo/trunk/src /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk-Hadoop-2.0 #209 (See https://builds.apache.org/job/Accumulo-Trunk-Hadoop-2.0/209/)
        ACCUMULO-1316, ACCUMULO-14 merge to trunk (Revision 1479020)
        ACCUMULO-14 move MAC to server module
        ACCUMULO-1360 added apache header (Revision 1478927)

        Result = SUCCESS
        ctubbsii :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/assemble/pom.xml
        • /accumulo/trunk/core
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/proxy/pom.xml
        • /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/trunk/server
        • /accumulo/trunk/server/pom.xml
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini
        • /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java
        • /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/test
        • /accumulo/trunk/server/src/test/resources/FooFilter.jar
        • /accumulo/trunk/server/src/test/resources/log4j.properties
        • /accumulo/trunk/src
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java

        kturner :
        Files :

        • /accumulo/trunk
        • /accumulo/trunk/assemble
        • /accumulo/trunk/core
        • /accumulo/trunk/docs/examples/README.classpath
        • /accumulo/trunk/examples
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java
        • /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java
        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/proxy/pom.xml
        • /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/trunk/server
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java
        • /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java
        • /accumulo/trunk/src
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk-Hadoop-2.0 #209 (See https://builds.apache.org/job/Accumulo-Trunk-Hadoop-2.0/209/ ) ACCUMULO-1316 , ACCUMULO-14 merge to trunk (Revision 1479020) ACCUMULO-14 move MAC to server module ACCUMULO-1360 added apache header (Revision 1478927) Result = SUCCESS ctubbsii : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/assemble/pom.xml /accumulo/trunk/core /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/proxy/pom.xml /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/trunk/server /accumulo/trunk/server/pom.xml /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java /accumulo/trunk/server/src/test/java/org/apache/accumulo/server/test /accumulo/trunk/server/src/test/resources/FooFilter.jar /accumulo/trunk/server/src/test/resources/log4j.properties /accumulo/trunk/src /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java kturner : Files : /accumulo/trunk /accumulo/trunk/assemble /accumulo/trunk/core /accumulo/trunk/docs/examples/README.classpath /accumulo/trunk/examples /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/ZooStore.java /accumulo/trunk/fate/src/main/java/org/apache/accumulo/fate/zookeeper/ZooSession.java /accumulo/trunk/pom.xml /accumulo/trunk/proxy/pom.xml /accumulo/trunk/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/trunk/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/trunk/server /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java /accumulo/trunk/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java /accumulo/trunk/src /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TableOperationsIT.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Hide
        Hudson added a comment -

        Integrated in Accumulo-1.5-Hadoop-2.0 #100 (See https://builds.apache.org/job/Accumulo-1.5-Hadoop-2.0/100/)
        ACCUMULO-14 move MAC to mini package (Revision 1478988)
        ACCUMULO-14 move MAC to server module (Revision 1478896)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/branches/1.5/server/pom.xml
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini
        • /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/test
        • /accumulo/branches/1.5/server/src/test/resources/FooFilter.jar
        • /accumulo/branches/1.5/server/src/test/resources/log4j.properties
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java

        kturner :
        Files :

        • /accumulo/branches/1.5/proxy/pom.xml
        • /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java
        • /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java
        • /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java
        • /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java
        • /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java
        • /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Show
        Hudson added a comment - Integrated in Accumulo-1.5-Hadoop-2.0 #100 (See https://builds.apache.org/job/Accumulo-1.5-Hadoop-2.0/100/ ) ACCUMULO-14 move MAC to mini package (Revision 1478988) ACCUMULO-14 move MAC to server module (Revision 1478896) Result = SUCCESS kturner : Files : /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/branches/1.5/server/pom.xml /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloCluster.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/mini/MiniAccumuloConfig.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/mini/MiniAccumuloClusterTest.java /accumulo/branches/1.5/server/src/test/java/org/apache/accumulo/server/test /accumulo/branches/1.5/server/src/test/resources/FooFilter.jar /accumulo/branches/1.5/server/src/test/resources/log4j.properties /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java kturner : Files : /accumulo/branches/1.5/proxy/pom.xml /accumulo/branches/1.5/proxy/src/main/java/org/apache/accumulo/proxy/Proxy.java /accumulo/branches/1.5/proxy/src/test/java/org/apache/accumulo/proxy/SimpleTest.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloCluster.java /accumulo/branches/1.5/server/src/main/java/org/apache/accumulo/server/test/MiniAccumuloConfig.java /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java /accumulo/branches/1.5/test/src/main/java/org/apache/accumulo/test/MiniAccumuloConfig.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/fate/zookeeper/ZooLockTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MetaSplitTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/ShellServerTest.java /accumulo/branches/1.5/test/src/test/java/org/apache/accumulo/test/TestAccumuloSplitRecovery.java
        Hide
        Billie Rinaldi added a comment -

        Awesome, that fixed my problem. Thanks, Keith!

        Show
        Billie Rinaldi added a comment - Awesome, that fixed my problem. Thanks, Keith!
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #628 (See https://builds.apache.org/job/Accumulo-Trunk/628/)
        ACCUMULO-14 fixed issue with starting more than one mini accumulo cluster from the same jvm (Revision 1432111)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #628 (See https://builds.apache.org/job/Accumulo-Trunk/628/ ) ACCUMULO-14 fixed issue with starting more than one mini accumulo cluster from the same jvm (Revision 1432111) Result = SUCCESS kturner : Files : /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        Hide
        Keith Turner added a comment -

        Smoke-test framework for iterators

        There is a ticket for this ACCUMULO-626

        Show
        Keith Turner added a comment - Smoke-test framework for iterators There is a ticket for this ACCUMULO-626
        Hide
        Josh Elser added a comment -

        I wanted to leave some notes about what I'd like to see from MiniAccumuloCluster (perhaps this is a separate discussion..). I will admit that I haven't dug through the source code yet.

        A short wishlist of things I'd like to see from MiniAccumuloCluster (or some mocking framework which uses it):

        • Smoke-test framework for iterators (API to run an iterator over data asserting the same results while varying things like server-side memory buffer, multiple tservers, adding/removing split points, etc)
        • The ability to run multiple tservers in memory on a single host
        • Table configurations and tablet hosting/migration/etc works when having multiple tservers

        It would be cool to even make some sort of Maven plugin/archetype that one could include in their own Maven project to do "more realistic" testing against Accumulo instead of necessarily depending on a test module in Accumulo? Just a thought, I'm not sure of the best way to bundle this.

        Show
        Josh Elser added a comment - I wanted to leave some notes about what I'd like to see from MiniAccumuloCluster (perhaps this is a separate discussion..). I will admit that I haven't dug through the source code yet. A short wishlist of things I'd like to see from MiniAccumuloCluster (or some mocking framework which uses it): Smoke-test framework for iterators (API to run an iterator over data asserting the same results while varying things like server-side memory buffer, multiple tservers, adding/removing split points, etc) The ability to run multiple tservers in memory on a single host Table configurations and tablet hosting/migration/etc works when having multiple tservers It would be cool to even make some sort of Maven plugin/archetype that one could include in their own Maven project to do "more realistic" testing against Accumulo instead of necessarily depending on a test module in Accumulo? Just a thought, I'm not sure of the best way to bundle this.
        Hide
        Billie Rinaldi added a comment -

        No, that seems fine. I just wanted to make sure that was the way we wanted it before I add the hadoop version profiles.

        Show
        Billie Rinaldi added a comment - No, that seems fine. I just wanted to make sure that was the way we wanted it before I add the hadoop version profiles.
        Hide
        Keith Turner added a comment -

        Keith, is there a reason you didn't want to make the examples pom the parent of instamo.

        Yes, I wanted to it to be a self contained example that a developer could use to quickly get up and running with Accumulo. I do not want to deploy it. An instamo jar in maven repos would have no use. I added it as a child of the examples pom just so it would automatically be pulled into eclipse, should I remove that?

        Show
        Keith Turner added a comment - Keith, is there a reason you didn't want to make the examples pom the parent of instamo. Yes, I wanted to it to be a self contained example that a developer could use to quickly get up and running with Accumulo. I do not want to deploy it. An instamo jar in maven repos would have no use. I added it as a child of the examples pom just so it would automatically be pulled into eclipse, should I remove that?
        Hide
        Billie Rinaldi added a comment -

        I think instamo at least has to have the Apache pom as its parent to get maven repository deployment to work. Keith, is there a reason you didn't want to make the examples pom the parent of instamo (so it could inherit version numbers for its dependencies)?

        Show
        Billie Rinaldi added a comment - I think instamo at least has to have the Apache pom as its parent to get maven repository deployment to work. Keith, is there a reason you didn't want to make the examples pom the parent of instamo (so it could inherit version numbers for its dependencies)?
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #567 (See https://builds.apache.org/job/Accumulo-Trunk/567/)
        ACCUMULO-14 add instamo to parent pom (Revision 1413917)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/trunk/examples/instamo
        • /accumulo/trunk/examples/instamo/src/test/java/ExampleAccumuloUnitTest.java
        • /accumulo/trunk/examples/instamo/src/test/java/org
        • /accumulo/trunk/examples/instamo/src/test/java/org/apache
        • /accumulo/trunk/examples/instamo/src/test/java/org/apache/accumulo
        • /accumulo/trunk/examples/instamo/src/test/java/org/apache/accumulo/instamo
        • /accumulo/trunk/examples/instamo/src/test/java/org/apache/accumulo/instamo/ExampleAccumuloUnitTest.java
        • /accumulo/trunk/examples/pom.xml
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #567 (See https://builds.apache.org/job/Accumulo-Trunk/567/ ) ACCUMULO-14 add instamo to parent pom (Revision 1413917) Result = SUCCESS kturner : Files : /accumulo/trunk/examples/instamo /accumulo/trunk/examples/instamo/src/test/java/ExampleAccumuloUnitTest.java /accumulo/trunk/examples/instamo/src/test/java/org /accumulo/trunk/examples/instamo/src/test/java/org/apache /accumulo/trunk/examples/instamo/src/test/java/org/apache/accumulo /accumulo/trunk/examples/instamo/src/test/java/org/apache/accumulo/instamo /accumulo/trunk/examples/instamo/src/test/java/org/apache/accumulo/instamo/ExampleAccumuloUnitTest.java /accumulo/trunk/examples/pom.xml
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #565 (See https://builds.apache.org/job/Accumulo-Trunk/565/)
        ACCUMULO-14 update svn ignore (Revision 1413720)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/trunk/examples/instamo
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #565 (See https://builds.apache.org/job/Accumulo-Trunk/565/ ) ACCUMULO-14 update svn ignore (Revision 1413720) Result = SUCCESS kturner : Files : /accumulo/trunk/examples/instamo
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #562 (See https://builds.apache.org/job/Accumulo-Trunk/562/)
        ACCUMULO-14 added mini cluster example (Revision 1412374)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/trunk/examples/instamo
        • /accumulo/trunk/examples/instamo/README.md
        • /accumulo/trunk/examples/instamo/pom.xml
        • /accumulo/trunk/examples/instamo/src
        • /accumulo/trunk/examples/instamo/src/main
        • /accumulo/trunk/examples/instamo/src/main/java
        • /accumulo/trunk/examples/instamo/src/main/java/org
        • /accumulo/trunk/examples/instamo/src/main/java/org/apache
        • /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo
        • /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo/instamo
        • /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo/instamo/AccumuloApp.java
        • /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo/instamo/MapReduceExample.java
        • /accumulo/trunk/examples/instamo/src/main/resources
        • /accumulo/trunk/examples/instamo/src/main/resources/log4j.properties
        • /accumulo/trunk/examples/instamo/src/test
        • /accumulo/trunk/examples/instamo/src/test/java
        • /accumulo/trunk/examples/instamo/src/test/java/ExampleAccumuloUnitTest.java
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #562 (See https://builds.apache.org/job/Accumulo-Trunk/562/ ) ACCUMULO-14 added mini cluster example (Revision 1412374) Result = SUCCESS kturner : Files : /accumulo/trunk/examples/instamo /accumulo/trunk/examples/instamo/README.md /accumulo/trunk/examples/instamo/pom.xml /accumulo/trunk/examples/instamo/src /accumulo/trunk/examples/instamo/src/main /accumulo/trunk/examples/instamo/src/main/java /accumulo/trunk/examples/instamo/src/main/java/org /accumulo/trunk/examples/instamo/src/main/java/org/apache /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo/instamo /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo/instamo/AccumuloApp.java /accumulo/trunk/examples/instamo/src/main/java/org/apache/accumulo/instamo/MapReduceExample.java /accumulo/trunk/examples/instamo/src/main/resources /accumulo/trunk/examples/instamo/src/main/resources/log4j.properties /accumulo/trunk/examples/instamo/src/test /accumulo/trunk/examples/instamo/src/test/java /accumulo/trunk/examples/instamo/src/test/java/ExampleAccumuloUnitTest.java
        Hide
        Keith Turner added a comment -

        Maybe this should stay as a separate project? I say that so that an Accumulo release would not be delayed by needing to keep instamo in sync. It might even be great to have instamo able to work with multiple accumulo releases at once

        I just checked in something to examples/instamo. It should not hold up a release in anyway. The Accumulo web page can be updated to point to this example anytime after 1.5.0 is released. The instamo github project contained three major components a pom, example code, and MiniAccumuloCluster. Now that MiniAccumuloCluster is part of Accumulo it will work with any version of Accumulo from 1.5.0 forward as long as versions match. For example you will need to use accumulo-test-1.5.0 with accumulo-core-1.5.0. I think creating a version of MiniAccumuloCluster that works with any version of Accumulo would result in a very convoluted piece of code over time. I think having a version of MiniAccumuloCluster that only works with one version of Accumulo is much easier to maintain. The pom and example code in the instamo git hub project just become examples for in Accumulo source.

        Show
        Keith Turner added a comment - Maybe this should stay as a separate project? I say that so that an Accumulo release would not be delayed by needing to keep instamo in sync. It might even be great to have instamo able to work with multiple accumulo releases at once I just checked in something to examples/instamo. It should not hold up a release in anyway. The Accumulo web page can be updated to point to this example anytime after 1.5.0 is released. The instamo github project contained three major components a pom, example code, and MiniAccumuloCluster. Now that MiniAccumuloCluster is part of Accumulo it will work with any version of Accumulo from 1.5.0 forward as long as versions match. For example you will need to use accumulo-test-1.5.0 with accumulo-core-1.5.0. I think creating a version of MiniAccumuloCluster that works with any version of Accumulo would result in a very convoluted piece of code over time. I think having a version of MiniAccumuloCluster that only works with one version of Accumulo is much easier to maintain. The pom and example code in the instamo git hub project just become examples for in Accumulo source.
        Hide
        Hudson added a comment -

        Integrated in Accumulo-Trunk #554 (See https://builds.apache.org/job/Accumulo-Trunk/554/)
        ACCUMULO-14 initial checkin of MiniAccumuloCluster (Revision 1410144)

        Result = SUCCESS
        kturner :
        Files :

        • /accumulo/trunk/pom.xml
        • /accumulo/trunk/test
        • /accumulo/trunk/test/pom.xml
        • /accumulo/trunk/test/src
        • /accumulo/trunk/test/src/main
        • /accumulo/trunk/test/src/main/java
        • /accumulo/trunk/test/src/main/java/org
        • /accumulo/trunk/test/src/main/java/org/apache
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test
        • /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java
        • /accumulo/trunk/test/src/test
        • /accumulo/trunk/test/src/test/java
        • /accumulo/trunk/test/src/test/java/org
        • /accumulo/trunk/test/src/test/java/org/apache
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test
        • /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        Show
        Hudson added a comment - Integrated in Accumulo-Trunk #554 (See https://builds.apache.org/job/Accumulo-Trunk/554/ ) ACCUMULO-14 initial checkin of MiniAccumuloCluster (Revision 1410144) Result = SUCCESS kturner : Files : /accumulo/trunk/pom.xml /accumulo/trunk/test /accumulo/trunk/test/pom.xml /accumulo/trunk/test/src /accumulo/trunk/test/src/main /accumulo/trunk/test/src/main/java /accumulo/trunk/test/src/main/java/org /accumulo/trunk/test/src/main/java/org/apache /accumulo/trunk/test/src/main/java/org/apache/accumulo /accumulo/trunk/test/src/main/java/org/apache/accumulo/test /accumulo/trunk/test/src/main/java/org/apache/accumulo/test/MiniAccumuloCluster.java /accumulo/trunk/test/src/test /accumulo/trunk/test/src/test/java /accumulo/trunk/test/src/test/java/org /accumulo/trunk/test/src/test/java/org/apache /accumulo/trunk/test/src/test/java/org/apache/accumulo /accumulo/trunk/test/src/test/java/org/apache/accumulo/test /accumulo/trunk/test/src/test/java/org/apache/accumulo/test/MiniAccumuloClusterTest.java
        Hide
        David Medinets added a comment -

        Maybe this should stay as a separate project? I say that so that an Accumulo release would not be delayed by needing to keep instamo in sync. It might even be great to have instamo able to work with multiple accumulo releases at once .. like rvm does for ruby (https://rvm.io/).

        Show
        David Medinets added a comment - Maybe this should stay as a separate project? I say that so that an Accumulo release would not be delayed by needing to keep instamo in sync. It might even be great to have instamo able to work with multiple accumulo releases at once .. like rvm does for ruby ( https://rvm.io/ ).
        Hide
        Keith Turner added a comment -

        Just checked in MiniAccumuloCluster r1410144

        I am trying to decide where the best place to put something like instamo in svn. A simple self contained maven project that uses the 1.5 MiniAccumuloCluster. Once 1.5 is released I want to put simple straight forward instructions on how to download and run it on the Accumulo web page. Currently thinking of creating a contrib/instamo or trunk/examples/instamo. Could have something like the following on the Accumulo web page showing how to get up and running against Accumulo in minutes.

          svn export https://svn.apache.org/repos/asf/accumulo/tags/1.5.0/examples/instamo
          cd instamo
          vim src/main/java/instamo/AccumuloApp.java
          mvn package
          mvn exec:exec
        
        Show
        Keith Turner added a comment - Just checked in MiniAccumuloCluster r1410144 I am trying to decide where the best place to put something like instamo in svn. A simple self contained maven project that uses the 1.5 MiniAccumuloCluster. Once 1.5 is released I want to put simple straight forward instructions on how to download and run it on the Accumulo web page. Currently thinking of creating a contrib/instamo or trunk/examples/instamo. Could have something like the following on the Accumulo web page showing how to get up and running against Accumulo in minutes. svn export https://svn.apache.org/repos/asf/accumulo/tags/1.5.0/examples/instamo cd instamo vim src/main/java/instamo/AccumuloApp.java mvn package mvn exec:exec
        Hide
        Keith Turner added a comment -

        I started playing around with a new implementation for this ticket and created the following which works against 1.4. I am going to work on bringing it into trunk, comments are welcome.

        https://github.com/keith-turner/instamo

        Show
        Keith Turner added a comment - I started playing around with a new implementation for this ticket and created the following which works against 1.4. I am going to work on bringing it into trunk, comments are welcome. https://github.com/keith-turner/instamo
        Hide
        Eric Newton added a comment -

        I sat down last week with one goal: to be able to make all the services use a FileSystem object provided by the test infrastructure, such that you could make a minicluster and do local testing without needing an external HDFS instance.

        That's when I discovered how much of the code just fetches a FileSystem instance using the Hadoop configuration files. It was doing pretty well until I ran into the HdfsZooInstance class which is used to fetch server configuration information.

        The cascading effects of passing FileSystem or Instance objects began touching a large percentage of the code. There are some parts, like a couple of the system Iterators, that expect to be able to grab configuration information through global objects: there is no approved way for Iterators be passed this kind of information. Looking at the system configuration also entails some security considerations. Anyhow, I fell so far down the rabbit hole, I reverted the whole thing.

        It's going to take a few attempts to make this happen. I still hope to do it for 1.5.

        In the mean time, the "Functional Tests" aren't looking so bad. We can, and should, run them more frequently. I would like the map/reduce version to run nightly, at least. Some of the crazy tests that are in the Functional Tests should be added to the random walk tests. Things like "set the metadata tablet size 512 bytes and make a table with 5000 splits". We need to move from "verify normal operations work in the face of failures" to "normal is overrated."

        Show
        Eric Newton added a comment - I sat down last week with one goal: to be able to make all the services use a FileSystem object provided by the test infrastructure, such that you could make a minicluster and do local testing without needing an external HDFS instance. That's when I discovered how much of the code just fetches a FileSystem instance using the Hadoop configuration files. It was doing pretty well until I ran into the HdfsZooInstance class which is used to fetch server configuration information. The cascading effects of passing FileSystem or Instance objects began touching a large percentage of the code. There are some parts, like a couple of the system Iterators, that expect to be able to grab configuration information through global objects: there is no approved way for Iterators be passed this kind of information. Looking at the system configuration also entails some security considerations. Anyhow, I fell so far down the rabbit hole, I reverted the whole thing. It's going to take a few attempts to make this happen. I still hope to do it for 1.5. In the mean time, the "Functional Tests" aren't looking so bad. We can, and should, run them more frequently. I would like the map/reduce version to run nightly, at least. Some of the crazy tests that are in the Functional Tests should be added to the random walk tests. Things like "set the metadata tablet size 512 bytes and make a table with 5000 splits". We need to move from "verify normal operations work in the face of failures" to "normal is overrated."
        Hide
        Jesse Yates added a comment -

        @Keith, point of clairification - all the final modifications have already been removed in the latest patch.
        +1 on following the primary goal for patches, but still think we should try to leave code cleaner than when you found it (at least as much as is reasonable).

        Show
        Jesse Yates added a comment - @Keith, point of clairification - all the final modifications have already been removed in the latest patch. +1 on following the primary goal for patches, but still think we should try to leave code cleaner than when you found it (at least as much as is reasonable).
        Hide
        Keith Turner added a comment -

        Here are my thoughts on updating vars to final simultaneously w/ this feature.

        • Makes the patch harder to review for this feature.
        • Makes the patch harder to merge to other branches. (For example if I want to merge feature X and not Y to an older branch, but the patch contains feature X and Y commingled.)
        • Final was only added to the classes changed for this feature. If you really think it is a worthwhile improvement, it may be worth making a large change and tacking that in one ticket.
        • When looking at code for forensics reasons trying to fix a bug, I have found in some cases that svn revisions targeted to a specific feature or bug fix are helpful when trying to understand why a change was made and what code that change affected.

        I am actually making a more general argument for keeping patches concise to the primary feature being addressed by the patch.

        Show
        Keith Turner added a comment - Here are my thoughts on updating vars to final simultaneously w/ this feature. Makes the patch harder to review for this feature. Makes the patch harder to merge to other branches. (For example if I want to merge feature X and not Y to an older branch, but the patch contains feature X and Y commingled.) Final was only added to the classes changed for this feature. If you really think it is a worthwhile improvement, it may be worth making a large change and tacking that in one ticket. When looking at code for forensics reasons trying to fix a bug, I have found in some cases that svn revisions targeted to a specific feature or bug fix are helpful when trying to understand why a change was made and what code that change affected. I am actually making a more general argument for keeping patches concise to the primary feature being addressed by the patch.
        Hide
        Eric Newton added a comment -

        Yes, Keith mentioned that a previous patch configured the servers to run without write-ahead logging. I modified the patch to configure the metadata table to not use write-ahead logging, and it worked much better.

        Show
        Eric Newton added a comment - Yes, Keith mentioned that a previous patch configured the servers to run without write-ahead logging. I modified the patch to configure the metadata table to not use write-ahead logging, and it worked much better.
        Hide
        Jesse Yates added a comment -

        I dropped everything that I could get away with, for this first iteration. I just wanted to get something up and running. Technically a logger is not needed for a cluster to run and people probably aren't going to be testing a lot of that functionality (in the general case). However, it is on the roadmap of things I want to add. I'm thinking it will be setup with a boolean switch for whether or not it should be enabled in the minicluster. In HBase they found the biggest slowdown to their minicluster was all the daemons coordination, not the writing to disk vs. in memory, so I wanted to keep that as minimal as possible.

        Show
        Jesse Yates added a comment - I dropped everything that I could get away with, for this first iteration. I just wanted to get something up and running. Technically a logger is not needed for a cluster to run and people probably aren't going to be testing a lot of that functionality (in the general case). However, it is on the roadmap of things I want to add. I'm thinking it will be setup with a boolean switch for whether or not it should be enabled in the minicluster. In HBase they found the biggest slowdown to their minicluster was all the daemons coordination, not the writing to disk vs. in memory, so I wanted to keep that as minimal as possible.
        Hide
        Eric Newton added a comment -

        This is very cool. But I'm not seeing a logger running?

        Show
        Eric Newton added a comment - This is very cool. But I'm not seeing a logger running?
        Hide
        Jesse Yates added a comment -

        Okay, lets try this again.

        Dropping as much of the 'final'-ization and spacing as was obvious (at least in the major classes).

        Show
        Jesse Yates added a comment - Okay, lets try this again. Dropping as much of the 'final'-ization and spacing as was obvious (at least in the major classes).
        Hide
        Jesse Yates added a comment -

        Sorry, that was the 'save actions' in eclipse making haphazard changes. But, yeah, I'm using the accumulo formatter (though apparently a lot of this was some crazy line wrapping that is really making it gross).

        As far as changes to the TS and Master, I just added a new constructor that doesn't do argument parsing, but instead gets them passed in in a more DI oriented style (which also makes testing way easier).

        I also made a couple changes to the initalization steps in each of those as well, essentially allowing booleans to be passed in to determine if the system should wait for ZK and the DFS to be ready; in the local version they are assumed to be ready, but the default is to wait (the string parsing version).

        As far as final, its really just better coding practice to make stuff like that final unless you have a reason not to, and since no functionality gets broken, I don't see a why that would be an issue updating them simultaneously.

        I'll look into getting more 'clean' version of the patch up soon.

        Show
        Jesse Yates added a comment - Sorry, that was the 'save actions' in eclipse making haphazard changes. But, yeah, I'm using the accumulo formatter (though apparently a lot of this was some crazy line wrapping that is really making it gross). As far as changes to the TS and Master, I just added a new constructor that doesn't do argument parsing, but instead gets them passed in in a more DI oriented style (which also makes testing way easier). I also made a couple changes to the initalization steps in each of those as well, essentially allowing booleans to be passed in to determine if the system should wait for ZK and the DFS to be ready; in the local version they are assumed to be ready, but the default is to wait (the string parsing version). As far as final, its really just better coding practice to make stuff like that final unless you have a reason not to, and since no functionality gets broken, I don't see a why that would be an issue updating them simultaneously. I'll look into getting more 'clean' version of the patch up soon.
        Hide
        Keith Turner added a comment -

        Jesse,

        I took a quick look at the patch. It was hard to see what changes were made to the tablet server and master to achieve the goals of this ticket. There were formatting changes, many additions of final, additions of @Override. All of this noise makes it hard to know what changes where made to these very important classes. If you think things in the master and tablet should be marked final, I think that work should be done in a separate ticket w/ separate patches. If you are you using eclipse, are you using formatter mentioned at http://incubator.apache.org/accumulo/source.html? Would it be possible to submit a patch that did not have so many extraneous changes? Or point out what the critical change to the master and tablet server were?

        Show
        Keith Turner added a comment - Jesse, I took a quick look at the patch. It was hard to see what changes were made to the tablet server and master to achieve the goals of this ticket. There were formatting changes, many additions of final, additions of @Override. All of this noise makes it hard to know what changes where made to these very important classes. If you think things in the master and tablet should be marked final, I think that work should be done in a separate ticket w/ separate patches. If you are you using eclipse, are you using formatter mentioned at http://incubator.apache.org/accumulo/source.html? Would it be possible to submit a patch that did not have so many extraneous changes? Or point out what the critical change to the master and tablet server were?
        Hide
        Jesse Yates added a comment -

        Initial work for getting a more 'real' mockAccumulo.

        Essentially, it uses a local ZK cluster and the local file system to run accumulo, using all the 'real' classes.

        This biggest slowdown is in waiting for the tabletserver to come online. However, it is actually pretty snappy to startup.

        Adding this patch to get review of the overall design. Its it NOT a final version, or even really that all that close. I just want to make sure I'm not wasting too much time.

        So far, had to do a little work making sure the TS and Master could be started and also did an in-memory version of the Initialize class (more copy and paste, as I was just trying to get something up). However, everything runs in the same JVM in different threads.

        Also, I'm looking for suggestions on the best way to shutdown the cluster, rather than just killing the threads.

        Thanks!

        Show
        Jesse Yates added a comment - Initial work for getting a more 'real' mockAccumulo. Essentially, it uses a local ZK cluster and the local file system to run accumulo, using all the 'real' classes. This biggest slowdown is in waiting for the tabletserver to come online. However, it is actually pretty snappy to startup. Adding this patch to get review of the overall design. Its it NOT a final version, or even really that all that close. I just want to make sure I'm not wasting too much time. So far, had to do a little work making sure the TS and Master could be started and also did an in-memory version of the Initialize class (more copy and paste, as I was just trying to get something up). However, everything runs in the same JVM in different threads. Also, I'm looking for suggestions on the best way to shutdown the cluster, rather than just killing the threads. Thanks!
        Hide
        Jesse Yates added a comment -

        @John: +1 I haven't had the time to devote to this issue that it deserves. !.5 would be a great place for it.

        Show
        Jesse Yates added a comment - @John: +1 I haven't had the time to devote to this issue that it deserves. !.5 would be a great place for it.
        Hide
        jv added a comment -

        This would be a great new feature for 1.5. I think for 1.4, since we're so close to wrapping up on it, it's not worthwhile to undertake this effort as it could hold back release. I think a full mocking would be great come then, giving plenty of time for it to be developed, as well as for the rest of the community (really myself and most of the other comitters) to really learn and understand the true benefits of Mocking.

        So I think this should be bumped to 1.5 where it can be given serious consideration.

        Show
        jv added a comment - This would be a great new feature for 1.5. I think for 1.4, since we're so close to wrapping up on it, it's not worthwhile to undertake this effort as it could hold back release. I think a full mocking would be great come then, giving plenty of time for it to be developed, as well as for the rest of the community (really myself and most of the other comitters) to really learn and understand the true benefits of Mocking. So I think this should be bumped to 1.5 where it can be given serious consideration.
        Hide
        Jesse Yates added a comment -

        Oh, I had no idea that there were functional tests. Those are definitely a solid tool.

        However, I still think that having a set of integration tests (before functional tests) is a reasonable goal. By developing a pipeline of tests, developers will have a shorter iteration time when building new features with more confidence that they aren't breaking anything.

        Side note: are we running these functional tests on the nightly build? I couldn't see where we were. This is something important that actually needs to be run as part of a build cycle to make sure we aren't breaking anything. Integration tests would be great for this on jenkins since we don't need to spin up hadoop or zk.

        On top of the utility for developers, users should still get a good way to test things, to make sure that they are writing 'good' functionality (e.g. new iterators). A more 'real' mock instance would go a long way to help that.

        Show
        Jesse Yates added a comment - Oh, I had no idea that there were functional tests. Those are definitely a solid tool. However, I still think that having a set of integration tests (before functional tests) is a reasonable goal. By developing a pipeline of tests, developers will have a shorter iteration time when building new features with more confidence that they aren't breaking anything. Side note: are we running these functional tests on the nightly build? I couldn't see where we were. This is something important that actually needs to be run as part of a build cycle to make sure we aren't breaking anything. Integration tests would be great for this on jenkins since we don't need to spin up hadoop or zk. On top of the utility for developers, users should still get a good way to test things, to make sure that they are writing 'good' functionality (e.g. new iterators). A more 'real' mock instance would go a long way to help that.
        Hide
        Keith Turner added a comment -

        Something to consider is the functional testing framework. This framework spins up an accumulo instance to run test against. An instance is spun up for each test. The framework is written in python. Test can be written in python or java. This is used to test accumulo functionality, it is not geared for users. Running all of the functional test takes 1 to 2 hours. This is in test/system/auto and org.apache.accumulo.server.test.functional.

        Show
        Keith Turner added a comment - Something to consider is the functional testing framework. This framework spins up an accumulo instance to run test against. An instance is spun up for each test. The framework is written in python. Test can be written in python or java. This is used to test accumulo functionality, it is not geared for users. Running all of the functional test takes 1 to 2 hours. This is in test/system/auto and org.apache.accumulo.server.test.functional.
        Hide
        Jesse Yates added a comment -

        My first thoughts are that when we spin up a mock cluster, it literally spins up everything from a tablet on up. However, the actual memory backing for the tablet is just local memory. This would be actually advantageous to separate out as we then also have a completely pluggable backend for accumulo - it becomes really easy to port this over to another file system or have a local instance running on just local files (no dependency on HDFS whatsoever).

        There is a concern then for spinning up mock zk cluster - but that is relatively lightweight and registration of the master is going to be pretty fast.

        So everything still runs in the same jvm, but it is real from the tablet up - the only testing that doesn't work with this is testing the actual files that are written to disk (and I guess anything else we put behind the interface).

        Show
        Jesse Yates added a comment - My first thoughts are that when we spin up a mock cluster, it literally spins up everything from a tablet on up. However, the actual memory backing for the tablet is just local memory. This would be actually advantageous to separate out as we then also have a completely pluggable backend for accumulo - it becomes really easy to port this over to another file system or have a local instance running on just local files (no dependency on HDFS whatsoever). There is a concern then for spinning up mock zk cluster - but that is relatively lightweight and registration of the master is going to be pretty fast. So everything still runs in the same jvm, but it is real from the tablet up - the only testing that doesn't work with this is testing the actual files that are written to disk (and I guess anything else we put behind the interface).

          People

          • Assignee:
            Keith Turner
            Reporter:
            Jesse Yates
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development