Uploaded image for project: 'Apache Gora'
  1. Apache Gora
  2. GORA-367

testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce) failing in new environments

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Not A Problem
    • 0.3, 0.4, 0.2.1, 0.5
    • 0.7
    • gora-core
    • New instaled OS and new {{"git clone ..."}}.

    Description

      I create the issue with informative purpouses.

      Issue information

      The following error is raised in clear new environments when executing mvn package:

      gora-core/target/surefire-reports/org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce.txt:

      testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce)  Time elapsed: 3.785 sec  <<< ERROR!
      java.lang.NullPointerException
      	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.tearDown(DataStoreMapReduceTestBase.java:73)
      	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:66)
      

      The reason is found in console log scrolling up quite a while up to this lines:

      14/08/26 21:10:22 WARN datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect permission for /home/alfonso/git/gora-alfonsonishikawa/gora-core/target/test-data/dfs/data/data1, expected: rwxr-xr-x, while actual: rwxrwxr-x
      14/08/26 21:10:22 WARN datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect permission for /home/alfonso/git/gora-alfonsonishikawa/gora-core/target/test-data/dfs/data/data2, expected: rwxr-xr-x, while actual: rwxrwxr-x
      14/08/26 21:10:22 ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.
      3769 [main] ERROR org.apache.gora.mapreduce.DataStoreMapReduceTestBase - Hadoop Test Case set up failed
      java.lang.NullPointerException
      	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:422)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
      	at org.apache.hadoop.mapred.HadoopTestCase.setUp(HadoopTestCase.java:148)
      	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:60)
      	at junit.framework.TestCase.runBare(TestCase.java:132)
      

      Solution

      Set in ~/.profile the line umask 022 or take a look at man pam_umask.

      Attachments

        Issue Links

          Activity

            People

              alfonsonishikawa Alfonso Nishikawa Muñumer
              alfonsonishikawa Alfonso Nishikawa Muñumer
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: