Uploaded image for project: 'Apache Gora'
  1. Apache Gora
  2. GORA-367

testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce) failing in new environments

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Not A Problem
    • Affects Version/s: 0.3, 0.4, 0.2.1, 0.5
    • Fix Version/s: 0.7
    • Component/s: gora-core
    • Labels:
    • Environment:
      New instaled OS and new {{"git clone ..."}}.

      Description

      I create the issue with informative purpouses.

      Issue information

      The following error is raised in clear new environments when executing mvn package:

      gora-core/target/surefire-reports/org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce.txt:

      testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce)  Time elapsed: 3.785 sec  <<< ERROR!
      java.lang.NullPointerException
      	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.tearDown(DataStoreMapReduceTestBase.java:73)
      	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:66)
      

      The reason is found in console log scrolling up quite a while up to this lines:

      14/08/26 21:10:22 WARN datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect permission for /home/alfonso/git/gora-alfonsonishikawa/gora-core/target/test-data/dfs/data/data1, expected: rwxr-xr-x, while actual: rwxrwxr-x
      14/08/26 21:10:22 WARN datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect permission for /home/alfonso/git/gora-alfonsonishikawa/gora-core/target/test-data/dfs/data/data2, expected: rwxr-xr-x, while actual: rwxrwxr-x
      14/08/26 21:10:22 ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.
      3769 [main] ERROR org.apache.gora.mapreduce.DataStoreMapReduceTestBase - Hadoop Test Case set up failed
      java.lang.NullPointerException
      	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:422)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
      	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
      	at org.apache.hadoop.mapred.HadoopTestCase.setUp(HadoopTestCase.java:148)
      	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:60)
      	at junit.framework.TestCase.runBare(TestCase.java:132)
      

      Solution

      Set in ~/.profile the line umask 022 or take a look at man pam_umask.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                alfonso.nishikawa Alfonso Nishikawa
                Reporter:
                alfonso.nishikawa Alfonso Nishikawa
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: