[GORA-367] testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce) failing in new environments

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Not A Problem
• Affects Version/s: 0.3, 0.4, 0.2.1, 0.5
• Fix Version/s: 0.7
• Component/s: gora-core
• Labels: hadoop umask
• Environment: New instaled OS and new {{"git clone ..."}}.
• Assignee: Alfonso Nishikawa Muñumer
• Reporter: Alfonso Nishikawa Muñumer
• Created: 26/Aug/14 22:39
• Updated: 03/Mar/22 14:18
• Resolved: 26/Aug/14 22:41

Description

I create the issue with informative purpouses.

Issue information

The following error is raised in clear new environments when executing mvn package:

gora-core/target/surefire-reports/org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce.txt:

testCountQuery(org.apache.gora.avro.mapreduce.TestDataFileAvroStoreMapReduce)  Time elapsed: 3.785 sec  <<< ERROR!
java.lang.NullPointerException
	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.tearDown(DataStoreMapReduceTestBase.java:73)
	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:66)

The reason is found in console log scrolling up quite a while up to this lines:

14/08/26 21:10:22 WARN datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect permission for /home/alfonso/git/gora-alfonsonishikawa/gora-core/target/test-data/dfs/data/data1, expected: rwxr-xr-x, while actual: rwxrwxr-x
14/08/26 21:10:22 WARN datanode.DataNode: Invalid directory in dfs.data.dir: Incorrect permission for /home/alfonso/git/gora-alfonsonishikawa/gora-core/target/test-data/dfs/data/data2, expected: rwxr-xr-x, while actual: rwxrwxr-x
14/08/26 21:10:22 ERROR datanode.DataNode: All directories in dfs.data.dir are invalid.
3769 [main] ERROR org.apache.gora.mapreduce.DataStoreMapReduceTestBase - Hadoop Test Case set up failed
java.lang.NullPointerException
	at org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:422)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
	at org.apache.hadoop.mapred.HadoopTestCase.setUp(HadoopTestCase.java:148)
	at org.apache.gora.mapreduce.DataStoreMapReduceTestBase.setUp(DataStoreMapReduceTestBase.java:60)
	at junit.framework.TestCase.runBare(TestCase.java:132)

Solution

Set in ~/.profile the line umask 022 or take a look at man pam_umask.

Issue Links

• is related to: GORA-357 Maven Surefire testFailureIgnore is true