Currently there are failures with HDFS tests intermittently. Some of these are due to resource constraints on the Apache Jenkins machines others are due to poor test assumptions.
- Consolidate hdfs configuration into HdfsTestUtil
- Ensure socketTimeout long enough for HDFS tests
- Ensure HdfsTestUtil.getClientConfiguration used in tests
- Replace deprecated HDFS calls
- Use try-with-resources to ensure closing of HDFS resources