[BIGTOP-1972] Umbrella: Additional tests to hdfs, mr, flume, sqoop, tez, oozie, hive modules

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: backlog, 1.0.0
• Fix Version/s: backlog
• Component/s: tests
• Assignee: Venkata Srinivasa Rao Kolla
• Reporter: Venkata Srinivasa Rao Kolla
• Created: 20/Aug/15 10:24
• Updated: 22/Jan/16 21:11

Description

Add new tests for HDFS, MR, FLUME, TEZ, OOZIE, HIVE modules.
Below is the summary of the new tests we are planning to add:

HDFS:

• HDFS balancer
• ACLs
• Archive functionality
• cat, chmod, chown, test, text, count, cp, distcp, du, expung, get,
  getmerge, ls, mv, put, setrep, stat, touchz commands functionality
• webHDFS functionality.

MR:

• Hadoop installation verification
• Distributed cache
• Compression Formats
• Different Key Value Input Formats.
• mr cli

HIVE:

• Beeline
• Hive Cli,
• Hive JDBC,
• Hive UDFs

FLUME:
sources - httpsource, execsource, spooldir, avrò, thrift, syslog
sinks - hdfssink, fileroll, avrò, thrifts, loggersink

OOZIE:

• cli,
• MR jobs,
• Hive scripts,
• streaming jobs,
• rerun jobs,
• tez jobs,
• sqoop jobs

We will create separate Jira tickets with the new tests that we are going to add for each of these modules and will link to this ticket.

Sub-Tasks

• Add new tests for HDFS Balancer functionality: Resolved
• Add new tests for -setfacl option: Patch Available
• Add new tests for hadoop archive functionality: Resolved
• Add new tests for hdfs cat, chmod, chown commands: Resolved
• Add new tests for test, text, count commands: Resolved
• Add new tests for chgrp, cp, ls, mv, du, put, get, mkdir, stat and touchz: Resolved
• Add new tests for getmerge, setrep functionality: Resolved
• Add new tests for distcp: Patch Available
• Add new tests for webhdfs: Resolved
• Add new tests for mr jobs: Resolved
• Add new oozie tests: Open
• Add tests for tez module: Patch Available
• Add new tests for hive: Resolved
• Add hive udf tests: Patch Available
• Add hive tests using beeline with tez execution engine: Patch Available
• Add hive DDL tests submitted using hivecli with tez: Patch Available
• Add hive dml tests using hive cli with tez: Patch Available
• Add hive tests using jdbc with tez: Patch Available
• Add hive ddl tests with beeline using mr engine: Patch Available
• Add hive ddl tests with jdbc using mr engine: Patch Available
• Add hive dml tests using hive cli: Patch Available
• Add hive dml tests using jdbc with mr engine: Patch Available
• Add hive dml tests using beeline with mr engine: Patch Available