[IMPALA-1944] Unable to read data from recursive directories as table location

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: Impala 2.1.1
• Assignee: Unassigned
• Reporter: Vijay
• Created: 08/Apr/15 10:47
• Updated: 22/Oct/20 04:48
• Resolved: 22/Oct/20 04:48

Description

By default Impala reads the files from table LOCATION 'hdfs_path' but not from the sub directories in that table LOCATION 'hdfs_path'.

Example: If a table is created with location '/home/data/input/'

and if the directory structure is as follows:
/home/data/input/a.txt
/home/data/input/b.txt
/home/data/input/subdir1/x.txt
/home/data/input/subdir2/y.txt

then Impala can query from following files only
/home/data/input/a.txt
/home/data/input/b.txt

Following files are not queried
/home/data/input/subdir1/x.txt
/home/data/input/subdir2/y.txt

It seems recursive reading is not working.

Issue Links

• duplicates: IMPALA-8454 Recursively list files within transactional tables
• relates to: IMPALA-4596 Impala should support scan of sub directories recursively

Sub-Tasks

• Hive supports recursive reading, so impala should support as well.: Resolved