[ATLAS-4369] import-hive.sh does not write logs to /var/log/atlas/import-hive.log file, instead write into ${atlas.log.file} under the directory "${atlas.log.dir}"

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 2.2.0
• Fix Version/s: 3.0.0, 2.3.0
• Component/s: atlas-core
• Assignee: Disha Talreja
• Reporter: Umesh Padashetty
• Created: 22/Jul/21 17:28
• Updated: 14/Sep/21 21:25
• Resolved: 13/Sep/21 18:20

Description

When the import scripts like 

• import-kafka.sh
• import-hive.sh
• import-hbase.sh

are run, the corresponding logs are written into 

• /var/log/atlas/import-kafka.log
• /var/log/atlas/import-hive.log
• /var/log/atlas/import-hbase.log

/var/log/atlas/import-kafka.log and /var/log/atlas/import-hbase.log logs are correctly written. But when import-hive.sh is ran, /var/log/atlas/import-hive.log is not created or written to

[root@ccycloud-1 atlas]# ls -ltr
total 10988
drwxr-xr-x 2 cstm_atlas cstm_atlas     4096 Jul 16 06:55 jstacks
drwxr-xr-x 4 root       root           4096 Jul 16 06:55 audit
-rw-r--r-- 1 cstm_atlas cstm_atlas        0 Jul 16 06:55 metric.log
-rw-r--r-- 1 cstm_atlas cstm_atlas        0 Jul 16 06:55 failed.log
drwxr-xr-x 2 cstm_atlas cstm_atlas     4096 Jul 18 03:52 support-bundle
-rw-r--r-- 1 root       root          21573 Jul 22 09:56 import-kafka.log
-rw-r--r-- 1 root       root         159459 Jul 22 09:58 import-hbase.log
-rw-r--r-- 1 cstm_atlas cstm_atlas    19429 Jul 22 10:12 gc-worker.log.0.current
-rw-r--r-- 1 cstm_atlas cstm_atlas   179081 Jul 22 10:22 audit.log
-rw-r--r-- 1 cstm_atlas cstm_atlas 10840903 Jul 22 10:23 application.log 

whereas it creates a directory with the name ${atlas.log.dir} and a file with the name ${atlas.log.file} under it 

[root@ccycloud-1 hook-bin]# ls -ltr
total 44
-rwxr-xr-x 1 root root  3892 Jul 14 13:09 import-kafka.sh
-rwxr-xr-x 1 root root  4547 Jul 14 13:09 import-hive.sh
-rwxr-xr-x 1 root root  4341 Jul 14 13:09 import-hbase.sh
drwxr-sr-x 2 root root  4096 Jul 22 10:23 ${atlas.log.dir}
-rw-r--r-- 1 root root 20094 Jul 22 10:23 derby.log 

The import-hive.sh logs are written into ${atlas.log.file}

[root@ccycloud-1 ${atlas.log.dir}]# ls -ltra
total 48
drwxr-sr-x 3 root root  4096 Jul 22 10:23 ..
drwxr-sr-x 2 root root  4096 Jul 22 10:23 .
-rw-r--r-- 1 root root 40960 Jul 22 10:23 ${atlas.log.file} 

The import-hive.sh logs should be written into /var/log/atlas/import-hive.log

Issue Links

• is duplicated by: ATLAS-4420 [Atlas: Hive Import] The hive import logs are not generated