Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Currently Oozie Start task takes ~3 minutes. Which includes some time-
expensive actions like:
1\. Extracting a big tar archive
2\. Execute prepare-war fom it
3\. Checking for hdfs directory via hadoop binary.
1 and 2 can be avoid on the non-first starts, by saving checksum of archive
which was extracted, and not re-extracting it unless the checksum changed, or
the unextracted folder is gone.
3 can benefit from using fast WebHDFS calls.
*As a result for me for non-first Oozie start this reduced time of start from 180 seconds to 13-30 seconds.*
Attachments
Issue Links
- breaks
-
AMBARI-18567 Cannot start Oozie if WebHDFS is disabled
- Resolved
- links to