Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3439

Hive2 action is not parsing application ID for TEZ from log file properly

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • trunk
    • 5.2.0
    • action
    • None

    Description

      Oozie workflow does not populate ChildJobUrl for Hive2 Action while Hive1 is able to find child job ids.

      I looked at the code and found that pattern is not correct for hive2 action logs generated in usercache.

      static final Pattern[] HIVE2_JOB_IDS_PATTERNS = {
      
      Pattern.compile("Ended Job = (job_\\S*)"),
       Pattern.compile("Submitted application (application[0-9_]*)"),
       Pattern.compile("Running with YARN Application = (application[0-9_]*)")
      }
      
      

      Adding below pattern should help in getting Hive 2 action Tez application id

      Pattern.compile("Executing on YARN cluster with App id (application[0-9_]*)"),
      
      

      Attachments

        1. OOZIE-3439-001.patch
          0.9 kB
          Shubham

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            shubham.chhabra Shubham
            shubham.chhabra Shubham
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment