Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11145

launch_container.sh problem when hive query with backqoute

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.1.0
    • None
    • None
    • Yarn   3.1.0

      Hive   3.1.0

      HDP   3.1.0.0-78

    Description

      When hive query start up a Distcp job as a MapReduce job,it was named as ”distcp:[clipped SQL context]“  by default,when the sql is [insert into mydb.newtb select * from mydb.oldtb], it's like "distcp:insert into mydb.tb...db.oldtb". And this name will be used in lancher.container.sh as the value of TIMELINE_FLOW_NAME_TAG

       

      When I use backquote on one of database name and table name,it will cause a bash problem.Like 

      export TIMELINE_FLOW_NAME_TAG="distcp: INSERT INTO mydb.ne ...db`.`oldtb` (Stage-1)"

      in shell script file.The error is

      [container route]/launch_container.sh: line 33: unexpected EOF while looking for matching ``'

       

      I can solve this by set mapreduce.job.name to a static name ,just avoid this problem. Perhaps the default naming convention for Distcp tasks can be changed,which SQL context is not included.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            gwbw cc

            Dates

              Created:
              Updated:

              Slack

                Issue deployment