Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10313

Add hadoop process id to the suffix of hadoop-unjar directory

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.3
    • None
    • client
    • None

    Description

      We used azkaban to submit many yarn jobs, and the /tmp directory will have many hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban machine takes up a lot of space, but we do not know which process generated this directory. In order to solve this problem, we add the hadoop process id to the suffix of the hadoop-unjar directory.

       

      • hadoop process id

       

      10554 org.apache.hadoop.util.RunJar

       

      • hadoop-unjar directory name

       

      hadoop-unjar8020753511094521686-10554
      

      Attachments

        Activity

          People

            Youquan Lin Youquan Lin
            Youquan Lin Youquan Lin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: