Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10313

Add hadoop process id to the suffix of hadoop-unjar directory

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.1.3
    • Fix Version/s: None
    • Component/s: client
    • Labels:
      None
    • Target Version/s:

      Description

      We used azkaban to submit many yarn jobs, and the /tmp directory will have many hadoop-unjar directories. Sometimes the hadoop-unjar directory on the azkaban machine takes up a lot of space, but we do not know which process generated this directory. In order to solve this problem, we add the hadoop process id to the suffix of the hadoop-unjar directory.

       

      • hadoop process id

       

      10554 org.apache.hadoop.util.RunJar

       

      • hadoop-unjar directory name

       

      hadoop-unjar8020753511094521686-10554
      

        Attachments

          Activity

            People

            • Assignee:
              Youquan Lin Youquan Lin
              Reporter:
              Youquan Lin Youquan Lin
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: