Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5658

YARN should have a hook to delete a path from HDFS when an application ends

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • resourcemanager
    • None

    Description

      There are many cases when a client uploads data to HDFS and then needs to subsequently clean it up, such as with the distributed cache. It would be helpful if YARN would do that cleanup automatically on job completion.

      The hook could be generic to an URI supported by FileSystem.

      Attachments

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. YARN-2261 YARN should have a way to run post-application cleanup

          • Major - Major loss of function.
          • Open

          Activity

            People

              templedf Daniel Templeton
              templedf Daniel Templeton
              Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated: