Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11585

Yarn Timeline generic-application-history.fs-history-store application log files increase too much,How to set ttl?

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.1.2
    • None
    • None

    Description

      In my hadoop cluster :
      set yarn.timeline-service.generic-application-history.enabled=true;
      set yarn.timeline-service.generic-application-history.store-class=org.apache.hadoop.yarn.server.applicationhistoryservice.FileSystemApplicationHistoryStore;
      set yarn.timeline-service.generic-application-history.fs-history-store.uri=/user/yarn/timeline/generic_history;

      hdfs dfs -count /user/yarn/timeline/generic_history/ApplicationHistoryDataRoot
                 1      3150832 82436180812 
      the number of files in it will increase to the limit of dfs.namenode.fs-limits.max-directory-items=3200000 in less than one month and increase too fast.Now the files were cleaned  manually. Does have any ttl suggestions to clean automatically ?what should i do?

      Attachments

        Activity

          People

            Unassigned Unassigned
            hansonhe hansonhe
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: