Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-3545

MR Jobhistory cannot work well with o3fs hadoop compatible file system

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • Ozone Filesystem
    • None

    Description

      After take a look at the code of JobHistory, i see jobhistory use `fs.getModificationTime()` to get the directory modification time, and use it as a condition of starting scan the job directories.

      But, for ozone, wile insert a child to a `directory`, the modification time of the `directory` don't update now.

      So we should update the modification time of `directory`, otherwise, MR Jobhistory and some other component which use the modification time of `directory` cannot work as expected.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            maobaolong Baolong Mao
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment