Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6604

The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.4.0
    • 2.5.0
    • hdfs-client
    • None

    • Centos 6.5 and distribution Hortonworks Data Platform v2.1

    • Reviewed

    Description

      When HDFS shortcircuit is enabled, the file descriptors of the deleted HDFS blocks are kept open until the cache is full. This prevents the operating system to free the space on disk.

      More details on the mailing list thread

      Attachments

        1. HDFS-6604.002.patch
          3 kB
          Colin McCabe
        2. HDFS-6604.001.patch
          0.8 kB
          Colin McCabe

        Issue Links

        is related to

        Sub-task - The sub-task of the issue HDFS-6750 The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            cmccabe Colin McCabe
            G.Reina Giuseppe Reina
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment