Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14603 Über-JIRA: HDFS RBF stabilization phase II
  3. HDFS-13811

RBF: Race condition between router admin quota update and periodic quota update service

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.3.0
    • None
    • None
    • Reviewed

    Description

      If we try to update quota of an existing mount entry and at the same time periodic quota update service is running on the same mount entry, it is leading the mount table to inconsistent state.

      Here transactions are:

      A - Quota update service is fetching mount table entries.

      B - Quota update service is updating the mount table with current usage.

      A' - User is trying to update quota using admin cmd.

      and the transaction sequence is [ A A' B ]

      quota update service is updating the mount table with old quota value.

      Attachments

        1. HDFS-13811-000.patch
          26 kB
          Dibyendu Karmakar
        2. HDFS-13811-HDFS-13891-000.patch
          26 kB
          Dibyendu Karmakar
        3. HDFS-13811.001.patch
          14 kB
          Jinglun
        4. HDFS-13811.002.patch
          14 kB
          Jinglun
        5. HDFS-13811.003.patch
          16 kB
          Jinglun
        6. HDFS-13811.004.patch
          21 kB
          Jinglun
        7. HDFS-13811.005.patch
          22 kB
          Jinglun
        8. HDFS-13811.006.patch
          20 kB
          Jinglun
        9. HDFS-13811.007.patch
          18 kB
          Jinglun

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            LiJinglun Jinglun
            dibyendu_hadoop Dibyendu Karmakar
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment