Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6634 inotify in HDFS
  3. HDFS-6777

Supporting consistent edit log reads when in-progress edit log segments are included

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: qjm
    • Labels:
      None
    • Target Version/s:

      Description

      For inotify, we want to be able to read transactions from in-progress edit log segments so we can serve transactions to listeners soon after they are committed. This JIRA works toward ensuring that we do not send unsync'ed transactions back to the client by discarding in-progress segments if we have a finalized segment starting at the same transaction ID. See the design document for more background and details.

        Attachments

        1. 6777-design.2.pdf
          26 kB
          James Thomas
        2. 6777-design.pdf
          22 kB
          James Thomas
        3. HDFS-6777.patch
          24 kB
          James Thomas

          Activity

            People

            • Assignee:
              james.thomas James Thomas
              Reporter:
              james.thomas James Thomas
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: