Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3077 Quorum-based protocol for reading and writing edit logs
  3. HDFS-3571

Allow EditLogFileInputStream to read from a remote URL

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.0.3-alpha
    • ha, namenode
    • None
    • Reviewed

    Description

      In order to start up from remote edits storage (like the JournalNodes of HDFS-3077), the NN needs to be able to load edits from a URL, instead of just local disk. This JIRA extends EditLogFileInputStream to be able to use a URL reference in addition to the current File reference.

      Attachments

        1. hdfs-3571.txt
          13 kB
          Todd Lipcon
        2. hdfs-3571.txt
          13 kB
          Todd Lipcon
        3. hdfs-3571-branch-2.txt
          13 kB
          Todd Lipcon

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4302 Precondition in EditLogFileInputStream's length() method is checked too early in NameNode startup, causing fatal exception

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: