Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3602

Enhancements to HDFS for Windows Server and Windows Azure development and runtime environments

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • None
    • None
    • None
    • Windows

    Description

      This JIRA tracks the work that needs to be done on trunk to enable Hadoop to run on Windows Server and Azure environments. This incorporates porting relevant work from the similar effort on branch 1 tracked via HADOOP-8079.

      Attachments

        Issue Links

          incorporates

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4769 TestPersistBlocks#testRestartDfs fails on Windows

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5209 Provide Windows Stat() implementation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4145 Merge hdfs cmd line scripts from branch-1-win

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4163 HDFS distribution build fails on Windows

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4260 Fix HDFS tests to set test dir to a valid HDFS path as opposed to the local build path

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4275 MiniDFSCluster-based tests fail on Windows due to failure to delete test namenode directory

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4276 HDFS tests have multiple failures on Windows due to file locking conflict

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4716 TestAllowFormat#testFormatShouldBeIgnoredForNonFileBasedDirs fails on Windows

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4752 TestRBWBlockInvalidation fails on Windows due to file locking

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5090 Disable TestGlobPaths#pTestEscape on Windows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-9638 parallel test changes caused invalid test path for several HDFS tests on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4287 HTTPFS tests fail on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4470 several HDFS tests attempt file operations on invalid HDFS paths when running on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4674 TestBPOfferService fails on Windows due to failure parsing datanode data directory as URI

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4734 HDFS Tests that use ShellCommandFencer are broken on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4740 Fixes for a few test failures on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4741 TestStorageRestore#testStorageRestoreFailure fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4743 TestNNStorageRetentionManager fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5099 Namenode#copyEditLogSegmentsToSharedDir should close EditLogInputStreams upon finishing

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4274 BlockPoolSliceScanner does not close verification log during shutdown

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4609 TestAuditLogs should release log handles between tests

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4732 TestDFSUpgradeFromImage fails on Windows due to failure to unpack old image tarball that contains hard links

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4818 several HDFS tests that attempt to make directories unusable do not work correctly on Windows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5093 TestGlobPaths should re-use the MiniDFSCluster to avoid failure on Windows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5100 TestNamenodeRetryCache fails on Windows due to incorrect cleanup

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5105 TestFsck fails on Windows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5106 TestDatanodeBlockScanner fails on Windows due to incorrect path format

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Test - A new unit, integration or system test. HADOOP-9948 Add a config value to CLITestHelper to skip tests on Windows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Test - A new unit, integration or system test. HDFS-5186 TestFileJournalManager fails on Windows due to file handle leaks

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          is part of

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-8562 Enhancements to support Hadoop on Windows Server and Windows Azure environments

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4811 race condition between 2 namenodes in standby that are trying to checkpoint with one another can delete or corrupt a good fsimage

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-3519 Checkpoint upload may interfere with a concurrent saveNamespace

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4632 globStatus using backslash for escaping does not work on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4633 TestDFSClientExcludedNodes fails sporadically if excluded nodes cache expires too quickly

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4725 fix HDFS file handle leaks

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4745 TestDataTransferKeepalive#testSlowReader has race condition that causes sporadic failure

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4748 MiniJournalCluster#restartJournalNode leaks resources, which causes sporadic test failures

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4768 File handle leak in datanode when a block pool is removed

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4783 TestDelegationTokensWithHA#testHAUtilClonesDelegationTokens fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4810 several HDFS HA tests have timeouts that are too short

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-4782 backport edit log corruption toleration to branch-1-win

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4582 TestHostsFiles fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4583 TestNodeCount fails

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4603 TestMiniDFSCluster fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4604 TestJournalNode fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4610 Move to using common utils FileUtil#setReadable/Writable/Executable and FileUtil#canRead/Write/Execute

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4677 Editlog should support synchronous writes

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4695 TestEditLog leaks open file handles between tests

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4722 TestGetConf#testFederation times out on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-5065 TestSymlinkHdfsDisable fails on Windows

          • Major - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4607 TestGetConf#testGetSpecificKey fails on Windows

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. HDFS-4705 Address HDFS test failures on Windows because of invalid dfs.namenode.name.dir

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              bikassaha Bikas Saha
              bikassaha Bikas Saha
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: