Version 2.9.0

RELEASED

Start: 25/Nov/15

Released: 17/Nov/17

Release Notes

2.9.0 releaseShow more
1–200 of 394View in Issue Navigator
PTKeySummaryAssigneeStatus
BlockerSub-taskHADOOP-13050Upgrade to AWS SDK 1.11.45Steve LoughranResolved
BlockerBugHADOOP-13996Fix some release build issuesAndrew WangResolved
BlockerBugHADOOP-14207"dfsadmin -refreshCallQueue" fails with DecayRpcSchedulerSurendra Singh LilhoreResolved
BlockerSub-taskHADOOP-14324Refine S3 server-side-encryption key as encryption secret; improve error reporting and diagnosticsSteve LoughranResolved
BlockerSub-taskHADOOP-14384Reduce the visibility of FileSystem#newFSDataOutputStreamBuilder before the API becomes stableLei (Eddy) XuResolved
BlockerBugHADOOP-14399Configuration does not correctly XInclude absolute file URIsJonathan Turner EaglesResolved
BlockerBugHADOOP-14428s3a: mkdir appears to be brokenMingliang LiuResolved
BlockerBugHADOOP-14501Switch from aalto-xml to woodstox to handle odd XML featuresJonathan Turner EaglesResolved
BlockerSub-taskHADOOP-14596AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs errorSteve LoughranResolved
BlockerBugHADOOP-14658branch-2 compilation is broken in hadoop-azureSunil GResolved
BlockerBugHADOOP-14683FileStatus.compareTo binary compatible issueAkira AjisakaResolved
BlockerBugHADOOP-14727Socket not closed properly when reading Configurations with BlockReaderRemoteJonathan Turner EaglesResolved
BlockerBugHADOOP-14814Fix incompatible API change on FsServerDefaults to HADOOP-14104Junping DuResolved
BlockerBugHADOOP-14842Hadoop 2.8.2 release build process get stuck due to java issueJunping DuResolved
BlockerSub-taskHADOOP-14890Move up to AWS SDK 1.11.199Steve LoughranResolved
BlockerBugHADOOP-14958CLONE - Fix source-level compatibility after HADOOP-11252Junping DuResolved
BlockerBugHADOOP-14966Handle JDK-8071638 for hadoop-commonBibin ChundattResolved
BlockerBugHADOOP-14990Clean up jdiff xml files added for 2.8.2 releaseJunping DuResolved
BlockerBugHADOOP-15013Fix ResourceEstimator findbugs issuesArun SureshResolved
CriticalBugHADOOP-9849License information is missing for native CRC32 codeAndrew WangResolved
CriticalBugHADOOP-11780Prevent IPC reader thread deathDaryn SharpResolved
CriticalBugHADOOP-12469distcp should not ignore the ignoreFailures optionMingliang LiuResolved
CriticalImprovementHADOOP-12759RollingFileSystemSink should eagerly rotate directoriesDaniel TempletonResolved
CriticalBugHADOOP-13833TestSymlinkHdfsFileSystem#testCreateLinkUsingPartQualPath2 fails after HADOOP13605Brahma Reddy BattulaResolved
CriticalBugHADOOP-14024KMS JMX endpoint throws ClassNotFoundExceptionJohn ZhugeResolved
CriticalBugHADOOP-14066VersionInfo should be marked as public APIAkira AjisakaResolved
CriticalBugHADOOP-14100Upgrade Jsch jar to latest version to fix vulnerability in old versionsVinayakumar BResolved
CriticalImprovementHADOOP-14150Implement getHomeDirectory() method in NativeAzureFileSystemSanthosh G NayakResolved
CriticalBugHADOOP-14204S3A multipart commit failing, "UnsupportedOperationException at java.util.Collections$UnmodifiableList.sort"Steve LoughranResolved
CriticalBugHADOOP-14214DomainSocketWatcher::add()/delete() should not self interrupt while looping await()Mingliang LiuResolved
CriticalImprovementHADOOP-14251Credential provider should handle property key deprecationJohn ZhugeResolved
CriticalBugHADOOP-14283Upgrade AWS SDK to 1.11.134Aaron FabbriResolved
CriticalBugHADOOP-14687AuthenticatedURL will reuse bad/expired session cookiesDaryn SharpResolved
CriticalBugHADOOP-14919BZip2 drops records when reading data in splitsJason Darrell LoweResolved
CriticalBugHADOOP-15030[branch-2] Include hadoop-cloud-storage-project in the main hadoop pom modulesSubramaniam KrishnanResolved
MajorImprovementHADOOP-7308Remove unused TaskLogAppender configurations from log4j.propertiesTodd LipconResolved
MajorBugHADOOP-9631ViewFs should use underlying FileSystem's server side defaultsErik KrogenResolved
MajorBugHADOOP-10321TestCompositeService should cover all enumerations of adding a service to a parent serviceRay ChiangResolved
MajorBugHADOOP-10694Remove synchronized input streams from Writable deserializationGopal VijayaraghavanResolved
MajorBugHADOOP-10829Iteration on CredentialProviderFactory.serviceLoader is thread-unsafeBenoy AntonyResolved
MajorImprovementHADOOP-11552Allow handoff on the server side for RPC requestsSiddharth SethResolved
MajorSub-taskHADOOP-11572s3a delete() operation fails during a concurrent delete of child entriesSteve LoughranResolved
MajorBugHADOOP-11703git should ignore .DS_Store files on Mac OS XAbin ShahabResolved
MajorImprovementHADOOP-11794Enable distcp to copy blocks in parallelYongjun ZhangResolved
MajorImprovementHADOOP-12097Allow port range to be specified while starting webapp Varun SaxenaResolved
MajorImprovementHADOOP-12291Add support for nested groups in LdapGroupsMappingEsther KundinResolved
MajorNew FeatureHADOOP-12321Make JvmPauseMonitor an AbstractServiceSunil GResolved
MajorImprovementHADOOP-12566Add NullGroupMappingDaniel TempletonResolved
MajorBugHADOOP-12573TestRPC.testClientBackOff failingXiao ChenResolved
MajorImprovementHADOOP-12625Add a config to disable the /logs endpointsRobert KanterResolved
MajorBugHADOOP-12653Use SO_REUSEADDR to avoid getting "Address already in use" when using kerberos and attempting to bind to any port on the local IP addressColin McCabeResolved
MajorBugHADOOP-12655TestHttpServer.testBindAddress bind port range is wider than expectedWei-Chiu ChuangResolved
MajorNew FeatureHADOOP-12702Add an HDFS metrics sinkDaniel TempletonResolved
MajorSub-taskHADOOP-12705Upgrade Jackson 2.2.3 to 2.7.8Sean MackroryResolved
MajorSub-taskHADOOP-12710Remove dependency on commons-httpclient for TestHttpServerLogsWei-Chiu ChuangResolved
MajorImprovementHADOOP-12713Disable spurious checkstyle checksAndrew WangResolved
MajorNew FeatureHADOOP-12747support wildcard in libjars argumentSangjin LeeResolved
MajorImprovementHADOOP-12782Faster LDAP group name resolution with ActiveDirectoryWei-Chiu ChuangResolved
MajorImprovementHADOOP-12817Enable TLS v1.1 and 1.2Robert KanterResolved
MajorNew FeatureHADOOP-12847hadoop daemonlog should support https and SPNEGO for Kerberized clusterWei-Chiu ChuangResolved
MajorBugHADOOP-12888Shell to disable bash and setsid support when running under JVM security managerCostin LeauResolved
MajorSub-taskHADOOP-12926lz4.c does not detect 64-bit mode properlyAlan BurlisonResolved
MajorBugHADOOP-12954Add a way to change hadoop.security.token.service.use_ipRobert KanterResolved
MajorImprovementHADOOP-12984Add GenericTestUtils.getTestDir method and use it for temporary directory in testsSteve LoughranResolved
MajorImprovementHADOOP-13018Make Kdiag check whether hadoop.token.files points to existent and valid filesRavi PrakashResolved
MajorSub-taskHADOOP-13075Add support for SSE-KMS and SSE-C in s3a filesystemSteve MoistResolved
MajorBugHADOOP-13102Update GroupsMapping documentation to reflect the new changesEsther KundinResolved
MajorBugHADOOP-13119Add ability to secure log servlet using proxy usersYuanbo LiuResolved
MajorTestHADOOP-13178TestShellBasedIdMapping.testStaticMapUpdate doesn't work on OS XKaiResolved
MajorImprovementHADOOP-13197Add non-decayed call metrics for DecayRpcSchedulerXiaoyu YaoResolved
MajorBugHADOOP-13254Create framework for configurable disk checkersYufei GuResolved
MajorImprovementHADOOP-13337Update maven-enforcer-plugin version to 1.4.1Tsuyoshi OzawaResolved
MajorNew FeatureHADOOP-13345S3Guard: Improved Consistency for S3AChris NaurothResolved
MajorBugHADOOP-13353LdapGroupsMapping getPassward shouldn't return null when IOException throwsWei-Chiu ChuangResolved
MajorImprovementHADOOP-13354Update WASB driver to use the latest version (4.2.0) of SDK for Microsoft Azure Storage ClientsSivaguru SankaridurgResolved
MajorNew FeatureHADOOP-13396Allow pluggable audit loggers in KMSXiao ChenResolved
MajorBugHADOOP-13403AzureNativeFileSystem rename/delete performance improvementsSubramanyam PattipakaResolved
MajorBugHADOOP-13414Hide Jetty Server version header in HTTP responsesSurendra Singh LilhoreResolved
MajorImprovementHADOOP-13427Eliminate needless uses of FileSystem#{exists(), isFile(), isDirectory()}Mingliang LiuResolved
MajorBugHADOOP-13433Race in UGI.reloginFromKeytabDuo ZhangResolved
MajorBugHADOOP-13437KMS should reload whitelist and default key ACLs when hot-reloadingXiao ChenResolved
MajorBugHADOOP-13476CredentialProviderFactory fails at class loading from libhdfs (JNI)Aaron FabbriResolved
MajorBugHADOOP-13508FsPermission string constructor does not recognize sticky bitAtul SikariaResolved
MajorImprovementHADOOP-13522Add %A and %a formats for fs -stat command to print permissionsAlex GarbariniResolved
MajorBugHADOOP-13556Change Configuration.getPropsWithPrefix to use getProps instead of iteratorLarry McCayResolved
MajorNew FeatureHADOOP-13578Add Codec for ZStandard Compressionchurro moralesResolved
MajorBugHADOOP-13588ConfServlet should respect Accept request headerWeiwei YangResolved
MajorBugHADOOP-13602Fix some warnings by findbugs in hadoop-maven-pluginTsuyoshi OzawaResolved
MajorImprovementHADOOP-13605Clean up FileSystem javadocs, logging; improve diagnostics on FS loadSteve LoughranResolved
MajorBugHADOOP-13626Remove distcp dependency on FileStatus serializationChristopher DouglasResolved
MajorSub-taskHADOOP-13627Have an explicit KerberosAuthException for UGI to throw, text from public constantsXiao ChenResolved
MajorImprovementHADOOP-13628Support to retrieve specific property from configuration via REST APIWeiwei YangResolved
MajorBugHADOOP-13675Bug in return value for delete() calls in WASBDushyanthResolved
MajorImprovementHADOOP-13687Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop.Chris NaurothResolved
MajorImprovementHADOOP-13688Stop bundling HTML source code in javadoc JARsAndrew WangResolved
MajorBugHADOOP-13697LogLevel#main throws exception if no arguments providedMingliang LiuResolved
MajorImprovementHADOOP-13702Add a new instrumented read-write lockJingcheng DuResolved
MajorImprovementHADOOP-13709Ability to clean up subprocesses spawned by Shell when the process exitsEric BadgerResolved
MajorImprovementHADOOP-13737Cleanup DiskChecker interfaceArpit AgarwalResolved
MajorImprovementHADOOP-13738DiskChecker should perform some disk IOArpit AgarwalResolved
MajorBugHADOOP-13789Hadoop Common includes generated test protos in both jar and test-jarSean BusbeyResolved
MajorBugHADOOP-13831Correct check for error code to detect Azure Storage Throttling and provide retriesGaurav KanadeResolved
MajorTaskHADOOP-13835Move Google Test Framework code from mapreduce to hadoop-commonVarun VasudevResolved
MajorSub-taskHADOOP-13854KMS should log error details in KMSExceptionsProviderXiao ChenResolved
MajorBugHADOOP-13858TestGridmixMemoryEmulation and TestResourceUsageEmulators fail on the environment other than Linux or WindowsAkira AjisakaResolved
MajorBugHADOOP-13859TestConfigurationFieldsBase fails for fields that are DEFAULT values of skipped properties.Haibo ChenResolved
MajorImprovementHADOOP-13863Azure: Add a new SAS key mode for WASB.DushyanthResolved
MajorBugHADOOP-13867FilterFileSystem should override rename(.., options) to take effect of Rename options called via FilterFileSystem implementationsVinayakumar BResolved
MajorBugHADOOP-13928TestAdlFileContextMainOperationsLive.testGetFileContext1 runtime errorJohn ZhugeResolved
MajorImprovementHADOOP-13930Azure: Add Authorization support to WASBSivaguru SankaridurgResolved
MajorNew FeatureHADOOP-13933Add haadmin -getAllServiceState option to get the HA state of all the NameNodes/ResourceManagersSurendra Singh LilhoreResolved
MajorBugHADOOP-13942Build failure due to errors of javadoc build in hadoop-azureKaiResolved
MajorBugHADOOP-13943TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863Brahma Reddy BattulaResolved
MajorImprovementHADOOP-13945Azure: Add Kerberos and Delegation token support to WASB client.Santhosh G NayakResolved
MajorImprovementHADOOP-13953Make FTPFileSystem's data connection mode and transfer mode configurableXiao ChenResolved
MajorBugHADOOP-13976Path globbing does not match newlinesEric BadgerResolved
MajorBugHADOOP-13988KMSClientProvider does not work with WebHDFS and Apache Knox w/ProxyUserXiaoyu YaoResolved
MajorImprovementHADOOP-14003Make additional KMS tomcat settings configurableAndrew WangResolved
MajorBugHADOOP-14026start-build-env.sh: invalid docker image nameGergő PásztorResolved
MajorBugHADOOP-14029Fix KMSClientProvider for non-secure proxyuser use caseXiaoyu YaoResolved
MajorSub-taskHADOOP-14032Reduce fair call queue priority inversionDaryn SharpResolved
MajorSub-taskHADOOP-14033Reduce fair call queue lock contentionDaryn SharpResolved
MajorSub-taskHADOOP-14034Allow ipc layer exceptions to selectively close connectionsDaryn SharpResolved
MajorSub-taskHADOOP-14035Reduce fair call queue backoff's impact on clientsDaryn SharpResolved
MajorSub-taskHADOOP-14040Use shaded aws-sdk uber-JAR 1.11.86Steve LoughranResolved
MajorBugHADOOP-14044Synchronization issue in delegation token cancel functionalityHrishikesh GadreResolved
MajorImprovementHADOOP-14095Document caveats about the default JavaKeyStoreProvider in KMSXiao ChenResolved
MajorImprovementHADOOP-14104Client should always ask namenode for kms provider path.Rushabh ShahResolved
MajorImprovementHADOOP-14112Über-jira adl:// Azure Data Lake Phase I: StabilizationJohn ZhugeResolved
MajorBugHADOOP-14116FailoverOnNetworkExceptionRetry does not wait when failover on certain exception Jian HeResolved
MajorSub-taskHADOOP-14135Remove URI parameter in AWSCredentialProvider constructorsMingliang LiuResolved
MajorBugHADOOP-14146KerberosAuthenticationHandler should authenticate with SPN in AP-REQDaryn SharpResolved
MajorBugHADOOP-14166Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not usedSurendra Singh LilhoreResolved
MajorBugHADOOP-14170FileSystemContractBaseTest is not cleaning up test directory clearlyMingliang LiuResolved
MajorSub-taskHADOOP-14174Set default ADLS access token provider type to ClientCredentialJohn ZhugeResolved
MajorBugHADOOP-14195CredentialProviderFactory$getProviders is not thread-safeVihang KarajgaonkarResolved
MajorSub-taskHADOOP-14196Azure Data Lake doc is missing required config entryAtul SikariaResolved
MajorSub-taskHADOOP-14197Fix ADLS doc for credential providerJohn ZhugeResolved
MajorBugHADOOP-14205No FileSystem for scheme: adlJohn ZhugeResolved
MajorBugHADOOP-14211FilterFs and ChRootedFs are too aggressive about enforcing "authorityNeeded"Erik KrogenResolved
MajorImprovementHADOOP-14213Move Configuration runtime check for hadoop-site.xml to initializationJonathan Turner EaglesResolved
MajorImprovementHADOOP-14216Improve Configuration XML Parsing PerformanceJonathan Turner EaglesResolved
MajorSub-taskHADOOP-14220Enhance S3GuardTool with bucket-info and set-capacity commands, testsSteve LoughranResolved
MajorImprovementHADOOP-14233Delay construction of PreCondition.check failure message in Configuration#setJonathan Turner EaglesResolved
MajorImprovementHADOOP-14240Configuration#get return value optimizationJonathan Turner EaglesResolved
MajorImprovementHADOOP-14242Make KMS Tomcat SSL property sslEnabledProtocols and clientAuth configurableJohn ZhugeResolved
MajorImprovementHADOOP-14246Authentication Tokens should use SecureRandom instead of Random and 256 bit secretsRobert KanterResolved
MajorSub-taskHADOOP-14255S3A to delete unnecessary fake directory objects in mkdirs()Mingliang LiuResolved
MajorImprovementHADOOP-14260Configuration.dumpConfiguration should redact sensitive informationJohn ZhugeResolved
MajorBugHADOOP-14272Azure: WasbRemoteCallHelper should use String equals for comparison.Santhosh G NayakResolved
MajorBugHADOOP-14273Azure: NativeAzureFileSystem should respect config for kerberosSupportEnabled flagSanthosh G NayakResolved
MajorImprovementHADOOP-14274Azure: Simplify Ranger-WASB policy modelSivaguru SankaridurgResolved
MajorSub-taskHADOOP-14289Move log4j APIs over to slf4j in hadoop-commonAkira AjisakaResolved
MajorSub-taskHADOOP-14290Update SLF4J from 1.7.10 to 1.7.25Akira AjisakaResolved
MajorBugHADOOP-14293Initialize FakeTimer with a less trivial valueAndrew WangResolved
MajorSub-taskHADOOP-14296Move logging APIs over to slf4j in hadoop-toolsAkira AjisakaResolved
MajorSub-taskHADOOP-14301Deprecate SharedInstanceProfileCredentialsProvider in branch-2.Mingliang LiuResolved
MajorBugHADOOP-14306TestLocalFileSystem tests have very low timeoutsEric BadgerResolved
MajorBugHADOOP-14311Add python2.7-dev to DockerfileAllen WittenauerResolved
MajorBugHADOOP-14320TestIPC.testIpcWithReaderQueuing fails intermittentlyEric BadgerResolved
MajorBugHADOOP-14341Support multi-line value for ssl.server.exclude.cipher.listJohn ZhugeResolved
MajorTaskHADOOP-14344Revert HADOOP-13606 swift FS to add a service load metadata fileJohn ZhugeResolved
MajorBugHADOOP-14346CryptoOutputStream throws IOException on flush() if stream is closedPierre LacaveResolved
MajorBugHADOOP-14351Azure: RemoteWasbAuthorizerImpl and RemoteSASKeyGeneratorImpl should not use Kerberos interactive user cacheSanthosh G NayakResolved
MajorBugHADOOP-14361Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrentlySanthosh G NayakResolved
MajorBugHADOOP-14369NetworkTopology calls expensive toString() when loggingÍñigo GoiriResolved
MajorBugHADOOP-14371License error in TestLoadBalancingKMSClientProvider.javahu xiaodongResolved
MajorBugHADOOP-14372TestSymlinkLocalFS timeouts are too lowEric BadgerResolved
MajorBugHADOOP-14373License error In org.apache.hadoop.metrics2.util.Servershu xiaodongResolved
MajorBugHADOOP-14374License error in GridmixTestUtils.javalixinglongResolved
MajorBugHADOOP-14376Memory leak when reading a compressed file using the native libraryEli AcherkanResolved
MajorBugHADOOP-14377Increase Common test timeouts from 1 second to 10 secondsEric BadgerResolved
MajorImprovementHADOOP-14383Implement FileSystem that reads from HTTP / HTTPS endpointsHaohui MaiResolved
MajorSub-taskHADOOP-14394Provide Builder pattern for DistributedFileSystem.createLei (Eddy) XuResolved
MajorSub-taskHADOOP-14395Provide Builder pattern for DistributedFileSystem.appendLei (Eddy) XuResolved
MajorSub-taskHADOOP-14397Pull up the builder pattern to FileSystem and add AbstractContractCreateTest for itLei (Eddy) XuResolved
MajorBugHADOOP-14405Fix performance regression due to incorrect use of DataChecksumLiXin GeResolved
MajorImprovementHADOOP-14407DistCp - Introduce a configurable copy buffer sizeOmkar Aradhya K SResolved
MajorBugHADOOP-14412HostsFileReader#getHostDetails is very expensive on large clustersJason Darrell LoweResolved
MajorBugHADOOP-14416Path starting with 'wasb:///' not resolved correctly while authorizing with WASB-RangerSivaguru SankaridurgResolved
MajorBugHADOOP-14427Avoid reloading of Configuration in ViewFileSystem creation.Vinayakumar BResolved
MajorBugHADOOP-14429FTPFileSystem#getFsAction always returns FsAction.NONEHongyuan LiResolved
MajorBugHADOOP-14431ModifyTime of FileStatus returned by SFTPFileSystem's getFileStatus method is wrongHongyuan LiResolved
MajorBugHADOOP-14436Remove the redundant colon in ViewFs.mdBaolong MaoResolved
MajorImprovementHADOOP-14440Add metrics for connections droppedEric BadgerResolved
MajorImprovementHADOOP-14442Owner support for ranger-wasb integrationVarada HemeswariResolved
MajorImprovementHADOOP-14443Azure: Support retry and client side failover for authorization, SASKey and delegation token generationSanthosh G NayakResolved
MajorImprovementHADOOP-14455ViewFileSystem#rename should support be supported within same nameservice with different mountpointsBrahma Reddy BattulaResolved
MajorBugHADOOP-14460Azure: update doc for live and contract testsMingliang LiuResolved
MajorBugHADOOP-14461Azure: handle failure gracefully in case of missing account access keyMingliang LiuResolved
MajorImprovementHADOOP-14465LdapGroupsMapping - support user and group search baseShwetha GSResolved
MajorBugHADOOP-14472Azure: TestReadAndSeekPageBlobAfterWrite fails intermittentlyMingliang LiuResolved
MajorBugHADOOP-14474Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failuresAkira AjisakaResolved
MajorBugHADOOP-14478Optimize NativeAzureFsInputStream for positional readsRajesh BalamohanResolved
MajorBugHADOOP-14486TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0 Hongyuan LiResolved
MajorImprovementHADOOP-14491Azure has messed doc structureMingliang LiuResolved
MajorImprovementHADOOP-14497Logs for KMS delegation token lifecycleXiao ChenResolved
MajorBugHADOOP-14500Azure: TestFileSystemOperationExceptionHandling{,MultiThreaded} failsRajesh BalamohanResolved
MajorImprovementHADOOP-14503Make RollingAverages a mutable metricHanisha KoneruResolved
MajorImprovementHADOOP-14515Specifically configure zookeeper-related log levels in KMS log4jXiao ChenResolved
1–200 of 394