Version 2.8.0

RELEASED

Start date not set

Released: 22/Mar/17

Release Notes

2.8.0 releaseShow more
PTKeySummaryAssigneeStatus
BlockerImprovementHADOOP-7266Deprecate metrics v1Akira AjisakaResolved
BlockerImprovementHADOOP-10776Open up already widely-used APIs for delegation-token fetching & renewal to ecosystem projectsVinod Kumar VavilapalliResolved
BlockerBugHADOOP-11628SPNEGO auth does not work with CNAMEs in JDK8Daryn SharpResolved
BlockerImprovementHADOOP-11812Implement listLocatedStatus for ViewFileSystem to speed up split calculationGera ShegalovClosed
BlockerBugHADOOP-11917test-patch.sh should work with ${BASEDIR}/patchprocess setupsAllen WittenauerResolved
BlockerBugHADOOP-11934Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loopLarry McCayClosed
BlockerBugHADOOP-12001Limiting LDAP search conflicts with posixGroup additionPatrick WhiteResolved
BlockerBugHADOOP-12022fix site -Pdocs -Pdist in hadoop-project-dist; cleanout remaining forrest bitsAllen WittenauerResolved
BlockerBugHADOOP-12202releasedocmaker drops missing component and assignee entriesAllen WittenauerResolved
BlockerBugHADOOP-12302Fix native compilation on Windows after HADOOP-7824Vinayakumar BResolved
BlockerBugHADOOP-12304Applications using FileContext fail with the default file system configured to be wasb/s3/etc.Chris NaurothClosed
BlockerBugHADOOP-12406AbstractMapWritable.readFields throws ClassNotFoundException with custom writablesNadeem DoubaClosed
BlockerBugHADOOP-12508delete fails with exception when lease is held on blobGaurav KanadeResolved
BlockerBugHADOOP-12577Bump up commons-collections version to 3.2.2 to address a security flawWei-Chiu ChuangClosed
BlockerBugHADOOP-12587Hadoop AuthToken refuses to work without a maxinactive attribute in issued tokenBenoy AntonyResolved
BlockerImprovementHADOOP-12600FileContext and AbstractFileSystem should be annotated as a Stable interface.Chris NaurothResolved
BlockerBugHADOOP-12681start-build-env.sh fails in branch-2Kengo SekiResolved
BlockerBugHADOOP-12717NPE when trying to rename a directory in Windows Azure Storage FileSystemRobert YokotaResolved
BlockerBugHADOOP-12892fix/rewrite create-releaseAllen WittenauerResolved
BlockerBugHADOOP-12893Verify LICENSE.txt and NOTICE.txtXiao ChenClosed
BlockerImprovementHADOOP-12904Update Yetus to 0.2.0Allen WittenauerResolved
BlockerBugHADOOP-13149Windows distro build fails on dist-copynativelibs.Chris NaurothResolved
BlockerBugHADOOP-13245Fix up some misc create-release issuesAllen WittenauerResolved
BlockerBugHADOOP-13316Enforce Kerberos authentication for required ops in DelegationTokenAuthenticatorXiao ChenResolved
BlockerBugHADOOP-13350Additional fix to LICENSE and NOTICEXiao ChenClosed
BlockerBugHADOOP-13428Fix hadoop-common to generate jdiffWangda TanResolved
BlockerSub-taskHADOOP-13544JDiff reports unncessarily show unannotated APIs and cause confusion while our javadocs only show annotated and public APIsVinod Kumar VavilapalliResolved
BlockerBugHADOOP-13552RetryInvocationHandler logs all remote exceptionsJason Darrell LoweResolved
BlockerBugHADOOP-13812Upgrade Tomcat to 6.0.48John ZhugeResolved
BlockerSub-taskHADOOP-13823s3a rename: fail if dest file existsSteve LoughranResolved
BlockerBugHADOOP-13958Bump up release year to 2017Junping DuResolved
CriticalSub-taskHADOOP-10940RPC client does no bounds checking of responsesDaryn SharpResolved
CriticalBugHADOOP-10941Proxy user verification NPEs if remote host is unresolvableBenoy AntonyResolved
CriticalBugHADOOP-11218Add TLSv1.1,TLSv1.2 to KMS, HttpFS, SSLFactoryVijay SinghResolved
CriticalBugHADOOP-11252RPC client does not time out by defaultMasatake IwasakiClosed
CriticalBugHADOOP-11491HarFs incorrectly declared as requiring an authorityBrahma Reddy BattulaClosed
CriticalBugHADOOP-11780Prevent IPC reader thread deathDaryn SharpResolved
CriticalTestHADOOP-11904test-patch.sh goes into an infinite loop on non-maven buildsAllen WittenauerResolved
CriticalBugHADOOP-11932 MetricsSinkAdapter hangs when being stoppedBrahma Reddy BattulaClosed
CriticalBugHADOOP-11962Sasl message with MD5 challenge text shouldn't be LOG out even in debug level.Junping DuResolved
CriticalBugHADOOP-11966Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh.Chris NaurothClosed
CriticalBugHADOOP-11969ThreadLocal initialization in several classes is not thread safeSean BusbeyResolved
CriticalBugHADOOP-12004test-patch breaks with reexec in certain situationsSean BusbeyResolved
CriticalBugHADOOP-12052IPC client downgrades all exception types to IOE, breaks callers trying to use themBrahma Reddy BattulaResolved
CriticalBugHADOOP-12054RPC client should not retry for InvalidToken exceptionsVarun SaxenaResolved
CriticalBugHADOOP-12078The default retry policy does not handle RetriableException correctly Arpit AgarwalClosed
CriticalBugHADOOP-12107long running apps may have a huge number of StatisticsData instances under FileSystemSangjin LeeClosed
CriticalBugHADOOP-12258Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regressionZhihai XuResolved
CriticalBugHADOOP-12313NPE in JvmPauseMonitor when calling stop() before start()Gabor LiptakResolved
CriticalBugHADOOP-12317Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOSTAnubhav DhootResolved
CriticalBugHADOOP-12345Pad hostname correctly in CredentialsSys.javaPradeep Nayak Udupi KadbetResolved
CriticalBugHADOOP-12407Test failing: hadoop.ipc.TestSaslRPCSteve LoughranResolved
CriticalBugHADOOP-12441Fix kill command behavior under some Linux distributions.Wangda TanResolved
CriticalBugHADOOP-12478Shell.getWinUtilsPath() has been renamed Shell.getWinutilsPath() Steve LoughranResolved
CriticalBugHADOOP-12483Maintain wrapped SASL ordering for postponed IPC responsesDaryn SharpResolved
CriticalBugHADOOP-12590TestCompressorDecompressor failing without stack tracesJohn ZhugeResolved
CriticalBugHADOOP-12622RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy's retry could be very misleading.Junping DuResolved
CriticalBugHADOOP-12634Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copyGaurav KanadeResolved
CriticalImprovementHADOOP-12668Support excluding weak Ciphers in HttpServer2 through ssl-server.xml Vijay SinghResolved
CriticalBugHADOOP-12678Handle empty rename pending metadata file during atomic rename in redo pathmadhumita chakrabortyResolved
CriticalBugHADOOP-12751While using kerberos Hadoop incorrectly assumes names with '@' to be non-simpleBolke de BruinResolved
CriticalBugHADOOP-12780During WASB atomic rename handle crash when one directory has been renamed but not file under it.madhumita chakrabortyResolved
CriticalImprovementHADOOP-12971FileSystemShell doc should explain relative pathJohn ZhugeResolved
CriticalBugHADOOP-13026Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticatorXuan GongResolved
CriticalBugHADOOP-13083The number of javadocs warnings is limited to 100 Gergely NovákResolved
CriticalBugHADOOP-13138Unable to append to a SequenceFile with Compression.NONE.Vinayakumar BResolved
CriticalBugHADOOP-13192org.apache.hadoop.util.LineReader cannot handle multibyte delimiters correctlydevinzhuClosed
CriticalBugHADOOP-13270BZip2CompressionInputStream finds the same compression marker twice in corner case, causing duplicate data blocksKaiClosed
CriticalBugHADOOP-13381KMS clients should use KMS Delegation Tokens from current UGI.Xiao ChenResolved
CriticalBugHADOOP-13512ReloadingX509TrustManager should keep reloading in case of exceptionMingliang LiuResolved
CriticalBugHADOOP-13700Remove unthrown IOException from TrashPolicy#initialize and #getInstance signaturesAndrew WangResolved
CriticalBugHADOOP-13749KMSClientProvider combined with KeyProviderCache can result in wrong UGI being usedXiaoyu YaoResolved
CriticalBugHADOOP-13826S3A Deadlock in multipart copy due to thread pool limits.Sean MackroryResolved
CriticalBugHADOOP-13838KMSTokenRenewer should close providersXiao ChenResolved
CriticalImprovementHADOOP-13956Read ADLS credentials from Credential ProviderJohn ZhugeResolved
CriticalBugHADOOP-14028S3A BlockOutputStreams doesn't delete temporary files in multipart uploads or handle part upload failuresSteve LoughranResolved
CriticalNew FeatureHADOOP-14048REDO operation of WASB#AtomicRename should create placeholder blob for destination folderNITIN VERMAResolved
CriticalBugHADOOP-14062ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabledSteven RandResolved
CriticalSub-taskHADOOP-14138Remove S3A ref from META-INF service discovery, rely on existing core-default entrySteve LoughranResolved
MajorImprovementHADOOP-6842"hadoop fs -text" does not give a useful text representation of MapWritable objectsAkira AjisakaResolved
MajorImprovementHADOOP-7139Allow appending to existing SequenceFilesKanaka Kumar AvvaruClosed
MajorBugHADOOP-7165listLocatedStatus(path, filter) is not redefined in FilterFsHairong KuangResolved
MajorBugHADOOP-7817RawLocalFileSystem.append() should give FSDataOutputStream with accurate .getPos()Kanaka Kumar AvvaruClosed
MajorSub-taskHADOOP-7824NativeIO.java flags and identifiers must be set correctly for each platform, not hardcoded to their Linux valuesMartin WalshResolved
MajorImprovementHADOOP-7930Kerberos relogin interval in UserGroupInformation should be configurableRobert KanterResolved
MajorBugHADOOP-8151Error handling in snappy decompressor throws invalid exceptionsMatthew FoleyClosed
MajorBugHADOOP-8419GzipCodec NPE upon reset with IBM JDKYu LiClosed
MajorBugHADOOP-8436NPE In getLocalPathForWrite ( path, conf ) when the required context item is not configuredBrahma Reddy BattulaResolved
MajorBugHADOOP-8437getLocalPathForWrite should throw IOException for invalid pathsBrahma Reddy BattulaResolved
MajorBugHADOOP-9121InodeTree.java has redundant check for vName while throwing exceptionArup MalakarClosed
MajorBugHADOOP-9242Duplicate surefire plugin config in hadoop-commonAndrey KlochkovClosed
MajorNew FeatureHADOOP-9477Add posixGroups support for LDAP groups mapping serviceDapeng SunResolved
MajorBugHADOOP-9658SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loadedZhijie ShenClosed
MajorBugHADOOP-9692Improving log message when SequenceFile reader throws EOFException on zero-length fileZhe ZhangResolved
MajorBugHADOOP-9729The example code of org.apache.hadoop.util.Tool is incorrecthellojinjieResolved
MajorImprovementHADOOP-9737JarFinder#getJar should delete the jar file upon destruction of the JVMJean-Baptiste OnofréResolved
MajorImprovementHADOOP-10035Cleanup TestFilterFileSystemSuresh SrinivasResolved
MajorImprovementHADOOP-10048LocalDirAllocator should avoid holding locks while accessing the filesystemJason Darrell LoweResolved
MajorSub-taskHADOOP-10300Allowed deferred sending of call responsesDaryn SharpResolved
MajorBugHADOOP-10406TestIPC.testIpcWithReaderQueuing may failXiao ChenResolved
MajorSub-taskHADOOP-10597RPC Server signals backoff to clients when all request queues are fullMing MaResolved
MajorTestHADOOP-10729Add tests for PB RPC in case version mismatch of client and serverJunping DuResolved
MajorBugHADOOP-10823TestReloadingX509TrustManager is flakyMingliang LiuResolved
MajorBugHADOOP-109454-digit octal umask permissions throws a parse errorChang LiResolved
MajorNew FeatureHADOOP-10971Add -C flag to make `hadoop fs -ls` print filenames onlyKengo SekiResolved
MajorImprovementHADOOP-11031Design Document for Credential Provider APILarry McCayResolved
MajorBugHADOOP-11098[JDK8] Max Non Heap Memory default changed between JDK7 and 8Tsuyoshi OzawaClosed
MajorBugHADOOP-11120hadoop fs -rmr gives wrong adviceJuliet HouglandResolved
MajorBugHADOOP-11149Increase the timeout of TestZKFailoverControllerSteve LoughranResolved
MajorBugHADOOP-11180Change log message "token.Token: Cannot find class for token kind kms-dt" to debugYi LiuResolved
MajorImprovementHADOOP-11212NetUtils.wrapException to handle SocketException explicitlySteve LoughranResolved
MajorImprovementHADOOP-11226Add a configuration to set ipc.Client's traffic class with IPTOS_LOWDELAY|IPTOS_RELIABILITYGopal VijayaraghavanResolved
MajorSub-taskHADOOP-11262Enable YARN to use S3A Pieter ReuseResolved
MajorBugHADOOP-11328ZKFailoverController does not log Exception when doRun raises errorsTianyin XuResolved
MajorBugHADOOP-11361Fix a race condition in MetricsSourceAdapter.updateJmxCacheBrahma Reddy BattulaClosed
MajorBugHADOOP-11418Property "io.compression.codec.lzo.class" does not work with other value besides defaultYuanbo LiuResolved
MajorBugHADOOP-11487FileNotFound on distcp to s3n/s3a due to creation inconsistency John ZhugeResolved
MajorBugHADOOP-11515Upgrade jsch lib to jsch-0.1.51 to avoid problems running on java7Tsuyoshi OzawaResolved
MajorBugHADOOP-11581Fix Multithreaded correctness Warnings #org.apache.hadoop.fs.shell.LsBrahma Reddy BattulaResolved
MajorSub-taskHADOOP-11613Remove commons-httpclient dependency from hadoop-azureMasatake IwasakiResolved
MajorImprovementHADOOP-11661Deprecate FileUtil#copyMergeBrahma Reddy BattulaResolved
MajorBugHADOOP-11677Add cookie flags for logs and static contextsnijelResolved
MajorBugHADOOP-11685StorageException complaining " no lease ID" during HBase distributed log splittingDuo XuResolved
MajorImprovementHADOOP-11687Ignore x-* and response headers when copying an Amazon S3 objectHarsh JResolved
MajorImprovementHADOOP-11692Improve authentication failure WARN message to avoid user confusionYongjun ZhangResolved
MajorImprovementHADOOP-11694Ãœber-jira: S3a phase II: robustness, scale and performanceSteve LoughranResolved
MajorBugHADOOP-11704DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize()Anubhav DhootResolved
MajorImprovementHADOOP-11713ViewFileSystem should support snapshot methods.Rakesh RadhakrishnanResolved
MajorImprovementHADOOP-11717Add Redirecting WebSSO behavior with JWT Token in Hadoop AuthLarry McCayResolved
MajorBugHADOOP-11730Regression: s3n read failure recovery brokenTadayoshi SatoClosed
MajorNew FeatureHADOOP-11731Rework the changelog and releasenotesAllen WittenauerResolved
MajorImprovementHADOOP-11741Add LOG.isDebugEnabled() guard for some LOG.debug()Walter SuResolved
MajorTestHADOOP-11746rewrite test-patch.shAllen WittenauerResolved
MajorSub-taskHADOOP-11772RPC Invoker relies on static ClientCache which has synchronized(this) blocksHaohui MaiResolved
MajorTaskHADOOP-11791Update src/site/markdown/releases to include old versions of HadoopAllen WittenauerResolved
MajorTaskHADOOP-11792Remove all of the CHANGES.txt filesAndrew WangResolved
MajorBugHADOOP-11797releasedocmaker.py needs to put ASF headers on outputAllen WittenauerResolved
MajorBugHADOOP-11800Clean up some test methods in TestCodec.javaBrahma Reddy BattulaResolved
MajorBugHADOOP-11802DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShmColin McCabeClosed
MajorBugHADOOP-11821Fix findbugs warnings in hadoop-slsBrahma Reddy BattulaResolved
MajorImprovementHADOOP-11827Speed-up distcp buildListing() using threadpoolZoran DimitrijevicResolved
MajorNew FeatureHADOOP-11843Make setting up the build environment easierNiels BasjesResolved
MajorBugHADOOP-11846TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8Larry McCayResolved
MajorBugHADOOP-11848Incorrect arguments to sizeof in DomainSocket.cMalcolm KavalskyResolved
MajorBugHADOOP-11859PseudoAuthenticationHandler fails with httpcomponents v4.4Eugene KoifmanResolved
MajorBugHADOOP-11861test-patch.sh rewrite addendum patchAllen WittenauerResolved
MajorBugHADOOP-11864JWTRedirectAuthenticationHandler breaks java8 javadocsLarry McCayResolved
MajorBugHADOOP-11868Invalid user logins trigger large backtraces in server logChang LiClosed
MajorBugHADOOP-11870[JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issuesRobert KanterResolved
MajorBugHADOOP-11877SnappyDecompressor's Logger class name is wrongSurendra Singh LilhoreResolved
MajorBugHADOOP-11878FileContext.java # fixRelativePart should check for not null for a more informative exceptionBrahma Reddy BattulaResolved
MajorTestHADOOP-11881test-patch.sh javac result is wildly wrongKengo SekiResolved
MajorBugHADOOP-11885hadoop-dist dist-layout-stitching.sh does not work with dashAndrew WangResolved
MajorBugHADOOP-11889Make checkstyle runnable from root projectGera ShegalovResolved
MajorBugHADOOP-11891OsSecureRandom should lazily fill its reservoirArun SureshClosed
MajorImprovementHADOOP-11893Mark org.apache.hadoop.security.token.Token as @InterfaceAudience.PublicBrahma Reddy BattulaResolved
MajorImprovementHADOOP-11894Bump the version of Apache HTrace to 3.2.0-incubatingMasatake IwasakiResolved
MajorBugHADOOP-11900Add failIfNoTests=false to hadoop-build-tools pomGera ShegalovResolved
MajorImprovementHADOOP-11901BytesWritable fails to support 2G chunks due to integer overflowReynold XinResolved
MajorTestHADOOP-11906test-patch.sh should use 'file' command for patch determinismSean BusbeyResolved
MajorBugHADOOP-11924Tolerate JDK-8047340-related exceptions in Shell#isSetSidAvailable preventing class initTsuyoshi OzawaResolved
MajorImprovementHADOOP-11925backport trunk's smart-apply-patch.sh to branch-2Allen WittenauerResolved
MajorBugHADOOP-11926test-patch.sh mv does wrong mathAllen WittenauerResolved
MajorBugHADOOP-11927Fix "undefined reference to dlopen" error when compiling libhadooppipesXianyin XinResolved
MajorBugHADOOP-11928Test-patch check for @author tags incorrectly flags removal of @author tagsKengo SekiResolved
MajorTestHADOOP-11930test-patch in offline mode should tell maven to be in offline modeSean BusbeyResolved
MajorBugHADOOP-11936Dockerfile references a removed imageAllen WittenauerResolved
MajorImprovementHADOOP-11939Deprecate DistCpV1 and LogalyzerBrahma Reddy BattulaResolved
MajorImprovementHADOOP-11948test-patch's issue matching regex should be configurable.Sean BusbeyResolved
MajorTestHADOOP-11949Add user-provided plugins to test-patchSean BusbeyResolved
MajorSub-taskHADOOP-11954Solaris does not support RLIMIT_MEMLOCK as in LinuxAlan BurlisonResolved
MajorBugHADOOP-11958MetricsSystemImpl fails to show backtrace when an error occursJason Darrell LoweResolved
MajorBugHADOOP-11959WASB should configure client side socket timeout in storage client blob request optionsIvan MiticResolved
MajorImprovementHADOOP-11960Enable Azure-Storage Client Side logging.DushyanthResolved
MajorImprovementHADOOP-11970Replace uses of ThreadLocal<Random> with JDK7 ThreadLocalRandomSean BusbeyResolved
MajorBugHADOOP-11973Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLsGregory ChananClosed
MajorImprovementHADOOP-11984Enable parallel JUnit tests in pre-commit.Chris NaurothResolved
MajorBugHADOOP-11991test-patch.sh isn't re-executed even if smart-apply-patch.sh is modifiedKengo SekiResolved
MajorBugHADOOP-11994smart-apply-patch wrongly assumes that git is infallibleKengo SekiResolved
MajorTestHADOOP-12000cannot use --java-home in test-patchAllen WittenauerResolved
MajorBugHADOOP-12017Hadoop archives command should use configurable replication factor when closingBibin ChundattResolved
MajorBugHADOOP-12019update BUILDING.txt to include python for 'mvn site' in windows Vinayakumar BResolved
MajorTestHADOOP-12030test-patch should only report on newly introduced findbugs warnings.Sean BusbeyResolved
MajorSub-taskHADOOP-12036Consolidate all of the cmake extensions in one directoryAlan BurlisonResolved
MajorBugHADOOP-12042Users may see TrashPolicy if hdfs dfs -rm is runJ.AndreinaResolved
MajorImprovementHADOOP-12049Control http authentication cookie persistence via configurationHuizhi LuResolved
MajorImprovementHADOOP-12050Enable MaxInactiveInterval for hadoop http auth tokenHuizhi LuResolved
MajorImprovementHADOOP-12055Deprecate usage of NativeIO#linkAndrew WangResolved
MajorBugHADOOP-12056Use DirectoryStream in DiskChecker#checkDirs to detect errors when listing a directoryZhihai XuResolved
MajorImprovementHADOOP-12059S3Credentials should support use of CredentialProviderSean BusbeyResolved
MajorBugHADOOP-12073Azure FileSystem PageBlobInputStream does not return -1 on EOFIvan MiticResolved
MajorBugHADOOP-12076Incomplete Cache Mechanism in CredentialProvider APILarry McCayResolved
MajorImprovementHADOOP-12081Fix UserGroupInformation.java to support 64-bit zLinuxAkira AjisakaResolved
MajorImprovementHADOOP-12082Support multiple authentication schemes via AuthenticationFilterHrishikesh GadreResolved
MajorBugHADOOP-12087[JDK8] Fix javadoc errors caused by incorrect or illegal tagsAkira AjisakaResolved
MajorBugHADOOP-12088KMSClientProvider uses equalsIgnoreCase("application/json")Brahma Reddy BattulaResolved
MajorBugHADOOP-12089StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASBDuo XuResolved
MajorBugHADOOP-12095org.apache.hadoop.fs.shell.TestCount failsBrahma Reddy BattulaResolved
MajorBugHADOOP-12100ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermissionBibin ChundattClosed
MajorTestHADOOP-12101Add automatic search of default Configuration variables to TestConfigurationFieldsBaseRay ChiangResolved
1200 of 781