|
|
| |
|
HADOOP-6360 |
UNRESOLVED
|
Eclipse Plugin does not build for Hadoop 0.20.1
|
|
|
| |
|
HADOOP-5882 |
FIXED
|
Progress is not updated when the New Reducer is running reduce phase
|
|
|
| |
|
HADOOP-6213 |
FIXED
|
HADOOP-3676
Remove commons dependency on commons-cli2
|
|
|
| |
|
HADOOP-5539 |
FIXED
|
o.a.h.mapred.Merger not maintaining map out compression on intermediate files
|
|
|
| |
|
HADOOP-5213 |
FIXED
|
BZip2CompressionOutputStream NullPointerException
|
|
|
| |
|
HADOOP-6017 |
FIXED
|
NameNode and SecondaryNameNode fail to restart because of abnormal filenames.
|
|
|
| |
|
HADOOP-5636 |
FIXED
|
Job is left in Running state after a killJob
|
|
|
| |
|
HADOOP-5850 |
FIXED
|
map/reduce doesn't run jobs with 0 maps
|
|
|
| |
|
HADOOP-5908 |
FIXED
|
ArithmeticException in heartbeats with zero map jobs
|
|
|
| |
|
HADOOP-5718 |
FIXED
|
Capacity Scheduler should not check for presence of default queue while starting up.
|
|
|
| |
|
HADOOP-5884 |
FIXED
|
Capacity scheduler should account high memory jobs as using more capacity of the queue
|
|
|
| |
|
HADOOP-5746 |
FIXED
|
Errors encountered in MROutputThread after the last map/reduce call can go undetected
|
|
|
| |
|
HADOOP-6080 |
FIXED
|
Handling of Trash with quota
|
|
|
| |
|
HADOOP-5688 |
FIXED
|
HftpFileSystem.getChecksum(..) does not work for the paths with scheme and authority
|
|
|
| |
|
HADOOP-5924 |
FIXED
|
JT fails to recover the jobs after restart after HADOOP:4372
|
|
|
| |
|
HADOOP-5921 |
FIXED
|
JobTracker does not come up because of NotReplicatedYetException
|
|
|
| |
|
HADOOP-5719 |
FIXED
|
Jobs failed during job initalization are never removed from Capacity Schedulers waiting list
|
|
|
| |
|
HADOOP-5932 |
FIXED
|
MemoryMatcher logs 0 as freeMemOnTT even though there are free slots available on TaskTraker
|
|
|
| |
|
HADOOP-3315 |
FIXED
|
New binary file format
|
|
|
| |
|
HADOOP-6145 |
FIXED
|
No error message for deleting non-existant file or directory.
|
|
|
| |
|
HADOOP-5648 |
FIXED
|
Not able to generate gridmix.jar on already compiled version of hadoop
|
|
|
| |
|
HADOOP-5641 |
FIXED
|
Possible NPE in CapacityScheduler's MemoryMatcher
|
|
|
| |
|
HADOOP-5533 |
FIXED
|
Recovery duration shown on the jobtracker webpage is inaccurate
|
|
|
| |
|
HADOOP-5726 |
FIXED
|
Remove pre-emption from the capacity scheduler code base
|
|
|
| |
|
HADOOP-5881 |
FIXED
|
Simplify configuration related to task-memory-monitoring and memory-based scheduling
|
|
|
| |
|
HADOOP-5883 |
FIXED
|
TaskMemoryMonitorThread might shoot down tasks even if their processes momentarily exceed the requested memory
|
|
|
| |
|
HADOOP-5920 |
FIXED
|
TestJobHistory fails some times.
|
|
|
| |
|
HADOOP-5655 |
FIXED
|
TestMRServerPorts fails on java.net.BindException
|
|
|
| |
|
HADOOP-5646 |
FIXED
|
TestQueueCapacities is failing Hudson tests for the last few builds
|
|
|
| |
|
HADOOP-5654 |
FIXED
|
TestReplicationPolicy.<init> fails on java.net.BindException
|
|
|
| |
|
HADOOP-5736 |
FIXED
|
Update CapacityScheduler documentation to reflect latest changes
|
|
|
| |
|
HADOOP-5828 |
FIXED
|
Use absolute path for JobTracker's mapred.local.dir in MiniMRCluster
|
|
|
| |
|
HADOOP-5349 |
FIXED
|
When the size required for a path is -1, LocalDirAllocator.getLocalPathForWrite fails with a DiskCheckerException when the disk it selects is bad.
|
|
|
| |
|
HADOOP-6215 |
FIXED
|
fix GenericOptionParser to deal with -D with '=' in the value
|
|
|
| |
|
HADOOP-6141 |
FIXED
|
hadoop 0.20 branch "test-patch" is broken
|
|
|
| |
|
HADOOP-5691 |
FIXED
|
org.apache.hadoop.mapreduce.Reducer should not be abstract.
|
|
|
| |
|
HADOOP-4856 |
DUPLICATE
|
Document JobInitializationPoller configuration in capacity scheduler forrest documentation.
|
|
|
| |
|
HADOOP-4931 |
DUPLICATE
|
Document TaskTracker's memory management functionality and CapacityScheduler's memory based scheduling.
|
|
|
| |
|
HADOOP-3676 |
DUPLICATE
|
Remove Hadoop's dependance on the cli 2 snapshot
|
|
|
| |
|
HADOOP-5869 |
DUPLICATE
|
TestQueueCapacities timeout in trunk.
|
|
|
| |
|
HADOOP-5951 |
FIXED
|
StorageInfo needs Apache license header.
|
|
|
| |
|
HADOOP-4626 |
FIXED
|
API link in forrest doc should point to the same version of hadoop.
|
|
|
| |
|
HADOOP-5711 |
FIXED
|
Change Namenode file close log to info
|
|
|
| |
|
HADOOP-5937 |
FIXED
|
Correct info message "Use hadoop dfs -safemode option" to " Use hdfs dfsadmin -safemode option" .
|
|
|
| |
|
HADOOP-6139 |
FIXED
|
Incomplete help message is displayed for rm and rmr options.
|
|
|
| |
|
HADOOP-5714 |
FIXED
|
Metric to show number of fs.exists (or number of getFileInfo) calls
|
|
|
| |
|
HADOOP-5210 |
FIXED
|
Reduce Task Progress shows > 100% when the total size of map outputs (for a single reducer) is high
|
|
|
| |
|
HADOOP-6259 |
WON'T FIX
|
Fair Scheduler in core.jar
|
|
|
| |
|
HADOOP-5990 |
DUPLICATE
|
HADOOP:5937 should not be committed to 20 branch
|
|
|
| |
|
HADOOP-4674 |
FIXED
|
hadoop fs -help should list detailed help info for the following commands: test, text, tail, stat & touchz
|
|
|
|
|
| |
|
HADOOP-5154 |
FIXED
|
4-way deadlock in FairShare scheduler
|
|
|
| |
|
HADOOP-4878 |
FIXED
|
After introduction of ivy ant test-patch always returns -1 score
|
|
|
| |
|
HADOOP-5605 |
FIXED
|
All the replicas incorrectly got marked as corrupt.
|
|
|
| |
|
HADOOP-4988 |
FIXED
|
An earlier fix, for HADOOP-4373, results in a problem with reclaiming capacity when one or more queues have a capacity equal to zero
|
|
|
| |
|
HADOOP-5465 |
FIXED
|
Blocks remain under-replicated
|
|
|
| |
|
HADOOP-4876 |
FIXED
|
Capacity reclaimation for queue would not work as intended
|
|
|
| |
|
HADOOP-5214 |
FIXED
|
ConcurrentModificationException in FairScheduler.getTotalSlots
|
|
|
| |
|
HADOOP-5384 |
FIXED
|
DataNodeCluster should not create blocks with generationStamp == 1
|
|
|
| |
|
HADOOP-4977 |
FIXED
|
Deadlock between reclaimCapacity and assignTasks
|
|
|
| |
|
HADOOP-5534 |
FIXED
|
Deadlock triggered by FairScheduler scheduler's servlet due to changes from HADOOP-5214.
|
|
|
| |
|
HADOOP-5522 |
FIXED
|
Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial
|
|
|
| |
|
HADOOP-4638 |
FIXED
|
Exception thrown in/from RecoveryManager.recover() should be caught and handled
|
|
|
| |
|
HADOOP-5585 |
FIXED
|
FileSystem statistic counters are too high when JVM reuse is enabled.
|
|
|
| |
|
HADOOP-4204 |
FIXED
|
Fix warnings generated by FindBugs
|
|
|
| |
|
HADOOP-5281 |
FIXED
|
GzipCodec fails second time it is used in a process
|
|
|
| |
|
HADOOP-4783 |
FIXED
|
History files are given world readable permissions.
|
|
|
| |
|
HADOOP-5417 |
FIXED
|
IPC client drops interrupted exceptions
|
|
|
| |
|
HADOOP-5306 |
FIXED
|
Job History file can have empty string as http port after JobTracker Restart in case of lost TT, which can result in NumberFormatException when JT is restarted 2nd time
|
|
|
| |
|
HADOOP-5248 |
FIXED
|
Job directories could remain undeleted in some scenarios after job completes.
|
|
|
| |
|
HADOOP-5327 |
FIXED
|
Job files for a job failing because of ACLs are not clean from the system directory
|
|
|
| |
|
HADOOP-5376 |
FIXED
|
JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException
|
|
|
| |
|
HADOOP-5285 |
FIXED
|
JobTracker hangs for long periods of time
|
|
|
| |
|
HADOOP-5146 |
FIXED
|
LocalDirAllocator misses files on the local filesystem
|
|
|
| |
|
HADOOP-5576 |
FIXED
|
LocalJobRunner does not run jobs using new MapReduce API
|
|
|
| |
|
HADOOP-4869 |
FIXED
|
Lost Trackers may not be able to join back
|
|
|
| |
|
HADOOP-4035 |
FIXED
|
Modify the capacity scheduler (HADOOP-3445) to schedule tasks based on memory requirements and task trackers free memory
|
|
|
| |
|
HADOOP-4956 |
FIXED
|
NPE when jobdetails.jsp
|
|
|
| |
|
HADOOP-5247 |
FIXED
|
NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.
|
|
|
| |
|
HADOOP-4949 |
FIXED
|
Native compilation is broken
|
|
|
| |
|
HADOOP-5548 |
FIXED
|
Observed negative running maps on the job tracker
|
|
|
| |
|
HADOOP-4664 |
FIXED
|
Parallelize job initialization
|
|
|
| |
|
HADOOP-5075 |
FIXED
|
Potential infinite loop in updateMinSlots
|
|
|
| |
|
HADOOP-5338 |
FIXED
|
Reduce tasks are stuck waiting for map outputs when none are in progress
|
|
|
| |
|
HADOOP-5241 |
FIXED
|
Reduce tasks get stuck because of over-estimated task size (regression from 0.18)
|
|
|
| |
|
HADOOP-5233 |
FIXED
|
Reducer not Succeded after 100%
|
|
|
| |
|
HADOOP-5531 |
FIXED
|
Remove Chukwa on branch-0.20
|
|
|
| |
|
HADOOP-4874 |
FIXED
|
Remove bindings to lzo
|
|
|
| |
|
HADOOP-5282 |
FIXED
|
Running tasks on lost trackers are incorrectly logging the attempt and task failures
|
|
|
| |
|
HADOOP-5493 |
FIXED
|
Shuffle copiers do not return Codecs back to the pool at the end of shuffling
|
|
|
| |
|
HADOOP-5440 |
FIXED
|
Successful taskid are not removed from TaskMemoryManager
|
|
|
| |
|
HADOOP-5516 |
FIXED
|
TaskMemoryManagerThread crashes in a corner case
|
|
|
| |
|
HADOOP-5269 |
FIXED
|
TaskTracker.runningTasks holding FAILED_UNCLEAN and KILLED_UNCLEAN taskStatuses forever in some cases.
|
|
|
| |
|
HADOOP-4695 |
FIXED
|
TestGlobalFilter.testServletFilter fails
|
|
|
| |
|
HADOOP-4879 |
FIXED
|
TestJobTrackerRestart fails on trunk
|
|
|
| |
|
HADOOP-5490 |
FIXED
|
TestParallelInitialization failed on NoSuchElementException
|
|
|
| |
|
HADOOP-4786 |
FIXED
|
TestTrackerBlacklistAcrossJobs compilation is broken
|
|
|
| |
|
HADOOP-4787 |
FIXED
|
TestTrackerBlacklistAcrossJobs fails randomly
|
|
|
| |
|
HADOOP-4857 |
FIXED
|
TestUlimit is failing after Hadoop-4620
|
|
|
| |
|
HADOOP-5577 |
FIXED
|
The Job.waitForCompletion doesn't print status as the job runs
|
|
|
| |
|
HADOOP-4178 |
FIXED
|
The capacity scheduler's defaults for queues should be configurable.
|
|
|
| |
|
HADOOP-5382 |
FIXED
|
The new map/reduce api doesn't support combiners
|
|
|
| |
|
HADOOP-5437 |
FIXED
|
Unit test for jvm -reuse
|
|
|
| |
|
HADOOP-5280 |
FIXED
|
When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap.
|
|
|
| |
|
HADOOP-4744 |
FIXED
|
Wrong resolution of hostname and port
|
|
|
| |
|
HADOOP-4782 |
FIXED
|
[HOD] HOD opens up directory permissions more than required
|
|
|
| |
|
HADOOP-4785 |
FIXED
|
avoid two calls to System.currentTimeMillis() in heartbeat
|
|
|
| |
|
HADOOP-5564 |
FIXED
|
hadoop command uses large JVM heap size
|
|
|
| |
|
HADOOP-5588 |
FIXED
|
hadoop commands seem extremely slow in 0.20 branch
|
|
|
| |
|
HADOOP-4896 |
FIXED
|
hdfs fsck does not load hdfs configuration.
|
|
|
| |
|
HADOOP-4716 |
FIXED
|
testRestartWithLostTracker frequently times out
|
|
|
| |
|
HADOOP-5272 |
FIXED
|
JobTracker does not log TIP start information after restart
|
|
|
| |
|
HADOOP-5394 |
FIXED
|
JobTracker might schedule 2 attempts of the same task with the same attempt id across restarts
|
|
|
| |
|
HADOOP-5479 |
FIXED
|
NameNode should not send empty block replication request to DataNode
|
|
|
| |
|
HADOOP-5551 |
FIXED
|
Namenode permits directory destruction on overwrite
|
|
|
| |
|
HADOOP-5274 |
FIXED
|
gridmix2 is not getting compiled to generate gridmix.jar
|
|
|
| |
|
HADOOP-3192 |
FIXED
|
Test behavior of very large (32GB) name nodes
|
|
|
| |
|
HADOOP-5923 |
DUPLICATE
|
java.lang.ArrayIndexOutOfBoundsException in heartbeats after JT restart
|
|
|
| |
|
HADOOP-4669 |
FIXED
|
A file-open sometimes may not set the access time of a file
|
|
|
| |
|
HADOOP-4458 |
FIXED
|
Add a unit test for applications creating symlinks in wokring directory
|
|
|
| |
|
HADOOP-4505 |
FIXED
|
Add a unit test to test faulty setup task and cleanup task killing the job
|
|
|
| |
|
HADOOP-4545 |
FIXED
|
Add an example of a secondary sort
|
|
|
| |
|
HADOOP-2774 |
FIXED
|
Add counters to show number of key/values that have been sorted and merged in the maps and reduces
|
|
|
| |
|
HADOOP-4185 |
FIXED
|
HADOOP-3750
Add setVerifyChecksum() method to FileSystem
|
|
|
| |
|
HADOOP-4708 |
FIXED
|
Add support for dfsadmin commands for test TestCLI unit test
|
|
|
| |
|
HADOOP-5514 |
FIXED
|
Add waiting/failed tasks to JobTracker metrics
|
|
|
| |
|
HADOOP-4348 |
FIXED
|
Adding service-level authorization to Hadoop
|
|
|
| |
|
HADOOP-4826 |
FIXED
|
Admin command saveNamespace.
|
|
|
| |
|
HADOOP-5645 |
FIXED
|
After HADOOP-4920 we need a place to checkin releasenotes.html
|
|
|
| |
|
HADOOP-4103 |
FIXED
|
Alert for missing blocks
|
|
|
| |
|
HADOOP-4126 |
FIXED
|
Allow access to HDFS web UI on EC2
|
|
|
| |
|
HADOOP-4575 |
FIXED
|
An independent HTTPS proxy for HDFS
|
|
|
| |
|
HADOOP-3136 |
FIXED
|
Assign multiple tasks per TaskTracker heartbeat
|
|
|
| |
|
HADOOP-5145 |
FIXED
|
Balancer sometimes runs out of memory after days or weeks running
|
|
|
| |
|
HADOOP-4599 |
FIXED
|
BlocksMap and BlockInfo should be package private.
|
|
|
| |
|
HADOOP-3063 |
FIXED
|
BloomMapFile - fail-fast version of MapFile for sparsely populated key space
|
|
|
| |
|
HADOOP-4388 |
FIXED
|
Bug in Datanode transferBlocks code
|
|
|
| |
|
HADOOP-5459 |
FIXED
|
CRC errors not detected reading intermediate output into memory with problematic length
|
|
|
| |
|
HADOOP-5466 |
FIXED
|
CSS Style Changes for Hadoop Doc Headers and Code
|
|
|
| |
|
HADOOP-4979 |
FIXED
|
Capacity Scheduler does not always return no task to a TT if a job's memry requirements are not met
|
|
|
| |
|
HADOOP-4513 |
FIXED
|
Capacity scheduler should initialize tasks asynchronously
|
|
|
| |
|
HADOOP-4774 |
FIXED
|
CapacityScheduler should work even if capacity-scheduler.xml is not in the classpath i.e with the code defaults
|
|
|
| |
|
HADOOP-5468 |
FIXED
|
Change Hadoop doc menu to sub-menus
|
|
|
| |
|
HADOOP-4699 |
FIXED
|
Change TaskTracker.MapOutputServlet to send only the IFile segment, validate checksum in Reduce
|
|
|
| |
|
HADOOP-4825 |
FIXED
|
Chukwa - change jps to ps for process status detection
|
|
|
| |
|
HADOOP-4925 |
FIXED
|
Chukwa HTTP connection policies are too hard to configure
|
|
|
| |
|
HADOOP-5030 |
FIXED
|
Chukwa RPM build improvements
|
|
|
| |
|
HADOOP-4792 |
FIXED
|
Chukwa build process generates files not tracked by svn
|
|
|
| |
|
HADOOP-4909 |
FIXED
|
Clean up map/reduce api to take JobContext in the static methods
|
|
|
| |
|
HADOOP-4838 |
FIXED
|
Cleanup Metrics and the MBeans
|
|
|
| |
|
HADOOP-4980 |
FIXED
|
Cleanup the Capacity Scheduler code
|
|
|
| |
|
HADOOP-3921 |
FIXED
|
Clover breaks nightly builds
|
|
|
| |
|
HADOOP-4583 |
FIXED
|
Code optimization/cleanup in HDFS
|
|
|
| |
|
HADOOP-4843 |
FIXED
|
Collect Job History log file and Job Conf file into Chukwa
|
|
|
| |
|
HADOOP-4950 |
FIXED
|
CompressorStream and BlockCompressorStream should be public
|
|
|
| |
|
HADOOP-5085 |
FIXED
|
Copying a file to local with Crc throws an exception
|
|
|
| |
|
HADOOP-4187 |
FIXED
|
HADOOP-3750
Create a MapReduce-specific ReflectionUtils that handles JobConf and JobConfigurable
|
|
|
| |
|
HADOOP-5554 |
FIXED
|
DataNodeCluster should create blocks with the same generation stamp as the blocks created in CreateEditsLog
|
|
|
| |
|
HADOOP-5483 |
FIXED
|
Directory/file cleanup thread throws IllegalStateException
|
|
|
| |
|
HADOOP-4849 |
FIXED
|
Document service level authorization - HADOOP-4348
|
|
|
| |
|
HADOOP-4818 |
FIXED
|
Enable JobTracker Instrumentation API with user job configuration
|
|
|
| |
|
HADOOP-4523 |
FIXED
|
Enhance how memory-intensive user tasks are handled
|
|
|
| |
|
HADOOP-4608 |
FIXED
|
Examples -Driver does not check first argument.
|
|
|
| |
|
HADOOP-4771 |
FIXED
|
FSImage saveFSImage() will have problem.
|
|
|
| |
|
HADOOP-4860 |
FIXED
|
File Tailing Adaptor test cases causes random failure
|
|
|
| |
|
HADOOP-4892 |
FIXED
|
File descriptor leak in Chukwa's ExecPlugin
|
|
|
| |
|
HADOOP-3497 |
FIXED
|
File globbing with a PathFilter is too restrictive
|
|
|
| |
|
HADOOP-4677 |
FIXED
|
FileSystem.getFileBlockLocations() (aka default implementation for Local FileSystem) incorrect.
|
|
|
| |
|
HADOOP-4210 |
FIXED
|
Findbugs warnings are printed related to equals implementation of several classes
|
|
|
| |
|
HADOOP-3750 |
FIXED
|
Fix and enforce module dependencies
|
|
|
| |
|
HADOOP-4253 |
FIXED
|
Fix warnings generated by FindBugs
|
|
|
| |
|
HADOOP-3422 |
FIXED
|
Ganglia counter metrics are all reported with the metric name "value", so the counter values can not be seen
|
|
|
| |
|
HADOOP-5111 |
FIXED
|
Generic mapreduce classes cannot be used with Job::set* methods
|
|
|
| |
|
HADOOP-4567 |
FIXED
|
GetFileBlockLocations should return the NetworkTopology information of the machines that hosts those blocks
|
|
|
| |
|
HADOOP-4346 |
FIXED
|
Hadoop triggers a "soft" fd leak.
|
|
|
| |
|
HADOOP-4179 |
FIXED
|
Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
|
|
|
| |
|
HADOOP-5079 |
FIXED
|
HashFunction inadvertently destroys some randomness
|
|
|
| |
|
HADOOP-4830 |
FIXED
|
Have end to end tests based on MiniMRCluster to verify that queue capacities are honoured.
|
|
|
| |
|
HADOOP-4572 |
FIXED
|
INode and its sub-classes should be package private
|
|
|
| |
|
HADOOP-5414 |
FIXED
|
IO exception while executing hadoop fs -touchz fileName
|
|
|
| |
|
HADOOP-4339 |
FIXED
|
Improve FsShell -du/-dus and FileSystem.getContentSummary efficiency
|
|
|
| |
|
HADOOP-4668 |
FIXED
|
Improve JavaDoc on JobConf.setCombinerClass to better document restrictions on combiners
|
|
|
| |
|
HADOOP-4827 |
FIXED
|
Improve data aggregation in database
|
|
|
| |
|
HADOOP-4791 |
FIXED
|
Improve rpm build process for Chukwa
|
|
|
| |
|
HADOOP-4453 |
FIXED
|
Improve ssl handling for distcp
|
|
|
| |
|
HADOOP-4880 |
FIXED
|
Improvements to TestJobTrackerRestart
|
|
|
| |
|
HADOOP-4244 |
FIXED
|
In "ant test-patch", runContribTestOnEclipseFiles should not be run on Hudson only
|
|
|
| |
|
HADOOP-4530 |
FIXED
|
In fsck, HttpServletResponse sendError fails with IllegalStateException
|
|
|
| |
|
HADOOP-4999 |
FIXED
|
IndexOutOfBoundsException in FSEditLog
|
|
|
| |
|
HADOOP-4374 |
FIXED
|
JVM should not be killed but given an opportunity to exit gracefully
|
|
|
| |
|
HADOOP-4737 |
FIXED
|
Job end notification should give status as "KILLED" when job gets killed.
|
|
|
| |
|
HADOOP-5259 |
FIXED
|
Job with output hdfs:/user/<username>/outputpath (no authority) fails with Wrong FS
|
|
|
| |
|
HADOOP-3986 |
FIXED
|
JobClient should not have a static configuration
|
|
|
| |
|
HADOOP-5337 |
FIXED
|
JobTracker greedily schedules tasks without running tasks to join
|
|
|
| |
|
HADOOP-5499 |
FIXED
|
JobTracker metrics do not match job counters
|
|
|
| |
|
HADOOP-4245 |
FIXED
|
KFS: Update the kfs jar file
|
|
|
| |
|
HADOOP-5292 |
FIXED
|
KFS: calling getFileBlockLocations() on 0-length file causes a NPE
|
|
|
| |
|
HADOOP-4666 |
FIXED
|
Launch reduces only after a few maps have run in the Fair Scheduler
|
|
|
| |
|
HADOOP-4576 |
FIXED
|
Modify pending tasks count in the UI to pending jobs count in the UI
|
|
|
| |
|
HADOOP-4837 |
FIXED
|
Move HADOOP_CONF_DIR to chukwa-env.sh
|
|
|
| |
|
HADOOP-4628 |
FIXED
|
Move Hive out of Core
|
|
|
| |
|
HADOOP-4618 |
FIXED
|
Move http server from FSNamesystem into NameNode.
|
|
|
| |
|
HADOOP-4683 |
FIXED
|
Move the call to getMapCompletionEvents in ReduceTask.ReduceCopier.fetchOutputs to a separate thread
|
|
|
| |
|
HADOOP-4565 |
FIXED
|
MultiFileInputSplit can use data locality information to create splits
|
|
|
| |
|
HADOOP-3810 |
FIXED
|
NameNode seems unstable on a cluster with little space left
|
|
|
| |
|
HADOOP-4029 |
FIXED
|
NameNode should report status and performance for each replica of image and log
|
|
|
| |
|
HADOOP-4692 |
FIXED
|
Namenode in infinite loop for replicating/deleting corrupted block
|
|
|
| |
|
HADOOP-5644 |
FIXED
|
Namnode is stuck in safe mode
|
|
|
| |
|
HADOOP-5139 |
FIXED
|
RPC call throws IllegalArgumentException complaining duplicate metrics registration
|
|
|
| |
|
HADOOP-4377 |
FIXED
|
Race condition creating S3 buffer directory for NativeS3FileSystem
|
|
|
| |
|
HADOOP-5473 |
FIXED
|
Race condition in command-line kill for a task
|
|
|
| |
|
HADOOP-4612 |
FIXED
|
HADOOP-3750
Remove RunJar's dependency on JobClient
|
|
|
| |
|
HADOOP-4188 |
FIXED
|
HADOOP-3750
Remove Task's dependency on concrete file systems
|
|
|
| |
|
HADOOP-4805 |
FIXED
|
Remove black list feature from Chukwa Agent to Chukwa Collector communication
|
|
|
| |
|
HADOOP-5519 |
FIXED
|
Remove claims from mapred-default.xml that prime numbers of tasks are helpful.
|
|
|
| |
|
HADOOP-5521 |
FIXED
|
Remove dependency of testcases on RESTART_COUNT
|
|
|
| |
|
HADOOP-3461 |
FIXED
|
Remove dfs.StringBytesWritbale
|
|
|
| |
|
HADOOP-5328 |
FIXED
|
Renaming of Job histroy file is incorrect if Jobtracker is restarted multimple times
|
|
|
| |
|
HADOOP-1230 |
FIXED
|
Replace parameters with context objects in Mapper, Reducer, Partitioner, InputFormat, and OutputFormat classes
|
|
|
| |
|
HADOOP-5549 |
FIXED
|
ReplicationMonitor should schedule both replication and deletion work in one iteration
|
|
|
| |
|
HADOOP-4623 |
FIXED
|
Running tasks are not maintained by JobInProgress if speculation is off
|
|
|
| |
|
HADOOP-4422 |
FIXED
|
S3 file systems should not create bucket
|
|
|
| |
|
HADOOP-4558 |
FIXED
|
Scheduler fails to reclaim capacity if Jobs are submitted to queue one after the other
|
|
|
| |
|
HADOOP-4845 |
FIXED
|
Shuffle counter issues
|
|
|
| |
|
HADOOP-5048 |
FIXED
|
Sometimes job is still displayed in jobqueue_details page for long time after job was killed.
|
|
|
| |
|
HADOOP-4631 |
FIXED
|
Split the default configurations into 3 parts
|
|
|
| |
|
HADOOP-4579 |
FIXED
|
StorageDirectory is not removed from the storage directories list when writing to an edits fails
|
|
|
| |
|
HADOOP-4284 |
FIXED
|
Support for user configurable global filters on HttpServer
|
|
|
| |
|
HADOOP-5471 |
FIXED
|
SyncLogs thread in Child.java would update wrong file for a cleanup attempt, in some cases.
|
|
|
| |
|
HADOOP-4796 |
FIXED
|
Test target for chukwa build.xml needs to comply to hadoop build.xml test suites
|
|
|
| |
|
HADOOP-5607 |
FIXED
|
TestCapacityScheduler fails with NPE
|
|
|
| |
|
HADOOP-5432 |
FIXED
|
TestHdfsProxy fails on 0.20
|
|
|
| |
|
HADOOP-4698 |
FIXED
|
TestMapRed fails with 64bit JDK
|
|
|
| |
|
HADOOP-5505 |
FIXED
|
TestMissingBlocksAlert fails on 0.20.
|
|
|
| |
|
HADOOP-5484 |
FIXED
|
TestRecoveryManager fails wtih FileAlreadyExistsException
|
|
|
| |
|
HADOOP-5211 |
FIXED
|
TestSetupAndCleanupFailure fails with timeout
|
|
|
| |
|
HADOOP-5565 |
FIXED
|
The job instrumentation API needs to have a method for finalizeJob,
|
|
|
| |
|
HADOOP-4276 |
FIXED
|
The mapred.*ID classes are inefficient for hashCode and serialization
|
|
|
| |
|
HADOOP-3842 |
FIXED
|
There is a window where the JobTracker is in the RUNNING state (i.e ready to accept jobs) and never executes them.
|
|
|
| |
|
HADOOP-5571 |
FIXED
|
TupleWritable can return incorrect results if it contains more than 32 values
|
|
|
| |
|
HADOOP-5298 |
FIXED
|
Unit test fails out on trunk org.apache.hadoop.http.TestServletFilter.testServletFilter
|
|
|
| |
|
HADOOP-4828 |
FIXED
|
Update documentation for default configuration
|
|
|
| |
|
HADOOP-1650 |
FIXED
|
Upgrade Jetty to 6.x
|
|
|
| |
|
HADOOP-4970 |
FIXED
|
Use the full path when move files to .Trash/Current
|
|
|
| |
|
HADOOP-3293 |
FIXED
|
When an input split spans cross block boundary, the split location should be the host having most of bytes on it.
|
|
|
| |
|
HADOOP-5395 |
FIXED
|
When queue ACLs are enabled, the error message shown when a job is submitted to a non-existent queue is misleading
|
|
|
| |
|
HADOOP-4445 |
FIXED
|
Wrong number of running map/reduce tasks are displayed in queue information.
|
|
|
| |
|
HADOOP-4705 |
FIXED
|
[HOD] Grant read permissions for files/directories created by hod as part of provisioning hadoop clusters
|
|
|
| |
|
HADOOP-4937 |
FIXED
|
[HOD] Include ringmaster RPC port information in the notes attribute
|
|
|
| |
|
HADOOP-4238 |
FIXED
|
[mapred] Unavailable schedulingInfo in "hadoop list [all]" output should be marked "N/A"
|
|
|
| |
|
HADOOP-4916 |
FIXED
|
adjust build.xml to reference external properties when building the "init.d" for the rpm
|
|
|
| |
|
HADOOP-5066 |
FIXED
|
ant binary should not compile docs
|
|
|
| |
|
HADOOP-5326 |
FIXED
|
bzip2 codec (CBZip2OutputStream) creates corrupted output file for some inputs
|
|
|
| |
|
HADOOP-2771 |
FIXED
|
changing the number of reduces dramatically changes the time of the map time
|
|
|
| |
|
HADOOP-4993 |
FIXED
|
chukwa agent startup should be more modular
|
|
|
| |
|
HADOOP-4873 |
FIXED
|
display minMaps/Reduces on advanced scheduler page
|
|
|
| |
|
HADOOP-4661 |
FIXED
|
distch: a tool for distributed ch{mod,own}
|
|
|
| |
|
HADOOP-5227 |
FIXED
|
distcp -delete option deletes all files from the destination directory
|
|
|
| |
|
HADOOP-4920 |
FIXED
|
do not keep forrest output in subversion
|
|
|
| |
|
HADOOP-4645 |
FIXED
|
hdfs proxy doesn't package itself right.
|
|
|
| |
|
HADOOP-5390 |
FIXED
|
hdfsproxy includes duplicate jars in tarball, source in binary tarball
|
|
|
| |
|
HADOOP-3770 |
FIXED
|
improve composition, submission and result collection of gridmix
|
|
|
| |
|
HADOOP-5275 |
FIXED
|
ivy directory should be there in hadoop tar ball
|
|
|
| |
|
HADOOP-4621 |
FIXED
|
javadoc: warning - Multiple sources of package comments found for some packages
|
|
|
| |
|
HADOOP-3344 |
FIXED
|
libhdfs: always builds 32bit, even when x86_64 Java used
|
|
|
| |
|
HADOOP-4688 |
FIXED
|
multiple spills/reducers test case for mergeParts() needed
|
|
|
| |
|
HADOOP-4749 |
FIXED
|
reducer should output input data size when shuffling is done
|
|
|
| |
|
HADOOP-4305 |
FIXED
|
repeatedly blacklisted tasktrackers should get declared dead
|
|
|
| |
|
HADOOP-5065 |
FIXED
|
setOutputFormatClass in mapreduce.Job fails for SequenceFileOutputFormat
|
|
|
| |
|
HADOOP-5068 |
FIXED
|
testClusterBlockingForLackOfMemory in TestCapacityScheduler fails randomly
|
|
|
| |
|
HADOOP-6150 |
FIXED
|
Need to be able to instantiate a comparator instance from a comparator string without creating a TFile.Reader object
|
|
|
| |
|
HADOOP-4598 |
FIXED
|
'-setrep' command skips under-replicated blocks
|
|
|
| |
|
HADOOP-4758 |
FIXED
|
Add a splitter for metrics contexts
|
|
|
| |
|
HADOOP-4944 |
FIXED
|
Allow Xinclude in hadoop config file
|
|
|
| |
|
HADOOP-5463 |
FIXED
|
Balancer throws "Not a host:port pair" unless port is specified in fs.default.name
|
|
|
| |
|
HADOOP-4854 |
FIXED
|
Capacity Scheduler should read the reclaim-capacity-interval config value from its own config file
|
|
|
| |
|
HADOOP-4789 |
FIXED
|
Change fair scheduler to share between pools by default, not between invidual jobs
|
|
|
| |
|
HADOOP-4804 |
FIXED
|
Create Forrest documentation for the fair scheduler
|
|
|
| |
|
HADOOP-3923 |
FIXED
|
Deprecate org.apache.hadoop.mapred.StatusHttpServer
|
|
|
| |
|
HADOOP-4844 |
FIXED
|
Document deprecation of o.a.h.fs.permission.AccessControlException better
|
|
|
| |
|
HADOOP-4622 |
FIXED
|
Explicitly specify interpretor for non-native binaries
|
|
|
| |
|
HADOOP-5255 |
FIXED
|
Fix for HADOOP-5079 HashFunction inadvertently destroys some randomness
|
|
|
| |
|
HADOOP-4855 |
FIXED
|
Fix help message in MRAdmin
|
|
|
| |
|
HADOOP-4589 |
FIXED
|
Fix the PiEstimator output messages and code comments
|
|
|
| |
|
HADOOP-4408 |
FIXED
|
FsAction operations shouldn't create new Objects
|
|
|
| |
|
HADOOP-4676 |
FIXED
|
Go back to Job has a wrong URL on blacklisted trackers page
|
|
|
| |
|
HADOOP-4325 |
FIXED
|
Hadoop SocketInputStream.read() should return -1 in case of EOF.
|
|
|
| |
|
HADOOP-4706 |
FIXED
|
IFileOutputStream.close should call close of the underlying stream
|
|
|
| |
|
HADOOP-4649 |
FIXED
|
Improve abstraction for spill indices
|
|
|
| |
|
HADOOP-4691 |
FIXED
|
In the javadoc of IndexedSortable.compare(...), the link is wrong.
|
|
|
| |
|
HADOOP-4234 |
FIXED
|
KFS: Allow KFS layer to interface with multiple KFS namenodes
|
|
|
| |
|
HADOOP-4226 |
FIXED
|
LineReader::readLine cleanup
|
|
|
| |
|
HADOOP-4963 |
FIXED
|
Logs saying org.apache.hadoop.util.DiskChecker$DiskErrorException in TaskTracker are not relevant
|
|
|
| |
|
HADOOP-4671 |
FIXED
|
Make some "flag" booleans volatile because they are set/read in different threads
|
|
|
| |
|
HADOOP-5142 |
FIXED
|
MapWritable#putAll does not store classes
|
|
|
| |
|
HADOOP-4429 |
FIXED
|
Misconfigured UNIX Groups Break Hadoop
|
|
|
| |
|
HADOOP-4820 |
FIXED
|
Remove unused method FSNamesystem.deleteInSafeMode
|
|
|
| |
|
HADOOP-4747 |
FIXED
|
Reuse FileStatus in FsShell where possible
|
|
|
| |
|
HADOOP-4141 |
FIXED
|
ScriptBasedMapping has infinite loop with invalid jobconf parameter
|
|
|
| |
|
HADOOP-5026 |
FIXED
|
Startup scripts should be svn-executable
|
|
|
| |
|
HADOOP-4454 |
FIXED
|
Support comments in 'slaves' file
|
|
|
| |
|
HADOOP-4440 |
FIXED
|
TestJobInProgressListener should also test for jobs killed in queued state
|
|
|
| |
|
HADOOP-5320 |
FIXED
|
TestMapReduceLocal is missing a close() that is causing it to fail while running the test on NFS
|
|
|
| |
|
HADOOP-4728 |
FIXED
|
Tests for NameNode -checkpoint option with different configurations
|
|
|
| |
|
HADOOP-4435 |
FIXED
|
The JobTracker should display the amount of heap memory used
|
|
|
| |
|
HADOOP-4606 |
FIXED
|
There is a cygpath error if log directory does not exist
|
|
|
| |
|
HADOOP-5379 |
FIXED
|
Throw exception instead of writing to System.err when there is a CRC error on CBZip2InputStream
|
|
|
| |
|
HADOOP-5557 |
FIXED
|
Two minor problems in TestOverReplicatedBlocks
|
|
|
| |
|
HADOOP-5305 |
FIXED
|
Unit test org.apache.hadoop.fs.TestCopyFiles.testMapCount fails on trunk
|
|
|
| |
|
HADOOP-4437 |
FIXED
|
Use qMC sequence to improve the accuracy of PiEstimator
|
|
|
| |
|
HADOOP-4722 |
FIXED
|
adding tests for quotas command line error messages
|
|
|
| |
|
HADOOP-4571 |
FIXED
|
chukwa conf files are not cleaned up
|
|
|
| |
|
HADOOP-4732 |
FIXED
|
connectionTimeout and readTimeout are passed in wrong order in ReduceTask.java
|
|
|
| |
|
HADOOP-4894 |
FIXED
|
fix Chukwa's jettyCollector.sh
|
|
|
| |
|
HADOOP-4690 |
FIXED
|
fuse-dfs - create source file/function + utils + config + main source files
|
|
|
| |
|
HADOOP-4753 |
FIXED
|
gridmix2 code can be condensed
|
|
|
| |
|
HADOOP-4262 |
FIXED
|
message generated when the client exception has a null message is not useful
|
|
|
| |
|
HADOOP-4207 |
FIXED
|
update derby.jar to eliminate the one time wait of 2-3 minutes while running junit tests
|
|
|
| |
|
HADOOP-4947 |
FIXED
|
use regex to parse chukwa commands
|
|
|
| |
|
HADOOP-4640 |
FIXED
|
Add ability to split text files compressed with lzo
|
|
|
| |
|
HADOOP-4884 |
FIXED
|
Change Date format pattern for Time Series graph
|
|
|
| |
|
HADOOP-4889 |
FIXED
|
Chukwa RPM needs to chown user/group in build stage instead of post install stage.
|
|
|
| |
|
HADOOP-4811 |
FIXED
|
Import style sheet images for Chukwa
|
|
|
| |
|
HADOOP-4914 |
FIXED
|
Support chkconfig for chukwa start up scripts
|
|
|
| |
|
HADOOP-5520 |
FIXED
|
Typo in diskQuota help documentation
|
|
|
| |
|
HADOOP-5416 |
FIXED
|
Wrong description of " hadoop fs -test " in FS Shell guide .
|
|
|
| |
|
HADOOP-3180 |
FIXED
|
add name of faulty class to WritableName.getClass IOException upon ClassNotFoundException
|
|
|
| |
|
HADOOP-4485 |
FIXED
|
ant compile-native shorthand
|
|
|
| |
|
HADOOP-4770 |
FIXED
|
gridmix2 run script doesn't work on trunk
|
|
|
| |
|
HADOOP-4704 |
FIXED
|
javadoc: "the the" => "the"
|
|
|
| |
|
HADOOP-5122 |
FIXED
|
libhdfs test conf uses deprecated fs.default.name value
|
|
|
| |
|
HADOOP-4650 |
FIXED
|
local.cache.size is set to 10 GB, while DEFAULT_CACHE_SIZE is set to 1 MB
|
|
|
| |
|
HADOOP-4738 |
FIXED
|
saveVersion.sh could write a package-info.java that cannot be compiled when used with git
|
|
|
| |
|
HADOOP-4587 |
FIXED
|
typo in javadoc for map.input.file
|
|
|
|
|
| |
|
HADOOP-5154 |
FIXED
|
4-way deadlock in FairShare scheduler
|
|
|
| |
|
HADOOP-5213 |
FIXED
|
BZip2CompressionOutputStream NullPointerException
|
|
|
| |
|
HADOOP-5465 |
FIXED
|
Blocks remain under-replicated
|
|
|
| |
|
HADOOP-5384 |
FIXED
|
DataNodeCluster should not create blocks with generationStamp == 1
|
|
|
| |
|
HADOOP-5522 |
FIXED
|
Document job setup/cleaup tasks and task cleanup tasks in mapred tutorial
|
|
|
| |
|
HADOOP-4638 |
FIXED
|
Exception thrown in/from RecoveryManager.recover() should be caught and handled
|
|
|
| |
|
HADOOP-3998 |
FIXED
|
Got an exception from ClientFinalizer when the JT is terminated
|
|
|
| |
|
HADOOP-5421 |
FIXED
|
HADOOP-4638 has broken 0.19 compilation
|
|
|
| |
|
HADOOP-5376 |
FIXED
|
JobInProgress.obtainTaskCleanupTask() throws an ArrayIndexOutOfBoundsException
|
|
|
| |
|
HADOOP-5392 |
FIXED
|
JobTracker crashes during recovery if job files are garbled
|
|
|
| |
|
HADOOP-5285 |
FIXED
|
JobTracker hangs for long periods of time
|
|
|
| |
|
HADOOP-5146 |
FIXED
|
LocalDirAllocator misses files on the local filesystem
|
|
|
| |
|
HADOOP-5332 |
FIXED
|
Make support for file append API configurable
|
|
|
| |
|
HADOOP-5247 |
FIXED
|
NPEs in JobTracker and JobClient when mapred.jobtracker.completeuserjobs.maximum is set to zero.
|
|
|
| |
|
HADOOP-6017 |
FIXED
|
NameNode and SecondaryNameNode fail to restart because of abnormal filenames.
|
|
|
| |
|
HADOOP-5241 |
FIXED
|
Reduce tasks get stuck because of over-estimated task size (regression from 0.18)
|
|
|
| |
|
HADOOP-5233 |
FIXED
|
Reducer not Succeded after 100%
|
|
|
| |
|
HADOOP-5440 |
FIXED
|
Successful taskid are not removed from TaskMemoryManager
|
|
|
| |
|
HADOOP-5269 |
FIXED
|
TaskTracker.runningTasks holding FAILED_UNCLEAN and KILLED_UNCLEAN taskStatuses forever in some cases.
|
|
|
| |
|
HADOOP-5449 |
FIXED
|
Verify if JobHistory.HistoryCleaner works as expected
|
|
|
| |
|
HADOOP-5280 |
FIXED
|
When expiring a lost launched task, JT doesn't remove the attempt from the taskidToTIPMap.
|
|
|
| |
|
HADOOP-5479 |
FIXED
|
NameNode should not send empty block replication request to DataNode
|
|
|
| |
|
HADOOP-5551 |
|
