Description
User can merge incremental backup images into single incremental backup image.
- Merge supports only incremental images
- Merge supports only images for the same backup destinations
Command:
hbase backup merge image1,image2,..imageK
Example:
hbase backup merge backup_143126764557,backup_143126764456
When operation is complete, only the most recent backup image will be kept (in above example - backup_143126764557) as a merged backup image, all other images will be deleted from both: file system and backup system tables, corresponding backup manifest for the merged backup image will be updated to remove dependencies from deleted images. Merged backup image will contains all the data from original image and from deleted images.
Attachments
Attachments
- HBASE-14135-v3.patch
- 58 kB
- Vladimir Rodionov
- HBASE-14135-v5.patch
- 90 kB
- Vladimir Rodionov
- HBASE-14135-v6.patch
- 108 kB
- Vladimir Rodionov
- HBASE-14135-v7.patch
- 115 kB
- Vladimir Rodionov
- HBASE-14135-v8.patch
- 114 kB
- Vladimir Rodionov
- HBASE-14135-v9.patch
- 124 kB
- Vladimir Rodionov
- HBASE-14135-v10.patch
- 125 kB
- Josh Elser
- HBASE-14135-v11.patch
- 125 kB
- Vladimir Rodionov
Issue Links
- is part of
-
HBASE-14414 HBase Backup/Restore Phase 3
- Closed
Activity
Two issues with incremental backup implementation:
- Storage usage. WAL files are significantly larger than hfiles, especially when compression is enabled in hfiles
- Restore operation time.
The most significant is the first one. We can that storage reduction factor will be something between 3-5 once convert (merge) is implemented.
Running conversion (merge) on a remote destination (cluster) is not feasible in many cases, so merge will require reading/writing data back and forth between source and destination.
I will postpone this feature until filtering at the source during incremental backup is done (HBASE-14141).
Since a lot of effort has gone into fault tolerance, I think each backup improvement should have builtin fault tolerance design.
Why is this backup stuff in hbase-server? BackupAdmin, BackupMergeJob, etc. and not in hbase-backup? This is phase 3. I'd have thought the backup module would be well along by now (Where do I go to read on current state of backup feature?) hbase-server is already overly fat with test suite that takes way too long, etc., etc. Lets not compound.
BackupMergeJob is a MR job or something? I presume that is what the 'Job' is about? There is nothing in class comment saying so.. .just generic Interface. Drop the 'Job' on classname if Interface has no requirement that implementation be a MR job (could it be done w/ Spark or in a simple process?)
Why does the formatting in this patch differ from that of the rest of the code? (line between class comment or method comment and class opener or method... parens on own lines instead of at end of method spec line... Sometimes operators/parens have spaces around or before them, other times they do not...
mergeBackups doesn't return a future? It is synchronous? Doc says nothing on this.
Why is this backup stuff in hbase-server? BackupAdmin, BackupMergeJob, etc. and not in hbase-backup? This is phase 3. I'd have thought the backup module would be well along by now (Where do I go to read on current state of backup feature?) hbase-server is already overly fat with test suite that takes way too long, etc., etc. Lets not compound.
We have separate JIRA for modularization : HBASE-17614. This is part Phase 3. I can start working on that once this one is committed. Long running tests are well-known issue for us. and again we have a separate JIRA for that as well.
BackupMergeJob is a MR job or something?
No it is just a generic Job which can be configured and executed
mergeBackups doesn't return a future? It is synchronous? Doc says nothing on this.
Yes, it is synchronous. All operations are client-driven.
Formatting will be fixed in the next patch.
Long running tests are well-known issue for us.
And? What is the intent? To change them? Thanks.
No it is just a generic Job which can be configured and executed
You understand how someone might think 'MR' when they see 'Job'. Do you want to prevent any confusion?
Yes, it is synchronous. All operations are client-driven.
And if the client goes away? They query to find running jobs?
And? What is the intent? To change them? Thanks.
Yes. There is a JIRA HBASE-16458.
You understand how someone might think 'MR' when they see 'Job'. Do you want to prevent any confusion?
We have had already long discussion about this topic in the past. Should we start it again?
Originally it was Service, then - Task, now is Job. What do you suggest, stack?
And if the client goes away? They query to find running jobs?
Job will fail, but next time (run), repair will be started automatically (mostly cleanup stuff). We have repair tool, just in case if "client goes away" or some other disaster happens.
Originally it was Service, then - Task, now is Job. What do you suggest, stack?
How about process? Seems generic enough to capture MR Job among other possibilities.. Stack?
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 1m 31s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
+1 | mvninstall | 8m 41s | master passed |
+1 | compile | 1m 47s | master passed |
+1 | checkstyle | 1m 49s | master passed |
+1 | mvneclipse | 0m 41s | master passed |
-1 | findbugs | 7m 58s | hbase-server in master has 10 extant Findbugs warnings. |
+1 | javadoc | 1m 26s | master passed |
+1 | mvninstall | 2m 17s | the patch passed |
+1 | compile | 1m 53s | the patch passed |
+1 | javac | 1m 53s | the patch passed |
+1 | checkstyle | 1m 43s | the patch passed |
+1 | mvneclipse | 0m 38s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 77m 18s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha3. |
-1 | findbugs | 8m 27s | hbase-server generated 3 new + 10 unchanged - 0 fixed = 13 total (was 10) |
+1 | javadoc | 1m 23s | the patch passed |
-1 | unit | 213m 38s | hbase-server in the patch failed. |
+1 | asflicense | 0m 23s | The patch does not generate ASF License warnings. |
332m 27s |
Reason | Tests |
---|---|
FindBugs | module:hbase-server |
Nullcheck of conn at line 94 of value previously dereferenced in org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupMergeJob.run(String[]) At MapReduceBackupMergeJob.java:94 of value previously dereferenced in org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupMergeJob.run(String[]) At MapReduceBackupMergeJob.java:[line 94] | |
Exception is caught when Exception is not thrown in org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupMergeJob.run(String[]) At MapReduceBackupMergeJob.java:is not thrown in org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupMergeJob.run(String[]) At MapReduceBackupMergeJob.java:[line 161] | |
org.apache.hadoop.hbase.backup.util.BackupUtils.MILLISEC_IN_HOUR isn't final but should be At BackupUtils.java:be At BackupUtils.java:[line 73] |
Subsystem | Report/Notes |
---|---|
Docker | Client=17.03.0-ce Server=17.03.0-ce Image:yetus/hbase:757bf37 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12874988/HBASE-14135-v3.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux 5db52a88b226 4.8.3-std-1 #1 SMP Fri Oct 21 11:15:43 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / bc8ebc6 |
Default Java | 1.8.0_131 |
findbugs | v3.1.0-RC3 |
findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/7581/artifact/patchprocess/branch-findbugs-hbase-server-warnings.html |
findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/7581/artifact/patchprocess/new-findbugs-hbase-server.html |
unit | https://builds.apache.org/job/PreCommit-HBASE-Build/7581/artifact/patchprocess/patch-unit-hbase-server.txt |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/7581/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/7581/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 2m 37s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
-1 | @author | 0m 0s | The patch appears to contain 1 @author tags which the community has agreed to not allow in code contributions. |
-1 | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
+1 | mvninstall | 4m 25s | master passed |
+1 | compile | 0m 51s | master passed |
+1 | checkstyle | 0m 59s | master passed |
+1 | mvneclipse | 0m 21s | master passed |
-1 | findbugs | 3m 30s | hbase-server in master has 10 extant Findbugs warnings. |
+1 | javadoc | 0m 33s | master passed |
-1 | mvninstall | 0m 31s | hbase-server in the patch failed. |
-1 | compile | 0m 30s | hbase-server in the patch failed. |
-1 | javac | 0m 30s | hbase-server in the patch failed. |
+1 | checkstyle | 0m 57s | the patch passed |
+1 | mvneclipse | 0m 22s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
-1 | hadoopcheck | 1m 34s | The patch causes 44 errors with Hadoop v2.6.1. |
-1 | hadoopcheck | 3m 4s | The patch causes 44 errors with Hadoop v2.6.2. |
-1 | hadoopcheck | 4m 31s | The patch causes 44 errors with Hadoop v2.6.3. |
-1 | hadoopcheck | 5m 57s | The patch causes 44 errors with Hadoop v2.6.4. |
-1 | hadoopcheck | 7m 23s | The patch causes 44 errors with Hadoop v2.6.5. |
-1 | hadoopcheck | 8m 52s | The patch causes 44 errors with Hadoop v2.7.1. |
-1 | hadoopcheck | 10m 22s | The patch causes 44 errors with Hadoop v2.7.2. |
-1 | hadoopcheck | 11m 50s | The patch causes 44 errors with Hadoop v2.7.3. |
-1 | hadoopcheck | 13m 13s | The patch causes 44 errors with Hadoop v3.0.0-alpha3. |
-1 | findbugs | 0m 28s | hbase-server in the patch failed. |
-1 | javadoc | 0m 35s | hbase-server generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0) |
-1 | unit | 0m 28s | hbase-server in the patch failed. |
+1 | asflicense | 0m 8s | The patch does not generate ASF License warnings. |
30m 50s |
This message was automatically generated.
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 0m 14s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
+1 | mvninstall | 3m 36s | master passed |
+1 | compile | 0m 44s | master passed |
+1 | checkstyle | 0m 53s | master passed |
+1 | mvneclipse | 0m 15s | master passed |
-1 | findbugs | 3m 6s | hbase-server in master has 10 extant Findbugs warnings. |
+1 | javadoc | 0m 29s | master passed |
+1 | mvninstall | 0m 46s | the patch passed |
+1 | compile | 0m 38s | the patch passed |
+1 | javac | 0m 38s | the patch passed |
+1 | checkstyle | 0m 47s | the patch passed |
+1 | mvneclipse | 0m 15s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 28m 36s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha3. |
+1 | findbugs | 3m 34s | the patch passed |
+1 | javadoc | 0m 34s | the patch passed |
+1 | unit | 116m 3s | hbase-server in the patch passed. |
+1 | asflicense | 0m 16s | The patch does not generate ASF License warnings. |
161m 9s |
Subsystem | Report/Notes |
---|---|
Docker | Client=1.11.2 Server=1.11.2 Image:yetus/hbase:757bf37 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12876474/HBASE-14135-v6.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux f01985501bd3 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / 7d08c78 |
Default Java | 1.8.0_131 |
findbugs | v3.1.0-RC3 |
findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/7603/artifact/patchprocess/branch-findbugs-hbase-server-warnings.html |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/7603/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/7603/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 0m 19s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
+1 | mvninstall | 3m 34s | master passed |
+1 | compile | 0m 41s | master passed |
+1 | checkstyle | 0m 51s | master passed |
+1 | mvneclipse | 0m 17s | master passed |
-1 | findbugs | 2m 45s | hbase-server in master has 9 extant Findbugs warnings. |
+1 | javadoc | 0m 28s | master passed |
+1 | mvninstall | 0m 47s | the patch passed |
+1 | compile | 0m 40s | the patch passed |
+1 | javac | 0m 40s | the patch passed |
+1 | checkstyle | 0m 50s | the patch passed |
+1 | mvneclipse | 0m 15s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 30m 39s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha4. |
+1 | findbugs | 3m 9s | the patch passed |
+1 | javadoc | 0m 29s | the patch passed |
-1 | unit | 85m 40s | hbase-server in the patch failed. |
+1 | asflicense | 0m 31s | The patch does not generate ASF License warnings. |
132m 20s |
Reason | Tests |
---|---|
Timed out junit tests | org.apache.hadoop.hbase.regionserver.wal.TestSecureWALReplay |
org.apache.hadoop.hbase.master.procedure.TestDisableTableProcedure | |
org.apache.hadoop.hbase.coprocessor.TestRegionObserverInterface | |
org.apache.hadoop.hbase.regionserver.TestSplitLogWorker | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncWALReplay | |
org.apache.hadoop.hbase.regionserver.TestRowTooBig | |
org.apache.hadoop.hbase.master.procedure.TestServerCrashProcedure | |
org.apache.hadoop.hbase.master.procedure.TestEnableTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestCreateTableProcedure | |
org.apache.hadoop.hbase.regionserver.compactions.TestFIFOCompactionPolicy | |
org.apache.hadoop.hbase.mapreduce.TestTableInputFormat | |
org.apache.hadoop.hbase.mapreduce.TestHRegionPartitioner | |
org.apache.hadoop.hbase.master.TestGetLastFlushedSequenceId | |
org.apache.hadoop.hbase.master.procedure.TestSafemodeBringsDownMaster | |
org.apache.hadoop.hbase.backup.TestRemoteBackup | |
org.apache.hadoop.hbase.snapshot.TestSnapshotClientRetries | |
org.apache.hadoop.hbase.regionserver.TestRemoveRegionMetrics | |
org.apache.hadoop.hbase.trace.TestHTraceHooks | |
org.apache.hadoop.hbase.TestHBaseTestingUtility | |
org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook | |
org.apache.hadoop.hbase.regionserver.TestTags | |
org.apache.hadoop.hbase.regionserver.TestTimestampFilterSeekHint | |
org.apache.hadoop.hbase.mapred.TestTableInputFormat | |
org.apache.hadoop.hbase.TestFullLogReconstruction | |
org.apache.hadoop.hbase.master.assignment.TestAssignmentManager | |
org.apache.hadoop.hbase.backup.TestFullBackup | |
org.apache.hadoop.hbase.wal.TestWALFiltering | |
org.apache.hadoop.hbase.quotas.TestQuotaStatusRPCs | |
org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint | |
org.apache.hadoop.hbase.regionserver.wal.TestWALReplay | |
org.apache.hadoop.hbase.TestMultiVersions | |
org.apache.hadoop.hbase.quotas.TestMasterSpaceQuotaObserver | |
org.apache.hadoop.hbase.mapreduce.TestCellCounter | |
org.apache.hadoop.hbase.wal.TestWALSplitCompressed | |
org.apache.hadoop.hbase.TestZooKeeper | |
org.apache.hadoop.hbase.replication.regionserver.TestWALEntryStream | |
org.apache.hadoop.hbase.mob.compactions.TestPartitionedMobCompactor | |
org.apache.hadoop.hbase.regionserver.TestMutateRowsRecovery | |
org.apache.hadoop.hbase.filter.TestScanRowPrefix | |
org.apache.hadoop.hbase.backup.TestBackupDescribe | |
org.apache.hadoop.hbase.quotas.TestRegionSizeUse | |
org.apache.hadoop.hbase.coprocessor.TestMasterObserver | |
org.apache.hadoop.hbase.regionserver.TestRegionServerAbort | |
org.apache.hadoop.hbase.backup.TestRepairAfterFailedDelete | |
org.apache.hadoop.hbase.io.asyncfs.TestSaslFanOutOneBlockAsyncDFSOutput | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDefaultVisLabelService | |
org.apache.hadoop.hbase.regionserver.TestCompactSplitThread | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort | |
org.apache.hadoop.hbase.util.TestHBaseFsckEncryption | |
org.apache.hadoop.hbase.backup.TestBackupDeleteRestore | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithCustomVisLabService | |
org.apache.hadoop.hbase.regionserver.TestWalAndCompactingMemStoreFlush | |
org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures | |
org.apache.hadoop.hbase.io.asyncfs.TestFanOutOneBlockAsyncDFSOutput | |
org.apache.hadoop.hbase.coprocessor.TestIncrementTimeRange | |
org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling | |
org.apache.hadoop.hbase.TestClusterBootOrder | |
org.apache.hadoop.hbase.regionserver.TestSplitWalDataLoss | |
org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster | |
org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders | |
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupDeleteTable | |
org.apache.hadoop.hbase.backup.TestRemoteRestore | |
org.apache.hadoop.hbase.backup.TestFullBackupSet | |
org.apache.hadoop.hbase.mob.compactions.TestMobCompactor | |
org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush | |
org.apache.hadoop.hbase.master.TestDeadServer | |
org.apache.hadoop.hbase.regionserver.TestRegionServerReportForDuty | |
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential | |
org.apache.hadoop.hbase.backup.TestFullRestore | |
org.apache.hadoop.hbase.quotas.TestQuotaObserverChoreWithMiniCluster | |
org.apache.hadoop.hbase.security.TestSecureIPC | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRolling | |
org.apache.hadoop.hbase.master.TestMasterShutdown | |
org.apache.hadoop.hbase.backup.TestBackupDelete | |
org.apache.hadoop.hbase.coprocessor.TestRegionObserverForAddingMutationsFromCoprocessors | |
org.apache.hadoop.hbase.regionserver.throttle.TestCompactionWithThroughputController | |
org.apache.hadoop.hbase.backup.master.TestBackupLogCleaner | |
org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster | |
org.apache.hadoop.hbase.regionserver.TestPerColumnFamilyFlush | |
org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsOpWithDifferentUsersNoACL | |
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2 | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster | |
org.apache.hadoop.hbase.regionserver.TestJoinedScanners | |
org.apache.hadoop.hbase.util.TestFromClientSide3WoUnsafe | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupMergeWithFailures | |
org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController | |
org.apache.hadoop.hbase.mob.TestExpiredMobFileCleaner | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedureFromClient | |
org.apache.hadoop.hbase.filter.TestFuzzyRowAndColumnRangeFilter | |
org.apache.hadoop.hbase.TestAcidGuarantees | |
org.apache.hadoop.hbase.TestGlobalMemStoreSize | |
org.apache.hadoop.hbase.TestNamespace | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupWithFailures | |
org.apache.hadoop.hbase.io.encoding.TestChangingEncoding | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithACL | |
org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks | |
org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster | |
org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter | |
org.apache.hadoop.hbase.TestMovedRegionsCleaner | |
org.apache.hadoop.hbase.coprocessor.TestOpenTableInCoprocessor | |
org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoadWithOldClient | |
org.apache.hadoop.hbase.mapreduce.TestHashTable | |
org.apache.hadoop.hbase.mapreduce.TestSyncTable | |
org.apache.hadoop.hbase.mapreduce.TestCopyTable | |
org.apache.hadoop.hbase.backup.TestBackupDeleteWithFailures | |
org.apache.hadoop.hbase.regionserver.TestRecoveredEdits | |
org.apache.hadoop.hbase.security.access.TestCellACLWithMultipleVersions | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelReplicationWithExpAsString | |
org.apache.hadoop.hbase.backup.TestFullBackupWithFailures | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsReplication | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityWithCheckAuths | |
org.apache.hadoop.hbase.util.TestRegionMover | |
org.apache.hadoop.hbase.quotas.TestQuotaObserverChoreRegionReports | |
org.apache.hadoop.hbase.snapshot.TestMobRestoreFlushSnapshotFromClient | |
org.apache.hadoop.hbase.replication.TestReplicationTableBase | |
org.apache.hadoop.hbase.filter.TestColumnRangeFilter | |
org.apache.hadoop.hbase.master.procedure.TestProcedureAdmin | |
org.apache.hadoop.hbase.TestIOFencing | |
org.apache.hadoop.hbase.regionserver.TestRSKilledWhenInitializing | |
org.apache.hadoop.hbase.regionserver.TestHRegion | |
org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel | |
org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient | |
org.apache.hadoop.hbase.regionserver.TestRegionOpen | |
org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk | |
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite | |
org.apache.hadoop.hbase.security.access.TestWithDisabledAuthorization | |
org.apache.hadoop.hbase.TestLocalHBaseCluster | |
org.apache.hadoop.hbase.master.procedure.TestMasterProcedureEvents | |
org.apache.hadoop.hbase.backup.TestBackupStatusProgress | |
org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner | |
org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient | |
org.apache.hadoop.hbase.mob.TestDefaultMobStoreFlusher | |
org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed | |
org.apache.hadoop.hbase.util.TestHBaseFsckMOB | |
org.apache.hadoop.hbase.backup.TestRestoreBoundaryTests | |
org.apache.hadoop.hbase.coprocessor.TestRegionObserverBypass | |
org.apache.hadoop.hbase.regionserver.TestClusterId | |
org.apache.hadoop.hbase.regionserver.TestRegionServerHostname | |
org.apache.hadoop.hbase.backup.TestBackupBoundaryTests | |
org.apache.hadoop.hbase.security.access.TestScanEarlyTermination | |
org.apache.hadoop.hbase.fs.TestBlockReorder | |
org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient | |
org.apache.hadoop.hbase.security.access.TestCoprocessorWhitelistMasterObserver | |
org.apache.hadoop.hbase.TestServerSideScanMetricsFromClientSide | |
org.apache.hadoop.hbase.regionserver.TestSettingTimeoutOnBlockingPoint | |
org.apache.hadoop.hbase.coprocessor.TestRegionServerCoprocessorExceptionWithAbort | |
org.apache.hadoop.hbase.TestMetaTableAccessor | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncWALReplayCompressed | |
org.apache.hadoop.hbase.master.TestRegionPlacement2 | |
org.apache.hadoop.hbase.backup.TestBackupRepair | |
org.apache.hadoop.hbase.io.hfile.TestHFileBlock | |
org.apache.hadoop.hbase.security.access.TestZKPermissionsWatcher | |
org.apache.hadoop.hbase.replication.TestMultiSlaveReplication | |
org.apache.hadoop.hbase.regionserver.TestRegionReplicaFailover | |
org.apache.hadoop.hbase.util.TestConnectionCache | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad | |
org.apache.hadoop.hbase.backup.TestBackupMultipleDeletes | |
org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingStrategy | |
org.apache.hadoop.hbase.wal.TestWALFactory | |
org.apache.hadoop.hbase.regionserver.TestStore | |
org.apache.hadoop.hbase.util.TestIdReadWriteLock | |
org.apache.hadoop.hbase.coprocessor.TestCoprocessorStop | |
org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad | |
org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd | |
org.apache.hadoop.hbase.mapreduce.TestTableSnapshotInputFormat | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedure | |
org.apache.hadoop.hbase.replication.TestMasterReplication | |
org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManagerZkImpl | |
org.apache.hadoop.hbase.regionserver.wal.TestSecureAsyncWALReplay | |
org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed | |
org.apache.hadoop.hbase.backup.TestFullBackupSetRestoreSet | |
org.apache.hadoop.hbase.TestPartialResultsFromClientSide | |
org.apache.hadoop.hbase.replication.TestReplicationSource | |
org.apache.hadoop.hbase.coprocessor.TestMasterCoprocessorExceptionWithAbort | |
org.apache.hadoop.hbase.regionserver.TestAtomicOperation | |
org.apache.hadoop.hbase.tool.TestCanaryTool | |
org.apache.hadoop.hbase.io.TestFileLink | |
org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat | |
org.apache.hadoop.hbase.master.procedure.TestRestoreSnapshotProcedure | |
org.apache.hadoop.hbase.master.procedure.TestAddColumnFamilyProcedure | |
org.apache.hadoop.hbase.master.procedure.TestCreateNamespaceProcedure | |
org.apache.hadoop.hbase.backup.TestBackupShowHistory | |
org.apache.hadoop.hbase.regionserver.TestCompactionInDeadRegionServer | |
org.apache.hadoop.hbase.regionserver.TestMajorCompaction | |
org.apache.hadoop.hbase.regionserver.TestScannerRetriableFailure | |
org.apache.hadoop.hbase.util.TestFSUtils | |
org.apache.hadoop.hbase.backup.TestIncrementalBackup | |
org.apache.hadoop.hbase.wal.TestWALSplit | |
org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers | |
org.apache.hadoop.hbase.mapreduce.TestImportTsv | |
org.apache.hadoop.hbase.master.procedure.TestTruncateTableProcedure |
Subsystem | Report/Notes |
---|---|
Docker | Client=17.03.0-ce Server=17.03.0-ce Image:yetus/hbase:757bf37 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12877855/HBASE-14135-v7.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux 2ff8eed358f7 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / 56d00f5 |
Default Java | 1.8.0_131 |
findbugs | v3.1.0-RC3 |
findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/7701/artifact/patchprocess/branch-findbugs-hbase-server-warnings.html |
unit | https://builds.apache.org/job/PreCommit-HBASE-Build/7701/artifact/patchprocess/patch-unit-hbase-server.txt |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/7701/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/7701/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
v8 adds some minor clean ups.
elserj, can you take a look at this patch?
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 0m 15s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. |
+1 | mvninstall | 4m 37s | master passed |
+1 | compile | 0m 51s | master passed |
+1 | checkstyle | 0m 56s | master passed |
+1 | mvneclipse | 0m 18s | master passed |
-1 | findbugs | 3m 30s | hbase-server in master has 9 extant Findbugs warnings. |
+1 | javadoc | 0m 43s | master passed |
+1 | mvninstall | 0m 58s | the patch passed |
+1 | compile | 0m 49s | the patch passed |
+1 | javac | 0m 49s | the patch passed |
+1 | checkstyle | 0m 55s | the patch passed |
+1 | mvneclipse | 0m 19s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 36m 52s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha4. |
+1 | findbugs | 3m 52s | the patch passed |
+1 | javadoc | 0m 35s | the patch passed |
-1 | unit | 101m 38s | hbase-server in the patch failed. |
+1 | asflicense | 0m 27s | The patch does not generate ASF License warnings. |
158m 2s |
Reason | Tests |
---|---|
Failed junit tests | hadoop.hbase.backup.TestIncrementalBackupMergeWithFailures |
Timed out junit tests | org.apache.hadoop.hbase.master.TestMasterMetricsWrapper |
org.apache.hadoop.hbase.regionserver.wal.TestSecureWALReplay | |
org.apache.hadoop.hbase.master.procedure.TestDeleteTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestCreateTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestServerCrashProcedure | |
org.apache.hadoop.hbase.regionserver.TestRowTooBig | |
org.apache.hadoop.hbase.regionserver.TestSplitLogWorker | |
org.apache.hadoop.hbase.regionserver.compactions.TestFIFOCompactionPolicy | |
org.apache.hadoop.hbase.master.TestGetLastFlushedSequenceId | |
org.apache.hadoop.hbase.regionserver.wal.TestFSHLog | |
org.apache.hadoop.hbase.regionserver.TestCompaction | |
org.apache.hadoop.hbase.trace.TestHTraceHooks | |
org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer2 | |
org.apache.hadoop.hbase.regionserver.TestRegionServerMetrics | |
org.apache.hadoop.hbase.regionserver.TestRemoveRegionMetrics | |
org.apache.hadoop.hbase.master.assignment.TestAssignmentManager | |
org.apache.hadoop.hbase.master.TestAssignmentManagerMetrics | |
org.apache.hadoop.hbase.regionserver.TestTags | |
org.apache.hadoop.hbase.regionserver.TestTimestampFilterSeekHint | |
org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint | |
org.apache.hadoop.hbase.mapred.TestTableMapReduceUtil | |
org.apache.hadoop.hbase.replication.regionserver.TestWALEntryStream | |
org.apache.hadoop.hbase.master.TestGetInfoPort | |
org.apache.hadoop.hbase.TestZooKeeper | |
org.apache.hadoop.hbase.wal.TestWALSplitCompressed | |
org.apache.hadoop.hbase.master.TestAssignmentListener | |
org.apache.hadoop.hbase.master.TestMasterFailoverBalancerPersistence | |
org.apache.hadoop.hbase.filter.TestScanRowPrefix | |
org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster | |
org.apache.hadoop.hbase.regionserver.TestColumnSeeking | |
org.apache.hadoop.hbase.regionserver.TestMutateRowsRecovery | |
org.apache.hadoop.hbase.master.balancer.TestFavoredStochasticLoadBalancer | |
org.apache.hadoop.hbase.regionserver.TestRegionServerAbort | |
org.apache.hadoop.hbase.io.asyncfs.TestSaslFanOutOneBlockAsyncDFSOutput | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort | |
org.apache.hadoop.hbase.master.TestMasterMetrics | |
org.apache.hadoop.hbase.master.TestTableStateManager | |
org.apache.hadoop.hbase.master.cleaner.TestReplicationZKNodeCleaner | |
org.apache.hadoop.hbase.master.assignment.TestAssignmentOnRSCrash | |
org.apache.hadoop.hbase.master.procedure.TestMasterFailoverWithProcedures | |
org.apache.hadoop.hbase.regionserver.TestWalAndCompactingMemStoreFlush | |
org.apache.hadoop.hbase.io.asyncfs.TestFanOutOneBlockAsyncDFSOutput | |
org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable | |
org.apache.hadoop.hbase.master.TestSplitLogManager | |
org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS | |
org.apache.hadoop.hbase.master.balancer.TestFavoredNodeTableImport | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncLogRolling | |
org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer | |
org.apache.hadoop.hbase.master.TestRollingRestart | |
org.apache.hadoop.hbase.regionserver.TestSplitWalDataLoss | |
org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster | |
org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders | |
org.apache.hadoop.hbase.master.TestDistributedLogSplitting | |
org.apache.hadoop.hbase.TestJMXConnectorServer | |
org.apache.hadoop.hbase.regionserver.TestHRegionWithInMemoryFlush | |
org.apache.hadoop.hbase.regionserver.TestRegionServerReportForDuty | |
org.apache.hadoop.hbase.master.TestMasterShutdown | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRolling | |
org.apache.hadoop.hbase.regionserver.throttle.TestCompactionWithThroughputController | |
org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster | |
org.apache.hadoop.hbase.regionserver.TestPerColumnFamilyFlush | |
org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster | |
org.apache.hadoop.hbase.regionserver.TestJoinedScanners | |
org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedureFromClient | |
org.apache.hadoop.hbase.master.TestMaster | |
org.apache.hadoop.hbase.filter.TestFuzzyRowAndColumnRangeFilter | |
org.apache.hadoop.hbase.TestGlobalMemStoreSize | |
org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor | |
org.apache.hadoop.hbase.TestNamespace | |
org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks | |
org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster | |
org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter | |
org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoadWithOldClient | |
org.apache.hadoop.hbase.regionserver.TestRecoveredEdits | |
org.apache.hadoop.hbase.master.procedure.TestMasterProcedureSchedulerConcurrency | |
org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter | |
org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster | |
org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache | |
org.apache.hadoop.hbase.replication.TestReplicationTableBase | |
org.apache.hadoop.hbase.filter.TestColumnRangeFilter | |
org.apache.hadoop.hbase.master.TestRestartCluster | |
org.apache.hadoop.hbase.master.procedure.TestProcedureAdmin | |
org.apache.hadoop.hbase.TestIOFencing | |
org.apache.hadoop.hbase.regionserver.TestRSKilledWhenInitializing | |
org.apache.hadoop.hbase.regionserver.TestHRegion | |
org.apache.hadoop.hbase.master.TestWarmupRegion | |
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite | |
org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk | |
org.apache.hadoop.hbase.TestLocalHBaseCluster | |
org.apache.hadoop.hbase.master.procedure.TestMasterProcedureEvents | |
org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner | |
org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed | |
org.apache.hadoop.hbase.regionserver.TestClusterId | |
org.apache.hadoop.hbase.regionserver.TestRegionServerHostname | |
org.apache.hadoop.hbase.regionserver.TestEndToEndSplitTransaction | |
org.apache.hadoop.hbase.regionserver.TestSettingTimeoutOnBlockingPoint | |
org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncWALReplayCompressed | |
org.apache.hadoop.hbase.regionserver.TestEncryptionKeyRotation | |
org.apache.hadoop.hbase.replication.TestMultiSlaveReplication | |
org.apache.hadoop.hbase.io.hfile.TestHFileBlock | |
org.apache.hadoop.hbase.regionserver.TestRegionReplicaFailover | |
org.apache.hadoop.hbase.regionserver.TestStore | |
org.apache.hadoop.hbase.filter.TestFuzzyRowFilterEndToEnd | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedure | |
org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad | |
org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManagerZkImpl | |
org.apache.hadoop.hbase.replication.TestMasterReplication | |
org.apache.hadoop.hbase.master.assignment.TestSplitTableRegionProcedure | |
org.apache.hadoop.hbase.regionserver.wal.TestSecureAsyncWALReplay | |
org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed | |
org.apache.hadoop.hbase.replication.TestReplicationSource | |
org.apache.hadoop.hbase.regionserver.TestAtomicOperation | |
org.apache.hadoop.hbase.tool.TestCanaryTool | |
org.apache.hadoop.hbase.io.TestFileLink | |
org.apache.hadoop.hbase.master.TestMasterOperationsForRegionReplicas | |
org.apache.hadoop.hbase.master.procedure.TestDeleteNamespaceProcedure | |
org.apache.hadoop.hbase.master.procedure.TestRestoreSnapshotProcedure | |
org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat | |
org.apache.hadoop.hbase.master.TestMetaShutdownHandler | |
org.apache.hadoop.hbase.regionserver.TestMajorCompaction | |
org.apache.hadoop.hbase.regionserver.TestCompactionInDeadRegionServer | |
org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers | |
org.apache.hadoop.hbase.master.procedure.TestCloneSnapshotProcedure | |
org.apache.hadoop.hbase.master.procedure.TestTruncateTableProcedure |
Subsystem | Report/Notes |
---|---|
Docker | Client=1.11.2 Server=1.11.2 Image:yetus/hbase:757bf37 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12877901/HBASE-14135-v8.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux 002e2a74d9d9 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / 56d00f5 |
Default Java | 1.8.0_131 |
findbugs | v3.1.0-RC3 |
findbugs | https://builds.apache.org/job/PreCommit-HBASE-Build/7706/artifact/patchprocess/branch-findbugs-hbase-server-warnings.html |
unit | https://builds.apache.org/job/PreCommit-HBASE-Build/7706/artifact/patchprocess/patch-unit-hbase-server.txt |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/7706/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/7706/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
Unwinding my queue, vrodionov, but I'll try to get to this tmrw or Friday.
Thanks, elserj RB for your convenience:
https://reviews.apache.org/r/60309/
We have repair tool, just in case if "client goes away" or some other disaster happens.
This was one question I had on RB. Let me add to it since it was brought up here as well.
It looks like there is the potential for files in HDFS to be orphaned (via a hard JVM crash where "deleteOnExit" wouldn't fire) and for entries in the hbase:backup table to be orphaned. The tooling to clean these up is great – should we have some automation inside of the Master to try to catch these scenarios and proactively clean it up for the user?
I am thinking about something very un-aggressive (e.g. cleaning up files in hdfs after many hours or days). WDYT?
It looks like there is the potential for files in HDFS to be orphaned (via a hard JVM crash where "deleteOnExit" wouldn't fire) and for entries in the hbase:backup table to be orphaned. The tooling to clean these up is great – should we have some automation inside of the Master to try to catch these scenarios and proactively clean it up for the user?
This is not only for backup, right, elserj? Hard crash can happen during regular HBase operation, do we have any automation tools in Master to address potential issues?
This is not only for backup, right, Josh Elser?
Yeah, it definitely applies to all aspects of HBase. WALs is probably the most prevalent area I can think of.
Hard crash can happen during regular HBase operation, do we have any automation tools in Master to address potential issues?
For WALs, I'm sure you're well aware of all of the CleanerChore logic we have surrounding WAL archival/removal that run in the Master. For these backup tools, it's a bit different since things are primarily being driven by the client instead of inside of HBase itself. I'm less asking the question "why wasn't server-side driven cleanup implemented" and more trying to ask the question "should we implement such cleanup?". I'd defer to you to say how easy such an automated (and safe) cleanup would be inside of the Master.
If it would be too difficult (which is what my gut-reaction was), a tool/utility to summarize these (expected) transient data (files in HDFS and hbase:backup records) would be really nice to have. If/when we would have to debug some kind of issue WRT backups or just HDFS use by hbase, such a tool could give us a definitive yes/no as to whether these transient files are to blame or not.
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 0m 19s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
+1 | mvninstall | 4m 48s | master passed |
+1 | compile | 0m 58s | master passed |
+1 | checkstyle | 1m 4s | master passed |
+1 | mvneclipse | 0m 24s | master passed |
+1 | findbugs | 4m 35s | master passed |
+1 | javadoc | 0m 43s | master passed |
+1 | mvninstall | 1m 6s | the patch passed |
+1 | compile | 0m 52s | the patch passed |
+1 | javac | 0m 52s | the patch passed |
+1 | checkstyle | 0m 58s | the patch passed |
+1 | mvneclipse | 0m 20s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 43m 23s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha4. |
+1 | findbugs | 4m 38s | the patch passed |
+1 | javadoc | 0m 39s | the patch passed |
-1 | unit | 151m 8s | hbase-server in the patch failed. |
+1 | asflicense | 0m 19s | The patch does not generate ASF License warnings. |
216m 45s |
Reason | Tests |
---|---|
Failed junit tests | hadoop.hbase.master.TestMasterFailover |
Subsystem | Report/Notes |
---|---|
Docker | Client=1.11.2 Server=1.11.2 Image:yetus/hbase:bdc94b1 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12880102/HBASE-14135-v9.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux 2ebc0117b574 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / fe890b7 |
Default Java | 1.8.0_131 |
findbugs | v3.1.0-RC3 |
unit | https://builds.apache.org/job/PreCommit-HBASE-Build/7912/artifact/patchprocess/patch-unit-hbase-server.txt |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/7912/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/7912/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
If it would be too difficult (which is what my gut-reaction was), a tool/utility to summarize these (expected) transient data (files in HDFS and hbase:backup records) would be really nice to have. If/when we would have to debug some kind of issue WRT backups or just HDFS use by hbase, such a tool could give us a definitive yes/no as to whether these transient files are to blame or not.
We do have repair tool. It takes care of most failure scenarios (not all of them probably) and does housekeeping appropriately.
We do have repair tool. It takes care of most failure scenarios (not all of them probably) and does housekeeping appropriately.
Ah! I'm just showing some ignorance then. That sounds good to me.
v10. Some minor fixes based on a recent RB comments
I will try to find some time to verify that, but I think this is essentially ready to go.
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 0m 15s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
+1 | mvninstall | 4m 27s | master passed |
+1 | compile | 0m 50s | master passed |
+1 | checkstyle | 0m 56s | master passed |
+1 | mvneclipse | 0m 18s | master passed |
+1 | findbugs | 3m 34s | master passed |
+1 | javadoc | 0m 36s | master passed |
+1 | mvninstall | 0m 56s | the patch passed |
+1 | compile | 0m 49s | the patch passed |
+1 | javac | 0m 49s | the patch passed |
+1 | checkstyle | 0m 56s | the patch passed |
+1 | mvneclipse | 0m 19s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 37m 42s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha4. |
+1 | findbugs | 3m 46s | the patch passed |
+1 | javadoc | 0m 36s | the patch passed |
-1 | unit | 76m 57s | hbase-server in the patch failed. |
+1 | asflicense | 0m 31s | The patch does not generate ASF License warnings. |
133m 56s |
Reason | Tests |
---|---|
Timed out junit tests | org.apache.hadoop.hbase.regionserver.wal.TestSecureWALReplay |
org.apache.hadoop.hbase.master.procedure.TestEnableTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestDeleteTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestModifyTableProcedure | |
org.apache.hadoop.hbase.regionserver.TestRowTooBig | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncWALReplay | |
org.apache.hadoop.hbase.regionserver.TestSplitLogWorker | |
org.apache.hadoop.hbase.regionserver.compactions.TestFIFOCompactionPolicy | |
org.apache.hadoop.hbase.master.TestGetLastFlushedSequenceId | |
org.apache.hadoop.hbase.regionserver.wal.TestFSHLog | |
org.apache.hadoop.hbase.regionserver.TestCompaction | |
org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer2 | |
org.apache.hadoop.hbase.regionserver.TestRemoveRegionMetrics | |
org.apache.hadoop.hbase.snapshot.TestSnapshotClientRetries | |
org.apache.hadoop.hbase.backup.TestRemoteBackup | |
org.apache.hadoop.hbase.master.TestAssignmentManagerMetrics | |
org.apache.hadoop.hbase.regionserver.TestTags | |
org.apache.hadoop.hbase.regionserver.TestTimestampFilterSeekHint | |
org.apache.hadoop.hbase.TestHBaseTestingUtility | |
org.apache.hadoop.hbase.TestFullLogReconstruction | |
org.apache.hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpoint | |
org.apache.hadoop.hbase.wal.TestWALFiltering | |
org.apache.hadoop.hbase.backup.TestFullBackup | |
org.apache.hadoop.hbase.quotas.TestMasterSpaceQuotaObserver | |
org.apache.hadoop.hbase.replication.regionserver.TestWALEntryStream | |
org.apache.hadoop.hbase.master.TestGetInfoPort | |
org.apache.hadoop.hbase.TestZooKeeper | |
org.apache.hadoop.hbase.wal.TestWALSplitCompressed | |
org.apache.hadoop.hbase.master.TestAssignmentListener | |
org.apache.hadoop.hbase.master.TestMasterFailoverBalancerPersistence | |
org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster | |
org.apache.hadoop.hbase.regionserver.TestColumnSeeking | |
org.apache.hadoop.hbase.regionserver.TestMutateRowsRecovery | |
org.apache.hadoop.hbase.regionserver.TestRegionServerAbort | |
org.apache.hadoop.hbase.quotas.TestRegionSizeUse | |
org.apache.hadoop.hbase.backup.TestBackupDescribe | |
org.apache.hadoop.hbase.io.asyncfs.TestSaslFanOutOneBlockAsyncDFSOutput | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRollAbort | |
org.apache.hadoop.hbase.backup.TestRepairAfterFailedDelete | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDefaultVisLabelService | |
org.apache.hadoop.hbase.util.TestHBaseFsckEncryption | |
org.apache.hadoop.hbase.ipc.TestRpcClientLeaks | |
org.apache.hadoop.hbase.master.TestTableStateManager | |
org.apache.hadoop.hbase.backup.TestBackupDeleteRestore | |
org.apache.hadoop.hbase.regionserver.TestWalAndCompactingMemStoreFlush | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithCustomVisLabService | |
org.apache.hadoop.hbase.io.asyncfs.TestFanOutOneBlockAsyncDFSOutput | |
org.apache.hadoop.hbase.master.TestMasterRestartAfterDisablingTable | |
org.apache.hadoop.hbase.master.TestSplitLogManager | |
org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS | |
org.apache.hadoop.hbase.master.balancer.TestFavoredNodeTableImport | |
org.apache.hadoop.hbase.master.TestRollingRestart | |
org.apache.hadoop.hbase.regionserver.TestSplitWalDataLoss | |
org.apache.hadoop.hbase.regionserver.TestRegionMergeTransactionOnCluster | |
org.apache.hadoop.hbase.io.encoding.TestDataBlockEncoders | |
org.apache.hadoop.hbase.master.TestDistributedLogSplitting | |
org.apache.hadoop.hbase.TestJMXConnectorServer | |
org.apache.hadoop.hbase.util.TestMiniClusterLoadEncoded | |
org.apache.hadoop.hbase.master.TestDeadServer | |
org.apache.hadoop.hbase.backup.TestFullBackupSet | |
org.apache.hadoop.hbase.backup.TestRemoteRestore | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupDeleteTable | |
org.apache.hadoop.hbase.regionserver.TestRegionServerReportForDuty | |
org.apache.hadoop.hbase.util.TestMiniClusterLoadSequential | |
org.apache.hadoop.hbase.master.TestMasterShutdown | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRolling | |
org.apache.hadoop.hbase.backup.TestFullRestore | |
org.apache.hadoop.hbase.security.TestSecureIPC | |
org.apache.hadoop.hbase.regionserver.throttle.TestCompactionWithThroughputController | |
org.apache.hadoop.hbase.backup.TestBackupDelete | |
org.apache.hadoop.hbase.regionserver.TestSplitTransactionOnCluster | |
org.apache.hadoop.hbase.regionserver.TestPerColumnFamilyFlush | |
org.apache.hadoop.hbase.backup.master.TestBackupLogCleaner | |
org.apache.hadoop.hbase.client.TestAvoidCellReferencesIntoShippedBlocks | |
org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL | |
org.apache.hadoop.hbase.mapreduce.TestHFileOutputFormat2 | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsOpWithDifferentUsersNoACL | |
org.apache.hadoop.hbase.regionserver.wal.TestLogRollingNoCluster | |
org.apache.hadoop.hbase.regionserver.TestJoinedScanners | |
org.apache.hadoop.hbase.util.TestFromClientSide3WoUnsafe | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupMergeWithFailures | |
org.apache.hadoop.hbase.regionserver.throttle.TestFlushWithThroughputController | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedureFromClient | |
org.apache.hadoop.hbase.master.TestMaster | |
org.apache.hadoop.hbase.mob.TestExpiredMobFileCleaner | |
org.apache.hadoop.hbase.TestAcidGuarantees | |
org.apache.hadoop.hbase.TestGlobalMemStoreSize | |
org.apache.hadoop.hbase.regionserver.TestCompactionWithCoprocessor | |
org.apache.hadoop.hbase.backup.TestHFileArchiving | |
org.apache.hadoop.hbase.TestNamespace | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupWithFailures | |
org.apache.hadoop.hbase.io.hfile.TestForceCacheImportantBlocks | |
org.apache.hadoop.hbase.regionserver.TestHRegionOnCluster | |
org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsWithDeletes | |
org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoadWithOldClient | |
org.apache.hadoop.hbase.mapreduce.TestSyncTable | |
org.apache.hadoop.hbase.mapreduce.TestHashTable | |
org.apache.hadoop.hbase.mapreduce.TestCopyTable | |
org.apache.hadoop.hbase.regionserver.TestRecoveredEdits | |
org.apache.hadoop.hbase.quotas.TestSpaceQuotasWithSnapshots | |
org.apache.hadoop.hbase.backup.TestBackupDeleteWithFailures | |
org.apache.hadoop.hbase.master.procedure.TestMasterProcedureSchedulerConcurrency | |
org.apache.hadoop.hbase.security.access.TestCellACLWithMultipleVersions | |
org.apache.hadoop.hbase.filter.TestMultiRowRangeFilter | |
org.apache.hadoop.hbase.backup.TestFullBackupWithFailures | |
org.apache.hadoop.hbase.TestHBaseOnOtherDfsCluster | |
org.apache.hadoop.hbase.master.TestMasterNoCluster | |
org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache | |
org.apache.hadoop.hbase.util.TestRegionMover | |
org.apache.hadoop.hbase.replication.TestReplicationTableBase | |
org.apache.hadoop.hbase.filter.TestColumnRangeFilter | |
org.apache.hadoop.hbase.master.TestRestartCluster | |
org.apache.hadoop.hbase.quotas.TestQuotaObserverChoreRegionReports | |
org.apache.hadoop.hbase.snapshot.TestMobRestoreFlushSnapshotFromClient | |
org.apache.hadoop.hbase.TestIOFencing | |
org.apache.hadoop.hbase.regionserver.TestRSKilledWhenInitializing | |
org.apache.hadoop.hbase.regionserver.TestHRegion | |
org.apache.hadoop.hbase.util.TestMiniClusterLoadParallel | |
org.apache.hadoop.hbase.master.TestWarmupRegion | |
org.apache.hadoop.hbase.snapshot.TestRestoreFlushSnapshotFromClient | |
org.apache.hadoop.hbase.io.hfile.TestCacheOnWrite | |
org.apache.hadoop.hbase.io.encoding.TestLoadAndSwitchEncodeOnDisk | |
org.apache.hadoop.hbase.TestLocalHBaseCluster | |
org.apache.hadoop.hbase.master.procedure.TestMasterProcedureEvents | |
org.apache.hadoop.hbase.regionserver.TestMultiColumnScanner | |
org.apache.hadoop.hbase.backup.TestBackupStatusProgress | |
org.apache.hadoop.hbase.security.access.TestAccessController | |
org.apache.hadoop.hbase.regionserver.TestFSErrorsExposed | |
org.apache.hadoop.hbase.snapshot.TestMobFlushSnapshotFromClient | |
org.apache.hadoop.hbase.regionserver.TestClusterId | |
org.apache.hadoop.hbase.regionserver.TestRegionServerHostname | |
org.apache.hadoop.hbase.backup.TestRestoreBoundaryTests | |
org.apache.hadoop.hbase.security.access.TestTablePermissions | |
org.apache.hadoop.hbase.fs.TestBlockReorder | |
org.apache.hadoop.hbase.backup.TestBackupBoundaryTests | |
org.apache.hadoop.hbase.regionserver.TestSettingTimeoutOnBlockingPoint | |
org.apache.hadoop.hbase.snapshot.TestFlushSnapshotFromClient | |
org.apache.hadoop.hbase.regionserver.wal.TestAsyncWALReplayCompressed | |
org.apache.hadoop.hbase.replication.TestMultiSlaveReplication | |
org.apache.hadoop.hbase.io.hfile.TestHFileBlock | |
org.apache.hadoop.hbase.regionserver.TestRegionReplicaFailover | |
org.apache.hadoop.hbase.util.TestConnectionCache | |
org.apache.hadoop.hbase.backup.TestBackupRepair | |
org.apache.hadoop.hbase.regionserver.TestStore | |
org.apache.hadoop.hbase.wal.TestBoundedRegionGroupingStrategy | |
org.apache.hadoop.hbase.wal.TestWALFactory | |
org.apache.hadoop.hbase.backup.TestIncrementalBackupWithBulkLoad | |
org.apache.hadoop.hbase.backup.TestBackupMultipleDeletes | |
org.apache.hadoop.hbase.wal.TestFSHLogProvider | |
org.apache.hadoop.hbase.util.TestIdReadWriteLock | |
org.apache.hadoop.hbase.regionserver.TestHRegionServerBulkLoad | |
org.apache.hadoop.hbase.mapreduce.TestTableSnapshotInputFormat | |
org.apache.hadoop.hbase.replication.regionserver.TestReplicationSourceManagerZkImpl | |
org.apache.hadoop.hbase.replication.TestMasterReplication | |
org.apache.hadoop.hbase.regionserver.wal.TestSecureAsyncWALReplay | |
org.apache.hadoop.hbase.regionserver.wal.TestWALReplayCompressed | |
org.apache.hadoop.hbase.replication.TestReplicationSource | |
org.apache.hadoop.hbase.master.procedure.TestFastFailOnProcedureNotRegistered | |
org.apache.hadoop.hbase.regionserver.TestAtomicOperation | |
org.apache.hadoop.hbase.backup.TestFullBackupSetRestoreSet | |
org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsOnNewVersionBehaviorTable | |
org.apache.hadoop.hbase.tool.TestCanaryTool | |
org.apache.hadoop.hbase.io.TestFileLink | |
org.apache.hadoop.hbase.master.TestMasterOperationsForRegionReplicas | |
org.apache.hadoop.hbase.master.procedure.TestAddColumnFamilyProcedure | |
org.apache.hadoop.hbase.master.procedure.TestDeleteNamespaceProcedure | |
org.apache.hadoop.hbase.master.procedure.TestRestoreSnapshotProcedure | |
org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat | |
org.apache.hadoop.hbase.master.TestMetaShutdownHandler | |
org.apache.hadoop.hbase.regionserver.TestMajorCompaction | |
org.apache.hadoop.hbase.regionserver.TestCompactionInDeadRegionServer | |
org.apache.hadoop.hbase.util.TestFSUtils | |
org.apache.hadoop.hbase.backup.TestBackupShowHistory | |
org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers | |
org.apache.hadoop.hbase.master.procedure.TestCloneSnapshotProcedure | |
org.apache.hadoop.hbase.master.procedure.TestTruncateTableProcedure | |
org.apache.hadoop.hbase.wal.TestWALSplit | |
org.apache.hadoop.hbase.backup.TestIncrementalBackup |
Subsystem | Report/Notes |
---|---|
Docker | Client=1.11.2 Server=1.11.2 Image:yetus/hbase:bdc94b1 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12881084/HBASE-14135-v10.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux 0eac43bda216 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / 794a3b1 |
Default Java | 1.8.0_131 |
findbugs | v3.1.0-RC3 |
unit | https://builds.apache.org/job/PreCommit-HBASE-Build/8003/artifact/patchprocess/patch-unit-hbase-server.txt |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/8003/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/8003/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
This is not a blocker. What is a blocker is moving backup out of hbase-server module, HBASE-17614
Re-attaching v10 since qa since seems to have not been accurate.
+1 once we get a proper QA back.
What is a blocker is moving backup out of hbase-server module,
HBASE-17614
vrodionov, can you find the cycles to also take on this work in the near-term, please?
-1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 13m 7s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
+1 | mvninstall | 3m 54s | master passed |
+1 | compile | 0m 40s | master passed |
+1 | checkstyle | 0m 48s | master passed |
+1 | mvneclipse | 0m 15s | master passed |
+1 | findbugs | 2m 59s | master passed |
+1 | javadoc | 0m 30s | master passed |
+1 | mvninstall | 0m 48s | the patch passed |
+1 | compile | 0m 41s | the patch passed |
+1 | javac | 0m 41s | the patch passed |
+1 | checkstyle | 0m 49s | the patch passed |
+1 | mvneclipse | 0m 16s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 32m 13s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha4. |
+1 | findbugs | 3m 16s | the patch passed |
+1 | javadoc | 0m 30s | the patch passed |
-1 | unit | 108m 29s | hbase-server in the patch failed. |
+1 | asflicense | 0m 20s | The patch does not generate ASF License warnings. |
169m 59s |
Reason | Tests |
---|---|
Timed out junit tests | org.apache.hadoop.hbase.master.procedure.TestDisableTableProcedure |
org.apache.hadoop.hbase.master.procedure.TestModifyTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestCreateTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestEnableTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestDeleteTableProcedure | |
org.apache.hadoop.hbase.master.TestGetLastFlushedSequenceId | |
org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer2 | |
org.apache.hadoop.hbase.master.TestAssignmentManagerMetrics | |
org.apache.hadoop.hbase.master.TestMasterFailoverBalancerPersistence | |
org.apache.hadoop.hbase.master.cleaner.TestSnapshotFromMaster | |
org.apache.hadoop.hbase.master.TestTableStateManager | |
org.apache.hadoop.hbase.master.cleaner.TestReplicationZKNodeCleaner | |
org.apache.hadoop.hbase.master.assignment.TestAssignmentOnRSCrash | |
org.apache.hadoop.hbase.master.TestSplitLogManager | |
org.apache.hadoop.hbase.master.procedure.TestWALProcedureStoreOnHDFS | |
org.apache.hadoop.hbase.master.balancer.TestFavoredNodeTableImport | |
org.apache.hadoop.hbase.master.TestRollingRestart | |
org.apache.hadoop.hbase.master.balancer.TestStochasticLoadBalancer | |
org.apache.hadoop.hbase.master.TestDistributedLogSplitting | |
org.apache.hadoop.hbase.quotas.TestSpaceQuotas | |
org.apache.hadoop.hbase.master.TestMasterShutdown | |
org.apache.hadoop.hbase.client.TestAvoidCellReferencesIntoShippedBlocks | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedureFromClient | |
org.apache.hadoop.hbase.master.procedure.TestTableDescriptorModificationFromClient | |
org.apache.hadoop.hbase.TestAcidGuarantees | |
org.apache.hadoop.hbase.master.TestMasterNoCluster | |
org.apache.hadoop.hbase.master.snapshot.TestSnapshotFileCache | |
org.apache.hadoop.hbase.master.TestRestartCluster | |
org.apache.hadoop.hbase.master.TestWarmupRegion | |
org.apache.hadoop.hbase.master.procedure.TestDeleteColumnFamilyProcedure | |
org.apache.hadoop.hbase.master.procedure.TestModifyColumnFamilyProcedure | |
org.apache.hadoop.hbase.master.assignment.TestSplitTableRegionProcedure | |
org.apache.hadoop.hbase.master.TestMasterOperationsForRegionReplicas | |
org.apache.hadoop.hbase.master.procedure.TestModifyNamespaceProcedure | |
org.apache.hadoop.hbase.master.procedure.TestCreateNamespaceProcedure | |
org.apache.hadoop.hbase.master.procedure.TestAddColumnFamilyProcedure | |
org.apache.hadoop.hbase.master.procedure.TestDeleteNamespaceProcedure | |
org.apache.hadoop.hbase.master.procedure.TestRestoreSnapshotProcedure | |
org.apache.hadoop.hbase.master.procedure.TestTruncateTableProcedure | |
org.apache.hadoop.hbase.master.procedure.TestCloneSnapshotProcedure |
Subsystem | Report/Notes |
---|---|
Docker | Client=1.12.3 Server=1.12.3 Image:yetus/hbase:bdc94b1 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12881385/HBASE-14135-v10.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux 3713eb9b0e4d 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / 8da77b4 |
Default Java | 1.8.0_144 |
findbugs | v3.1.0-RC3 |
unit | https://builds.apache.org/job/PreCommit-HBASE-Build/8027/artifact/patchprocess/patch-unit-hbase-server.txt |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/8027/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/8027/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
+1 overall |
Vote | Subsystem | Runtime | Comment |
---|---|---|---|
0 | reexec | 0m 15s | Docker mode activated. |
+1 | hbaseanti | 0m 0s | Patch does not have any anti-patterns. |
+1 | @author | 0m 0s | The patch does not contain any @author tags. |
+1 | test4tests | 0m 0s | The patch appears to include 2 new or modified test files. |
+1 | mvninstall | 4m 34s | master passed |
+1 | compile | 0m 44s | master passed |
+1 | checkstyle | 0m 48s | master passed |
+1 | mvneclipse | 0m 15s | master passed |
+1 | findbugs | 3m 2s | master passed |
+1 | javadoc | 0m 29s | master passed |
+1 | mvninstall | 0m 52s | the patch passed |
+1 | compile | 0m 41s | the patch passed |
+1 | javac | 0m 41s | the patch passed |
+1 | checkstyle | 0m 48s | the patch passed |
+1 | mvneclipse | 0m 15s | the patch passed |
+1 | whitespace | 0m 0s | The patch has no whitespace issues. |
+1 | hadoopcheck | 31m 51s | Patch does not cause any errors with Hadoop 2.6.1 2.6.2 2.6.3 2.6.4 2.6.5 2.7.1 2.7.2 2.7.3 or 3.0.0-alpha4. |
+1 | findbugs | 3m 4s | the patch passed |
+1 | javadoc | 0m 28s | the patch passed |
+1 | unit | 120m 55s | hbase-server in the patch passed. |
+1 | asflicense | 0m 21s | The patch does not generate ASF License warnings. |
169m 55s |
Subsystem | Report/Notes |
---|---|
Docker | Client=1.11.2 Server=1.11.2 Image:yetus/hbase:bdc94b1 |
JIRA Issue | |
JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12881536/HBASE-14135-v11.patch |
Optional Tests | asflicense javac javadoc unit findbugs hadoopcheck hbaseanti checkstyle compile |
uname | Linux e2ed64238b29 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26 18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
Build tool | maven |
Personality | /home/jenkins/jenkins-slave/workspace/PreCommit-HBASE-Build/component/dev-support/hbase-personality.sh |
git revision | master / 71a9a9a |
Default Java | 1.8.0_144 |
findbugs | v3.1.0-RC3 |
Test Results | https://builds.apache.org/job/PreCommit-HBASE-Build/8047/testReport/ |
modules | C: hbase-server U: hbase-server |
Console output | https://builds.apache.org/job/PreCommit-HBASE-Build/8047/console |
Powered by | Apache Yetus 0.4.0 http://yetus.apache.org |
This message was automatically generated.
Committed to master and branch-2.
Please do try to prioritize the work on HBASE-17614, vrodionov. We don't want to get into a position where this work holds up 2.0.0.
FAILURE: Integrated in Jenkins build HBase-2.0 #326 (See https://builds.apache.org/job/HBase-2.0/326/)
HBASE-14135 Merge backup images (Vladimir Rodionov) (elserj: rev 35aa7aae3a0d269d809416f6ff24599517f5b44b)
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupRestoreFactory.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupCommands.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupAdminImpl.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/util/BackupUtils.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceBackupMergeJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceRestoreJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/RestoreTablesClient.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/HBackupFileSystem.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupAdmin.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupInfo.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupMergeJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManifest.java
- (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/HFileSplitterJob.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceHFileSplitterJob.java
- (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestRepairAfterFailedDelete.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupDriver.java
- (add) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestIncrementalBackupMergeWithFailures.java
FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #3529 (See https://builds.apache.org/job/HBase-Trunk_matrix/3529/)
HBASE-14135 Merge backup images (Vladimir Rodionov) (elserj: rev 05e6e5695089640006d06c2f74126b50a73363b7)
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupCommands.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/util/BackupUtils.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceHFileSplitterJob.java
- (add) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestIncrementalBackupMergeWithFailures.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupDriver.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/HBackupFileSystem.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupMergeJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupInfo.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupAdmin.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceBackupMergeJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/RestoreTablesClient.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupRestoreFactory.java
- (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/HFileSplitterJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupAdminImpl.java
- (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestRepairAfterFailedDelete.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManifest.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceRestoreJob.java
FAILURE: Integrated in Jenkins build HBASE-14070.HLC #233 (See https://builds.apache.org/job/HBASE-14070.HLC/233/)
HBASE-14135 Merge backup images (Vladimir Rodionov) (elserj: rev 05e6e5695089640006d06c2f74126b50a73363b7)
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceRestoreJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManifest.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupMergeJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/util/BackupUtils.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupRestoreFactory.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/HBackupFileSystem.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupAdmin.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupInfo.java
- (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestRepairAfterFailedDelete.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceHFileSplitterJob.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupAdminImpl.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupCommands.java
- (delete) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/HFileSplitterJob.java
- (add) hbase-server/src/test/java/org/apache/hadoop/hbase/backup/TestIncrementalBackupMergeWithFailures.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/BackupDriver.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/RestoreTablesClient.java
- (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
- (add) hbase-server/src/main/java/org/apache/hadoop/hbase/backup/mapreduce/MapReduceBackupMergeJob.java
Moved to Phase 3.