[HDFS-11273] Move TransferFsImage#doGetUrl function to a Util class - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.0.0-alpha2
Component/s: hdfs
Labels:
None

Target Version/s:

2.10.0
Hadoop Flags:

Reviewed

Description

TransferFsImage#doGetUrl downloads files from the specified url and stores them in the specified storage location. ~~HDFS-4025~~ plans to synchronize the log segments in JournalNodes. If a log segment is missing from a JN, the JN downloads it from another JN which has the required log segment. We need TransferFsImage#doGetUrl and TransferFsImage#receiveFile to accomplish this.
So we propose to move the said functions to a Utility class so as to be able to use it for JournalNode syncing as well, without duplication of code.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-11273.000.patch
22/Dec/16 21:36
20 kB
Hanisha Koneru
HDFS-11273.001.patch
04/Jan/17 19:47
21 kB
Hanisha Koneru
HDFS-11273.002.patch
04/Jan/17 23:39
23 kB
Hanisha Koneru
HDFS-11273.003.patch
07/Jan/17 00:08
28 kB
Hanisha Koneru
HDFS-11273.004.patch
09/Jan/17 21:11
36 kB
Hanisha Koneru
HDFS-11273-branch-2.001.patch
05/May/17 00:12
35 kB
Hanisha Koneru
HDFS-11273-branch-2.002.patch
09/Jan/19 03:52
35 kB
Siyao Meng
HDFS-11273-branch-2.003.patch
02/Aug/19 14:02
35 kB
Siyao Meng

Issue Links

blocks

HDFS-4025 QJM: Sychronize past log segments to JNs that missed them

Resolved

is a parent of

HDFS-14696 Backport HDFS-11273 to branch-2 (Move TransferFsImage#doGetUrl function to a Util class)

Resolved

Activity

People

Assignee:: Hanisha Koneru

Reporter:: Hanisha Koneru

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 22/Dec/16 21:22

Updated:: 02/Oct/19 17:15

Resolved:: 07/Aug/19 01:31