[HDFS-12591] [READ] Implement LevelDBFileRegionFormat - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.1.0
Component/s: hdfs
Labels:
None

Hadoop Flags:

Reviewed

Description

The existing work for ~~HDFS-9806~~ uses an implementation of the FileRegion read from a csv file. This is good for testability and diagnostic purposes, but it is not very efficient for larger systems.

There should be a version that is similar to the TextFileRegionFormat that instead uses LevelDB.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-12591-HDFS-9806.001.patch
04/Oct/17 20:23
25 kB
Ewan Higgs
HDFS-12591-HDFS-9806.002.patch
06/Oct/17 20:54
16 kB
Virajith Jalaparti
HDFS-12591-HDFS-9806.003.patch
20/Oct/17 14:19
16 kB
Ewan Higgs
HDFS-12591-HDFS-9806.004.patch
01/Dec/17 03:00
15 kB
Virajith Jalaparti
HDFS-12591-HDFS-9806.005.patch
01/Dec/17 18:39
15 kB
Virajith Jalaparti
HDFS-12591-HDFS-9806.006.patch
02/Dec/17 02:11
14 kB
Virajith Jalaparti
HDFS-12591-HDFS-9806.007.patch
02/Dec/17 04:25
14 kB
Christopher Douglas

Issue Links

depends upon

HDFS-11902 [READ] Merge BlockFormatProvider and FileRegionProvider.

Resolved

HDFS-12665 [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

Resolved

Activity

People

Assignee:: Ewan Higgs

Reporter:: Ewan Higgs

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 04/Oct/17 20:22

Updated:: 18/Dec/17 19:16

Resolved:: 02/Dec/17 20:22