Details

    • Type: New Feature New Feature
    • Status: In Progress
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      HDFS is inefficient with large numbers of small files. Thus one might pack many small files into large, compressed, archives. But, for efficient map-reduce operation, it is desireable to be able to split inputs into smaller chunks, with one or more small original file per split. The zip format, unlike tar, permits enumeration of files in the archive without scanning the entire archive. Thus a zip InputFormat could efficiently permit splitting large archives into splits that contain one or more archived files.

        Activity

        No work has yet been logged on this issue.

          People

          • Assignee:
            indrajit
            Reporter:
            Doug Cutting
          • Votes:
            8 Vote for this issue
            Watchers:
            26 Start watching this issue

            Dates

            • Created:
              Updated:

              Development