Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: harchive
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Each HAR file system has two index files that contains information on how files are stored in the part files. During the block location calculation, these indexes are reread for every file in the archive. Caching the indexes and the status of the part files will greatly reduce the number of name node operations during the job setup time.

      1. MAPREDUCE-2459.1.patch
        15 kB
        Mac Yang
      2. MAPREDUCE-2459.2.patch
        16 kB
        Mac Yang

        Issue Links

          Activity

          Jason Lowe made changes -
          Link This issue is related to HADOOP-9757 [ HADOOP-9757 ]
          Jason Lowe made changes -
          Link This issue is duplicated by MAPREDUCE-865 [ MAPREDUCE-865 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Mahadev konar made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Mac Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Mac Yang made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Mac Yang made changes -
          Attachment MAPREDUCE-2459.2.patch [ 12479166 ]
          Mahadev konar made changes -
          Affects Version/s 0.23.0 [ 12315570 ]
          Fix Version/s 0.23.0 [ 12315570 ]
          Mahadev konar made changes -
          Affects Version/s 0.23.0 [ 12315570 ]
          Mac Yang made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Mac Yang made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-2459.1.patch [ 12477799 ]
          Mac Yang created issue -

            People

            • Assignee:
              Mac Yang
              Reporter:
              Mac Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development