Uploaded image for project: 'Tajo'
  1. Tajo
  2. TAJO-717

Improve file splitting for large number of splits

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0, 0.9.0
    • Component/s: Storage
    • Labels:
      None

      Description

      In currently, The storageManager invoke the getFileBlockStorageLocations() per input path, it occurred too many rpc to the associated datanodes

      • reducing remote call to datanode

        Attachments

        1. TAJO-717.patch
          25 kB
          Jinho Kim
        2. TAJO-717_20140404_14:07:24.patch
          22 kB
          Jinho Kim
        3. TAJO-717_20140407_17:28:49.patch
          26 kB
          Jinho Kim

          Activity

            People

            • Assignee:
              jhkim Jinho Kim
              Reporter:
              jhkim Jinho Kim
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: