Uploaded image for project: 'Tajo (Retired)'
  1. Tajo (Retired)
  2. TAJO-717

Improve file splitting for large number of splits

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0, 0.9.0
    • Storage
    • None

    Description

      In currently, The storageManager invoke the getFileBlockStorageLocations() per input path, it occurred too many rpc to the associated datanodes

      • reducing remote call to datanode

      Attachments

        1. TAJO-717.patch
          25 kB
          Jinho Kim
        2. TAJO-717_20140404_14:07:24.patch
          22 kB
          Jinho Kim
        3. TAJO-717_20140407_17:28:49.patch
          26 kB
          Jinho Kim

        Activity

          People

            jhkim Jinho Kim
            jhkim Jinho Kim
            Votes:
            0 Vote for this issue
            Watchers:
            3 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment