Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2468 Netty-based block server / client module
  3. SPARK-2959

Use a single FileClient and Netty client thread pool

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • None
    • None

    Description

      The current implementation creates a new Netty bootstrap for fetching each block. This is pretty crazy!

      We should reuse the bootstrap FileClient.

      Attachments

        Issue Links

          links to

          Web Link Github pull request

          Activity

            People

              rxin Reynold Xin
              rxin Reynold Xin
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: