Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-2625

Fix ShuffleReadMetrics for NettyBlockFetcherIterator

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.0.0
    • None
    • Shuffle, Spark Core
    • None

    Description

      NettyBlockFetcherIterator doesn't report fetchWaitTime and has some race conditions where multiple threads can be incrementing bytes read at the same time.

      Attachments

        Activity

          People

            rxin Reynold Xin
            sandyr Sandy Ryza
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: