Uploaded image for project: 'Ignite'
  1. Ignite
  2. IGNITE-4516

Hadoop: add optional gzip compression for shuffle output

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0
    • hadoop
    • None

    Description

      It was already implemented, but then reverted back due to performance drop. However, this feature might still be very useful because it decrease amount of heap memory required to store intermediate output for remote nodes.

      See commit 0062362.

      Attachments

        Issue Links

          Activity

            People

              vozerov Vladimir Ozerov
              vozerov Vladimir Ozerov
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: