Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1715

Closeable API for broadcast tensors

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.10.2
    • None
    • None

    Description

      Spark has added explicit termination api for broadcasts in 1.1. So broadcast variables are now closeable by driver.

      Spark 1.2 seems to have done this change a bit moot since it is using reference queues to shut off broadcasts (and caches) automatically now.

      PR https://github.com/apache/mahout/pull/135

      Attachments

        Activity

          People

            dlyubimov Dmitriy Lyubimov
            dlyubimov Dmitriy Lyubimov
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: