Uploaded image for project: 'Daffodil'
  1. Daffodil
  2. DAFFODIL-1440

JAPI/SAPI DataProcessor should be serializable

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.0.0
    • 2.3.0
    • API
    • None

    Description

      Some tools, such as Apache Spark, may need to serialize the DataProcessor to be able to send it to cluster nodes. Although we have the save/reload functions to support serialization, apache spark doesn't know how to use those, and just serializes the DataProcessor. So the SAPI/JAPI DataProcessors (which wrap the real DataProcessors) must also be made serializable.

      Attachments

        Activity

          People

            slawrence Steve Lawrence
            slawrence Steve Lawrence
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: