XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Implemented
    • 0.12.1
    • 0.12.2
    • None
    • None

    Description

      Need a function to convert a matrix to a tsv string which can then be plotted by

      • Zeppelin %table visualization packages
      • Passed to R / Python via Zeppelin Resource Manager

      It has been noted that a matrix can be registered as an RDD and passed across contexts directly in Spark, however this breaks the 'backend agnoistic' philosophy. Until H20 and Flink also both support Python / R environments it is more reasonable to use tab-seperated-value strings.

      Further, matrices might be extremely large and unfit for being directly converted to tsvs. It may be wise to introduce some sort of safety valve for preventing excessively large matrices from being materialized into local memory (eg. supposing the user hasn't called their own sampling method on a matrix).

      Attachments

        Issue Links

          Activity

            People

              smarthi Suneel Marthi
              rawkintrevo Trevor Grant
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: