XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Implemented
    • Affects Version/s: 0.12.1
    • Fix Version/s: 0.12.2
    • Component/s: visiualization
    • Labels:
      None

      Description

      Need a function to convert a matrix to a tsv string which can then be plotted by

      • Zeppelin %table visualization packages
      • Passed to R / Python via Zeppelin Resource Manager

      It has been noted that a matrix can be registered as an RDD and passed across contexts directly in Spark, however this breaks the 'backend agnoistic' philosophy. Until H20 and Flink also both support Python / R environments it is more reasonable to use tab-seperated-value strings.

      Further, matrices might be extremely large and unfit for being directly converted to tsvs. It may be wise to introduce some sort of safety valve for preventing excessively large matrices from being materialized into local memory (eg. supposing the user hasn't called their own sampling method on a matrix).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                smarthi Suneel Marthi
                Reporter:
                rawkintrevo Trevor Grant
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: