Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-135 Let there be hive
  3. TEZ-182

Can I has API to attach configuration to Vertices and Edges?

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.2.0
    • None

    Description

      Hive as well as other Apps are going to have to ship configuration to the actual Processors.

      The requested API would let you attach (static) data to each vertex and edge as well as the DAG itself at the time the DAG is assembled. The expectation is that the Processor has a structured way to retrieve that data for itself (the vertex) any edge connected to it as well as the overall "DAG" config.

      The shape of the configuration could be anything. At a minimum having a byte buffer would be sufficient (up to the app what serialization to use for the config).

      Attachments

        1. TEZ-182_outline.txt
          35 kB
          Siddharth Seth
        2. TEZ-182.2.txt
          50 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              hagleitn Gunther Hagleitner
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: