Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: llap
    • Labels:
      None

      Description

      Currently we use a lot of thread local magic to make things work in llap. MRLegacyInput makes sure we use the same thread in input and processor. The execution spawns a new thread per fragment and kills it afterwards.

      That's being done because of Tez/MapredContext, ExecContext and IOContext. These need to be shared for a single fragment but not across.

      Way to clean this up is probably by creating a HiveInput that can handle the config + state sharing more efficiently than generic Tez code.

      cc Siddharth Seth Gopal Vijayaraghavan Vikram Dixit K

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                hagleitn Gunther Hagleitner
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: