Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3866

Create ThreadLocal classloader per PigContext

    Details

    • Type: Wish
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.18.0
    • Component/s: impl
    • Labels:
      None

      Description

      For shared Hadoop environment, where there are large number of customers who submit PIG jobs for execution, it becomes very cumbersome to handle all support issue (ex providing access to CLI machine to every user, limiting user for submission etc).

      There is need to provide REST based interface for submitting PIG job/view PIG job status/view PIG request output, so that there is single entry point to cluster. With this, users are abstracted of Hadoop configuration and need to get access on machine. Also given it is hosted service, it is possible to provide rate limiting, QoS etc to user.

      We have designed such PIG self-service which provide REST APIs for all operations and this webapp runs under web container. In order to run multiple requests in same JVM, we need to create classloader per request thread.

        Attachments

        1. diff
          5 kB
          Ruchir

          Activity

            People

            • Assignee:
              r4_ruchir Ruchir
              Reporter:
              r4_ruchir Ruchir
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: