Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Query Processor
    • Labels:
      None

      Description

      Create pre task hooks for hive which can modify configuration parameters or task plans. This is very useful for implementing a number of different execution policies such as

      1. Sending jobs that work on small data sets to a different cluster.
      2. Sending jobs that work on archived data sets to a different cluster.

      etc.

      More details on the actual interfaces will follow soon.

      1. HIVE-1347.patch
        8 kB
        Ashish Thusoo

        Activity

        Hide
        Ashish Thusoo added a comment -

        A prelimnary patch for this. Take a look at the PreTask.java interface to look at the hook interface.

        Show
        Ashish Thusoo added a comment - A prelimnary patch for this. Take a look at the PreTask.java interface to look at the hook interface.
        Hide
        Namit Jain added a comment -

        TaskRunner contains the SessionState which contains the HiveConf, from where the user info is obtained.
        Since TaskRunner is being passed to the interface, you dont need to pass the user info explicitly

        Show
        Namit Jain added a comment - TaskRunner contains the SessionState which contains the HiveConf, from where the user info is obtained. Since TaskRunner is being passed to the interface, you dont need to pass the user info explicitly

          People

          • Assignee:
            Ashish Thusoo
            Reporter:
            Ashish Thusoo
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development