Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5663

Add an interface to Input/Ouput Formats to obtain delegation tokens

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      Currently, delegation tokens are obtained as part of the getSplits / checkOutputSpecs calls to the InputFormat / OutputFormat respectively.

      This works as long as the splits are generated on a node with kerberos credentials. For split generation elsewhere (AM for example), an explicit interface is required.

      Attachments

        1. MAPREDUCE-5663.patch.txt
          7 kB
          Michael Weng
        2. MAPREDUCE-5663.patch.txt2
          13 kB
          Michael Weng
        3. MAPREDUCE-5663.patch.txt3
          12 kB
          Michael Weng
        4. MAPREDUCE-5663.4.txt
          38 kB
          Siddharth Seth
        5. MAPREDUCE-5663.5.txt
          38 kB
          Siddharth Seth
        6. MAPREDUCE-5663.6.txt
          39 kB
          Siddharth Seth

        Activity

          People

            michaelweng Michael Weng
            sseth Siddharth Seth
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated: