Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-666 [Umbrella] Support rolling upgrades in YARN
  3. YARN-668

TokenIdentifier serialization should consider Unknown fields

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Incompatible change, Reviewed

      Description

      This would allow changing of the TokenIdentifier between versions. The current serialization is Writable. A simple way to achieve this would be to have a Proto object as the payload for TokenIdentifiers, instead of individual fields.

      TokenIdentifier continues to implement Writable to work with the RPC layer - but the payload itself is serialized using PB.

        Attachments

        1. YARN-668-demo.patch
          7 kB
          Junping Du
        2. YARN-668.patch
          83 kB
          Junping Du
        3. YARN-668-v2.patch
          95 kB
          Junping Du
        4. YARN-668-v3.patch
          97 kB
          Junping Du
        5. YARN-668-v4.patch
          97 kB
          Junping Du
        6. YARN-668-v5.patch
          68 kB
          Junping Du
        7. YARN-668-v6.patch
          71 kB
          Junping Du
        8. YARN-668-v7.patch
          73 kB
          Junping Du
        9. YARN-668-v8.patch
          72 kB
          Junping Du
        10. YARN-668-v9.patch
          73 kB
          Junping Du
        11. YARN-668-v10.patch
          71 kB
          Junping Du

          Issue Links

          blocks

          Sub-task - The sub-task of the issue YARN-2558 Updating ContainerTokenIdentifier#read/write to use ContainerId#getContainerId

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          breaks

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-6355 2.5 client cannot communicate with 2.5 job on 2.6 cluster

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-8310 Handle old NMTokenIdentifier, AMRMTokenIdentifier, and ContainerTokenIdentifier formats

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. YARN-2593 Many tests get failed on trunk

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-2615 ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

            Activity

              People

              • Assignee:
                djp Junping Du
                Reporter:
                sseth Siddharth Seth
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: