Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9698 [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler
  3. YARN-10135

FS-CS converter tool: issue warning on dynamic auto-create mapping rules

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
    • Hadoop Flags:
      Reviewed

      Description

      The converter tool should issue a warning whenever the conversion results in mapping rules similar to these:

      u:%user:[managedParentQueueName].[queueName]

      u:%user:[managedParentQueueName].%user

      u:%user:[managedParentQueueName].%primary_group

      u:%user:[managedParentQueueName].%secondary_group

      u:%user:%primary_group.%user

      u:%user:%secondary_group.%user

      u:%user:[managedParentQueuePath].%user

       

      The reason is that right now it's fully clear how we'll handle a case like "u:%user:%primary_group.%user", where "%primary_group.%user" might result in something like "users.john". 

      In case of "u:%user:[managedParentQueuePath].%user" , the [managedParentQueuePath] is a result of a full path from Fair Scheduler. Therefore it's not going to be a leaf queue. 

      The user might be required to do some fine tuning and adjust the property "auto-create-child-queues". We should display a warning about these additional steps.

       

       

        Attachments

        1. YARN-10135-001.patch
          8 kB
          Peter Bacsko
        2. YARN-10135-002.patch
          8 kB
          Peter Bacsko

          Activity

            People

            • Assignee:
              pbacsko Peter Bacsko
              Reporter:
              pbacsko Peter Bacsko
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: