Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9150

Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.3.0, 2.9.3
    • ATSv2
    • None
    • Reviewed

    Description

      Currently the TimelineSchemaCreator has a concrete implementation for creating Timeline Schema's only for HBase, Hence creating this JIRA for supporting multiple back-ends that ATSv2 can support.

      Usage:

             Add the following property in yarn-site.xml

      <!-- config required for specifying the TimelineSchemaCreator class for ATSv2-->
      <property>
       <name>yarn.timeline-service.schema-creator.class
       </name>
       <value>YOUR_TIMELINE_SCHEMA_CREATOR_CLASS</value> <!-- Default is org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineSchemaCreator-->
      </property>
      
      

          The Command needed to run the TimelineSchemaCreator need not be changed i.e the below existing command can be used irrespective of the backend configured.

      bin/hadoop org.apache.hadoop.yarn.server.timelineservice.storage.TimelineSchemaCreator -create
      

       

       

      Attachments

        1. jenkins_build.png
          491 kB
          Vrushali C
        2. YARN-9150.001.patch
          15 kB
          Sushil Ks
        3. YARN-9150.002.patch
          15 kB
          Sushil Ks
        4. YARN-9150-branch-2.001.patch
          14 kB
          Sushil Ks
        5. YARN-9150-branch-2.002.patch
          0.8 kB
          Sushil Ks
        6. YARN-9150-branch-2.003.patch
          15 kB
          Sushil Ks
        7. YARN-9150-branch-2.004.patch
          15 kB
          Sushil Ks
        8. YARN-9150-branch-2.patch
          14 kB
          Sushil Ks

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Sushil-K-S Sushil Ks
            Sushil-K-S Sushil Ks
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment