Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2928 YARN Timeline Service v.2: alpha 1
  3. YARN-3904

Refactor timelineservice.storage to add support to online and offline aggregation writers

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: timelineserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      After we finished the design for time-based aggregation, we can adopt our existing Phoenix storage into the storage of the aggregated data. In this JIRA, I'm proposing to refactor writers to add support to aggregation writers. Offline aggregation writers typically has less contextual information. We can distinguish these writers by special naming. We can also use CollectorContexts to model all contextual information and use it in our writer interfaces.

        Attachments

        1. YARN-3904-YARN-2928.001.patch
          58 kB
          Li Lu
        2. YARN-3904-YARN-2928.002.patch
          59 kB
          Li Lu
        3. YARN-3904-YARN-2928.003.patch
          59 kB
          Li Lu
        4. YARN-3904-YARN-2928.004.patch
          73 kB
          Li Lu
        5. YARN-3904-YARN-2928.005.patch
          76 kB
          Li Lu
        6. YARN-3904-YARN-2928.006.patch
          65 kB
          Li Lu
        7. YARN-3904-YARN-2928.007.patch
          68 kB
          Li Lu
        8. YARN-3904-YARN-2928.008.patch
          68 kB
          Li Lu
        9. YARN-3904-YARN-2928.009.patch
          68 kB
          Li Lu

          Issue Links

            Activity

              People

              • Assignee:
                gtcarrera9 Li Lu
                Reporter:
                gtcarrera9 Li Lu
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: