Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2928 YARN Timeline Service v.2: alpha 1
  3. YARN-3411

[Storage implementation] explore & create the native HBase schema for writes

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: timelineserver
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      There is work that's in progress to implement the storage based on a Phoenix schema (YARN-3134).

      In parallel, we would like to explore an implementation based on a native HBase schema for the write path. Such a schema does not exclude using Phoenix, especially for reads and offline queries.

      Once we have basic implementations of both options, we could evaluate them in terms of performance, scalability, usability, etc. and make a call.

        Attachments

        1. ATSv2BackendHBaseSchemaproposal.pdf
          259 kB
          Vrushali C
        2. YARN-3411.poc.txt
          28 kB
          Vrushali C
        3. YARN-3411.poc.2.txt
          37 kB
          Vrushali C
        4. YARN-3411.poc.3.txt
          41 kB
          Vrushali C
        5. YARN-3411.poc.4.txt
          41 kB
          Vrushali C
        6. YARN-3411.poc.5.txt
          47 kB
          Vrushali C
        7. YARN-3411.poc.6.txt
          46 kB
          Vrushali C
        8. YARN-3411.poc.7.txt
          49 kB
          Vrushali C
        9. YARN-3411-YARN-2928.001.patch
          49 kB
          Vrushali C
        10. YARN-3411-YARN-2928.002.patch
          49 kB
          Vrushali C
        11. YARN-3411-YARN-2928.003.patch
          56 kB
          Vrushali C
        12. YARN-3411-YARN-2928.004.patch
          56 kB
          Vrushali C
        13. YARN-3411-YARN-2928.005.patch
          56 kB
          Vrushali C
        14. YARN-3411-YARN-2928.006.patch
          57 kB
          Vrushali C
        15. YARN-3411-YARN-2928.007.patch
          58 kB
          Vrushali C

          Issue Links

            Activity

              People

              • Assignee:
                vrushalic Vrushali C
                Reporter:
                sjlee0 Sangjin Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: