Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2928 YARN Timeline Service v.2: alpha 1
  3. YARN-3411

[Storage implementation] explore & create the native HBase schema for writes

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • timelineserver
    • None
    • Reviewed

    Description

      There is work that's in progress to implement the storage based on a Phoenix schema (YARN-3134).

      In parallel, we would like to explore an implementation based on a native HBase schema for the write path. Such a schema does not exclude using Phoenix, especially for reads and offline queries.

      Once we have basic implementations of both options, we could evaluate them in terms of performance, scalability, usability, etc. and make a call.

      Attachments

        1. ATSv2BackendHBaseSchemaproposal.pdf
          259 kB
          Vrushali C
        2. YARN-3411.poc.txt
          28 kB
          Vrushali C
        3. YARN-3411.poc.2.txt
          37 kB
          Vrushali C
        4. YARN-3411.poc.3.txt
          41 kB
          Vrushali C
        5. YARN-3411.poc.4.txt
          41 kB
          Vrushali C
        6. YARN-3411.poc.5.txt
          47 kB
          Vrushali C
        7. YARN-3411.poc.6.txt
          46 kB
          Vrushali C
        8. YARN-3411.poc.7.txt
          49 kB
          Vrushali C
        9. YARN-3411-YARN-2928.001.patch
          49 kB
          Vrushali C
        10. YARN-3411-YARN-2928.002.patch
          49 kB
          Vrushali C
        11. YARN-3411-YARN-2928.003.patch
          56 kB
          Vrushali C
        12. YARN-3411-YARN-2928.004.patch
          56 kB
          Vrushali C
        13. YARN-3411-YARN-2928.005.patch
          56 kB
          Vrushali C
        14. YARN-3411-YARN-2928.006.patch
          57 kB
          Vrushali C
        15. YARN-3411-YARN-2928.007.patch
          58 kB
          Vrushali C

        Issue Links

          is related to

          Sub-task - The sub-task of the issue YARN-3706 Generalize native HBase writer for additional tables

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue YARN-3134 [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vrushalic Vrushali C
              sjlee0 Sangjin Lee
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: