Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-6875 New aggregated log file format for YARN log aggregation.
  3. YARN-6877

Create an abstract log reader for extendability

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-beta1
    • None
    • None
    • Reviewed

    Description

      Currently, TFile log reader is used to read aggregated log in YARN. We need to add an abstract layer, and pick up the correct log reader based on the configuration.

      Attachments

        1. YARN-6877-branch-2.001.patch
          82 kB
          Xuan Gong
        2. YARN-6877-trunk.001.patch
          84 kB
          Xuan Gong
        3. YARN-6877-trunk.002.patch
          89 kB
          Xuan Gong
        4. YARN-6877-trunk.003.patch
          115 kB
          Xuan Gong
        5. YARN-6877-trunk.004.patch
          115 kB
          Xuan Gong
        6. YARN-6877-trunk.005.patch
          119 kB
          Xuan Gong
        7. YARN-6877-trunk.006.patch
          116 kB
          Xuan Gong
        8. YARN-6877-trunk.007.patch
          116 kB
          Xuan Gong
        9. YARN-6877-trunk.008.patch
          116 kB
          Xuan Gong
        10. YARN-6877-branch-2.002.patch
          115 kB
          Xuan Gong

        Issue Links

          breaks

          Sub-task - The sub-task of the issue YARN-7148 TestLogsCLI fails in trunk and branch-2 and javadoc error

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. YARN-7257 AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

          • Major - Major loss of function.
          • Resolved
          depends upon

          Sub-task - The sub-task of the issue YARN-6876 Create an abstract log writer for extendability

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue YARN-7072 Add a new log aggregation file format controller

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue YARN-7089 Mark the log-aggregation-controller APIs as public

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xgong Xuan Gong
              xgong Xuan Gong
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: