Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9802 YARN Timeline Service v2 (post GA features)
  3. YARN-4561

Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: timelineserver
    • Labels:

      Description

      YARN-4062 deals with the flush and compaction related coprocessor basic functionality. We also need to ensure we can turn compaction on/off as a whole (in case of dealing with production issues) as well as provide a way to allow for blacklisting and whitelisting of processing compaction for certain records.

      For instance, we may want to compact only those records which belong to applications in that datacenter. This way we donot interfere with hbase replication causing coprocessors to process the same record in more than one dc at the same time.

      Also, we might want to not compact/process certain records, perhaps whose rowkey matches a certain criteria.

      Filing jira to track these enhancements

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                vrushalic Vrushali C
                Reporter:
                vrushalic Vrushali C
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: