Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9802 YARN Timeline Service v2 (post GA features)
  3. YARN-4561

Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • timelineserver

    Description

      YARN-4062 deals with the flush and compaction related coprocessor basic functionality. We also need to ensure we can turn compaction on/off as a whole (in case of dealing with production issues) as well as provide a way to allow for blacklisting and whitelisting of processing compaction for certain records.

      For instance, we may want to compact only those records which belong to applications in that datacenter. This way we donot interfere with hbase replication causing coprocessors to process the same record in more than one dc at the same time.

      Also, we might want to not compact/process certain records, perhaps whose rowkey matches a certain criteria.

      Filing jira to track these enhancements

      Attachments

        Issue Links

          Activity

            People

              vrushalic Vrushali C
              vrushalic Vrushali C
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: