Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
I don't think I've seen a non-trivial deployment where CellCounter can run without having to change the YARN/MR counter limits. It's always a pain.
We should make it so that the granularity of things CellCounter aggregates is configurable and make most of them opt-in so that we can stay under the default limit of counters when folks try the tool out. like < 100 of them.