Currently in Spark we could get executor summary through REST API /api/v1/applications/<app-id>/executors. The format of executor summary is:
Here are 6 memory related fields: memoryUsed, maxMemory, onHeapMemoryUsed, offHeapMemoryUsed, maxOnHeapMemory, maxOffHeapMemory.
These all 6 fields reflects the storage memory usage in Spark, but from the name of this 6 fields, user doesn't really know it is referring to storage memory or the total memory (storage memory + execution memory). This will be misleading.
So I think we should properly rename these fields to reflect their real meanings. Or we should will document it.