[YARN-5095] flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: YARN-2928
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: timelineserver
• Labels: yarn-2928-1st-milestone
• Target Version/s: YARN-2928
• Hadoop Flags: Reviewed
• Assignee: Varun Saxena
• Reporter: Sangjin Lee
• Created: 16/May/16 23:07
• Updated: 21/Oct/17 06:06
• Resolved: 26/May/16 00:01

Description

I have the RM recovery enabled. I see that upon restart the RM populates records into flow activity and flow runs but with wrong timestamps. What I mean by the timestamp is the part of the row key:

• flow activity: row created with the day of the RM restart
• flow run: row created with the RM start time as the "run id"

The following illustrates an example flow run:

metrics: [ ],
events: [ ],
id: "sjlee@Sleep job/1463433569917",
type: "YARN_FLOW_RUN",
createdtime: 1463422860987,
info: {
UID: "yarn_cluster!sjlee!Sleep job!1463433569917",
SYSTEM_INFO_FLOW_RUN_ID: 1463433569917,
SYSTEM_INFO_FLOW_NAME: "Sleep job",
SYSTEM_INFO_FLOW_RUN_END_TIME: 1463422865033,
SYSTEM_INFO_USER: "sjlee"
},
isrelatedto: { },
relatesto: { }

The created time and the end time are correct (i.e. original time), whereas the timestamp in the row key (= run id: 1463433569917) is actually later than the end time and coincides with the RM restart.