Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
-
None
-
HADOOP-4947use regex to parse chukwa commands but there's an error in the regex
the current regex is:
Pattern addCmdPattern = Pattern.compile("[aA][dD][dD]\\s+(\\S+)\\s+(\\S+)\\s+(.\\S)?\\s(\\d+)
s*");
does not correctly parsed this valid checkpoint entry:
"ADD org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped Syslog 0 /var/log/messages 114027"
Parsing result:
adaptorName org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped
dataType Syslog
params 0 /var/log/messages 11402
offset 7Instead of:
adaptorName org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped
dataType Syslog
params 0 /var/log/messages
offset 114027The correct regex is: "[aA][dD][dD]\\s+(\\S+)\\s+(\\S+)\\s+(.\\s)?\\s(\\d+)
s*"
Example of parsing: "ADD org.apache.hadoop.chukwa.datacollection.adaptor.MySpecificAdaptor Syslog 0 my param1 param2 /var/log/messages 114027";
Parsing result:
adaptorName org.apache.hadoop.chukwa.datacollection.adaptor.MySpecificAdaptor
dataType Syslog
params 0 my param1 param2 /var/log/messages
offset 114027HADOOP-4947 use regex to parse chukwa commands but there's an error in the regex the current regex is: Pattern addCmdPattern = Pattern.compile(" [aA] [dD] [dD] \\s+(\\S+)\\s+(\\S+)\\s+(. \\S)?\\s (\\d+) s*"); does not correctly parsed this valid checkpoint entry: "ADD org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped Syslog 0 /var/log/messages 114027" Parsing result: adaptorName org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped dataType Syslog params 0 /var/log/messages 11402 offset 7 Instead of: adaptorName org.apache.hadoop.chukwa.datacollection.adaptor.filetailer.CharFileTailingAdaptorUTF8NewLineEscaped dataType Syslog params 0 /var/log/messages offset 114027 The correct regex is: " [aA] [dD] [dD] \\s+(\\S+)\\s+(\\S+)\\s+(. \\s)?\\s (\\d+) s*" Example of parsing: "ADD org.apache.hadoop.chukwa.datacollection.adaptor.MySpecificAdaptor Syslog 0 my param1 param2 /var/log/messages 114027"; Parsing result: adaptorName org.apache.hadoop.chukwa.datacollection.adaptor.MySpecificAdaptor dataType Syslog params 0 my param1 param2 /var/log/messages offset 114027
-
Reviewed
-
Attachments
Attachments
Issue Links
- blocks
-
HADOOP-5036 chukwa agent controller remove file does not work
-
- Closed
-
- is blocked by
-
HADOOP-5138 Current Chukwa Trunk failed contrib unit tests.
-
- Closed
-