[CHUKWA-324] MetricsDataLoader should handle chukwa record with 0 matched fields

• Type: Improvement
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.2.0
• Fix Version/s: 0.2.0
• Component/s: Data Processors

Release Note

CHUKWA-324. For 0 matched field, changed MDL to skip empty SQL statement. (Eric Yang)

• Assignee: Eric Yang
• Reporter: Eric Yang
• Created: 22/Jun/09 17:27
• Updated: 23/Jun/09 15:41
• Resolved: 22/Jun/09 21:38

Description

As seen from postProcess.log:

2009-06-22 12:01:17,946 TRACE pool-1-thread-2 MetricDataLoader - INSERT INTO mr_job_2059_week SET ON DUPLICATE KEY
UPDATE ;
2009-06-22 12:01:25,957 ERROR pool-1-thread-2 MetricDataLoader - java.sql.BatchUpdateException: You have an error in
your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'ON
DUPLICATE KEY UPDATE' at line 1
java.sql.BatchUpdateException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL
server version for the right syntax to use near 'ON DUPLICATE KEY UPDATE' at line 1
at com.mysql.jdbc.StatementImpl.executeBatch(StatementImpl.java:1007)
at org.apache.hadoop.chukwa.dataloader.MetricDataLoader.run(MetricDataLoader.java:484)
at org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:561)
at org.apache.hadoop.chukwa.dataloader.MetricDataLoader.call(MetricDataLoader.java:50)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
2009-06-22 12:01:25,957 ERROR pool-1-thread-2 MetricDataLoader - SQLException: You have an error in your SQL syntax;
check the manual that corresponds to your MySQL server version for the right syntax to use near 'ON DUPLICATE KEY
UPDATE' at line 1

In this case, MDL should skip the record.