[HDDS-4497] Recon File Size Count task throws SQL Exception.

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Component/s: Ozone Recon
• Labels: pull-request-available
• Assignee: Aravindan Vijayan
• Reporter: Aravindan Vijayan
• Created: 23/Nov/20 17:45
• Updated: 24/Nov/20 00:06
• Resolved: 24/Nov/20 00:06

Description

Caused by: org.jooq.exception.DataAccessException: SQL [insert into FILE_COUNT_BY_SIZE (volume, bucket, file_size, count) values (?, ?, ?, ?)]; [SQLITE_CONSTRAINT]  Abort due to constraint violation (UNIQUE constraint failed: FILE_COUNT_BY_SIZE.volume, FILE_COUNT_BY_SIZE.bucket, FILE_COUNT_BY_SIZE.file_size)
        at org.jooq_3.11.9.SQLITE.debug(Unknown Source)
        at org.jooq.impl.Tools.translate(Tools.java:2429)
        at org.jooq.impl.DefaultExecuteContext.sqlException(DefaultExecuteContext.java:832)
        at org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:364)
        at org.jooq.impl.TableRecordImpl.storeInsert0(TableRecordImpl.java:202)
        at org.jooq.impl.TableRecordImpl$1.operate(TableRecordImpl.java:173)
        at org.jooq.impl.RecordDelegate.operate(RecordDelegate.java:125)
        at org.jooq.impl.TableRecordImpl.storeInsert(TableRecordImpl.java:169)
        at org.jooq.impl.TableRecordImpl.insert(TableRecordImpl.java:157)
        at org.jooq.impl.TableRecordImpl.insert(TableRecordImpl.java:152)
        at org.jooq.impl.DAOImpl.insert(DAOImpl.java:175)
        at org.jooq.impl.DAOImpl.insert(DAOImpl.java:151)
        at org.apache.hadoop.ozone.recon.tasks.FileSizeCountTask.lambda$writeCountsToDB$0(FileSizeCountTask.java:209)
        at java.util.HashMap$KeySet.forEach(HashMap.java:933)
        at org.apache.hadoop.ozone.recon.tasks.FileSizeCountTask.writeCountsToDB(FileSizeCountTask.java:181)
        at org.apache.hadoop.ozone.recon.tasks.FileSizeCountTask.reprocess(FileSizeCountTask.java:100)
        at org.apache.hadoop.ozone.recon.tasks.ReconTaskControllerImpl.lambda$reInitializeTasks$3(ReconTaskControllerImpl.java:175)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        ... 3 more
Caused by: org.sqlite.SQLiteException: [SQLITE_CONSTRAINT]  Abort due to constraint violation (UNIQUE constraint failed: FILE_COUNT_BY_SIZE.volume, FILE_COUNT_BY_SIZE.bucket, FILE_COUNT_BY_SIZE.file_size)
        at org.sqlite.core.DB.newSQLException(DB.java:941)
        at org.sqlite.core.DB.newSQLException(DB.java:953)
        at org.sqlite.core.DB.execute(DB.java:854)
        at org.sqlite.core.DB.executeUpdate(DB.java:895)
        at org.sqlite.jdbc3.JDBC3PreparedStatement.executeUpdate(JDBC3PreparedStatement.java:102)
        at org.jooq.tools.jdbc.DefaultPreparedStatement.executeUpdate(DefaultPreparedStatement.java:99)
        at org.jooq.impl.AbstractDMLQuery.execute(AbstractDMLQuery.java:629)
        at org.jooq.impl.AbstractQuery.execute(AbstractQuery.java:350)
        ... 17 more

Issue Links

• links to: GitHub Pull Request #1612