Uploaded image for project: 'Ambari'
  1. Ambari
  2. AMBARI-12319

Views : S020 Data storage error for Hive view (Mysql db)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Error setting up a Hive view instance.

      The underlying issue is this ...

      Exception [EclipseLink-4002] (Eclipse Persistence Services - 2.5.2.v20140319-9ad6abd): org.eclipse.persistence.exceptions.DatabaseException
      Internal Exception: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Row size too large. The maximum row size for the used table type, not counting BLOBs, is 65535. You have to change some columns to TEXT or BLOBs
      Error Code: 1118
      Call: CREATE TABLE DS_JOBIMPL_6 (DS_id VARCHAR(255) NOT NULL, DS_applicationId VARCHAR(4000), DS_confFile VARCHAR(4000), DS_dagId VARCHAR(4000), DS_dagName VARCHAR(4000), DS_dataBase VARCHAR(4000), DS_dateSubmitted BIGINT, DS_duration BIGINT, DS_forcedContent VARCHAR(4000), DS_globalSettings VARCHAR(4000), DS_logFile VARCHAR(4000), DS_owner VARCHAR(4000), DS_queryFile VARCHAR(4000), DS_queryId VARCHAR(4000), DS_referrer VARCHAR(4000), DS_sessionTag VARCHAR(4000), DS_sqlState VARCHAR(4000), DS_status VARCHAR(4000), DS_statusDir VARCHAR(4000), DS_statusMessage VARCHAR(4000), DS_title VARCHAR(4000), PRIMARY KEY (DS_id))
      Query: DataModifyQuery(sql="CREATE TABLE DS_JOBIMPL_6 (DS_id VARCHAR(255) NOT NULL, DS_applicationId VARCHAR(4000), DS_confFile VARCHAR(4000), DS_dagId VARCHAR(4000), DS_dagName VARCHAR(4000), DS_dataBase VARCHAR(4000), DS_dateSubmitted BIGINT, DS_duration BIGINT, DS_forcedContent VARCHAR(4000), DS_globalSettings VARCHAR(4000), DS_logFile VARCHAR(4000), DS_owner VARCHAR(4000), DS_queryFile VARCHAR(4000), DS_queryId VARCHAR(4000), DS_referrer VARCHAR(4000), DS_sessionTag VARCHAR(4000), DS_sqlState VARCHAR(4000), DS_status VARCHAR(4000), DS_statusDir VARCHAR(4000), DS_statusMessage VARCHAR(4000), DS_title VARCHAR(4000), PRIMARY KEY (DS_id))")
      

      Unfortunately, the org.eclipse.persistence.tools.schemaframework makes the assumption that if an exception is thrown during table creation it just means that the table already exists and it is ignored.

      Need to see if there is a way to surface these exceptions and to adjust the default column size so that we don't exceed the MySQL total row size limit.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                tbeerbower Tom Beerbower
                Reporter:
                tbeerbower Tom Beerbower
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: