Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3635

IllegalArgumentException - not a Parquet file (too small)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.1.0
    • Fix Version/s: 1.2.0
    • Labels:
      None
    • Environment:

      Test framework

      Description

      The (MapR internal) regression suite is sporadically seeing this error:

      /root/private-sql-hadoop-test/framework/resources/Precommit/Functional/ctas_flatten/100000rows/filter4.q
      Query:
      select * from dfs.ctas_flatten.`filter4_100000rows_ctas`
      Failed with exception
      java.sql.SQLException: SYSTEM ERROR: IllegalArgumentException: maprfs:///drill/testdata/ctas_flatten/filter4_100000rows_ctas/0_0_0.parquet is not a Parquet file (too small)

      [Error Id: 9749d6a7-685d-4663-9b27-1a456a5dec40 on drillats3.qa.lab:31010]
      at org.apache.drill.jdbc.impl.DrillCursor.nextRowInternally(DrillCursor.java:244)
      at org.apache.drill.jdbc.impl.DrillCursor.loadInitialSchema(DrillCursor.java:287)
      at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:1362)
      at org.apache.drill.jdbc.impl.DrillResultSetImpl.execute(DrillResultSetImpl.java:72)
      at net.hydromatic.avatica.AvaticaConnection.executeQueryInternal(AvaticaConnection.java:404)
      at net.hydromatic.avatica.AvaticaStatement.executeQueryInternal(AvaticaStatement.java:351)
      at net.hydromatic.avatica.AvaticaStatement.executeQuery(AvaticaStatement.java:78)
      at org.apache.drill.jdbc.impl.DrillStatementImpl.executeQuery(DrillStatementImpl.java:96)
      at org.apache.drill.test.framework.DrillTestJdbc.executeQuery(DrillTestJdbc.java:144)
      at org.apache.drill.test.framework.DrillTestJdbc.run(DrillTestJdbc.java:83)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
      at java.util.concurrent.FutureTask.run(FutureTask.java:262)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:744)
      Caused by: org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: IllegalArgumentException: maprfs:///drill/testdata/ctas_flatten/filter4_100000rows_ctas/0_0_0.parquet is not a Parquet file (too small)

      It doesn't happen every time, but based on looking at log files, it seems to happen more than half the time.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                cchang@maprtech.com Chun Chang
                Reporter:
                cwestin Chris Westin
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: