Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3650

"Fetch Parquet Footer" times out for a seemingly small parquet files

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: Future
    • Component/s: Storage - Parquet
    • Labels:
      None

      Description

      running the following query in our internal (MapR) test cluster:

      select c_integer, sum(c_integer) over(partition by c_varchar order by c_integer) from j8 order by c_integer
      

      sometimes fails with the following error:

      java.sql.SQLException: RESOURCE ERROR: Waited for 15000ms, but tasks for 'Fetch Parquet Footers' are not complete. Total runnable size 7, parallelism 7.
      

      j8 table contains 8 parquet files that don't exceed 5KB each

        Issue Links

          Activity

          Hide
          adeneche Deneche A. Hakim added a comment -

          Another failure in our internal cluster seem to be quite similar to this issue:

          when running:

          select * from logs where dir0=2013 and dir1=6
          

          it fails with the following exception:

          java.sql.SQLException: RESOURCE ERROR: Waited for 30937ms, but tasks for 'Get block maps' are not complete. Total runnable size 33, parallelism 16.
          
          Show
          adeneche Deneche A. Hakim added a comment - Another failure in our internal cluster seem to be quite similar to this issue: when running: select * from logs where dir0=2013 and dir1=6 it fails with the following exception: java.sql.SQLException: RESOURCE ERROR: Waited for 30937ms, but tasks for 'Get block maps' are not complete. Total runnable size 33, parallelism 16.

            People

            • Assignee:
              Unassigned
              Reporter:
              adeneche Deneche A. Hakim
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Development