Apache Drill
  1. Apache Drill
  2. DRILL-722

Intermittent failures in TestParquetWriter

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: 0.5.0
    • Component/s: Storage - Parquet
    • Labels:
      None

      Description

      The problem seems to be that ParquetReader, when reading a Decimal28 or Decimal38 type, needs to zero-out the ByteBuf that the value is being written to.

      1. DRILL-722.patch
        9 kB
        Steven Phillips

        Activity

        Hide
        Aditya Kishore added a comment - - edited

        The other issue that I noticed is that ParquetRecordWriter.flush() can be called (via ParquetRecordWriter.cleanup()) which in turn calls w.startBlock(recordCount); without checking if recordCount > 0 and result in an exception.

        Show
        Aditya Kishore added a comment - - edited The other issue that I noticed is that ParquetRecordWriter.flush() can be called (via ParquetRecordWriter.cleanup() ) which in turn calls w.startBlock(recordCount); without checking if recordCount > 0 and result in an exception.
        Hide
        Jacques Nadeau added a comment -

        Can you please rebase this patch?

        Show
        Jacques Nadeau added a comment - Can you please rebase this patch?
        Hide
        Jason Altekruse added a comment -

        This has been invalidated by DRILL-730 to handle the root issue rather than zeroing out the whole vector in a bunch of places. This issue can be closed.

        Show
        Jason Altekruse added a comment - This has been invalidated by DRILL-730 to handle the root issue rather than zeroing out the whole vector in a bunch of places. This issue can be closed.

          People

          • Assignee:
            Jason Altekruse
            Reporter:
            Steven Phillips
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development