Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-12031

[C++][CSV] infer CSV timestamps columns with fractional seconds

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 4.0.0
    • C++

    Description

      After implementing fractional second parsing in and ARROW-9107 and ARROW-10337, no support for inference of subsecond timestamps was added (see [code]([https://github.com/apache/arrow/blob/master/cpp/src/arrow/csv/inference_internal.h#L115), also mentioned inĀ ARROW-3738).

      The InferState logic could test for TimestampNS (with nanosecond resolution) after Timestamps with second resolution to not change existing inference results.

      Wouldn't expect too much interest in trying to infer timestamps with milli- and microsecond resolution. The nanosecond resolution can already parse the lower resolution ones.

      Attachments

        Issue Links

          Activity

            People

              dawg Martin Nowak
              dawg Martin Nowak
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m