Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4171

Python BigQuery source fails for timestamps < year 1900

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: sdk-py-core
    • Labels:
      None

      Description

      This seems to be due to Python SDK using 'date.strftime' which has a known limitation.

      https://bugs.python.org/issue1777412

      This has been fixed for Python 3.3+ 

       

      We might want to consider one of the workaround mentioned in the below post to fix BQ for Python 2.7.

      https://stackoverflow.com/questions/10263956/use-datetime-strftime-on-years-before-1900-require-year-1900

       

      This affects both Direct and Dataflow runners.

       

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              chamikara Chamikara Jayalath
            • Votes:
              1 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: