[SPARK-34938] Recover the interval case in the benchmark of ExtractBenchmark - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.2.0
Fix Version/s: 3.2.0
Component/s: Tests
Labels:
None

Description

Running benchmark: Invoke extract for interval
  Running case: cast to interval
21/04/02 10:40:01 INFO BlockManagerInfo: Removed broadcast_349_piece0 on 192.168.35.219:55076 in memory (size: 7.3 KiB, free: 434.4 MiB)
21/04/02 10:40:01 INFO BlockManagerInfo: Removed broadcast_348_piece0 on 192.168.35.219:55076 in memory (size: 7.3 KiB, free: 434.4 MiB)
21/04/02 10:40:01 INFO BlockManagerInfo: Removed broadcast_345_piece0 on 192.168.35.219:55076 in memory (size: 7.3 KiB, free: 434.4 MiB)
21/04/02 10:40:01 INFO BlockManagerInfo: Removed broadcast_346_piece0 on 192.168.35.219:55076 in memory (size: 7.3 KiB, free: 434.4 MiB)
21/04/02 10:40:01 INFO BlockManagerInfo: Removed broadcast_347_piece0 on 192.168.35.219:55076 in memory (size: 7.3 KiB, free: 434.4 MiB)
Exception in thread "main" org.apache.spark.sql.AnalysisException: cannot resolve 'subtractdates(CAST(timestamp_seconds(id) AS DATE), DATE '0001-01-01') + subtracttimestamps(timestamp_seconds(id), TIMESTAMP '1000-01-01 01:02:03.123456')' due to data type mismatch: argument 1 requires timestamp type, however, 'subtractdates(CAST(timestamp_seconds(id) AS DATE), DATE '0001-01-01')' is of day-time interval type.; line 1 pos 0;
'Project [unresolvedalias(cast(subtractdates(cast(timestamp_seconds(id#1400L) as date), 0001-01-01, false) + subtracttimestamps(timestamp_seconds(id#1400L), 1000-01-01 01:02:03.123456) as day-time interval), Some(org.apache.spark.sql.Column$$Lambda$1282/0x0000000800bd5040@5bff7f13))]
+- Range (1262304000, 1272304000, step=1, splits=Some(1))