[SEDONA-531] RDD spatial join in Python throws Not available error

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.1, 1.5.0, 1.5.1
• Fix Version/s: 1.5.2
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: Jia Yu
• Created: 09/Apr/24 05:39
• Updated: 28/Apr/24 08:22
• Resolved: 28/Apr/24 08:22

Description

I cannot longer access the fieldNames attribute of the resulting RDD. The following error appears:

´´´
AttributeError: Not available before 1.0.0 sedona version
´´´

This is interesting because the sedona version being used is not 1.0.0 but 1.4.1 or higher. Also this used to work without problem for previous versions of sedona.

I ran into this issue today migrating from sedona 1.4 to the latest one which deprecated the use of the SedonaRegistrator.

 

 

To reproduce:

 

Create a spatial_rdd and attempt to get the fieldNames attribute:

spatial_rdd = Adapter.toSpatialRdd(spatial_rdd.select('local_id','location'), 'location')
self.search_rdd.analyze()

print(f'showing spatial_rdd.fieldNames: {spatial_rdd.fieldNames}')

Issue Links

• duplicates: SEDONA-472 Adapter API no longer works with unshaded jar
• links to: GitHub Pull Request #1343