[HADOOP-18116] GCS connector in core-default.xml file missing

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.2.2
• Component/s: common, contrib/cloud

Environment

google cloud dataproc

• Target Version/s: 3.2.2
• Assignee: Unassigned
• Reporter: Ashish S Burkule
• Created: 08/Feb/22 11:19
• Updated: 08/Feb/22 11:55

Description

 

{{<property>
<name>fs.gs.impl</name>
<value>com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem</value>
<description>The FileSystem for gs: (GCS) uris.</description>
</property>
<property>
<name>fs.AbstractFileSystem.gs.impl</name>
<value>com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS</value>
<description>
The AbstractFileSystem for gs: (GCS) uris. Only necessary for use with Hadoop 2.
</description>
</property>}}

{{}}

these config are missing from core-default.xml which is present inside hadoop-common-3.2.2.jar file, which is causing the ssl enabled solr to not communicate with GCS.

{{}}

By adding these class in the jar file , we will be able to access the gcs directory as the connection between the connector and HDFS will be established.

{{}}

{{}}

{{}}

Issue Links

• duplicates: HADOOP-17402 Add GCS FS impl reference to core-default.xml