[CONNECTORS-1695] Sitemap xml not detected in version 2.17 webconnector

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: ManifoldCF 2.17
• Component/s: Web connector
• Assignee: Unassigned
• Reporter: DK
• Created: 24/Jan/22 16:41
• Updated: 25/Jan/22 21:24

Description

Trying to index sitemap xml and web connector index the whole xml into solr.

Please fix in version 2.17.

If it is any special config that needs to be taken care, please add here and add in documentation to make it clear.

 

Sitemap.xml:

<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<sitemap>
<loc>https://<url>/sitemap_1.xml</loc>
<lastmod>2022-01-21T16:04:45Z</lastmod>
</sitemap>

</sitemapindex>

 

sitemap_1.xml:

<urlset>
<url>
<loc>https://<docurl></loc>
<lastmod>2018-10-31T11:25:27Z</lastmod>
</url>
</urlset>