[SOLR-7383] DIH: rewrite XPathEntityProcessor/RSS example as the smallest good demo possible

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 5.0, 6.0
• Fix Version/s: 6.6, 7.0
• Component/s: contrib - DataImportHandler
• Assignee: Alexandre Rafalovitch
• Reporter: Upayavira
• Created: 13/Apr/15 11:51
• Updated: 25/May/17 17:13
• Resolved: 01/Apr/17 18:15

Description

The DIH example (solr/example/example-DIH/solr/rss/conf/rss-data-config.xml) is broken again. See associated issues.

Below is a config that should work.

This is caused by Slashdot seemingly oscillating between RDF/RSS and pure RSS. Perhaps we should depend upon something more static, rather than an external service that is free to change as it desires.

<dataConfig>
    <dataSource type="URLDataSource" />
    <document>
        <entity name="slashdot"
                pk="link"
                url="http://rss.slashdot.org/Slashdot/slashdot"
                processor="XPathEntityProcessor"
                forEach="/RDF/item"
                transformer="DateFormatTransformer">
				
            <field column="source" xpath="/RDF/channel/title" commonField="true" />
            <field column="source-link" xpath="/RDF/channel/link" commonField="true" />
            <field column="subject" xpath="/RDF/channel/subject" commonField="true" />
			
            <field column="title" xpath="/RDF/item/title" />
            <field column="link" xpath="/RDF/item/link" />
            <field column="description" xpath="/RDF/item/description" />
            <field column="creator" xpath="/RDF/item/creator" />
            <field column="item-subject" xpath="/RDF/item/subject" />
            <field column="date" xpath="/RDF/item/date" dateTimeFormat="yyyy-MM-dd'T'HH:mm:ss" />
            <field column="slash-department" xpath="/RDF/item/department" />
            <field column="slash-section" xpath="/RDF/item/section" />
            <field column="slash-comments" xpath="/RDF/item/comments" />
        </entity>
    </document>
</dataConfig>

Issue Links

• Is contained by: SOLR-10311 DIH examples: Umbrella case for minimal examples
• is related to: SOLR-4563 RSS DIH-example not working
• is related to: SOLR-2190 slashdot sample: xpath not match