[HDFS-9651] All web UIs should include a robots.txt file - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.9.0, 3.0.0-alpha4
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

Similar to ~~HDFS-330~~. So that public UIs don't get crawled.

I can provide a patch that includes a simple robots.txt. Another alternative is probably a Filter that provides one automatically for all UIs but I don't have time to do that.

If anyone wants to take over please go ahead.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-9651.1.patch
14/Jan/16 16:42
0.9 kB
Lars Francke
HDFS-9651.2.patch
08/Feb/16 07:53
2 kB
Lars Francke

Issue Links

relates to

HDFS-12889 Router UI is missing robots.txt file

Resolved

Activity

People

Assignee:: Lars Francke

Reporter:: Lars Francke

Votes:: 0 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 14/Jan/16 16:26

Updated:: 25/Oct/19 20:27

Resolved:: 05/Apr/17 03:49