[ARROW-7384] [Website] Fix search indexing warning reported by Google

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Website
• External issue URL: https://github.com/apache/arrow/issues/23660
• Assignee: Uwe Korn
• Reporter: Wes McKinney
• Created: 12/Dec/19 23:17
• Updated: 11/Jan/23 07:53
• Resolved: 27/Sep/20 20:30

Description

I received the following e-mail from Google regarding arrow.apache.org (since I'm an admin on the Analytics account)

Top Warnings

Warnings are suggestions for improvement. Some warnings can affect your appearance on Search; some might be reclassified as errors in the future. The following warnings were found on your site:

Indexed, though blocked by robots.txt

We recommend that you fix these issues when possible to enable the best experience and coverage in Google Search.