I'm suffering from proxy servers that are caching some of the HttpResponses that Hadoop generates in servlets/JSP pages. While the web ui is up to date, some of my build files are failing to pull stuff down because that is going via proxy -it sees an error page rather than the data
- Every servlet should set a short expires header and disable caching, especially in proxies.
- JSP pages should do it to
- It's essential that error responses do it.
Maybe this could be done in a filter. Otherwise something like
Before anyone rushes to do this, we should consult some HTTP experts in Yahoo! or Facebook to get the options right. It may be best to have, say, a 1s lifespan on everything.