Export - CSV (All fields)
Export - CSV (Current fields)
NUTCH-1404
Nutch script fails to find job file in deploy modeNUTCH-1401
Upgrade to Hadoop 1.0.3
Remove developer -core option for bin/nutch
TestProtocolHttpClient fails
Upgrade to Tika 1.1
-force and -resume arguments being ignored in ParserJob
readdb -stats fires java.io.EOFException
NPE when reprUrl is null in ParseUtil
HostDb NullPointerException
speed up indexing by eliminating the indexreducerNUTCH-1364
Add a counter in Generator for malformed urls
Make parsing in FetcherJob actually work.
Fix error handling of urls with empty fields
Fix mishandling of malformed urls in generator job
Do not accept bogus arguments
ParseUtil use ExecutorService instead of manually thread handling.
nutchgora Configure minimum throughput for fetcher
nutchgora support fetcher.queue.depth.multiplier property
nutchgora DomainStatistics support crawlId, counter bug and reformatting
Improve regex urlfilters/normalizers synchronization
remove unused dependancy because of access restriction
Make batchId explcit within debug logging and improve CLI
Increase scalability by only removing markers when they actually exist for DbUpdaterReducer
Introduce AvroStore, DataFileAvroStore and Accumulo Datastore implementations
Nutchgora to send HTTP-accept header
Add response headers to datastore for the protocol-httpclient plugin
Improve formatting of ant targets for clearer project help
GeneratorMapper.java dosen't return when skipping and already generated mark
Pass numTasks to FetcherJob
nutchgora fetcher does not show correct 'threads' and 'resuming' properties
Better exception logging and debugging during fetch.
crawlId not supported by all Tools
In distributed mode URL's are not partitioned
Upgrade to hsqldb 2.2.8
language-identifier should have option to use detected value by Tika even when uncertain
Check if limit has been reached in GeneraterReducer must be the first check performance-wise.NUTCH-1276
Fix [dep-ann]
Fix errors @ compile time
[nutchgora] - update to work with gora-0.2-incubating
FetcherJob must put 'fetchTime' on input
Change ivy.xml of all plugins to remove "nutch.root" property
Improve javac arguements for more verbose output
Update NOTICE.txt to drop some copyrights
Add trivial comment to lib/native/README.txt
Upgrade gora modules to 0.2 in ivy/ivy.xml
Less verbose logging when unmapped mimetypes are trying to be parsed.
Update job should impose an upper limit on the number of inlinks (nutchgora)
Add '/runtime' to svn ignore
Port NUTCH-1102 to nutchgora - consistent use of fetcher.parse
add commented out default settings to gora.properties files