Issue Details (XML | Word | Printable)

Key: LUCENE-831
Type: Improvement Improvement
Status: Open Open
Priority: Major Major
Assignee: Unassigned
Reporter: Hoss Man
Votes: 4
Watchers: 13
Operations

If you were logged in you would be able to see more operations.
Lucene - Java

Complete overhaul of FieldCache API/Implementation

Created: 14/Mar/07 07:25 AM   Updated: 11/Jun/09 09:32 AM
Return to search
Component/s: Search
Affects Version/s: None
Fix Version/s: 3.1

Time Tracking:
Not Specified

File Attachments:
  Size
Java Source File Licensed for inclusion in ASF works ExtendedDocument.java 2008-12-08 02:11 PM Robert Newson 16 kB
File Licensed for inclusion in ASF works fieldcache-overhaul.032208.diff 2008-03-22 09:13 PM Mark Miller 145 kB
File Licensed for inclusion in ASF works fieldcache-overhaul.diff 2007-06-04 03:39 AM Hoss Man 49 kB
File fieldcache-overhaul.diff 2007-03-14 07:27 AM Hoss Man 49 kB
Text File Licensed for inclusion in ASF works LUCENE-831-trieimpl.patch 2009-04-13 12:51 AM Uwe Schindler 8 kB
File Licensed for inclusion in ASF works LUCENE-831.03.28.2008.diff 2008-03-28 11:13 PM Mark Miller 202 kB
File Licensed for inclusion in ASF works LUCENE-831.03.30.2008.diff 2008-03-30 12:35 PM Mark Miller 216 kB
File Licensed for inclusion in ASF works LUCENE-831.03.31.2008.diff 2008-03-31 11:57 AM Mark Miller 245 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-16 12:22 AM Mark Miller 122 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-15 10:46 PM Mark Miller 122 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-13 03:14 PM Mark Miller 108 kB
Text File LUCENE-831.patch 2009-04-13 12:43 AM Mark Miller 105 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-12 11:16 PM Mark Miller 102 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-12 05:54 PM Mark Miller 85 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-12 03:39 PM Mark Miller 88 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2009-04-11 02:19 AM Mark Miller 142 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2008-12-06 02:10 PM Mark Miller 183 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2008-12-05 12:12 AM Mark Miller 183 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2008-12-04 11:38 PM Mark Miller 179 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2008-10-24 01:24 PM Mark Miller 174 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2008-08-23 07:15 PM Mark Miller 173 kB
Text File Licensed for inclusion in ASF works LUCENE-831.patch 2008-08-21 01:22 AM Mark Miller 157 kB
Issue Links:
Reference

Lucene Fields: New


 Description  « Hide
Motivation:
1) Complete overhaul the API/implementation of "FieldCache" type things...
a) eliminate global static map keyed on IndexReader (thus
eliminating synch block between completley independent IndexReaders)
b) allow more customization of cache management (ie: use
expiration/replacement strategies, disk backed caches, etc)
c) allow people to define custom cache data logic (ie: custom
parsers, complex datatypes, etc... anything tied to a reader)
d) allow people to inspect what's in a cache (list of CacheKeys) for
an IndexReader so a new IndexReader can be likewise warmed.
e) Lend support for smarter cache management if/when
IndexReader.reopen is added (merging of cached data from subReaders).
2) Provide backwards compatibility to support existing FieldCache API with
the new implementation, so there is no redundent caching as client code
migrades to new API.

 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Hoss Man made changes - 14/Mar/07 07:27 AM
Field Original Value New Value
Attachment fieldcache-overhaul.diff [ 12353253 ]
Hoss Man made changes - 04/Jun/07 03:39 AM
Attachment fieldcache-overhaul.diff [ 12358796 ]
Hoss Man made changes - 19/Jul/07 12:56 AM
Link This issue relates to LUCENE-743 [ LUCENE-743 ]
Otis Gospodnetic made changes - 27/Jul/07 12:07 AM
Comment [ Catching up with java-dev (just 300-400 more emails to go! ;)), I spotted this in "Lucene 2.2 soon" thread (Doron's email):

The part I am not sure of in this regard are my changes
to FieldCache and FieldcacheImpl, while LUCENE-831 is
ongoing too. (though btw 831 doesn't apply cleanly on
current trunk). (It is my plan to get into LUCENE-831
but I haven't got to it yet.)
]
Michael Busch made changes - 10/Jan/08 08:52 AM
Assignee Michael Busch [ michaelbusch ]
Michael Busch made changes - 01/Feb/08 10:12 PM
Description
Motivation:
1) Complete overhaul the API/implementation of "FieldCache" type things...
    a) eliminate global static map keyed on IndexReader (thus
        eliminating synch block between completley independent IndexReaders)
    b) allow more customization of cache management (ie: use
        expiration/replacement strategies, disk backed caches, etc)
    c) allow people to define custom cache data logic (ie: custom
        parsers, complex datatypes, etc... anything tied to a reader)
    d) allow people to inspect what's in a cache (list of CacheKeys) for
        an IndexReader so a new IndexReader can be likewise warmed.
    e) Lend support for smarter cache management if/when
        IndexReader.reopen is added (merging of cached data from subReaders).
2) Provide backwards compatibility to support existing FieldCache API with
    the new implementation, so there is no redundent caching as client code
    migrades to new API.

Motivation:
1) Complete overhaul the API/implementation of "FieldCache" type things...
    a) eliminate global static map keyed on IndexReader (thus
        eliminating synch block between completley independent IndexReaders)
    b) allow more customization of cache management (ie: use
        expiration/replacement strategies, disk backed caches, etc)
    c) allow people to define custom cache data logic (ie: custom
        parsers, complex datatypes, etc... anything tied to a reader)
    d) allow people to inspect what's in a cache (list of CacheKeys) for
        an IndexReader so a new IndexReader can be likewise warmed.
    e) Lend support for smarter cache management if/when
        IndexReader.reopen is added (merging of cached data from subReaders).
2) Provide backwards compatibility to support existing FieldCache API with
    the new implementation, so there is no redundent caching as client code
    migrades to new API.

Fix Version/s 2.4 [ 12312681 ]
Michael Busch made changes - 14/Mar/08 06:57 AM
Link This issue relates to LUCENE-1231 [ LUCENE-1231 ]
Mark Miller made changes - 22/Mar/08 09:13 PM
Attachment fieldcache-overhaul.032208.diff [ 12378441 ]
Mark Miller made changes - 28/Mar/08 11:13 PM
Attachment LUCENE-831.03.28.2008.diff [ 12378827 ]
Mark Miller made changes - 30/Mar/08 12:35 PM
Attachment LUCENE-831.03.30.2008.diff [ 12378895 ]
Mark Miller made changes - 31/Mar/08 11:57 AM
Attachment LUCENE-831.03.31.2008.diff [ 12378953 ]
Michael Busch made changes - 13/Aug/08 12:49 AM
Assignee Michael Busch [ michaelbusch ]
Mark Miller made changes - 15/Aug/08 11:18 AM
Fix Version/s 3.0 [ 12312889 ]
Fix Version/s 2.4 [ 12312681 ]
Mark Miller made changes - 21/Aug/08 01:22 AM
Attachment LUCENE-831.patch [ 12388649 ]
Mark Miller made changes - 23/Aug/08 07:15 PM
Attachment LUCENE-831.patch [ 12388801 ]
Mark Miller made changes - 24/Oct/08 01:24 PM
Attachment LUCENE-831.patch [ 12392789 ]
Mark Miller made changes - 04/Dec/08 11:38 PM
Attachment LUCENE-831.patch [ 12395349 ]
Mark Miller made changes - 05/Dec/08 12:12 AM
Attachment LUCENE-831.patch [ 12395351 ]
Mark Miller made changes - 06/Dec/08 02:10 PM
Attachment LUCENE-831.patch [ 12395488 ]
Robert Newson made changes - 08/Dec/08 02:11 PM
Attachment ExtendedDocument.java [ 12395557 ]
Uwe Schindler made changes - 02/Apr/09 12:07 PM
Link This issue is related to LUCENE-1582 [ LUCENE-1582 ]
Mark Miller made changes - 10/Apr/09 07:20 PM
Assignee Mark Miller [ markrmiller@gmail.com ]
Mark Miller made changes - 10/Apr/09 07:45 PM
Link This issue relates to LUCENE-1372 [ LUCENE-1372 ]
Mark Miller made changes - 11/Apr/09 02:19 AM
Attachment LUCENE-831.patch [ 12405217 ]
Mark Miller made changes - 12/Apr/09 03:39 PM
Attachment LUCENE-831.patch [ 12405274 ]
Mark Miller made changes - 12/Apr/09 05:54 PM
Attachment LUCENE-831.patch [ 12405278 ]
Mark Miller made changes - 12/Apr/09 11:16 PM
Attachment LUCENE-831.patch [ 12405290 ]
Mark Miller made changes - 13/Apr/09 12:43 AM
Attachment LUCENE-831.patch [ 12405291 ]
Uwe Schindler made changes - 13/Apr/09 12:51 AM
Attachment LUCENE-831-trieimpl.patch [ 12405292 ]
Mark Miller made changes - 13/Apr/09 03:14 PM
Attachment LUCENE-831.patch [ 12405325 ]
Mark Miller made changes - 15/Apr/09 10:46 PM
Attachment LUCENE-831.patch [ 12405589 ]
Mark Miller made changes - 16/Apr/09 12:22 AM
Attachment LUCENE-831.patch [ 12405596 ]
Mark Miller made changes - 12/May/09 03:10 AM
Assignee Mark Miller [ markrmiller@gmail.com ]
Michael McCandless made changes - 11/Jun/09 09:32 AM
Fix Version/s 3.0 [ 12312889 ]
Fix Version/s 3.1 [ 12314025 ]