[KinoSearch] KSx-IndexManager 0.001

[Marvin Humphrey]

On Jul 2, 2007, at 8:12 AM, Hans Dieter Pearcey wrote:
> 0.002 has the eg/ directory in it.

Nice.

> Partition is for when you index e.g. by
> user, where users will never search each other's data.   
> MultiSearcher is for
> aggregation.

Before you aggregate with MultiSearcher, you have to distribute index  
writing.  That phase looks identical.

It's not a terribly hard problem to solve.  I think we need a HowTo,  
though... so I've started one.

   http://www.rectangular.com/kinosearch/wiki/ScalingUp

>   for my $user (@users) {
>     $mgr->context($user);
>     $mgr->append([ $user->get_new_docs ]); # adds to /index/<ID>
>   }

One issue with this architecture is that each InvIndexer consumes a  
fair amount of memory.

Marvin Humphrey
Rectangular Research
http://www.rectangular.com/