[Kinosearch] Beginner help with search strategy

[Jozo Radic]

Hello.

I'm planning to develop my first small search engine in KinoSearch, and I'm looking for some input on what the best way to approach it would be. Basically, I have a bunch of different "meta-groups" and each of them will have several categories of documents associated. For example, each group will have ~100 text documents, ~50 presentations, ~500 web pages of one type and ~1000 web pages of another type.

Search results will be primarily grouped by the "meta-groups", and scored by the combined hits in all document categories. Each "hit" in the result page will show the "meta-group" name and top hits in each of the categories. But, I also want to offer the possibility of using only one of the categories to sort the relevance of the queries (for example, user wants to search only the text documents associated with the 'meta-groups').

I was thinking of using a separate index for each category and combining the results of queries on these separate indexes. The only problem is with the pagination of such results, as I'd have to fetch all the hits each time for each query, in order to create the full result set (grouped by 'meta-group'). Is there another, more elegant way to approach this?

Thanks for any input. 



-- 
See Exclusive Video: Hollywood Life's 5th Annual Style Awards
http://www.hollywoodlife.net/Awards.aspx?AwardsID=style2008