[KinoSearch] Re: Backtrace of segfault when building inverted index

[Edward Betts]

I tried again with r3550, it segfaulted after indexing a similar
number of documents, at least 4910000. Here is the backtrace:

Program received signal SIGSEGV, Segmentation fault.
[Switching to Thread -1210976064 (LWP 5187)]
0xb7dc5197 in memset () from /lib/i686/cmov/libc.so.6
(gdb) bt
#0  0xb7dc5197 in memset () from /lib/i686/cmov/libc.so.6
#1  0xb7ae05c6 in kino_VA_grow (self=0xbfe13290, capacity=94) at
../c_src/KinoSearch/Util/VArray.c:231
#2  0xb7ae26d0 in kino_TokenBatch_append (self=0xbfe13290,
token=0xbfe158b8) at ../c_src/h/KinoSearch/Util/VArray.h:331
#3  0xb7afb174 in kino_Tokenizer_tokenize_str (self=0x83793b8,
    string=0xbfe15ae8 "space-time organization in macromolecular
fluids : proceedings of the eleventh taniguchi international
symposium, hakone, japan, november 7-12, 1988 / f. tanaka, m. doi, t.
ohta, eds.", string_len=183, batch=0xbfe13290) at
../c_src/h/KinoSearch/Analysis/TokenBatch.h:342
#4  0xb7ae295c in kino_Tokenizer_transform (self=0x83793b8,
batch=0xbfe15a20) at ../c_src/h/KinoSearch/Analysis/Tokenizer.h:237
#5  0xb7ae22c5 in kino_PolyAnalyzer_transform_text (self=0x831cd68,
text=0x8402430) at ../c_src/h/KinoSearch/Analysis/Analyzer.h:197
#6  0xb7ae961e in kino_Inverter_add_field (self=0x8400d90,
fspec=0x83da938, field_name=0x816f8f8 "all", field_name_len=3,
    value=0xbfe15e48 "Space-time organization in macromolecular fluids
: proceedings of the eleventh Taniguchi International Symposium,
Hakone, Japan, November 7-12, 1988 / F. Tanaka, M. Doi, T. Ohta,
eds.", value_len=183) at ../c_src/h/KinoSearch/Analysis/Analyzer.h:207
#7  0xb7afb66c in kino_SegWriter_add_doc (self=0x83e1980,
doc=0x83e01c8) at ../c_src/h/KinoSearch/Index/Inverter.h:277
#8  0xb7a3f221 in XS_KinoSearch__Index__SegWriter_add_doc
(my_perl=0x8150008, cv=0x81dc2dc) at
../c_src/h/KinoSearch/Index/SegWriter.h:249
#9  0x080c0923 in Perl_pp_entersub ()
#10 0x080bf2fb in Perl_runops_standard ()
#11 0x0806721b in perl_run ()
#12 0x08063752 in main ()
(gdb)

-- 
Edward.