ICU for Chinese crashes indexer

### Bug Description: When indexing content with chinese chars (it also has numbers and latin chars not just Chinese), the indexer crashes, see output below. This is the index definition: # Use ICU charset_table = non_cjk,chinese morphology = icu_chinese Not sure how to send you the text/content that crashes the indexer, I can see: "Current document: docid=9260," but unsure which document this would be. Let me know which further information may be needed to pinpoint the problem. Thanks Roberto Manticore 25.0.0 ce3c27828@26032712 (columnar 13.0.0 e60b083@26032708) (secondary 13.0.0 e60b083@26032708) (knn 13.0.0 e60b083@26032708) (embeddings 1.1.1 e60b083@26032708) Copyright (c) 2001-2016, Andrew Aksyonoff Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com) Copyright (c) 2017-2026, Manticore Software LTD (https://manticoresearch.com) using config file '/etc/manticoresearch/manticore.conf'... indexing table 'myhb_zh'... free(): invalid next size (fast) *** Oops, indexer crashed! Please send the following report to developers. Manticore 25.0.0 ce3c27828@26032712 (columnar 13.0.0 e60b083@26032708) (secondary 13.0.0 e60b083@26032708) (knn 13.0.0 e60b083@26032708) (embeddings 1.1.1 e60b083@26032708) -------------- report begins here --------------- Current document: docid=9260, hits=194810 Current batch: minid=0, maxid=0 Hit pool start: docid=0, hit=0 -------------- backtrace begins here --------------- Program compiled with Clang 16.0.6 Configured with flags: Configured with these definitions: -DDISTR_BUILD=jammy -DUSE_SYSLOG=1 -DWITH_GALERA=1 -DWITH_RE2=1 -DWITH_RE2_FORCE_STATIC=1 -DWITH_STEMMER=1 -DWITH_STEMMER_FORCE_STATIC=1 -DWITH_NLJSON=1 -DWITH_UNIALGO=1 -DWITH_ICU=1 -DWITH_ICU_FORCE_STATIC=1 -DWITH_JIEBA=1 -DWITH_SSL=1 -DWITH_ZLIB=1 -DWITH_ZSTD=1 -DDL_ZSTD=1 -DZSTD_LIB=libzstd.so.1 -DWITH_CURL=1 -DDL_CURL=1 -DCURL_LIB=libcurl.so.4 -DWITH_ODBC=1 -DDL_ODBC=1 -DODBC_LIB=libodbc.so.2 -DWITH_EXPAT=1 -DDL_EXPAT=1 -DEXPAT_LIB=libexpat.so.1 -DWITH_ICONV=1 -DWITH_MYSQL=1 -DDL_MYSQL=1 -DMYSQL_LIB=libmysqlclient.so.21 -DWITH_POSTGRESQL=1 -DDL_POSTGRESQL=1 -DPOSTGRESQL_LIB=libpq.so.5 -DLOCALDATADIR=/var/lib/manticore -DFULL_SHARE_DIR=/usr/share/manticore Built on Linux x86_64 (jammy) (cross-compiled) Stack bottom = 0x0, thread stack size = 0x20000 Trying system backtrace: begin of system symbols: /usr/bin/indexer(_Z12sphBacktraceib+0x227)[0x55f8e7795627] /usr/bin/indexer(_Z7sigsegvi+0xbb)[0x55f8e7639d3b] /lib/x86_64-linux-gnu/libc.so.6(+0x42520)[0x7f7b5193e520] /lib/x86_64-linux-gnu/libc.so.6(pthread_kill+0x12c)[0x7f7b519929fc] /lib/x86_64-linux-gnu/libc.so.6(raise+0x16)[0x7f7b5193e476] /lib/x86_64-linux-gnu/libc.so.6(abort+0xd3)[0x7f7b519247f3] /lib/x86_64-linux-gnu/libc.so.6(+0x89677)[0x7f7b51985677] /lib/x86_64-linux-gnu/libc.so.6(+0xa0cfc)[0x7f7b5199ccfc] /lib/x86_64-linux-gnu/libc.so.6(+0xa2a9d)[0x7f7b5199ea9d] /lib/x86_64-linux-gnu/libc.so.6(free+0x73)[0x7f7b519a1453] /usr/bin/indexer(_ZN16FieldFilterCJK_c5ApplyEPKhiRN3sph8Vector_TIhNS2_13DefaultCopy_TIhEENS2_14DefaultRelimitENS2_16DefaultStorage_TIhEEEEb+0x202)[0x55f8e8871292] /usr/bin/indexer(_ZN10CSphSource15IterateDocumentERbR10CSphString+0x7f4)[0x55f8e879b1b4] /usr/bin/indexer(_ZN13CSphIndex_VLN5BuildERKN3sph8Vector_TIP10CSphSourceNS0_13DefaultCopy_TIS3_EENS0_14DefaultRelimitENS0_16DefaultStorage_TIS3_EEEEiiR17CSphIndexProgress+0xe0f)[0x55f8e7681d2f] /usr/bin/indexer(_Z7DoIndexRK17CSphConfigSectionPKcRK15CSphOrderedHashIS_10CSphString15CSphStrHashFuncLi256EEP8_IO_FILE+0x1dfd)[0x55f8e7637b5d] /usr/bin/indexer(main+0x26ea)[0x55f8e763cb1a] /lib/x86_64-linux-gnu/libc.so.6(+0x29d90)[0x7f7b51925d90] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80)[0x7f7b51925e40] /usr/bin/indexer(_start+0x25)[0x55f8e762eed5] Trying boost backtrace: 0# sphBacktrace(int, bool) in /usr/bin/indexer 1# sigsegv(int) in /usr/bin/indexer 2# 0x00007F7B5193E520 in /lib/x86_64-linux-gnu/libc.so.6 3# pthread_kill in /lib/x86_64-linux-gnu/libc.so.6 4# raise in /lib/x86_64-linux-gnu/libc.so.6 5# abort in /lib/x86_64-linux-gnu/libc.so.6 6# 0x00007F7B51985677 in /lib/x86_64-linux-gnu/libc.so.6 7# 0x00007F7B5199CCFC in /lib/x86_64-linux-gnu/libc.so.6 8# 0x00007F7B5199EA9D in /lib/x86_64-linux-gnu/libc.so.6 9# free in /lib/x86_64-linux-gnu/libc.so.6 10# FieldFilterCJK_c::Apply(unsigned char const*, int, sph::Vector_T<unsigned char, sph::DefaultCopy_T<unsigned char>, sph::DefaultRelimit, sph::DefaultStorage_T<unsigned char> >&, bool) in /usr/bin/indexer 11# CSphSource::IterateDocument(bool&, CSphString&) in /usr/bin/indexer 12# CSphIndex_VLN::Build(sph::Vector_T<CSphSource*, sph::DefaultCopy_T<CSphSource*>, sph::DefaultRelimit, sph::DefaultStorage_T<CSphSource*> > const&, int, int, CSphIndexProgress&) in /usr/bin/indexer 13# DoIndex(CSphConfigSection const&, char const*, CSphOrderedHash<CSphConfigSection, CSphString, CSphStrHashFunc, 256> const&, _IO_FILE*) in /usr/bin/indexer 14# main in /usr/bin/indexer 15# 0x00007F7B51925D90 in /lib/x86_64-linux-gnu/libc.so.6 16# __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6 17# _start in /usr/bin/indexer 0# sphBacktrace(int, bool) in /usr/bin/indexer 1# sigsegv(int) in /usr/bin/indexer 2# 0x00007F7B5193E520 in /lib/x86_64-linux-gnu/libc.so.6 3# pthread_kill in /lib/x86_64-linux-gnu/libc.so.6 4# raise in /lib/x86_64-linux-gnu/libc.so.6 5# abort in /lib/x86_64-linux-gnu/libc.so.6 6# 0x00007F7B51985677 in /lib/x86_64-linux-gnu/libc.so.6 7# 0x00007F7B5199CCFC in /lib/x86_64-linux-gnu/libc.so.6 8# 0x00007F7B5199EA9D in /lib/x86_64-linux-gnu/libc.so.6 9# free in /lib/x86_64-linux-gnu/libc.so.6 10# FieldFilterCJK_c::Apply(unsigned char const*, int, sph::Vector_T<unsigned char, sph::DefaultCopy_T<unsigned char>, sph::DefaultRelimit, sph::DefaultStorage_T<unsigned char> >&, bool) in /usr/bin/indexer 11# CSphSource::IterateDocument(bool&, CSphString&) in /usr/bin/indexer 12# CSphIndex_VLN::Build(sph::Vector_T<CSphSource*, sph::DefaultCopy_T<CSphSource*>, sph::DefaultRelimit, sph::DefaultStorage_T<CSphSource*> > const&, int, int, CSphIndexProgress&) in /usr/bin/indexer 13# DoIndex(CSphConfigSection const&, char const*, CSphOrderedHash<CSphConfigSection, CSphString, CSphStrHashFunc, 256> const&, _IO_FILE*) in /usr/bin/indexer 14# main in /usr/bin/indexer 15# 0x00007F7B51925D90 in /lib/x86_64-linux-gnu/libc.so.6 16# __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6 17# _start in /usr/bin/indexer ### Manticore Search Version: 25 ### Operating System Version: Ubuntu 22.04 ### Have you tried the latest development version? No ### Internal Checklist: ^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.} <details> - [ ] Implementation completed - [ ] Tests developed - [ ] Documentation updated - [ ] Documentation reviewed </details>