third_codes/cppjieba
1
0
Fork 0
mirror of https://github.com/yanyiwu/cppjieba.git synced 2025-07-18 00:00:12 +08:00
Code Issues Packages Projects Releases Wiki Activity

change multi user dicts seperator from ':' to '|;'

Browse Source
This commit is contained in:
yanyiwu 2015-12-09 00:01:27 +08:00
parent 0989dcb2c9
commit 8482bef442
3 changed files with 8 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
ChangeLog.md
View File

@ -1,5 +1,9 @@
# CppJieba ChangeLog
## v4.2.0
1. 修复[issue50]提到的多词典分隔符在Windows环境下存在的问题，从':'修改成'|'或';'。
## v4.1.2
1. 新增 Jieba::Locate 函数接口，作为计算分词结果的词语位置信息，在某些场景下有用，比如搜索结果高亮之类的。
@ -132,3 +136,4 @@
[Limonp]:http://github.com/yanyiwu/limonp.git
[Husky]:http://github.com/yanyiwu/husky.git
[issue50]:https://github.com/yanyiwu/cppjieba/issues/50

2
src/DictTrie.hpp
View File

@ -93,7 +93,7 @@ class DictTrie {
}
void LoadUserDict(const string& filePaths) {
vector<string> files = limonp::split(filePaths, ":");
vector<string> files = limonp::split(filePaths, "|;");
size_t lineno = 0;
for (size_t i = 0; i < files.size(); i++) {
ifstream ifs(files[i].c_str());

4
test/unittest/segments_test.cpp
View File

@ -108,7 +108,7 @@ TEST(MixSegmentTest, TestUserDict) {
TEST(MixSegmentTest, TestMultiUserDict) {
MixSegment segment("../test/testdata/extra_dict/jieba.dict.small.utf8", "../dict/hmm_model.utf8",
"../test/testdata/userdict.utf8:../test/testdata/userdict.2.utf8");
"../test/testdata/userdict.utf8;../test/testdata/userdict.2.utf8");
vector<string> words;
string res;
@ -225,7 +225,7 @@ TEST(QuerySegment, Test1) {
}
TEST(QuerySegment, Test2) {
QuerySegment segment("../test/testdata/extra_dict/jieba.dict.small.utf8", "../dict/hmm_model.utf8", "../test/testdata/userdict.utf8:../test/testdata/userdict.english", 3);
QuerySegment segment("../test/testdata/extra_dict/jieba.dict.small.utf8", "../dict/hmm_model.utf8", "../test/testdata/userdict.utf8|../test/testdata/userdict.english", 3);
{
const char* str = "小明硕士毕业于中国科学院计算所，后在日本京都大学深造";