211 Commits

Author SHA1 Message Date
Dingyuan Wang
14671d4feb fix __main__.py 2014-10-19 10:41:09 +08:00
Dingyuan Wang
b367690eeb use prefix dict instead of trie, add a command line interface, and a few small improvements 2014-10-19 10:32:23 +08:00
Dingyuan Wang
51df77831b use prefix dict instead of trie, add a command line interface, and a few small improvements 2014-10-18 22:23:26 +08:00
fxsjy
eb98eb9248 fix performance problem of extrag_tags 2014-10-10 15:41:28 +08:00
keroro520
77b442fa88 fix issues (https://github.com/fxsjy/jieba/issues/125) 2014-09-12 13:42:05 +08:00
Dingyuan Wang
626b415152 fix dict.itervalues mistake 2014-09-07 19:21:13 +08:00
Dingyuan Wang
6a3f228c72 fix python3 stuff 2014-09-07 18:50:10 +08:00
Dingyuan Wang
b16cf0d63f fix indent typo 2014-09-06 23:37:54 +08:00
Dingyuan Wang
6fad5fbb2c update to v0.33 2014-09-06 23:28:47 +08:00
Fukuball Lin
b658ee69cb 讓 jieba 可以自行增加 stop words 語料庫
1. 增加範例 stop words 語料庫
2. 為了讓 jieba 可以切換 stop words 語料庫,新增 set_stop_words 方法,並改寫 extract_tags
3. test 增加 extract_tags_stop_words.py 測試範例
2014-08-06 03:35:16 +08:00
Fukuball Lin
7198d562f1 讓 jieba 可以切換 idf 語料庫
1. 新增繁體中文 idf 語料庫
2. 為了讓 jieba 可以切換 iff 語料庫,新增 get_idf, set_idf_path 方法,並改寫 extract_tags
3. test 增加 extract_tags_idfpath
2014-08-05 22:55:13 +08:00
Dingyuan Wang
8b07bce568 fix the u'xxx' string. 2014-06-21 23:30:06 +08:00
Dingyuan Wang
c04ccd0d12 Update to v0.32 according to the master branch. 2014-06-14 22:31:13 +08:00
Dingyuan Wang
81f77d7a08 Fix the re in enable_parallel. 2014-06-14 15:22:13 +08:00
ShuraChow
7583f7760a fix issue #161
posseg每次根据jieba.user_word_tag_tab的长度判断是否有新词载入,如果有,则更新word_tag_tab,然后清空jieba.user_word_tag_tab
2014-06-10 02:04:09 +08:00
davidlihm
5b2ec920ed Update __init__.py 2014-05-15 07:55:11 +08:00
jagt
7f3513edb7 close cache file to avoid warning message. 2014-04-24 00:35:09 +08:00
wind
7488b114e7 use logging instead of print in init file 2014-03-20 13:48:33 +13:00
fxsjy
2682e887b8 Merge branch 'master' of https://github.com/fxsjy/jieba 2014-03-02 17:52:52 +08:00
fxsjy
9d4ac26f16 fix the bug of issue#137 2014-03-02 17:52:19 +08:00
Sun Junyi
3e430e9769 Update __init__.py 2014-02-16 20:09:57 +08:00
Honghe Wu
7720fbc1d8 fix a bug about can not import ChineseAnalyzer with change tab to 4 wihte spaces under PEP8 2014-02-15 19:32:29 +08:00
fxsjy
dafc73425e fix a little problem of dict.txt 2014-02-07 14:35:38 +08:00
fxsjy
7cc7e70843 Merge branch 'master' of https://github.com/fxsjy/jieba 2014-01-28 13:48:35 +08:00
fxsjy
18678d50c6 fix bug issue #132 2014-01-28 13:48:03 +08:00
aholic
e2c796088f better indent 2014-01-24 00:43:48 +08:00
fxsjy
5e6a2c4661 fix a bug of add_word 2013-12-05 13:35:40 +08:00
fxsjy
136676381a fix a bug of add_word 2013-12-05 13:33:24 +08:00
Herman Schaaf
95286b8887 Fix typo in error message 2013-10-21 22:21:09 +09:00
fxsjy
14a0ab0466 fix a bug in issue #111 2013-10-11 13:05:59 +08:00
fxsjy
759e1029c8 add an API to control log level: jieba.setLogLevel 2013-09-22 10:26:33 +08:00
Mozillazg
1cf3f0d00b use logging instead of print 2013-09-19 10:31:44 +08:00
gan
31d5845535 add better support for english. like input: 'this is interesting and interested me'-->output:'this interest interest',which 'interest' match 'interesting interested' 2013-09-09 11:54:30 +08:00
Sun Junyi
7e7fcc1184 add an option to disable HMM 2013-09-05 17:09:27 +08:00
fxsjy
21f7da0ca4 conver tab to spaces 2013-08-30 18:31:25 +08:00
fxsjy
c5bd9773d1 fix bug in issue #103 2013-08-30 18:26:53 +08:00
ZoeyYoung
25839b5127 fix bug 2013-08-21 19:46:14 +08:00
ZoeyYoung
d49542c06e fix bug 2013-08-21 19:31:12 +08:00
ZoeyYoung
dce353f88b merge from master 2013-08-21 15:32:46 +08:00
ZoeyYoung
2857ae45cc Merge branch 'master' into jieba3k
Conflicts:
	Changelog
	jieba/__init__.py
	jieba/finalseg/__init__.py
	jieba/posseg/__init__.py
	setup.py
	test/parallel/test_file.py
	test/test_file.py
2013-08-21 13:55:21 +08:00
gwdwyy
cc81135429 sed -i 's/not \(.*\) in/\1 not in/g' ... 2013-08-20 20:08:03 +08:00
Sun Junyi
90ab511deb fix the bug about issue: #92 2013-08-09 13:59:02 +08:00
fxsjy
b77645b3aa modify test_file.py; use less memory 2013-07-29 10:17:39 +08:00
fxsjy
ed1fa64e27 fix a bug. use sys.version_info.major can't be used in Python2.5 2013-07-29 10:07:55 +08:00
Sun Junyi
0f972df0ac raise exception in case of lower version 2013-07-29 10:01:47 +08:00
Sun Junyi
e68bb5a28e fix a compatibility problem;python2.5 has no 'multiprocessing'; 2013-07-29 09:57:09 +08:00
Sun Junyi
689e27280a Merge branch 'master' of https://github.com/fxsjy/jieba 2013-07-29 09:49:10 +08:00
Sun Junyi
9d87e798fd 0.31 release 2013-07-29 09:48:53 +08:00
Linker Lin
1dbc525dff 自动检测CPU数目,启动合适数目的进程。 2013-07-28 00:10:27 +08:00
fxsjy
8e9b4bbe72 fix the compatibility with Python2.5 2013-07-25 10:25:24 +08:00