109 Commits

Author	SHA1	Message	Date
Sun Junyi	45daf561c7	follow PEP8: change tab to 4 white spaces	2013-07-03 16:58:22 +08:00
Sun Junyi	dbec3ad9df	add some comments	2013-07-01 11:20:56 +08:00
Sun Junyi	efc784312c	add ChineseAnalyzer for whoosh search engine	2013-07-01 10:53:39 +08:00
Sun Junyi	f08690a2df	add 'search mode' for jieba.tokenize	2013-06-28 12:04:16 +08:00
Sun Junyi	cb1b0499f7	unittest for jieba.tokenize	2013-06-24 16:20:04 +08:00
Sun Junyi	11a3b10755	new method: jieba.tokenize	2013-06-24 16:14:11 +08:00
Sun Junyi	ca97b19951	merge change from master	2013-06-23 22:28:32 +08:00
Sun Junyi	c0816b9bb0	more mixed words	2013-06-18 18:09:55 +08:00
Sun Junyi	c9e8da9e63	add more mix words to dict.txt	2013-06-18 14:10:36 +08:00
fxsjy	08bfabb9d7	Merge branch 'jieba3k' of https://github.com/fxsjy/jieba into jieba3k	2013-06-08 11:30:07 +08:00
fxsjy	be1686654d	merge master to jieba3k	2013-06-08 11:18:56 +08:00
fxsjy	0087a4e7e3	adjust prob_trans for better support of name entity; fix some bad cases	2013-06-07 13:59:36 +08:00
Sun Junyi	4300f79788	add a example of using sklearn+jieba	2013-05-17 09:35:12 +08:00
Sun Junyi	a8f902545c	fix some bad cases	2013-05-15 18:21:08 +08:00
cloudaice	9ee20a5293	add generator test	2013-05-11 22:50:30 +02:00
cloudaice	0c050b5eb2	add jieba.posseg test case	2013-05-11 17:40:43 +02:00
cloudaice	b0f9e6721e	添加cutall 测试用例	2013-05-11 17:40:43 +02:00
cloudaice	a7ff398edc	添加cut,set_dictionary,cut_for_search三个测试用例	2013-05-11 17:40:43 +02:00
cloudaice	667203a9ae	替换tab为空格，使用join代替循环	2013-05-11 17:40:43 +02:00
cloudaice	a2d2078465	将tab换成空格，使用is判断对象是否为None	2013-05-11 17:40:42 +02:00
cloudaice	e0434871eb	修改demo.py的代码格式，使得符合pep8规范	2013-05-11 17:40:42 +02:00
Sun Junyi	c1bf815343	update test case	2013-05-02 17:01:16 +08:00
Sun Junyi	0e833cd441	fix a bug in py3k test case	2013-04-28 19:40:24 +08:00
Sun Junyi	273996f7d4	fix a test script in jieba3k	2013-04-27 16:18:40 +08:00
fxsjy	aae91b6fb6	merge change from master to jieba3k	2013-04-27 16:04:16 +08:00
Sun Junyi	94d455b079	hot fix of cut_all=True	2013-04-27 10:23:01 +08:00
Sun Junyi	59d5d3b811	fix bug and change version	2013-04-27 09:45:39 +08:00
fxsjy	8666428fb0	fix a bug of changing dictionary	2013-04-26 16:47:00 +08:00
fxsjy	9bebe6120b	utf-8 output is more friendly to Linux	2013-04-26 16:19:00 +08:00
Sun Junyi	d3339633d5	in the speed test: initialize first to ignore the time of dict loading	2013-04-26 14:51:58 +08:00
fxsjy	bc049090a5	make lazy load thread safe	2013-04-26 12:54:05 +08:00
fxsjy	b46166f768	use CRLF as seperator to make chunks in parallel mode	2013-04-20 18:46:04 +08:00
fxsjy	6b83593b5a	rm stub.log	2013-04-20 14:13:10 +08:00
fxsjy	62cf22121f	new feature: parallel segment with multiprocessing	2013-04-20 14:11:31 +08:00
Sun Junyi	6da857b554	merge changes from master branch	2013-04-19 10:21:34 +08:00
Sun Junyi	8d89e8afda	handle 的	2013-04-19 10:02:33 +08:00
fxsjy	45591bb9ab	support flag '_'; ignore white space	2013-04-12 21:53:03 +08:00
Sun Junyi	c77823aa1d	merge improvement to Py3k branch	2013-04-12 14:58:25 +08:00
Sun Junyi	94ad7e7035	support decimal point	2013-04-08 09:53:04 +08:00
Sun Junyi	a383f035ba	support decimal point: example PI=3.141569 = > PI / = / 3.14159	2013-04-08 09:38:49 +08:00
Sun Junyi	8e49199993	keep punctuation marks	2013-04-05 21:48:36 +08:00
Sun Junyi	58c363655c	support user defined word tag	2013-03-25 17:28:37 +08:00
Sun Junyi	6cc0e95759	rm 1.log	2013-03-22 15:19:57 +08:00
Sun Junyi	d2634a049b	fix a bug in pypy	2013-03-22 15:16:47 +08:00
Sun Junyi	0f4f9067c3	fix bugs in jieba for py3k	2013-03-21 11:10:57 +08:00
Sun Junyi	06ebc6f71c	en-chn mix words in POS	2012-12-12 14:24:44 +08:00
Sun Junyi	a8ae0398b4	add one example	2012-12-12 13:40:22 +08:00
Sun Junyi	6517119110	remove 1.log	2012-12-12 11:04:35 +08:00
Sun Junyi	8c05efed68	remove tlbb.txt	2012-12-12 11:04:19 +08:00
Sun Junyi	379cd4933a	support en-chn mixed words, like B超	2012-12-12 11:03:29 +08:00