mirror of
https://github.com/fxsjy/jieba.git
synced 2025-07-10 00:01:33 +08:00
Merge branch 'master' of https://github.com/fxsjy/jieba
This commit is contained in:
commit
7337c6d420
@ -120,11 +120,11 @@ Output:
|
||||
|
||||
功能 5) : 并行分词
|
||||
==================
|
||||
* 将目标文本按行分隔后,把各行文本分配到多个python进程并行分词,然后归并结果,从而获得分词速度的可观提升
|
||||
* 原理:将目标文本按行分隔后,把各行文本分配到多个python进程并行分词,然后归并结果,从而获得分词速度的可观提升
|
||||
* 基于python自带的multiprocessing模块,目前暂不支持windows
|
||||
* 用法:
|
||||
* jieba.enable_parallel(4) # 开启并行分词模式,参数为并行进程数
|
||||
* jieba.disable_parallel() # 关闭并行分词模式
|
||||
* `jieba.enable_parallel(4)` # 开启并行分词模式,参数为并行进程数
|
||||
* `jieba.disable_parallel()` # 关闭并行分词模式
|
||||
|
||||
* 例子:
|
||||
https://github.com/fxsjy/jieba/blob/master/test/parallel/test_file.py
|
||||
|
Loading…
x
Reference in New Issue
Block a user