red-future/common
4
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases 19 Wiki Activity

fix: GSE数据文件从gse/dict目录加载

Browse Source
This commit is contained in:
张斌
2026-04-21 10:24:47 +08:00
parent f671096dbe
commit e051046f77
12 changed files with 1886750 additions and 47 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
gse/dict/README.md Normal file
View File

@@ -0,0 +1,15 @@
Some dict/zh data is from [github.com/fxsjy/jieba](https://github.com/fxsjy/jieba)
update at 2023-11-16:
add two new dict documents , which from [github.com/GuocaiL/nlp_corpus](https://github.com/GuocaiL/nlp_corpus)
generated by `nlp_corpus/open_ner_data/boson/boson.txt`, `open_ner_data/people_daily/people_daily_ner.txt`, `open_ner_data/tianchi_yiyao/train.txt`,`open_ner_data/ResumeNER/dev.txt`
1. tf_idf.txt
The first column of this document is the term , the second column is the word frequency of the corresponding term, and the third column is the inverse document frequency of the corresponding term
2. tf_idf_origin.txt
the origin corpus text