Skip to content

告警成功率阈值从硬编码50%移入配置文件，以支持自定义;相关日志调整 #310

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
gyj126 wants to merge 15 commits into
base: develop
Choose a base branch
from
Open

告警成功率阈值从硬编码50%移入配置文件，以支持自定义;相关日志调整 #310

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
3183445
告警成功率阈值从硬编码50%移入配置文件，以支持自定义;相关日志调整
Apr 7, 2026
e8426e7
提高redis依赖兼容性：最大版本支持从<4.0提升到<6.0
Apr 7, 2026
f471fbf
提高redis依赖兼容性：最大版本支持从<4.0提升到<6.0
Apr 7, 2026
b1c5afa
文件下载爬虫第一次提交
Apr 7, 2026
5c0e78a
文件下载爬虫第二次提交，修复bug
Apr 7, 2026
edaeee4
文件下载爬虫第三次提交，修复细节bug
Apr 7, 2026
744f172
文件下载爬虫第四次提交，文档细节调整
Apr 7, 2026
0bfd88d
文件下载爬虫支持任务字段透传组装最终item；on_task_all_done方法签名修改。
Apr 8, 2026
e25915c
解决“文件下载爬虫支持任务字段透传组装最终item”的bug——第一次提交
Apr 8, 2026
5f4ddb4
解决“文件下载爬虫支持任务字段透传组装最终item”的bug——第一次提交
Apr 8, 2026
7162763
解决“文件下载爬虫支持任务字段透传组装最终item”的bug——第二次提交——修复竞态条件bug，新增skipped_count字段。
Apr 8, 2026
6c04fc0
解决“文件下载爬虫支持任务字段透传组装最终item”的bug——第四次提交——添加run_id标识，避免小概率情况下跨批次请求造成统计错误。
Apr 8, 2026
517042a
第五次提交：修复方法签名不一致问题，文档更新。
Apr 8, 2026
b1db0c9
第六次提交：修复方法签名不一致问题；选择mysql作为缓存时，按 redis_key分表，减少跨业务串扰。
Apr 8, 2026
b7a0835
Merge pull request #4 from gyj126/file-spider
gyj126 Apr 8, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
提高redis依赖兼容性：最大版本支持从<4.0提升到<6.0
  • Loading branch information
gaoyunjian committed Apr 7, 2026
commit f471fbf6d060350343dec850ec110e068add7b62
1 change: 0 additions & 1 deletion feapder/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,6 @@ selenium>=3.141.0
bs4>=0.0.1
ipython>=7.14.0
bitarray>=1.5.3
redis-py-cluster>=2.1.0
cryptography>=3.3.2
urllib3>=1.25.8
loguru>=0.5.3
Expand Down
1 change: 0 additions & 1 deletion setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,6 @@
"bitarray>=1.5.3",
"PyExecJS>=1.5.1",
"pymongo>=3.10.1",
"redis-py-cluster>=2.1.0",
] + render_requires

setuptools.setup(
Expand Down