Commits

History for

Commits on Feb 12, 2022

优化好提示
 Boris-code
committed
dba0d0b

Commits on Dec 30, 2021

爬虫集成支持传参
 Boris-code
committed
3a1afb2

Commits on Nov 18, 2021

适配python3.10
Boris-code
committed
aa3df59

Commits on Sep 22, 2021

pipeline 支持close方法
 Boris-code
committed
493ff7b

Commits on Aug 27, 2021

框架主线程捕获异常，防止爬虫某个线程死掉 1.6.7-beta2
Boris-code
committed
744608a

Commits on Aug 25, 2021

优化 redis锁，修复转字符串cookie为json时的bug，添加cookie池，response的源码支持重新赋值，以便浏览器渲染时使用
 Boris-code
committed
d1e0c78

Commits on Aug 17, 2021

数据入库失败自动重试
 Boris-code
committed
1b00eb3

Commits on Aug 15, 2021

auto_stop_when_spider_done参数改为keep_alive
Boris-code
committed
21d1737

Commits on Aug 4, 2021

解决jion报错问题
 Boris-code
committed
32721c6
集成打点监控
 Boris-code
committed
f5f17f9

Commits on Jul 15, 2021

优化批次爬虫下发新批次任务时需等待1分钟问题
 Boris-code
committed
239ba71
优化锁的问题
 Boris-code
committed
15ed732

Commits on Jun 18, 2021

日志支持带颜色输出
 Boris-code
committed
3f7491f

Commits on May 28, 2021

修改邮箱
 Boris-code
committed
1ef34e2

Commits on May 23, 2021

爬虫支持重复启动
 Boris-code
committed
3108880

Commits on May 13, 2021

线程可重复启动
 Boris-code
committed
b423722

Commits on May 7, 2021

change REQUEST_TIME_OUT 为 REQUEST_LOST_TIMEOUT
Boris-code
committed
c587877

Commits on Apr 25, 2021

Merge pull request #64 from yufengsoft/master
Boris-code
authored
ee33a9e
AirSpider 支持爬虫开始与结束的回调函数
 Boris-code
committed
a83614e

Commits on Apr 24, 2021

Update batch_spider.py
YufengSoft
authored
9f2e46d

Commits on Apr 8, 2021

add perfect_dict
Boris
committed
e04d3df

Commits on Mar 30, 2021

AirSpider 支持itemz自动入库
Boris
committed
a410275

Commits on Mar 26, 2021

支持邮件报警
Boris
committed
12a2c57

Commits on Mar 19, 2021

修复浏览器渲染问题
Boris
committed
5cf33fd

Commits on Mar 18, 2021

支持浏览器渲染下载
Boris
committed
7b1e067
完善文档, update_items改为非必须实现接口
Boris
committed
e017bdd

Commits on Mar 17, 2021

删除无用的配置
Boris
committed
601f3fc
修改AirSpider任务启动顺序
Boris
committed
f47cf62

Commits on Mar 15, 2021

更新注释
Boris
committed
5c920fc
删除无用的process_num参数
Boris
committed
22a813e

Commits on Mar 12, 2021

修复日志等级问题
Boris
committed
1fa8c85

Commits on Mar 11, 2021

delete_tabs 改为 delete_keys，添加常见问题-运行问题
Boris
committed
b7f8bff

Commits on Mar 7, 2021

完善爬虫进阶文档
Boris
committed
5825e00

Commits on Mar 3, 2021

修改爬虫parser函数为parse，添加集成爬虫示例
Boris
committed
416dd13

Commits on Feb 25, 2021

修改注释
Boris
committed
61cd355