yunke

Files

T

浅念 f92aac1a3d feat(scraper): 微信群消息抓取(368778条/750群)+浏览器守护循环+SQLite忙等

- 新 group-messages 实体:真机探明群消息=同一 msg/chats 端点 friendId 传 roomId;
  talker=发送者wxid、msgId=null→owner:room:createTime:talker 合成稳定主键(重扫幂等)
- 浏览器守护循环:超大群撑崩渲染进程时重启浏览器跳过毒群继续(实战2次自愈);
  200页上限;恢复路径补 await
- base.py SQLite connect_args timeout=60:并发写忙等而非撞锁报错
  (双抓取器并发写实测 database is locked 崩任务)
- 5个新单测,全量410绿

Co-Authored-By: Claude <noreply@anthropic.com>

2026-08-20 09:09:32 +08:00

__init__.py

chore: wechat end-to-end smoke script

2026-08-01 12:16:02 +08:00

backfill_customer_add_time.py

feat(scripts): backfill Customer.add_time from raw_json

2026-08-05 18:45:55 +08:00

backfill_customers.py

fix: sanitize lone surrogate chars in stored data + backfill script

2026-08-05 11:57:12 +08:00

cleanup_dividers.py

fix(scraper): 过滤type=-2日期分隔线 + 清理DB已有4062条分隔线