 浅念
|
3dc80805fa
|
feat(deploy): Docker镜像支持页面抓取(Playwright+Chromium+scripts/)+full_sync可移植
- Dockerfile:Chromium headless 系统依赖 + playwright install chromium
+ COPY scripts/(调度器 _page_subprocess 的入口,之前镜像里没有)
- full_sync_all.sh:DB_URL 外部可覆盖(容器 MySQL)、python 路径可移植
(容器 PATH / 本地 venv 双兼容)
Co-Authored-By: Claude <noreply@anthropic.com>
|
2026-08-22 10:15:58 +08:00 |
|
|
浅念
|
1d90829754
|
feat(scraper): WA群消息抓取(chatRecords friendUid=@g.us,chatRoomTalker=群内发送者)
- 真机探明:同 chatRecords 端点 friendUid 直接传 @g.us 群id(与微信群同套路)
- 群行 chatRoomTalker=发送者@lid、keyId 有值(缺失时合成稳定主键)
- file 字段直连 OSS URL 优先于 mediaName(WA群媒体 URL 现成!)
- 守护循环同微信群;full_sync 加 9b 步;3 新测试,416 绿
Co-Authored-By: Claude <noreply@anthropic.com>
|
2026-08-20 10:54:09 +08:00 |
|
|
浅念
|
02dd77a62f
|
feat(scraper): WA群抓取(type=1真机验证,223群)+群成员派生(12840成员/750群)
- wa-groups 实体:businessFriendList type=1 真机验证返回群,行结构是好友字段名
(friendUid=@g.us 群ID/nickName=群名),专用 _normalize_wa_group_row
- backfill_group_members.py:无独立成员API,从群消息派生(talker=成员,sender_name=昵称)
- full_sync_all.sh:+4步(5b WA群/语音后录音重链接/8b 群消息+成员/消息上限99999)
Co-Authored-By: Claude <noreply@anthropic.com>
|
2026-08-20 09:21:20 +08:00 |
|
|
浅念
|
9eb747f2b3
|
feat(scripts): 全量同步改纯页面方式(10步零API零风控)
Co-Authored-By: Claude <noreply@anthropic.com>
|
2026-08-15 14:45:50 +08:00 |
|
|
浅念
|
7beae8cf55
|
feat(scripts): 全渠道全量重同步脚本(页面抓取+API全覆盖)
Co-Authored-By: Claude <noreply@anthropic.com>
|
2026-08-15 14:38:01 +08:00 |
|