xinyouhe/yunke
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(scraper): WA群消息抓取(chatRecords friendUid=@g.us,chatRoomTalker=群内发送者)

Browse Source 
- 真机探明:同 chatRecords 端点 friendUid 直接传 @g.us 群id(与微信群同套路)
- 群行 chatRoomTalker=发送者@lid、keyId 有值(缺失时合成稳定主键)
- file 字段直连 OSS URL 优先于 mediaName(WA群媒体 URL 现成!)
- 守护循环同微信群;full_sync 加 9b 步;3 新测试,416 绿

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
浅念
2026-08-20 10:54:09 +08:00
parent b522be828a
commit 1d90829754
3 changed files with 180 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
yunke-server/scripts/full_sync_all.sh
+2
View File
@@ -33,6 +33,8 @@ $PY scripts/scrape_via_page.py --entity group-messages --max-conversations 99999
$PY -m scripts.backfill_group_members
echo "$(date) --- 9/10 WA messages ---"
$PY scripts/scrape_via_page.py --entity wa-messages --max-conversations 99999
echo "$(date) --- 9b/10 WA group messages ---"
$PY scripts/scrape_via_page.py --entity wa-group-messages --max-conversations 99999
echo "$(date) --- 10/10 Media download (audio+images) ---"
$PY scripts/scrape_via_page.py --entity media