浅念 64577a1b02 feat(msg): 类型归一化扩展(spike判别+49拆红包/转账)+存量回填+API msg_type/q过滤 ...

- _normalize_msg_type 升级 (raw_type, row): messageType 经典码优先 →
  49/appmsg 行级拆分(红包/转账/聊天记录) → 云客码兜底
- spike 修正: 云客 type=3 实为语音(messageType=34, 8754/8955 行),
  原 image_legacy 是误标; type_raw=3 的 201 行旧数据才是真图片
- 新映射: 5红包 6/7通话 9文件 10/18/20链接 11转账 13名片 14位置
  15/10000系统 21引用回复→text 22/19 证据不足留 unknown
- 回填 smoke.db: 620279 行重扫, 94268 行修正, unknown 87198→1885, 幂等
- GET /api/messages 加 msg_type(Literal 422)+q(LIKE 转义)参数
- 新增 test_scrape_msg_type.py(11) + test_api_messages 追加(8), 全量 466 绿

Co-Authored-By: Claude <noreply@anthropic.com>

2026-08-25 15:17:21 +08:00

..

__init__.py

chore: wechat end-to-end smoke script

2026-08-01 12:16:02 +08:00

backfill_chat_group_fields.py

feat(groups): chat_group 补 6 群主/建群列 + 复合PK迁移修复 + 存量回填

2026-08-25 14:32:12 +08:00

backfill_customer_add_time.py

feat(scripts): backfill Customer.add_time from raw_json

2026-08-05 18:45:55 +08:00

backfill_customers.py

fix: sanitize lone surrogate chars in stored data + backfill script

2026-08-05 11:57:12 +08:00

backfill_group_members.py

feat(scraper): WA群抓取(type=1真机验证,223群)+群成员派生(12840成员/750群)

2026-08-20 09:21:20 +08:00

backfill_msg_types.py

feat(msg): 类型归一化扩展(spike判别+49拆红包/转账)+存量回填+API msg_type/q过滤

2026-08-25 15:17:21 +08:00

cleanup_dividers.py

fix(scraper): 过滤type=-2日期分隔线 + 清理DB已有4062条分隔线

2026-08-15 15:07:43 +08:00

fix_media_paths.py

fix(media): 修复 Windows 反斜杠路径致 Linux 容器 404(49536 行 local_path 全量改为 /data/media 前缀)

2026-08-24 15:16:18 +08:00

full_resync.sh

feat(scripts): 全渠道全量重同步脚本(页面抓取+API全覆盖)

2026-08-15 14:38:01 +08:00

full_sync_all.sh

feat(scraper): moments 实体(浏览器fetch getFriendsterInfo,秒→ms,hashNext翻页,接入full_sync+4h调度+图片media)

2026-08-25 14:07:39 +08:00

healthcheck.py

feat(ops): 服务健康检查脚本(检测+拉起后端/前端/调度器)

2026-08-21 15:10:20 +08:00

migrate_sqlite_to_mysql.py

feat(deploy): 完成数据迁移与MySQL全链路(14表698k消息100%一致+5方言补丁+bind mount)

2026-08-22 12:40:44 +08:00

scrape_via_page.py

feat(msg): 类型归一化扩展(spike判别+49拆红包/转账)+存量回填+API msg_type/q过滤

2026-08-25 15:17:21 +08:00

seed_accounts.py

fix: wechat account scrape (form-data+dates) + frontend staff page

2026-08-01 17:11:17 +08:00

seed_chats.py

chore: seed chat messages for listed customers (seed_chats)

2026-08-05 09:54:40 +08:00

seed_whatsapp.py

fix: whatsapp businessFriendList needs page+departmentId+type

2026-08-01 17:53:26 +08:00

smoke_wechat.py

fix: live-validation fixes (list-coercion, .env session loading, smoke summary)

2026-08-01 15:23:43 +08:00