ConnorZhang776's recent timeline updates
ConnorZhang776

ConnorZhang776

V2EX member #537632, joined on 2021-03-15 15:03:18 +08:00
ConnorZhang776's recent replies
Feb 18, 2024
Replied to a topic by hard2reg Python 断点续爬中的去重问题
我赞同使用 bloomFilter + redis 的方法,非常实用,只需要一个简单的 hash 就可以确定是否存在,且可以自定义重复率,个人觉得非常实用
About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5301 Online   Highest 6679   ·     Select Language
创意工作者们的社区
World is powered by solitude
VERSION: 3.9.8.5 · 14ms · UTC 08:57 · PVG 16:57 · LAX 01:57 · JFK 04:57
♥ Do have faith in what you're doing.