GlobalForum: catching 1.2 billion bad links in 2 GB
How GlobalForum's database-backed spam check collapsed in a 10x traffic spike, and how a Bloom filter, about 2 GB of bits in Redis with no false negatives, answers most link checks without touching the database, stays current through rebuilds, and holds up in an attack.
01 · 3 AM
CASE-007 · Building a Scalable Spam Detection System for User-Submitted URLs Using Bloom Filters
Every link, checked, before the message posts.
Hundreds of messages a second
Meet Sarah, a content moderator at GlobalForum, a discussion platform with 500 million active users.
0:00 / 11:44