Scribe: Transporting petabytes per hour via a distributed, buffered queueing system
Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The o…
Discussion around the web
- Hacker News124 · 42 💬
Score breakdown
- Technical depth74
- Practical value60
- Originality85
- Writing quality100
- Source reputation88
- Recency0
- External engagement30
- On-site engagement0
More like this
Uber Engineering58
Reducing Logging Cost by Two Orders of Magnitude using CLP
unknown·23 min read
LinkedIn Engineering65
Introducing Northguard and Xinfra: scalable log storage at LinkedIn
unknown·19 min read
Yelp Engineering46
mrjob: Distributed Computing for Everybody
unknown·4 min read
Slack Engineering68
Syscall Auditing at Scale
unknown·10 min read
Engradar shows a summary and links to the original article. The full article is hosted on engineering.fb.com.