nayaread
HomeFavouritesTopicsSources
HomeFavouritesTopicsSources
NayaRead links to original engineering blogs. All copyright belongs to the respective authors.
Engineering at Meta·Oct 7, 2019·16 min read62

Scribe: Transporting petabytes per hour via a distributed, buffered queueing system

Our hardware infrastructure comprises millions of machines, all of which generate logs that we need to process, store, and serve. The total size of these logs is several petabytes every hour. The o…

Distributed SystemsObservability
Read original on engineering.fb.com

Discussion around the web

  • Hacker News124 · 42 💬

Score breakdown

  • Technical depth74
  • Practical value60
  • Originality85
  • Writing quality100
  • Source reputation88
  • Recency0
  • External engagement30
  • On-site engagement0

NayaRead shows a summary and links to the original article. The full article is hosted on engineering.fb.com.

More like this

Uber Engineering

Reducing Logging Cost by Two Orders of Magnitude using CLP

Sep 30, 2022·23 min read
LinkedIn Engineering

Introducing Northguard and Xinfra: scalable log storage at LinkedIn

19 min read
Discord Engineering

Overclocking dbt: Discord's Custom Solution in Processing Petabytes of Data

Apr 9, 2025·19 min read
Yelp Engineering

mrjob: Distributed Computing for Everybody

Oct 29, 2010·4 min read