We run a very simple filesystem based queue that processes around 1 billion even... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		donatj 55 days ago \| parent \| context \| favorite \| on: Building a message queue with only two UNIX signal... We run a very simple filesystem based queue that processes around 1 billion events a day. Makes use of XFS for it's better handling of large numbers of files. Corporate tried to push us to replace it with SQS and it could not keep up / costs with through the roof

RedShift1 55 days ago [–]

How does it work? Can you have multiple workers on the same payload? Do you archive the events afterwards?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact