Hacker News new | past | comments | ask | show | jobs | submit login

Anyone know if 0MQ (or similar) can have multiple publishers send to the same queue? Some context:

- I currently have an app where users submit content to a single machine, which is then queued (using Python's inbuilt Queue object), and processed and displayed by threads that run on the queue.

- In future, I've been thinking about using a network queue to easily publish from a single source to multiple display servers, with a load balancer in between them. This neatly handles my 'view only' users.

- But what about if I wanted to allow users to submit from any server, ie, spreading the load for contributing users as well?

I'm guess I'm looking for a multiple publisher / multiple subscriber queue. Does anyone know if they exist?




Yes, this is commonly called a message bus.

ZeroMQ supports this, you can just use a forwarding device where on one end you can connect the publishers and on the other end the subscribers.


Thanks Nicholas - I'd heard that term before but not known was it was till now. How do people avoid the forwarding device becoming an SPOF?


From the article: ZeroMQ follows a brokerless design so that there is no single point of failure.


There's no SPOF unless you create one. So the sentence should be more correct this way "ZeroMQ follows a brokerless design so that doesn't enforce single point of failure."




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: