Kafka PointToPoint

Question

The Problem

We have a multi-datacenter activeMQ setup, with NFS for each HA pair, and it seems that activeMQ isn't really scalable, and doesn't play well with NFS issues. (we're using 5.7)

The Possible Solution

Move to Kafka

Requirements

• We need PointToPoint & pub/sub functionality
• Message Priorities (I know kafka doesn't provide that out of the box, but there's a workaround for it on our side)

Question

Is this possible with Kafka (not necessarily out-of-the-box, but with some client tweaking)? If not, then what other technology would you suggest? It doesn't have to be JMS, but it needs to be scalable and reliable (and it needs to play well with NFS)

Answer 1

We need PointToPoint & pub/sub functionality

Kafka does that, shared my finding here

Message Priorities

Little confused what exactly you mean, but by priorities if you mean to consume from a specific offset then the Low level or Simple consumer API provide that. It also supports re-submission of messages as well

Answer 2

In your case I would use Kafka with 1 partition per topic with separate topics for each message priority level, solving prioritization of delivery on the subscriber side.