wberry wberry - 7 months ago 39
Java Question

Java/Python communication via message broker

What is a good solution for communication via message broker that supports both (C)Python and Java/JMS applications? My particular requirements are:


  • open source solution

  • Available on Linux-based systems

  • No rendezvous between sender and receiver required (i.e. uses a message broker)

  • Multiple producers and consumers supported for a single event queue (only one consumer receives each message)

  • Unit of work support with two-phase commit (XA support nice to have)

  • Support for persistent messages (i.e. that survive a restart of the broker)

  • Supports JMS for Java clients

  • No component is "fringe", meaning at risk of falling out of maintenance due to lack of community support/interest

  • If there is a Python client that manages to "speak JMS" that would be awesome, but an answer including a task to write my own Python JMS layer is acceptable



I have had a surprisingly hard time finding a solution for this. Apache's ActiveMQ has no Python support out of the box. ZeroMQ requires a rendezvous. RabbitMQ does not appear to support JMS. The best candidate I have found is a combination of ActiveMQ and the pyactivemq library. But the first and last release of pyactivemq was in 2008, so it would appear that that fails my "no fringe" requirement.

The ideal answer will be the names of one or more well-supported and well-documented open source packages, that you have personally used to communicate between a Java/JMS and Python application, and that do not require a lot of integration work to get started. An answer that includes an "easy" (up to a few days of work) implementation of additional glue code to meet all the requirements above, would be acceptable. A commercial solution, in the absence of a good open source candidate, would be acceptable also.

Also, Jython is out. (If only I could...) The same Python applications will need to use modules only available in CPython.

Answer

I have had a surprisingly hard time finding a solution for this. Apache's ActiveMQ has no Python support out of the box.

ActiveMQ brokers fully support using the Stomp protocol out of the box. Stomp is a text based protocol for messaging that has clients for many platforms and languages.

ActiveMQ's documentation should contain information on how to set up a connector for stomp. In its simplest form, enabling a connector would look something like:

<transportConnectors>
   <transportConnector name="stomp" uri="stomp://localhost:61613"/>
</transportConnectors>

Once enabled on the broker side, you can then use any python library that supports stomp. You can then use Stomp on the python side and JMS on the java side for communication with the broker and sending/receiving from specific destinations.