Has anyone integrated Kafka with MCS? I am experiencing a strange issue where I can SSH into the MCS and send messages from the MCS to the Kafka VM, without issue. I am getting source events, but I am not getting any communication from the MCS into Kafka. If anyone else has set up the Kafka integration, would you mind sharing your experience with me?
Thank you
While the Kafka configuration is defined on the MCS, the actual data flow is handled by the MCM.
The MCM is responsible for publishing source events and statistics directly to the Kafka cluster.
As a result, there is no network-level communication or message exchange between the MCS and the Kafka brokers.
Hi @Richard_Gavan - I had a similar issue where I couldn’t see any messages in the configured topic. It turns out that MCM is adding suffixes to the configured topic, so it’s technically creating a separate topic for the different categories (Channel Events, SCTE, etc). I’m going to request that these are documented or made configurable as the documentation page (https://community.tagvs.com/contentview/UPGRADES/566329345) doesn’t mention this. I discovered it by checking my Kafka server logs.
For example, if you set your topic string to ‘tagtest’ then what gets sent to the broker is ‘tagtest.ChannelEvent’. Once I changed the topic on my consumer to match, I started to see all the configured events.
Hi Andrew, thanks for getting back to me. I will have a look through the directory to see if any messages are getting through.
Thank you