Skip to content

HAZELCAST CLUSTER QUEUE - DATA SINK

Description

The HAZELCAST CLUSTER QUEUE data sink is designed to distribute data by placing it into a Hazelcast distributed queue. This method is particularly useful for enabling real-time data processing and analysis across a cluster of nodes, ensuring high availability and fault tolerance. The HAZELCAST CLUSTER QUEUE data sink supports various configuration options to customize the data distribution process, including specifying the queue name and other Hazelcast queue configurations.

Config

REQUIRED

Config Parameters

The following are the configuration parameters for the HAZELCAST CLUSTER QUEUE data sink:

Name Description
queueName The name of the Hazelcast distributed queue where the data will be placed. This is a required parameter.

Config Example

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<apiroConf version="1" xmlns="http://apiro.com/apiro/v1/root">
    <loadOrder>25</loadOrder>
    <dataSinks>
        <dataSink name="TEST_HAZELCAST_CLUSTER_QUEUE" definition="HAZELCAST_CLUSTER_QUEUE">
            <config>
                <![CDATA[
                    {
                        "queueName" : "ANON_DUMP"
                    }
                ]]>
            </config>
        </dataSink>
    </dataSinks>
</apiroConf>

Common Mistakes

  • Incorrect Queue Name: Ensure that the queueName parameter matches the name of an existing Hazelcast distributed queue.
  • Hazelcast Configuration: Verify that the Hazelcast cluster is correctly configured and running, and that the specified queue is properly set up with the desired configuration options.
  • Network Issues: If you encounter connectivity issues, check the network configuration of your Hazelcast cluster and ensure that all nodes can communicate with each other.
  • Permissions: Ensure that the user or service account used for data distribution has the necessary permissions to interact with the specified Hazelcast queue.