Questions tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have created a custom S3 Sink Connector
{
"name": "s3-sink-connector",
"config": {
"connector.class": "com.example.S3SinkConnector",
"tasks.max": "1",
"topics": "new-test-topic",
...
Originally asked on Stack Overflow. Here is a copy:
---
I have a Kafka 3.7.x cluster using ZooKeeper mode which works well. Now I am trying new Kafak in KRaft mode:
asked 14 days ago
Can we use AWS MSK replicators along with AWS MSK Serverless as we are using with AWS MSK Provisioned.
How can we handle replication between clusters in different regions
What are the cost associated...
I have 8 AWS MSK Kafka clusters. I thought of merging them into one and moving to serverless to reduce cost. But MSK Kafka serverless have some limitations/quota. I have to ensure that after merging...
S3SinkTask.java
package com.example;
import com.amazonaws.auth.AWSStaticCredentialsProvider;
import com.amazonaws.auth.BasicAWSCredentials;
import com.amazonaws.regions.Regions;
import...
I have 8 AWS MSK Kafka clusters.
I thought of merging them into one and moving to serverless to reduce cost.
But MSK Kafka serverless have some limitations/quota.
I have to ensure that after merging...
I have written a custom plugin code for S3SinkConnector
![I am facing this issue when I'm trying to access it what could be the possible...
When moving from AWS MSK Kafka to AWS MSK Kafka serverless, how to manage the existing replicators.
Are we need replicators when moving to serverless, will serverless handle replicator/replication by...
I have AWS MSK Kafka Cluster with 4 brokers
i want to get the storage used
i cant access / cant find the metric DataStorage in cloudwatch metrices.
is there any other metric i can use
is there a...
We have been trying to upgrade our AWS MSK cluster broker from kafka.t3.small → kafka.m7g.large. But it seems to go in the updating state for around 2-3 hours and then fail with...
Can somebody help with writing a connector plugin code for provisioning s3 sink connector to read messages from MSK Kafka topic and dump the messages into S3 Bucket.
I need help in writing the code...
I tried to access the metrices and try to get the insights from them using AWS CLI / Python scirpt, but its tricky to access since.
For an example, i have a kafka, and there are 3 brokers, and inside...