How to get all the messages from kafka topic and count them using java?
This code sometimes gives me all the messages from the beginning and waiting for another message and sometimes it's just waiting for another messageimport java.util.HashMap;import java.util.List;import...
View ArticleClik here to view.
Flutter Dialog unintentionaly triggers recreating of layout behind
I have an issue with my FLutter code that I am not able to solve neither to understand why this is happening.First the code in questoin:import 'dart:io';import 'dart:ui';import...
View ArticleHow to stop or timeout a consumer from consuming after specific time in...
Here is a hello world example on rabbitmq docs about consumer using php and php-amqplib package:<?phprequire_once __DIR__ . '/vendor/autoload.php';use...
View ArticleHow to pause KafkaJS consumer and retry after sometime
I'm using KafkaJS ( https://kafka.js.org ) to connect to a Kafka cluster. My consumers are responsible for processing tasks which can fail at some time and succeed after waiting for a duration (for...
View ArticleRabbitMQ Consumer goes down
Using rabbitMQ 3.8.2 and erlang 22.2.7, I tried to upload 3mb video file as base64 format through API, now the consumer is getting lost, queue is in ready stage always because of this further i can't...
View ArticleError: "Expected a method, getter, setter or operator declaration"
I am getting the error: "Expected a method, getter, setter or operator declaration" when I am implementing the below code.It includes a provider, consumer and StreamBuilder. Is there something I am...
View ArticleProblem with Kafka customer integration test with TestContainer
I have a problem while testing the integration of a Kafka consumer with kafkaContainer.In practice, when I send the message with the template, the consumer is not invoked.Can you help me?Here is some...
View ArticleKeyError: 'type' in a websocket_receive
I have two different apps in my Django project. While the first one (the one with the error raising consumers.py) works fine on its own, the second one keeps raising this:\chat\consumers.py", line 29,...
View Articleget results from kafka for a specific period of time
Here is my code, that uses kafka-python.now = datetime.now()month_ago = now - relativedelta(month=1)topic = 'some_topic_name'consumer = KafkaConsumer(topic, bootstrap_servers=PROD_KAFKA_SERVER,...
View ArticleFlink Kafka GroupId seems to be ignored when using KafkaSource
I'm new with Apache Flink. I've tried to get Events from Apache Kafka using the KafkaSource from Flink. So far so good, it seems to work fine. After restarting the flink task, I've got the same...
View ArticleProducer Consumers Using Semaphores
I am trying to understand the working of semaphores in the context of producers and consumers. Have a simple bounded queue containing push & pop APIs. Also, managing multiple producers and...
View ArticleFlutter provider not working in release apk and profile mode, but working...
The provider works to provide real time updates to consumers but only works in debug mode and not release mode and profile mode.Anyone has this issue ?Thank you very much !!!
View ArticleClik here to view.
Nifi ConsumeAMQP throwing NullPointerException
We use default ConsumeAMQP and Nifi version 1.18.0.RabbitMQ connection is successful, when data comes from RabbitMQ, ConsumeAMQP processor is throwing NullPointerException.Once exception occurs, there...
View ArticleOrder guarantees using streams and reducing chain of consumers
So as it goes in the current scenario, we have a set of APIs as listed below:Consumer<T> start();Consumer<T> performDailyAggregates();Consumer<T>...
View ArticleKafka consumer seek() losses some data in consmer.pool() with single consumer...
I am running one consumer and assigned 4 partitions(0,1,2,3) to it.consumer.assign(0,1,2,3)I have send A1,B2,C3,D4 data on partition 0,1,2,3 on the topic consumer is running.Now, i pool the data from...
View ArticleConsumer for type's messages "RoutingSlipActivityCompleted"
I've a code in which a routing slip is built. A consumer for consuming the completion of each routing slip's activity is built too but this part is never reached.This is the part in which the routing...
View ArticleAvoid flutter Consumer widget children rebuild
I am developing an app allowing to download maps of regions and show either on a map (using flutter_map) or in a list view. While downloading a map, a progress bar must be displayed on the list view,...
View ArticleWhat would group.instance.id should be for Kafka consumer static membership?
We are trying to set up static membership for Kafka consumers to account for container maintenance upgrades. Every once in while containers will be deployed with improvement which can take down...
View ArticleDjango channels reloading or refreshing self.scope['session'] values
I have multiple consumers, and wanted to pass a value from one consumer to the other using self.scope['sessions']. They are both created and initialized at the same time.After setting and saving...
View Article.NET, KAFKA: Why my consumer not consume when i recreate topic or if consumer...
This is my consumerusing System;using System.Threading;using System.Threading.Tasks;using Confluent.Kafka;using Microsoft.Extensions.Configuration;using Microsoft.Extensions.Hosting;using...
View ArticleCorrect use of Java 8 supplier consumer
I'm still strugling with Suppliers and Consumers for Java 8, I have this:final Set<String> roles = new HashSet<>();user.getRoleGroups().forEach(rg -> rg.getRoles().forEach(r ->...
View ArticleFacing issues with NATS Jetstreams perfomance with large number of parallel...
OverviewWe have been using the the nats bench CLI tool for benchmarking the performance of NATS Jetstream over different variables.In our use-case, we require 100K ephemeral parallel consumers...
View ArticleTalend tKafkaInput Consistently Reads Only Partial Messages from Kafka DLQ...
Question: I'm encountering a persistent issue with my Talend jobs involving Kafka and a Dead-Letter Queue (DLQ). I have a real-time job that continuously writes failed messages to a Kafka topic named...
View ArticleWhy is Camel sending Message body content rather than the Message itself when...
I created a Java class for EIP Event Messages. I expected to receive a Message at Observer.accept(Object o) when using Camel's Bean component but I get an Event instead. While this is convenient since...
View ArticleNASDAQ Python SDK Client - How to resolve Market Open/Close Data Delay?
I am using the NASDAQ Python SDK client to consume market data for the NLSUTP topic. The data is fetched using the NCDSClient and processed in real-time. I send the data received from the consumer via...
View ArticleWhat is the correct way to update two related fields using Riverpod in Flutter?
I am trying to implement two related fields in a form using Riverpod in Flutter. The first field is a segmented class type selection, and the second is a text field for entering a custom class type. I...
View ArticleDoes acking a message in Google Pub/Sub also ack its duplicates?
I have a subscription in Google Pub/Sub where messages can be either acknowledged (acked) or not acknowledged (nacked). To handle the at-least-once delivery guarantee of Pub/Sub, I use an idempotent...
View ArticleMassTransit set a specific the faultMessage exchange name
I have two services using the same message models and working with MT + RabbitMQI set each service consumer to have its own messages using a routing key.in case of exception MT will publish a Fault to...
View ArticleHow to restrict kafka stream messages consumption (to avoid external resource...
I created a Kafka stream-based application that performs processing (whatever it is) on files.The application basically receives "in real time" messages in a topic, and every message contains the path...
View ArticleClarification on behavior of QoS 1 and 2 if subscriber is unavailable
The general flow of MQTT is: producer ---> MQTT Broker ---> consumer.Assume that the MQTT Broker is always up and running but consumer is temporarily unavailable.If a producer sends a message to...
View Article