We have a supervisor reading stream data from kafka with one minute granularity. Every 15 minutes, we are running a “Reindex from druid” task that aggregates data by fifteenminute granularity for the previous 15 minutes and writes it into a new datasource. The task is running with success, but with no data written in the concerned datasource. while data is well present in the 1 minute granularity datasource.
if we wait for 1 hour and rerun the same task, the fifteenminute datasource is well-populated with data.
Is there any configuration we can add to reindex from druid task to reindex the newly inserted data?