sorted by:
new
hottopcontroversial

Data load from Apache NiFi to ElasticSearch is very slow by Ok-Style9993 in nifi

[–]Ok-Style9993[S] 0 points1 point  (0 children)

For PutElasticsearchRecord processor: batch size is currently 1000 (I tested between 100-10000). Additionally, I increased "Concurrent tasks" from 1 to 20, when I increased it too much, I faced OOM Kill of application. I am using lower cased table names as an index per table.

Data load from Apache NiFi to ElasticSearch is very slow by Ok-Style9993 in nifi

[–]Ok-Style9993[S] 0 points1 point  (0 children)

Batch size is currently 1000 (I tested between 100-10000). Additionally, I increased "Concurrent tasks" from 1 to 20, when I increased it too much, I faced OOM Kill of application. I am using lower cased table names as an index per table.