Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

These write/read streams are from Vertx implementation are very coupled to Vertx KafkaProducer, Spring Kafka Template could not implement all contract methods of Write stream, so its need to more deeply test this functionality.

For my testing I uploaded 30K file and connected to profiler to compare graphs of mod-data-import for old Vertx implementation and new Spring Template

Image Removed

                                                                                                                        Pic. 1 - Vertex implementation

Image Removed

                                                                                                                      Pic. 2 - Spring implementation

From these pictures of memory utilizations we see pick loads when files are dividing into chunks and sending to Kafka, and after it how Garbage collector works when mod-data-import is without load.