Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Diagram (updated with changes made in Quesnelia R1 2024)



Expand
titleClick here to expand flow prior to Quesnelia changes

Flow (prior to Quesnelia)

  1. JobDefinition (uuid, profile - defines job type: insert/update) for import created in mod-srm
  2. EDIFACT file + JobDefinition ID are uploaded from WEB client to mod-data-import (stored in memory, can be persisted. possible oom)
  3. EDIFACT records are packed into batches and put to Kafka queue DI_RAW_RECORDS_CHUNK_READ
  4. mod-srm reads batches from the queue, validates and passes to mod-srs via Kafka queue DI_RAW_RECORDS_CHUNK_PARSED. JobStarts on first chunk received.
  5. mod-srs stores records into PostgreSQL database and returns the result back via Kafka queue (broken records are also stored as 'error record') - DI_PARSED_RECORDS_CHUNK_SAVED
  6. mod-srm reads the profile and creates JSON payload (containing parsed EDIFACT, profile, mapping parameters) for processing. exports it to an appropriate Kafka queue - DI_EDIFACT_RECORD_CREATED
  7. mod-invoice  DI_EDIFACT_RECORD_CREATED

Diagram (prior to Quesnelia)

Drawio
bordertrue
diagramNamesave-edifact-create-invoices
simpleViewerfalse
width600
linksauto
tbstyletop
lboxtrue
diagramWidth1081
revision2

...