Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Diagram (updated with changes made in Quesnelia R1 2024)



Expand

Flow (prior to Quesnelia)

  1. JobDefinition (uuid, profile - defines job type: insert/update) for import created in mod-srm
  2. EDIFACT file + JobDefinition ID are uploaded from WEB client to mod-data-import (stored in memory, can be persisted. possible oom)
  3. EDIFACT records are packed into batches and put to Kafka queue DI_RAW_RECORDS_CHUNK_READ
  4. mod-srm reads batches from the queue, validates and passes to mod-srs via Kafka queue DI_RAW_RECORDS_CHUNK_PARSED. JobStarts on first chunk received.
  5. mod-srs stores records into PostgreSQL database and returns the result back via Kafka queue (broken records are also stored as 'error record') - DI_PARSED_RECORDS_CHUNK_SAVED
  6. mod-srm reads the profile and creates JSON payload (containing parsed EDIFACT, profile, mapping parameters) for processing. exports it to an appropriate Kafka queue - DI_EDIFACT_RECORD_CREATED
  7. mod-invoice  DI_EDIFACT_RECORD_CREATED

Diagram (prior to Quesnelia)

Drawio
bordertrue
diagramNamesave-edifact-create-invoices
simpleViewerfalse
width600
linksauto
tbstyletop
lboxtrue
diagramWidth1081
revision2