Flow description
- MARC file is uploaded from WEB client to mod-data-import
- MARC records are packed into batches and put to Kafka queue
- ?? here starts the job ??
- mod-srm reads batches from the queue, validates and passes to mod-srs via Kafka queue
- mod-srs stores records into PostgreSQL database and returns the result back via Kafka queue
- mod-srm reads the profile and creates payload for processing. exports it to Kafka queue (one message per MARC entry)
- mod-inventory reads the message, tries to match it according to profile rules. Exports matched records to Kafka queue one by one.
- mod-inventory-storage reads messages and stores matched entity to DB. exports the result to queue
- mod-inventory reads the message, tries to match (cycle 7-9).
- if nothing can be matched, exports result to kafka queue
- mod-srm reads queue, updates the progress. updates job state.
| Drawio | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|