Skip to:

Skip to Jira Navigation
Skip to Side Navigation
Skip to Main Content

Data Import (Batch Importer for Bib Acq) Q1 2019 Technical and NFR work

Description

Feature to link various technical and NFR work for Data Import app in Q1 2019

Priority

P3

Labels

NFRacq-dataimpdata-importdelimited_filesmandatorymarcimportsuppress-from-capplan

Fix versions

Development Team

Folijet

Assignee

Ann-Marie Breaux(Deactivated)

Solution Architect

None

Parent

UXPROD-47 Batch Importer (Bib/Acq)

Parent Field Value

None

Parent Status

None

Linked issues

continues

Data Import (Batch Importer for Bib Acq) Infrastructure and Planning

is continued by

Data Import (Batch Importer for Bib Acq) Q2 2019 Technical and NFR work

is defined by

UI: Data import application architecture

SPIKE: Have a way to get back to the Choose Job Profile screen

Change file upload implementation to use common java library for file upload and newly created stripes component for file upload

File upload: Show error message on UI when there is not enough server space for uploaded file(s)

Fix file name when creating upload definition

Have a way to get back to the Choose Job Profile screen

Show modal on Leaving Choose Job Profile page

Prohibit file upload when there is a draft job in progress

Return certain message codes from API for translation purposes

Slow resolve to the uploaded files card when uploading a large file

Code cleanup for SearchAndSort component within stripes-components repo

Use new endpoints from mod-source-record-storage

Use new endpoints from mod-source-record-manager

Use new endpoints from mod-data-import

Correct language string for plurals

Add BigTest tests for the Landing Page Job Logs pane

Fix error in stripes-components on blur for MultiSelect component when it is part of redux-form

Add possibility to disable MultiSelection component

Work down the automated testing debt for UIDATIMP older code, part 1

Cover "Have a way to get back to the Choose Job Profile screen" functionality with tests

ChangeManager: Add functionality for saving chunks of raw data

@Deprecated. Will be closed. ChangeManager: implement API for saving raw (source) data

@Deprecated. Will be closed. Change Manager: Handle the completion of the source data save

@Deprecated. Will be closed. ChangeManager: Create watcher to complete jobExecution

Use SRS Client instead of RestUtil.doRequest

Add DI support to the module

MetadataProviderJobExecutionAPITest.shouldReturnAllJobExecutionsOnGetWhenNoQueryIsSpecified expectation failed

Fix security vulnerabilities reported in jackson-databind >= 2.8.0, < 2.8.11.3

Change invalid uuid to valid ones in setup_test_data.sql script

Add ability for passing UI key for each fileDefinition while uploading file

Bring all the module's endpoints to the same structure

Use new endpoints from mod-source-record-storage

Use common schema to store user personal data

DaoUtil is copy-pasted in mod-source-record-storage & mod-source-record-manager

Increase test coverage and fix code smells in mod-source-record-manager

Create JobExecutionSourceChunk & DB table

Create Chunk Processing service

Simplify logic in Change Engine Service

Create distributable HTTP Client for all services provided by the module mod-source-record-storage

Cover chunk processing flow with API tests

Analyze the current state of the manager and describe the necessary steps to complete the first phase of import

Update counter of processed records

Implement JobExecutionSourceChunk processing routine.

Implement the way RecordFormat is defined by JobExecution

Create release version 1.2.0

Reuse GenericAsyncAnswer in mod-source-record-manager

Add GenericAsyncAnswer in data-import-utils

Apply GenericAsyncAnswer to simplify unit testing

Update RunBy, Progress, startedDate fields on start parsing

Delete Import statuses, fill status PARSING_IN_PROGRESS

Create periodic job for cleanup old files

Implement SourceReader for local files.

Add unit test for source reading functionality

Cover record splitting logic by unit tests;

Change file upload implementation to use common java library for file upload - DRAFT

Refactor error handling on JobExecution status update

Add DI support to the module

Add uploaded file size validation dependent on systems resources

Release data-import-utils

Bring all the module's endpoints to the same structure

Add new statuses for UploadDefinition and FileDefinition

Change file upload service according to @Stream API implementation

Unable to delete upload definition after deleting file

Update mod-data-import API documentation

Request for last draft upload definition responds very slowly

Do not change JobExecution status in mod-data-import FileProcessor

Use new endpoints from mod-source-record-manager

Increase test coverage in data-import-utils

Increase test coverage and fix code smells

Increase test coverage and fix code smells in mod-data-import

Missing Code Coverage in data-import-utils

Update endpoint restore/default GET --> POST

Error when uploading file with certain symbols in name

JobExecution status is not updated after deletion of UploadDefinition

Use SRM Client instead of RestUtil.doRequest

Create release version 1.2.0

Create release v1.1.0 for data-import-utils

Release bugfix versions of mod-data-import, mod-source-record-manager and mod-source-record-storage

Change module configuration to use Log4J 2 logger implementation.

Develop a CLI tool to allow initial filling with data for testing purposes.

Add DI support to the module

Bring all the module's endpoints to the same structure

Increase test coverage and fix code smells in mod-source-record-storage

Сalculate the generations' numbers for MARC record imported via Data Import

Create release version 2.1.0

UUID in Sample Data should not be generated

Change the JSON schema for ramls/raml-storage/schemas/mod-source-record-storage/parsedRecord.json

Update module descriptor to tenant interface v1.2

Create "Data import converter storage" module

Incorporate Spring DI

SPIKE: Investigate RMB solution to work with relations and foreign keys between entities.

Increase test coverage and fix code smells in mod-data-import-converter-storage

Design data structures for mod-data-import-converter-storage

Create release version 1.0.0

relates to

Data Import (Batch Importer for Bib Acq) - Misc navigation & screen issues

NFR: Data Import (Batch Importer for Bib Acq) Q3 2019 Technical, NFR, & Misc bug work

Checklist

hide

TestRail: Results

Activity

Show:

Done

Details

Reporter

Ann-Marie Breaux(Deactivated)

Analysis Estimator

Ann-Marie Breaux(Deactivated)

Front End Estimator

Ann-Marie Breaux(Deactivated)

Back End Estimator

Ann-Marie Breaux(Deactivated)

TestRail: Cases

Open TestRail: Cases

TestRail: Runs

Open TestRail: Runs

Created April 21, 2019 at 6:21 AM

Updated June 8, 2021 at 6:30 AM

Resolved April 21, 2019 at 6:21 AM

TestRail: Cases

TestRail: Runs