OAI-PMH Full Harvests

Owned by Magda Zacharska
Last updated: Jul 08, 2024 by Tatsiana Hryhoryeva
5 min read
DateEnvironmentReleasePrefixMax Number of RecordsStart timeEnd timeNumber of Records Harvested

Total Time Elapsed

Notes
06/26/2023Sprint testingPoppymarc21
SRS		5001:44 PM8:10 PM4 758 6716 h 26 minThe environment was shut down during the harvest
07/03/2023Sprint testingPoppymarc21_withholdings
SRS		5007/3/2023, 12:30 PM7/4/2023, 6:20 AM7 849 87217 h 50 min
07/05/2023Sprint testingPoppymarc21_withholdings
SRS +Inventory		5007/5/2023, 07:32 AM7/6/2023, 00:17 AM8 109 97716 h 45 min



07/13/2023Sprint testingPoppymarc21
SRS		3007/13/2023, 5:55 PM7/14/2023, 2:48 AM7 849 47208 h 53 min
07/13/2023Sprint testingPoppymarc21
Inventory		3007/13/2023, 5:34 PM7/13/2023, 5:51 PM260 0000 h 17 min
07/13/2023Sprint testingPoppy marc21_with holdings
Inventory		3007/13/2023, 5:12 PM7/13/2023, 5:32 PM260 0000 h 20 min
07/17/2023perf-firebird-fs09000000Poppymarc21
SRS		3007/17/2023, 3:04 PM7/18/2023, 2:46 AM7 849 47211 h 42 min
07/17/2023perf-firebird-fs09000000Poppymarc21
Inventory		3007/17/2023, 2:30 PM7/17/2023, 2:51 PM259 8000 h 21 min
07/18/2023perf-firebird-fs09000000Poppymarc21_with holdings
Inventory		3007/18/2023, 3:07 AM7/18/2023, 3:32 AM259 8000 h 25 min
07/18/2023perf-firebird-fs09000000Poppymarc21
SRS +Inventory		3007/18/2023, 8:02 AM7/18/2023, 7:43 PM8 109 60811 h 41 min



09/08/2023

Sprint testing
tenant fs09000000		Poppymarc21_with holdings
Inventory		1009/8/2023, 1:25 AM9/8/2023, 2:24 AM

260 034

59 min
09/08/2023Sprint testing
tenant fs09000000		Poppymarc21
Inventory		1009/8/2023, 2:31 AM9/8/2023, 3:33 AM

260 034

58 min
09/08/2023Sprint testing
tenant fs09000000		Poppymarc21_withholdings
SRS		1009/8/2023, 5:10 AM9/8/2023, 6:34 PM7 850 87713 h 24 min
09/08/2023Sprint testing
tenant fs09000000		Poppymarc21
SRS		1009/8/2023, 3:45 AM9/8/2023, 10:20 PM7 850 87718 h 35 min
09/10/2023Sprint testing
tenant fs09000000		Poppymarc21
SRS +Inventory		100

9/10/2023, 5:19 AM

9/10/2023, 9:25 PM

8 111 191

16 h 06 minRun from Poland, without using remote desk
09/10/2023Sprint testing
tenant fs09000000		Poppymarc21_withholdings
SRS +Inventory		100

9/10/2023, 5:19 AM

9/11/2023, 3:02 AM

8 111 19121 h 43 min

Run from Poland, without using remote desk

09/21/2023Sprint testing
tenant fs09000000		Poppy1) full marc21
SRS
2) incremental marc21 SRS
3) full 
marc21_withholdings SRS

100


100

100		2023-09-21T13:14

2023-09-21T13:21:16

2023-09-21T13:14:59

2023-09-22T05:18

2023-09-21T23:20:08

2023-09-22T11:07:04

7 820 055


2 010 036

6 858 296




16 h 04 min

9h 59 min

21 h 53 m
(was aborted)		2 full harvest and 1 incremental harvests in parallel 
The 2nd harvest was aborted by disconnection on the Remote machine
09/22/2023Sprint testing
tenant fs09000000		Poppy1) incremental marc21 SRS (full harvest  marc21_withholdings SRS from 21/09 was still in progress)
2) incremental 
marc21_withholdings SRS		100

100


2023-09-22T04:43:21

2023-09-22T10:31:10


2023-09-22T11:34:44

2023-09-22T11:34:45


1 498 687


239 133


The  harvests were aborted by " Unable to read data from the transport connection: An established connection was aborted by the software in your host machine."

09/27/2023

Sprint testing

tenant fs09000000

Poppy

1) full marc21 SRS + Inventory

2) full marc21_withholdings SRS + Inventory

3) Incremental marc21 SRS + Inventory

400


400


400

2023-09-26T08:06:00


2023-09-26T08:07:59


2023-09-26T08:27:43

2023-09-29T12:38:25


2023-09-27T07:58:50


2023-09-27T07:58:49

8 112 012


8 111 215


7 991 420

76 h 32 m

23 h 51 m

23 h 31 m


marc21 incremental was running on PTF environment, marc21_withholdings on firebird remote host environment, marc21 full on private machine

10/17/2023perf-firebird-fs09000000Poppy

1) full marc21 SRS 

2) full marc21_withholdings SRS 

100

100		2023-10-17T13:33:48

2023-10-17T13:28:48		2023-10-18T02:48:12

2023-10-18T06:38:19
7 850 262


7 850 262		13h 15min

17h 10min

Two in parallel full harvest

10/18/2023perf-firebird-fs09000000Poppyfull marc21_withholdings SRS 502023-10-18T14:00:572023-10-19T04:47:367 850 26214h 47min

10/19/2023perf-firebird-fs09000000Poppyfull marc21_withholdings SRS 1002023-10-19T06:48:102023-10-19T21:44:407 850 26214h 56min

10/20/2023perf-firebird-fs09000000Poppyfull marc21_withholdings Inventory2002023-10-20T05:53:412023-10-20T06:58:41260 0311h 05min

10/20/2023perf-firebird-fs09000000Poppyfull marc21_withholdings Inventory2002023-10-20T07:08:432023-10-20T08:03:02260 03155min

10/20/2023perf-firebird-fs09000000Poppyfull marc21_withholdings Inventory2002023-10-20T08:10:412023-10-20T09:04:50260 031 54min

10/20/2023perf-firebird-fs09000000Poppyfull marc21_withholdings SRS+Inventory200

2023-10-20T12:47:36

2023-10-21T03:42:56

8 111 157


14h 55 min

10/21/2023perf-firebird-fs09000000Poppyfull marc21_withholdings SRS+Inventory200

2023-10-21T09:05:03

2023-10-21T23:37:38

8 111 15714h 32 min

10/23/2023perf-firebird-fs09000000Poppyfull marc21_withholdings SRS+Inventory200

2023-10-23T09:47:59

2023-10-24T01:49:17

8 111 15716h 02 min

Noticed: for request-metadata the number of "returnedInstances" changes over time if no next harvesting has been started
The number of instances initially was  8 111 157 - as file with harvested records includes, and after some time it was changed to 8 111 356

10/25/2023perf-firebird-fs09000000Poppyfull marc21_withholdings SRS+Inventory200

2023-10-25T09:29:49

2023-10-26T00:378 111 15715h 08 min

10/27/2023https://bugfest-poppy.int.aws.folio.org/Poppyfull marc21_withholdings SRS3002023-10-27T19:05:592023-10-28T09:03:077 869 63913h 58 min
10/28/2023https://bugfest-poppy.int.aws.folio.org/Poppyfull marc21_withholdings SRS+Inventory3002023-10-28T15:51:122023-10-29T05:49:008 130 62913h 58 min
10/29/2023https://bugfest-poppy.int.aws.folio.org/Poppyfull marc21 SRS+Inventory3002023-10-29T09:36:052023-10-29T17:53:198 130 6298h 17 min
10/29/2023https://bugfest-poppy.int.aws.folio.org/Poppyfull marc21 SRS3002023-10-29T18:15:352023-10-30T03:48:097 869 6629h 33 min
10/31/2023https://bugfest-poppy.int.aws.folio.org/Poppyfull marc21 Inventory300

2023-10-31T14:04:46

2023-10-31T15:04:33

260 1721h
11/02/2023https://bugfest-poppy.int.aws.folio.org/Poppyfull marc21_withholdings Inventory3002023-11-02T07:00:282023-11-02T07:58:11260 26358 min
01/24/2024https://bugfest-poppy-consortium.int.aws.folio.org/Poppy

full

marc21_withholdings

-2024-01-24 12:43:352024-01-24 14:18:24735 594

1h 35min

Harvesting via central tenant. There were 11 member tenants. Each member tenant had different OAIPMH settings (SRS, Inventory, SRS+Inventory, different max number of records).
01/29/2024https://bugfest-poppy-consortium.int.aws.folio.org/Poppy

full

marc21


-2024-01-29 07:08:072024-01-29 08:04:06735 598

56 min

Harvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 01/24/2024.
01/30/2024https://bugfest-poppy-consortium.int.aws.folio.org/Poppy

full

marc21_withholdings

-2024-01-30 10:35:132024-01-30 11:57:33735 594

1h 22min

Harvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 01/24/2024.
01/31/2024https://bugfest-poppy-consortium.int.aws.folio.org/Poppy

full

marc21


-2024-01-31 05:47:022024-01-31 06:51:10735 599

1h 4min

Harvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 01/24/2024.
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

SRS+Inventory

5002024-04-08 08:03:472024-04-08 08:46:01353 53742 minHarvesting via member tenant (cs00000int_0001)
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

SRS+Inventory

5002024-04-08 09:06:572024-04-08 09:23:04353 54016 minHarvesting via member tenant (cs00000int_0001)
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

Inventory

5002024-04-08 09:42:242024-04-08 09:47:3730 0015 minHarvesting via member tenant (cs00000int_0002)
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

Inventory

5002024-04-08 10:53:502024-04-08 10:56:3630 0013 minHarvesting via member tenant (cs00000int_0002)
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

-2024-04-09 05:52:112024-04-09 07:22:271 163 4751h 30minHarvesting via central tenant. There were 11 member tenants. Each member tenant had different OAIPMH settings (SRS, Inventory, SRS+Inventory, different max number of records).
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

-2024-04-09 08:16:342024-04-09 10:54:501 163 4762h 39minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/09/2024.
04/09/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

Inventory

2002024-04-09 11:07:052024-04-09 12:03:23260 94156 min
 https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21

Inventory

5002024-04-11 09:46:322024-04-11 10:46:09261 0901 h
 https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS

5002024-04-12 14:28:592024-04-13 09:00:117 861 03118h 31min
04/13/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS

5002024-04-13 15:14:232024-04-14 08:39:027 861 033

17h 25min 


04/14/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

5002024-04-14 14:02:492024-04-15 08:39:418 123 02718h 37min
04/15/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

5002024-04-15 15:37:352024-04-16 06:38:006 905 47015h
04/16/2024https://bugfest-poppy.int.aws.folio.org/Poppy SP4

full

marc21_withholdings

SRS+Inventory

5002024-04-16 15:51:462024-04-17 06:03:158 241 93514h 11min
04/17/2024https://bugfest-poppy.int.aws.folio.org/Poppy SP4

full

marc21_withholdings

SRS+Inventory

5002024-04-17 15:56:542024-04-18 05:16:358 246 06813h 19min
04/18/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

502024-04-18 08:59:222024-04-19 12:40:497 910 67927h 50min
04/22/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

-2024-04-22 15:38:312024-04-22 17:23:201 163 7461h 45minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/09/2024.
04/22/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

-2024-04-22 18:00:092024-04-22 21:06:151 163 7503h 6minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/09/2024.
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

-2024-04-23 09:31:242024-04-23 11:13:181 163 7821h 42minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/09/2024.
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

-2024-04-23 11:25:372024-04-23 14:38:341 164 7663h 13minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/09/2024.
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

-2024-04-23 15:17:092024-04-23 18:30:381 163 9063h 13minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/09/2024.
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

SRS+Inventory

5002024-04-23 05:11:182024-04-23 06:01:05353 77550 minHarvesting via member tenant (cs00000int_0001)
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

SRS+Inventory

5002024-04-23 06:57:282024-04-23 07:18:40353 77621 min
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

Inventory

5002024-04-23 08:08:082024-04-23 08:13:1130 0045 min
04/23/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21

Inventory

5002024-04-23 08:48:262024-04-23 08:52:1630 0044 min
04/24/2024https://bugfest-poppy-consortium.int.aws.folio.org/Poppy SP4

full

marc21_withholdings

-2024-04-24 13:13:372024-04-24 15:04:461 049 4981h 51minHarvesting via central tenant. There were 11 member tenants. Each member tenant had different OAIPMH settings (SRS, Inventory, SRS+Inventory, different max number of records).
04/24/2024https://bugfest-poppy-consortium.int.aws.folio.org/Poppy SP4

full

marc21_withholdings

-2024-04-24 15:24:202024-04-24 17:05:361 049 5001h 41minHarvesting via central tenant. There were the same 11 member tenants with the same OAIPMH settings as in the harvesting at 04/24/2024.
 https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

2002024-05-03 05:30:592024-05-03 22:52:508 124 15017h 22min
 https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

2002024-05-04 14:56:222024-05-05 07:38:118 124 16016h 42min
05/14/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

2002024-05-14 10:57:092024-05-15 07:48:108 125 13620h 51min
05/15/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

2002024-05-15 14:54:302024-05-16 10:17:558 125 58719h 23min

05/17/2024

https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

-2024-05-17 11:12:082024-05-17 14:58:221 164 4593h 46minHarvesting via central tenant. There were 11 member tenants. Each member tenant had different OAIPMH settings (SRS, Inventory, SRS+Inventory, different max number of records).
05/29/2024https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia

full

marc21_withholdings

-2024-05-29 15:26:492024-05-29 18:30:261 164 4963h 4minHarvesting via central tenant. There were 11 member tenants. Each member tenant had different OAIPMH settings (SRS, Inventory, SRS+Inventory, different max number of records).
05/29/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia

full

marc21_withholdings

SRS+Inventory

2002024-05-29 19:20:372024-05-30 13:29:198 248 68018h 9min
 https://bugfest-quesnelia-consortium.int.aws.folio.orgQuesnelia SP1

full

marc21_withholdings

-2024-07-05 05:11:292024-07-05 08:29:021 399 9213h 18minHarvesting via central tenant. There were 11 member tenants. Each member tenant had different OAIPMH settings (SRS, Inventory, SRS+Inventory, different max number of records).
07/05/2024https://bugfest-quesnelia.int.aws.folio.org/Quesnelia SP1

full

marc21_withholdings

SRS+Inventory

2002024-07-05 09:18:222024-07-06 02:20:198 257 65817h 2min