Q1 2020 Overall Status Update (History)

This page contains historical data from the Overall Status Update table on the FOLIO Q1 2020 (Fameflower) Weekly Status Report

Report Date

Overall Status Update

Q1 Feature Count on Report Date



FunctionalNFR
2020-04-02

Jakub Skoczen

  • Q1 2020 Release Management
    • Release environment: https://folio-fameflower.dev.folio.org/
    • https://docs.google.com/spreadsheets/d/1NvvCq1wTfDeCnd7zHDIzLI7RBfuSr_Ty0tbzYzgEaI8/edit#gid=0
    • Bugfix releases since last report:
      • ui-erm-usage 2.7.1
      • data-import-processing-core v1.0.1
      • mod-inventory-storage 19.1.1
      • mod-source-record-storage v3.1.2
      • stripes-erm-components 2.3.1
      • ui-licenses 3.7.2
      • mod-data-import-converter-storage v1.7.1
      • stripes-acq-components v2.0.2
      • ui-invoice v2.0.2
      • ui-receiving v1.0.1
      • ui-organizations v2.0.1
      • mod-organizations-storage v3.0.1
      • mod-source-record-manager v2.1.1
      • mod-pubsub v1.1.1
      • mod-inventory 14.1.0
      • od-orders-storage v10.0.1
      • ui-orders v2.0.1
      • ui-data-import v1.8.1
      • mod-circulation 18.0.1
      • mod-invoice-storage 3.1.1
      • mod-erm-usage-harvester 1.6.1
      • mod-licenses v2.1.1
      • mod-finance 2.0.1
      • mod-ncip v1.1.0
      • edge-ncip v1.2.0
      • mod-data-export 1.1.0 
  • Core Platform development  in Sprint 84
    • Hit count issues reported during bugfest:  RMB-591 - Getting issue details... STATUS  
    • RMB 29.4.0: released feature back-port for Edelweiss:
    • RMB 29.5.0 (master), IN DEVELOPMENT:
      • RMB-588 - Getting issue details... STATUS
      • RMB-164 - Getting issue details... STATUS
    • Okapi 2.38.0 released with the following performance fixes:
      • OKAPI-813 - Getting issue details... STATUS  reported by Martin Tran, related:
      • OKAPI-811 - Getting issue details... STATUS  reported by Wayne Schneider, related:
    • Automatic Migrations / Module Upgrade  related:

Getting issues...

Getting issues...

2020-03-26

Jakub Skoczen

  • Core Platform development  in Sprint 84
    • RMB 29.3.2: released
      • Julian working on mod-inventory-storage 19.1.1  with RMB 29.3.2 and optimized upgrade path for Edelweiss → Fameflower
    • RMB 29.4.0 (branch) feature backport for Edelweiss:
    • RMB 29.5.0 (master), IN DEVELOPMENT:
      • RMB-588 - Getting issue details... STATUS
      • RMB-164 - Getting issue details... STATUS
  • Automatic Migrations / Module Upgrade  related:
  • Performance related:
    • OKAPI-813 - Getting issue details... STATUS  memory leak reported by Martin Tran, heap dumps delivered from the "no dropwizard" branch are invalid, Martin has been asked to repeat tests
    • OKAPI-811 - Getting issue details... STATUS  reported by Wayne Schneider

Cate Boerema (Deactivated)

Getting issues...

Getting issues...

2020-03-17

Jakub Skoczen

  • Q1 2020 Release Management
    • Platform team handled mod-user-import and mod-login-saml upgrades to RMB 29.x and  Q1 releases.
    • Release candidate env not bootstrapped due to missing module releases.
    • https://docs.google.com/spreadsheets/d/1NvvCq1wTfDeCnd7zHDIzLI7RBfuSr_Ty0tbzYzgEaI8/edit#gid=0
    • platform-core: Missing/unannounced module releases as of Monday 3/16 according to the release spreadsheet (maintainers and POs notified):

      • VEGA : mod-calendar, mod-email, mod-event-config, mod-feesfines, mod-template-engine, mod-sender, ui-calendar, ui-checkin, ui-circulation, ui-myprofile, ui-plugin-find-instance

      • Core:functional ui-checkout, ui-developer, ui-inventory, ui-service-points, ui-tags, ui-user

      • Update as of Tuesday 3/17: Vega modules marked as released. CF: ui-users pending release, rest released.

      • Updated as of Wednesday 3/18 : ui-users has been released. ui-requests had dependency issues which were addressed by Zak. ui-inventory has dependency issues with stripes-util  UIIN-1021 - Getting issue details... STATUS
      • Note: All but mod-event-config (26.x) and mod-sender (26.x) upgraded to RMB 29.x.
    • platform-complete : Missing/unannounced module releases as of Monday 3/16 according to the release spreadsheet (maintainers notified):
      • FSE: edge-patron, edge-sip2, mod-audit, mod-audit-filter, mod-patron, mod-rtac
      • Update as of Tuesday 3/17: All modules marked as released in the spreadsheet or removed from the release.
      • Update as of Wednesday 3/18: mod/edge-patron, mod/edge-rtac and edge-sip2 releases are not compatible with Q1. Matt and Bohdan have been notified. plugin-find-import-profile has dependency issues with stripes-acq-components Taras Tkachenko has been notified.
  • Core Platform development  in Sprint 84
    • RMB 29.3.1 hotfix release to address regressions like   MODINVSTOR-455 - Getting issue details... STATUS . Upgraded mod-inventory-storage 19.1.0 already shipped for Q1.
    • RMB 29.3.2 (branch):
      • RMB-583 - Getting issue details... STATUS  more complete solution to problems like  MODINVSTOR-455 - Getting issue details... STATUS  and a blocker for  RMB-575 - Getting issue details... STATUS
      • RMB-552 - Getting issue details... STATUS  automatic migrations/module upgrade performance releated
    • RMB 29.4.0 (master):
  • Automatic Migrations / Module Upgrade  related:
  • Performance related:
    • OKAPI-813 - Getting issue details... STATUS  memory leak reported by Martin Tran, heap dumps delivered from the "no dropwizard" branch are invalid, Martin has been asked to repeat tests

Anton Emelianov (Deactivated)

  • Meeting today to coordinate data prep for bugfest environment 
  • System is up and running now but need POs to go in and do the data setup work but coordinate whether data will be setup before or after Q1 migration
  • Met with 40 plus testers yesterday
  • Only 30% of test cases have been claimed
  • This week will be dedicated to configuring bugfest system and prepping it for Monday
  • About 10 new members have joined bugfest community (many from Germany)

Goldenrod Focus Tracks

Getting issues...

Getting issues...

2020-03-11

Jakub Skoczen

  • Platform development  in Sprint 84
    • RMB-583 - Getting issue details... STATUS  a blocker for  MODINVSTOR-413 - Getting issue details... STATUS  (blocked in PR due to poor performance) but also for a "keyword" search performance regressions  MODINVSTOR-455 - Getting issue details... STATUS  discovered last week 
  • Automatic Migrations / Module Upgrade  related:
    • OKAPI-773 - Getting issue details... STATUS
    • RMB-552 - Getting issue details... STATUS  (impact on migration performance)
  • Performance related:
    • OKAPI-813 - Getting issue details... STATUS  memory leak reported by Martin Tran, a branch out for testing
  • Q1 2020 Release Management 
    • Most modules upgraded to RMB 29.x on master
    • Modules still without a maintainer/team:
      • mod-login-saml
      • mod-user-import
    • mod-user-import release at risk for Q1 2020 –  Spitfire (responsible for changes in Q1) has no capacity to maintain the module. The Plaform team has picked up  MODUIMP-9 - Getting issue details... STATUS  to ease the release efforts


Cate Boerema (Deactivated)

  • Last week of Q1 development
  • Focus in wrapping up Q1 features and must-fix bugs
  • Much of this sprint will be focused on code reviews and creating releases


Getting issues...

Getting issues...

2020-02-25

Jakub Skoczen

  • Platform Development in Sprint 83:
    • RMB-559 - Getting issue details... STATUS  – streaming utility for RMB, requested by Kruthi Vuppala (Concorde) for  MODINV-196 - Getting issue details... STATUS
    • RMB-499 - Getting issue details... STATUS  – support for normalised searching of ISBN (and ISBN-like) fields, requested by Cate and Charlotte for  UIIN-647 - Getting issue details... STATUS
    • MODINVSTOR-438 - Getting issue details... STATUS
    • Okapi bug reports – tested by Hongwei with good results
      • OKAPI-795 - Getting issue details... STATUS  (raised by Hongwei)
      • OKAPI-796 - Getting issue details... STATUS  (raised by Hongwei)
    • OKAPI-509 - Getting issue details... STATUS
    • OKAPI-773 - Getting issue details... STATUS
  • Migrations  Discussed Q4 migration performance with Carole Godfrey. Julian has analysed the logs and script and identified long migration time as related to to the "effective location" migration script and not an issue in RMB/Okapi. Specifically for Q4 timeouts should be extended to accommodate long migration time. 
  • Performance Discussed Daisy vs Edelweiss performance with Martin Tran. There has been perf regressions of response time of ~30% for check-in/check-out. It's not clear if it's related to a specific module (e.g Inventory calls saw an improvement). We have speculated that the regression might be related to MODAT-56 - Getting issue details... STATUS . Martin will run the test again on a combination of older mod-authtoken and newer Okapi and use Giraffe to try to analyze where the degradation happens. Also, Okapi 2.37 was tested and there's a 30% increase in response times.
  • Search by call number
    • UIIN-985 - Getting issue details... STATUS
      Only "lightweight" normalisation for the "eye readable" search will be addressed in Q1. Blocked on  MODINVSTOR-444 - Getting issue details... STATUS  which does not require new Platform development (only new index configuration). 
  • Security Audit : three vulnerabilities reported in the first round, four in the second:
    • High: lack of permissions on an endpoint potentially carrying sensitive information – actual severity is lower as the sensitive information is not used for production deployments. Potentially related:  OKAPI-767 - Getting issue details... STATUS
    • Medium: header injection. Fixed in RMB in Q4 RMB-478 - Getting issue details... STATUS lack of rollout in certain module likely cause of the problem
    • Medium: token expiry. Known,  FOLIO-1233 - Getting issue details... STATUS  severity is low due to MODAT-56 - Getting issue details... STATUS

Cate Boerema (Deactivated)

  • 2 weeks until RMB, Stripes, OKAPI deadline 
  • 3 weeks until general module release deadline
  • Core Functional Q1 2020 features:

type key summary assignee reporter priority status resolution created updated due
Loading...
Refresh

  • In addition to the above features, CF has made significant progress on  UXPROD-88 - Getting issue details... STATUS  which wasn't originally targeted for Q1 but the stories were ready and we were blocked on other things (e.g.  UXPROD-2260 - Getting issue details... STATUS  was blocked by  UXPROD-2246 - Getting issue details... STATUS Lesson: features with ready requirements get developed.  Those that aren't ready are left behind.
  • Core Functional taking Call number searching (thin thread) from Core Platform, as they weren't tracking to get it done

Getting issues...

Getting issues...

2020-02-18

Jakub Skoczen

  • Platform Development in Sprint 82:
    • RMB-559 - Getting issue details... STATUS  – streaming utility for RMB, requested by Kruthi Vuppala (Concorde) for  MODINV-196 - Getting issue details... STATUS
    • RMB-499 - Getting issue details... STATUS  – support for normalised searching of ISBN (and ISBN-like) fields, requested by Cate and Charlotte for  UIIN-647 - Getting issue details... STATUS
    • Okapi bug reports: 
      • OKAPI-795 - Getting issue details... STATUS  (raised by Hongwei)
      • OKAPI-796 - Getting issue details... STATUS  (raised by Hongwei)
  • Discussed Q4 migration performance with Carole Godfrey. Julian has analysed the logs and script and identified long migration time as related to to the "effective location" migration script and not an issue in RMB/Okapi. Specifically for Q4 timeouts should be extended to accommodate long migration time. 
  • Search by normalised call numbers: 
    • UIIN-985 - Getting issue details... STATUS   UIIN-857 - Getting issue details... STATUS  should be considered in requirements analysis phase (not ready for development) latest implementation proposal from Frances Webb addresses most  UIIN-985 - Getting issue details... STATUS  but not all scenarios ( UIIN-857 - Getting issue details... STATUS )
  • Security Audit: three vulnerabilities reported so far (details kept private):
    • High: lack of permissions on an endpoint potentially carrying sensitive information – actual severity is lower as the sensitive information is not used for production deployments. Potentially related:  OKAPI-767 - Getting issue details... STATUS
    • Medium: header injection. Fixed in RMB in Q4 RMB-478 - Getting issue details... STATUS lack of rollout in certain module likely cause of the problem
    • Medium: token expiry. Known,  FOLIO-1233 - Getting issue details... STATUS  severity is low due to MODAT-56 - Getting issue details... STATUS

Getting issues...

Getting issues...

2020-02-11

Cate Boerema (Deactivated)

  • Discussion of how to store UXPROD-81 - Getting issue details... STATUS  data is ongoing
    • Vince and Marc were able to agree that the first step is to store check-ins so we will do that now which will allow us to complete the feature (because the data will be persisted)
    • More conversations are still needed to decide on whether and how to use mod-audit for storing and reporting on this data.  See comments in this story for some of the considerations:  CIRCSTORE-182 - Getting issue details... STATUS
  • Per the Thunderjet team, it's best to wait before using PubSub until some performance issues have been addressed
    • Given this, Core Functional will hold off on pursuing PubSub to address data synchronization:
  • Core Functional is picking up MODINVSTOR-439 - Getting issue details... STATUS from Concorde but is blocked awaiting Core Platform work
  • Core Functional is considering picking up  UXPROD-2185 - Getting issue details... STATUS  from Core Platform, as this work is delayed.  Might be a good way to expose some additional backenders to RMB.
  • Need to analyze state of Q2 requirements

Jakub Skoczen

  • sprint 82
  • Platform Dev section: 
      • in the current sprint two tickets are being investigated:
        • OKAPI-795 - Getting issue details... STATUS  (raised by Hongwei)
        • OKAPI-796 - Getting issue details... STATUS  (raised by Hongwei)
    • Limited capacity to address functionality related tickets – issues will be evaluated and priotized on a case-by-case basis, so far the following items are planned for Q1:
      • RMB-500 - Getting issue details... STATUS  – support for streaming "downloads" (note: bulk "imports" were added to Inventory instances/holdings/items by the team in Q4 and had good feedback from migrations), requested by Kruthi Vuppala (Concorde) for  MODINV-196 - Getting issue details... STATUS
      • RMB-499 - Getting issue details... STATUS  – support for normalised searching of ISBN (and ISBN-like) fields, requested by Cate and Charlotte for  UIIN-647 - Getting issue details... STATUS
      • MODINVSTOR-435 - Getting issue details... STATUS  and  CIRCSTORE-184 - Getting issue details... STATUS  – requested by BNCF for slow open loan queries, 

        https://folio-project.slack.com/archives/C9BBWRCNB/p1579860339261200

      • pending Q1 requests:  UXPROD-2185 - Getting issue details... STATUS  (search by normalised call number)
  • In addition, the following remaining DevOps tasks have/are being completed this sprint:

Getting issues...

Getting issues...

2020-02-04

Cate Boerema (Deactivated) - Repeating my update from last week because we didn't get to discuss it.

  • Q1 planning finalized.  See dashboard.

  • Q4 release closed.  
    • Statistics: Cross Release Statistics
      • In the end, the amount of work completed in Q4 2019 was very comparable to Q3 2019
      • That said, we clearly over-committed compared with previous quarters.  We committed to almost twice what we completed, resulting in a high percentage of "spillover" features.  Potential reasons:
        • Failure to account for increased bug fixing given we now have a production user
        • UNAM team dropping out
        • Over-commitment by teams not using the cap plan for planning (e.g. @Cult, Course reserves)
        • Requirements not ready for Export 
        • Technical dependencies between teams
      • For Q1, we have taken measures to avoid this issue:
        • Accounting for more bug fixing in the cap plan
        • Being more careful about accounting for technical dependencies and requirements readiness in planning
        • Our baseline committed feature count (90 features) is much more in line with previous quarters.
  • Other news:
    • Darcy Branchini taking over for Khalilah as lead PO for Vega
    • Core Functional putting  UXPROD-501 - Getting issue details... STATUS  on hold, as it is blocked by fee/fine work ( UXPROD-2246 - Getting issue details... STATUS )
    • To replace this work, Core Functional has begun development on  UXPROD-88 - Getting issue details... STATUS  which had previously been scheduled for Q2 
    • Discussing storage of  UXPROD-81 - Getting issue details... STATUS  data
      • In house use is looking like just a type of circulation data which ought to be captured in the circulation log (planned to leverage mod-audit)
      • While circ log was not deemed MVP, In house use was
      • This means we need to consider getting mod-audit fit for purpose.  See comment here, for Vince's thoughts on steps:  CIRCSTORE-182 - Getting issue details... STATUS
    • Anne-Marie is scheduling a knowledge sharing meeting on PubSub with from Core Functional, Thunderjet and Folijet to discuss what impact this may have in your apps.  Core Functional has a couple of bugs it has on hold awaiting a stable version of PubSub:

Getting issues...

Getting issues...

2020-01-29

Jakub Skoczen

  • combined sprint – 80 and 81
  • Starting from sprint 80 the Platform team is being restructured:
  • Platform Dev section: 
    • with the departure of EBSCO developers (Eric and Hongwei) Dev sub-team has been reduced to 2 devs: Adam (IndexData) and Julian (OLE/GBV)
    • Dev team will remain responsible for maintenance of Platform components – Okapi, RMB and authentication/authorization (mod-permissions/mod-authtoken/mod-login).
    • Performance optimisations remain a strong focus area:
      •  in Q4 2019 various inventory search/filtering and authentication/authorization perf improvements were delivered, many of which has had positive impact across the entire platform, including high-level circulation operations like check-in and check-out
      • in Q1 2020 the team will focus on generic solutions to improve business-logic layer (check-in/check-out/renewals but also other API operations, best combined with local optimisations in individual modules but capacity in the functional teams remains a challenge) and core infrastructure performance (Okapi/mod-authtoken/mod-permissions) plus any specific perf issues raised by the community.
      • in the current sprint two tickets are being investigated:
        • OKAPI-795 - Getting issue details... STATUS  (raised by Hongwei)
        • OKAPI-796 - Getting issue details... STATUS  (raised by Hongwei)
    • Limited capacity to address functionality related tickets – issues will be evaluated and priotized on a case-by-case basis, so far the following items are planned for Q1:
      • RMB-500 - Getting issue details... STATUS  – support for streaming "downloads" (note: bulk "imports" were added to Inventory instances/holdings/items by the team in Q4 and had good feedback from migrations), requested by Kruthi Vuppala (Concorde) for  MODINV-196 - Getting issue details... STATUS
      • RMB-499 - Getting issue details... STATUS  – support for normalised searching of ISBN (and ISBN-like) fields, requested by Cate and Charlotte for  UIIN-647 - Getting issue details... STATUS
      • MODINVSTOR-435 - Getting issue details... STATUS  and  CIRCSTORE-184 - Getting issue details... STATUS  – requested by BNCF for slow open loan queries, 

        https://folio-project.slack.com/archives/C9BBWRCNB/p1579860339261200

      • pending Q1 requests:  UXPROD-2185 - Getting issue details... STATUS  (search by normalised call number)
    • Limited capacity to keep maintaining orphaned and "no clear maintainer" modules, this includes:
      • mod-users
      • mod-users-bl
      • mod-user-import
      • mod-login-saml
      • mod-configuration
  • Platform DevOps resources (Ian, John and David) are being consolidated with the IndexData DevOps team. Until the project finds replacements or additional resources, ID DevOps will provide ongoing, steady-state support for:
    • maintenance of reference environments: folio-snapshot, folio-snapsthot-stable, folio-testing,
    • maintenance of the CI and build infrastructure (Jenkins) — integration, builds and testing for FOLIO modules
    • maintenance of the FOLIO Kubernetes cluster and related environments (e.g continuous snapshot environment, migrations env, performance env)
    • help with design and tooling for production-ready FOLIO deployments (systems documentation and diagrams, examples)
    • supporting FOLIO Release Management -- Q1 2020
    • general infrastructure support for FOLIO developers
  • In addition, the following remaining DevOps tasks have/are being completed this sprint:


Cate Boerema (Deactivated)

  • Q1 planning finalized.  See dashboard.

  • Q4 release closed.  
    • Statistics: Cross Release Statistics
      • In the end, the amount of work completed in Q4 2019 was very comparable to Q3 2019
      • That said, we clearly over-committed compared with previous quarters.  We committed to almost twice what we completed, resulting in a high percentage of "spillover" features.  Potential reasons:
        • Failure to account for increased bug fixing given we now have a production user
        • UNAM team dropping out
        • Over-commitment by teams not using the cap plan for planning (e.g. @Cult, Course reserves)
        • Requirements not ready for Export 
        • Technical dependencies between teams
      • For Q1, we have taken measures to avoid this issue:
        • Accounting for more bug fixing in the cap plan
        • Being more careful about accounting for technical dependencies and requirements readiness in planning
        • Our baseline committed feature count (90 features) is much more in line with previous quarters.
  • Other news:
    • Darcy Branchini taking over for Khalilah as lead PO for Vega
    • Core Functional putting  UXPROD-501 - Getting issue details... STATUS  on hold, as it is blocked by fee/fine work ( UXPROD-2246 - Getting issue details... STATUS )
    • To replace this work, Core Functional has begun development on  UXPROD-88 - Getting issue details... STATUS  which had previously been scheduled for Q2 
    • Discussing storage of  UXPROD-81 - Getting issue details... STATUS  data
      • In house use is looking like just a type of circulation data which ought to be captured in the circulation log (planned to leverage mod-audit)
      • While circ log was not deemed MVP, In house use was
      • This means we need to consider getting mod-audit fit for purpose.  See comment here, for Vince's thoughts on steps:  CIRCSTORE-182 - Getting issue details... STATUS
    • Anne-Marie is scheduling a knowledge sharing meeting on PubSub with from Core Functional, Thunderjet and Folijet to discuss what impact this may have in your apps.  Core Functional has a couple of bugs it has on hold awaiting a stable version of PubSub:

Getting issues...

Getting issues...

2020-01-21

Weekly status cancelled due to WOLFcon

Getting issues...

Getting issues...