Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Mission

The Performance Task Force (PTF) mission is to support the FOLIO community by

  • providing a performance testing environment, a performance testing framework, execution of performance tests
  • creating and maintaining standards for performance test scripts.

Having a Having a central and consistent environment will be key to display and convey test results to all teams. Equally important is having a common testing methodology and interpretation of test results that will enable everyone in the community to understand the results the same way.  The team will execute tests to establish   

The Performance Task Force (PTF) mission is to support the FOLIO community by

  • providing a performance testing environment, a performance testing framework, execution of performance tests to establish baseline performance metrics, to check for performance regressions, and to investigate performance issues. 
  • creating and maintaining standards for performance test scripts.

Operation

PTF 

  • Set up carrier-io framework, performance testing environment, maintaining environment
  • Develop performance testing guidelines and JMeter standards
  • Execute tests and share results with teams, and create JIRA defects or stories for teams to address performance issues.
  • Investigate performance issues reported by the community
  • Review test cases contributed by teams
  • Balance short term versus long term goals
    • Short Term 
      • Release performance system before the end of Q2 2020
      • Work directly with early implementers, e.g., Chalmers, to get their feedback on the FOLIO's performance
      • Create and execute tests for the highest/most impactful scenarios.
      • Investigate performance issues
      • Receive test scripts from teams and help them execute tests
      • Communicate with teams to share results and analysis
    • Long Term
      • Hooking carrier-io framework into CI pipelines.
      • Evolve carrier-io framework/system into a package that can be distributed across teams to enable teams to execute tests on their own.
      • Train teams to use carrier-io so they can execute the tests themselves
  • Scope of analysis:
    • FOLIO and integration points
    • Do not analyze third-party systems, which include FOLIO clients, but may make recommendations of how to better integrate with FOLIO
    • Do not fix performance issues, only identify and report them

...