Mission

The Performance Task Force (PTF) mission is to support the FOLIO community by

• providing a performance testing environment, a performance testing framework, execution of performance tests
• creating and maintaining standards for performance test scripts.

Having a Having a central and consistent environment will be key to display and convey test results to all teams. Equally important is having a common testing methodology and interpretation of test results that will enable everyone in the community to understand the results the same way.  The team will execute tests to establish   

The Performance Task Force (PTF) mission is to support the FOLIO community by

• providing a performance testing environment
• executing performance tests to establish baseline performance metrics, to check for performance regressions, and to investigate performance issues. 
• creating and maintaining standards for performance test scripts.

Operation

PTF 

• Set up carrier-io framework, performance testing environment, maintaining environment
• Develop performance testing guidelines and JMeter standards
• Execute tests and share results with teams, and create JIRA defects or stories for teams to address performance issues.
• Investigate performance issues reported by the community
• Review test cases contributed by teams
• Balance short term versus long term goals
  • Short Term 
    • Release performance system before the end of Q2 2020
    • Work directly with early implementers, e.g., Chalmers, to get their feedback on the FOLIO's performance
    • Create and execute tests for the highest/most impactful scenarios.
    • Investigate performance issues
    • Receive test scripts from teams and help them execute tests
    • Communicate with teams to share results and analysis
  • Long Term
    • Hooking carrier-io framework into CI pipelines.
    • Evolve carrier-io framework/system into a package that can be distributed across teams to enable teams to execute tests on their own.
    • Train teams to use carrier-io so they can execute the tests themselves
• Short term:
• Long term
• Scope of analysis:
• FOLIO and integration points
• Do not analyze third-party systems, which include FOLIO clients, but may make recommendations of how to better integrate with FOLIO
• Do not fix performance issues, only identify and report them

...

• Work with their team to identify performance scenarios to be investigated. Create JIRA tickets on the PTF board.
• Help PTF to triage and and prioritize PTF tests backlog.  Stephanie Buck will facilitate the discussions between PTF and the POs on priority.
• If performance issues are reported by PTF product owners would prioritize them on their team's board to have the issues fixed.

...

• Contribute JMeter test scripts to be run
• Keep JMeter test scripts up to date.
• Contribute seed data that are relevant to the test scenarios that the test scripts would run against. 
• Contribute scripts to load and unload the seed data
• Fix performance issues found by PTF

...