2019-02-04 RPWG Meeting notes

How to Structure Reporting Subgroup meetings moving forward

All

• Shall we open up this group to the rest of the Reporting SIG?

• make this a working group with homework?

• move the meeting time to mornings?

 Next Steps

• building out the schema data and/or loader

• need to have sample data catch up

• see if members of Reporting SIG are willing to stand up their own database

• look at documenting in GITHub
  
  

Please give Nassib Feedback on these items

• look at "not available" data label

• continue testing loans and users schema

• feedback on the data generator
  
  
  

State of Development

• building data warehouse features

• accommodate historical data

• working on data loader, making it performant

• working on adding data for second prototype

• data loader can do incremental updates and can be run in batch mode

• Roman working on new sample data generator

• Need sample data

• 1 million loan transactions in database
  
  

Documentation

• "Getting Started" documentation in the wiki

• Query and Software Development documentation maintained in GitHub

Data Structure

• review

loans

https://glintcore.net:8443/ldp/schemaspy/tables/loans.html

users

https://glintcore.net:8443/ldp/schemaspy/tables/users.html

• we can track versioning of dimension tables

• record effective attribute is a time stamp showing when the data was loaded

• "keys" added to allow multiple rows with the same userid (at different times)
  
  

Star Schema

• for testing the Star Schema, be sure you are working with "d_" or "f_" tables; this naming convention will change soon