Testing - basic database work
-
Construct a pair of dummy dataset files containing randomly generated rows and columns of numerical values. -
Write an importer for the dummy dataset.
Write tests for the basic database workflow:
-
Intialize the database and clear its content. -
Import the data from the first file on one MPI process and on multiple MPI processes. All data should be distributed evenly among the MPI processes. -
Import the data from the second file on one MPI process and on multiple MPI processes. Check if all data has been imported correctly and evenly. -
When working with multiple MPI processes, monitor the scaling of the file read. We should observe a decrease in loading time and memory required per MPI process as the number of MPI processes increase.
Remarks
- Intialize logs with the INFO level only.
- Monitor logs and report any insufficiencies or possible improvements. Our aim is to have no clutter and understandable overview of the whole process.
Edited by Rajko Cosic