Skip to content

Testing - basic database work

  • Construct a pair of dummy dataset files containing randomly generated rows and columns of numerical values.
  • Write an importer for the dummy dataset.

Write tests for the basic database workflow:

  • Intialize the database and clear its content.
  • Import the data from the first file on one MPI process and on multiple MPI processes. All data should be distributed evenly among the MPI processes.
  • Import the data from the second file on one MPI process and on multiple MPI processes. Check if all data has been imported correctly and evenly.
  • When working with multiple MPI processes, monitor the scaling of the file read. We should observe a decrease in loading time and memory required per MPI process as the number of MPI processes increase.

Remarks

  • Intialize logs with the INFO level only.
  • Monitor logs and report any insufficiencies or possible improvements. Our aim is to have no clutter and understandable overview of the whole process.
Edited by Rajko Cosic