Obviously some system is needed to ensure code on the master branch compiles and runs as expected... ideally with little or no human intervention.
Necessary Features:
- Build executable with all compilers available on machine, report build errors
- Run regression tests from reg_tests/ directory, report run errors
- Compare output to baseline output, report answer changes
Some discussion has taken place on the developer's mailing list:
- Recommendation to avoid shell scripts as much as possible
- Look into CMake / CTest?
Besides needing to create this testing infrastructure, I think we need to completely overhaul reg_tests/ so that it will play nice with the test system and be more amenable to introducing new regression tests.
Obviously some system is needed to ensure code on the master branch compiles and runs as expected... ideally with little or no human intervention.
Necessary Features:
Some discussion has taken place on the developer's mailing list:
Besides needing to create this testing infrastructure, I think we need to completely overhaul reg_tests/ so that it will play nice with the test system and be more amenable to introducing new regression tests.