From 7d3f68ca822c80e39a52bd4bcfb9ea13ad5ce61c Mon Sep 17 00:00:00 2001 From: bloodstalker Date: Wed, 25 Jan 2017 00:57:21 +0330 Subject: updated the test plan --- docs/tests.md | 19 ++++++++++++++++++- 1 file changed, 18 insertions(+), 1 deletion(-) (limited to 'docs') diff --git a/docs/tests.md b/docs/tests.md index 09e217a..7eb63e5 100644 --- a/docs/tests.md +++ b/docs/tests.md @@ -36,12 +36,29 @@ Also as an extra test, mutator is periodically run over all the C standard libra Needless to say, there are extra measures taken in the source code to make sure that mutator does not crash or hang.
Smoke tests are integrated into the build process.
+### Code Metrics and Code Coverage + +For determining the code coverage, mutator is currently using the facilities provided by Clang though it does not, to the best of my knowledge, provide MC/DC coverage.
+The coverage results will be made public after we start writing the unit tests either through [coveralls](https://coveralls.io) or a similar service.
+Project mutator currently has no means of getting the code metrics. If you have a way, plesee do let me know.
+ ### Unit Tests For unit tests, mutator will be using a human oracle for the first time the tests are being conducted. After the results are verified, we'll use the results determined to be true by the human oracle.
Unit tests are mutator's way of validation.
mutator will also feature XML and JSON schema files to make sure that the data generated for the reports are in the correct form and by extension find possible faults in the code. The faults detected, needless to say, are not limited to report generation, which is the primary reason of mutator having schemas for the reports it generates.
+##### project mutator is currently looking for unit testers. If you are interested, you can email me at thabogre@gmail.com .
+ ### Regression Tests -After the test results have been verified by a human oracle for the first time, we'll use the verified results as the oracle. Verifications will be performed by a script.
\ No newline at end of file +After the test results have been verified by a human oracle for the first time, we'll use the verified results as the oracle. Verifications will be performed by a script.
+Regression tests will be run periodically on the code-base.
+ +### Code Review + +After the implementation is done and we branch a release candidate, code reviews will start.
+Code reviews will be done by someone other than the person who wrote the code(hopefully!) if I manage to find people who are willing to help.
+Due to project mutator's currently limited resources, the initial review plan is to have someone just review code without the presence of the developer and contact him if he/she has any questions.
+ +#### project mutator is currently looking for code reviewers. Contact me at thabogre@gmail.com if you are interested.
\ No newline at end of file -- cgit v1.2.3