Skip to Main Content

Computer Search Report Checklist (CSRC): Reproducibility

Used to collect computer search (CS) information in systematic reviews. Goal was to assess CS for reproducibility.

Reproducibility of Computer Searches

This section is a place for information related to using the CSRC to guide the evaluation of computer search reporting to determine the reproducibility of computer searches.

Four areas of concern

Four areas of concern for researchers and readers of SR.

  1. Reproducibility of electronic searches.  This is the possibility or likelihood of actually reproducing an electronic search, using the same resources and steps.
  2. Confidence in reproducibility of electronic searches. 
  3. Replication of electronic searches.  This is the actual reproducing of electronic searches.
  4. Confidence in replication of electronic searches.

CSRC-R. A tool used for assessment

As part of the CSRC project, for a number of years computer search reports (or reports of electronic searches) in SR were evaluated for information that supports reproducibility. Those versions used items selected/adapted from the "original CSRC", and were "dubbed" the CSRC-R. Qualtrics versions of the CSRC-R have been used for ongoing work as indicated below. The QAESR version aimed to be a "short version".

© 2021 Kent State University All rights reserved.