Skip to Main Content

Computer Search Report Checklist (CSRC): Definitions - computer search reproducibility

Working set of definitions

This working set of definitions was used as a part of a recent study on the reproducibility of computer searches.  

Terms are in the left column, with definitions in the right.

Computer resource

A computer tool, search engine, or search function that the researcher uses to discover sources that contain substantive information or data to be synthesized as they address research topics in systematic reviews (SR).

Computer search

A researcher's choice of computer resources, and the researcher's complete use of those resources (steps taken, terms input, etc.) to the point of seeing computer search results to evaluate. Those choices and steps reflect what are often called computer search elements.

Computer search result

A listing of “hits”. The list of hits is on search screens after each computer search is run. Each computer search hit is brief information that represents a corresponding document that has the fuller content (substantive information) potentially of use for the SR.

Computer search report (CSR)

A computer search report is defined as a researcher's published description of computer search steps and choices (including the researcher's use of search results or "hits" for inclusion/exclusion decisions). Such reports are seen as detailing the actions taken to discover and select items with content to be used for review purposes. These steps are viewed as taking place prior to when full attention is given to "data extraction" or summary or synthesis activities.

A reproduced computer search

This is where a second researcher reads a CSR published by a first researcher, and the second researcher uses that CSR to develop and execute a computer search that uses the same computer resource(s), with the same steps, as those used by the first researcher.

Reproducibility of a computer search (CSr)

The extent to which a second researcher might execute a reproduced computer search. Ideally the CSr for a given SR is the extent to which reproduced computer searches might be executed for every computer resource used in that SR.  

Recommended CSR element

A computer search choice or characteristic that should be used and then reported or evident as used in SR.  These are found in major SR manuals and publications.

Computer search item

An explicitly worded statement or question that represents or addresses all or part of a recommended computer search element.  These are found on checklists.