Abstract
The purpose of this study was to develop a quality appraisal tool for the assessment of laboratory basic science biomechanical studies.
Materials andScore development comprised of the following phases: item identification/development, item reduction, content/face/criterion validity, weighting, test-retest reliability and internal consistency. For item identification/development, the panel was asked to independently list criteria and factors they considered important for cadaver study and generate items that should be used to appraise cadaver study quality. For content validity, the content validity ratio (CVR) was calculated. The minimum accepted content validity index (CVI) was set to 0.85. For weighting, equal weight for each item was 6.7% [15 items]. Based on these figures the panel was asked to either upscale or downscale the weight for each item ensuring that the final sum for all items was 100%. Face validity was assessed by each panel member using a Likert scale from 1–7. Strong face validity was defined as a mean score of >5. Test-retest reliability was assessed using 10 randomly selected studies. Criterion validity was assessed using the QUACS scale as standard. Internal consistency was assessed using Cronbach's alpha.
Five items reached a CVI of 1 and 10 items a CVI of 0.875. For weighting five items reached a final weight of 10% and ten items 5%. The mean score for face validity was 5.6. Test-retest reliability ranged from 0.78–1.00 with 9 items reaching a perfect score. Criterion validity was 0.76 and considered to be strong. Cronbach's alpha was calculated to be 0.71 indicating acceptable internal consistency.
The new proposed quality score for basic science studies consists of 15 items and has been shown to be reliable, valid and of acceptable internal consistency. It is suggested that this score should be utilised when assessing basic science studies.
