Systematic monitoring of male circumcision scale-up in Nyanza, Kenya: exploratory factor analysis of service quality instrument and performance ranking.

Background: Considerable conceptual and operational complexities related to service quality measurements and variability in delivery contexts of scaled-up medical male circumcision, pose real challenges to monitoring implementation of quality and safety. Clarifying latent factors of the quality instruments can enhance contextual applicability and the likelihood that observed service outcomes are appropriately assessed.

Objective: To explore factors underlying SYMMACS service quality assessment tool (adopted from the WHO VMMC quality toolkit) and; determine service quality performance using composite quality index derived from the latent factors.

Study Design: Using a comparative process evaluation of Voluntary Medical Male Circumcision Scale-Up in Kenya site level data was collected among health facilities providing VMMC over two years. Systematic Monitoring of the Medical Male Circumcision Scale-Up quality instrument was used to assess availability of guidelines, supplies and equipment, infection control, and continuity of care services. Exploratory factor analysis was performed to clarify quality structure.

Results: Fifty four items and 246 responses were analyzed. Based on Eigenvalue >1.00 cut-off, factors 1, 2 & 3 were retained each respectively having eigenvalues of 5.78; 4.29; 2.99. These cumulatively accounted for 29.1% of the total variance (12.9%; 9.5%; 6.7%) with final communality estimates being 13.06. Using a cut-off factor loading value of ≥0.4, fifteen items loading on factor 1, five on factor 2 and one on factor 3 were retained. Factor 1 closely relates to preparedness to deliver safe male circumcisions while factor two depicts skilled task performance and compliance with protocols. Of the 28 facilities, 32% attained between 90th and 95th percentile (excellent); 45% between 50th and 75th percentiles (average) and 14.3% below 25th percentile (poor).

Conclusion: the service quality assessment instrument may be simplified to have nearly 20 items that relate more closely to service outcomes. Ranking of facilities and circumcision procedure using a composite index based on these items indicates that majority performed above average.