English

Evaluation Questions Checklist

Virtually all evaluation guidance materials stress the need for good evaluation questions, yet the evaluation literature generally has provided only broad guidance on developing them. To help get to good questions–questions that are likely to lead to actionable evaluation findings–we created a checklist for use in assessing potential evaluation questions. The list is grounded in the evaluation literature and has benefitted from the practice wisdom of many evaluators inside and out of CDC. 

Finding the Right People for Your Evaluation Team

Broad stakeholder engagement is an essential element of the National Asthma Control Program’s approach to evaluation. People who have been included in evaluation planning and implementation are more likely to help ensure that the findings, which represent an investment of their time, are put to use. And so it follows that the evaluator is but one member of a team of people necessary to make the most of your evaluation.

Cultural Competence Assessment Tool for State Asthma Programs and Partners (CCAT)

We have created this packet to help you think about how to build your evaluation team. It includes a sample job description for an evaluator; a list of evaluator competencies; and sample letters for recruiting members of your strategic and individual evaluation planning teams.

With ever-growing diversity in the United States, cultural competence for all public health programs is an ethical imperative. The Cultural Competence Assessment Tool for State Asthma Programs and Partners (CCAT) is a practical resource designed to promote and enhance cultural competence among our many asthma partner organizations. Based on the Culturally and Linguistically Appropriate Service (CLAS) Standards, the CCAT is a self-assessment tool designed to guide programs in assessing the cultural competence of their own programs. Using a flexible, team-based approach, programs use the CCAT internally, with the aim of identifying program strengths and areas for improvement in cultural competence.

METHODS

As part of the Children’s Health Study, we measured lung function annually in 2120 children from three separate cohorts corresponding to three separate calendar periods: 1994–1998, 1997–2001, and 2007–2011. Mean ages of the children within each cohort were 11 years at the beginning of the period and 15 years at the end. Linear-regression models were used to examine the relationship between declining pollution levels over time and lung-function development from 11 to 15 years of age, measured as the increases in forced expiratory volume in 1 second (FEV1) and forced vital capacity (FVC) during that period (referred to as 4-year growth in FEV1 and FVC).

RESULTS

Over the 13 years spanned by the three cohorts, improvements in 4-year growth of both FEV1 and FVC were associated with declining levels of nitrogen dioxide (P<0.001 for FEV1 and FVC) and of particulate matter with an aerodynamic diameter of less than 2.5 μm (P= 0.008 for FEV1 and P<0.001 for FVC) and less than 10 μm (P<0.001 for FEV1 and FVC). These associations persisted after adjustment for several potential confounders. Significant improvements in lung-function development were observed in both boys and girls and in children with asthma and children without asthma. The proportions of children with clinically low FEV1 (defined as <80% of the predicted value) at 15 years of age declined significantly, from 7.9% to 6.3% to 3.6% across the three periods, as the air quality improved (P=0.001).

CONCLUSIONS

We found that long-term improvements in air quality were associated with statistically and clinically significant positive effects on lung-function growth in children. (Funded by the Health Effects Institute and others.)