2004 Jordan Institute
9, No. 4
Using Data to Enhance Child Welfare Practice
Everyone who works in child welfare in North Carolina knows that there are people in Raleigh and Washington, D.C. who are paid to evaluate the effectiveness of our child welfare system and make decisions about policy and funding. We know these professionals base their evaluations and decisions on data, which Websters defines as information, especially information organized for analysis or used as the basis for decision-making.
Most child welfare workers also know that they themselves are the source of much of this data, and that they add to it every time they enter information such as a childs name, age, or grade in school on forms like the NCDSSs 5104, Report to the Central Registry/CPS Application.
Though child welfare workers and their agencies put a lot of effort into collecting, entering, and passing on information, their role relative to data and evaluation is usually a passive one: once data are collected, the people on the front lines tend to wait for outside experts to tell them what the data means, how they are doing relative to performance measures, and what they should do to improve. Traditionally, child welfare agencies are data generators, not data consumers.
When an agency practices self-evaluation, it develops the capacity to use the information it has collected about itself and its community to enhance its work with families. The advantages of this approach include improvements in:
For a glimpse how self-evaluating agencies use data to engage staff, see Using Data-Based Newsletters to Engage Staff, Others Around Child Welfare Outcomes.
Longitudinal data allows practitioners, evaluators, and administrators to look at complete and accurate information about the experiences of all children in child welfare. Today, county DSSs are most familiar with the longitudinal data that the Division delivers in the form of the periodic experiences reports. These reports provide counties with data that reflects their performance on certain child welfare indicators:
Experiences reports enable counties to compare their performance on these indicators over time to the state as a whole, to counties of similar size, and to their own past performance. County-specific and statewide experiences reports can be found at <www.dhhs.state.nc.us/dss/childrensservices/stats/ctyexp.htm>.
Judy Wildfire, a professor at the UNC-Chapel Hill School of Social Work, is convinced it can. To persuade us, Wildfire, who helps agencies build their capacity to work with longitudinal data, conducted an analysis of the longitudinal data file that was the basis for the most recent experiences report.
First, using data for the whole State, Wildfire selected information related to the goal of serving children in the least restrictive placement possible. Specifically, she examined the experiences of children who initially entered placement between July 1, 1998 and June 30, 2003.
The data (see fig. 1, below) tell us that during this time most children were placed in a family-like setting, usually a foster home or kin home. However, they also tell us that older children were much more likely to be placed in non-family-like settings. About 50% of teens went to this type of placement.
Curious, Wildfire looked at where these teens were placed (see fig. 2, below). The numbers (not shown) reveal that each year slightly more than 300 teens were placed in congregate care facilities. This represents less than 10% of all the children who initially entered placement during this period.
In self-evaluating agencies, this is where supervisors and frontline staff come in. They know where policy and practice meet. They see with their own eyes when interventions work.
So we invite you and your agency to look at the experiences report data for your county with regard to initial placements. How do the experiences of teens in your county fit with the experiences of teens statewide? Do you place 50% of your teens in congregate care?
Once you have answered this question, your agency can decide whether the data have implications for practice. For example, if you find you do place 50% of teens in non-family-like settings, you must decide whether this is a good or bad thing. Perhaps all of these kids have needs that are best addressed by this type of placement. If so, your placement pattern may be appropriate. Then again, maybe teens are going to group care due to an inadequate number of foster homes for teens in your community. If so, you might consider a targeted foster parent recruitment campaign.
The point is, agencies must reach their own conclusions about what their data means and what to do about it.
To learn more about self-evaluation and working with longitudinal data, consult Measuring Outcomes in Child Welfare, a teaching manual developed by members of a Family to Family evaluation team from the UNCChapel Hill School of Social Work. You can find it online at <www.unc.edu/~lynnu/campmanual.pdf>.