[ Main Page of Report | Contents of Report ]
Many of the studies funded with the targeted Policy Research funds in Fiscal Years 1998, 1999 and/or 2000 are still on-going projects. However, several ASPE-funded studies, supported in whole or in part by the targeted Policy Research funds, have been completed or have released interim findings since our last report. Primary among them are findings from the National Academy of Sciences' Panel on Data and Methods for Measuring the Effects of Changes in Social Welfare Programs, the ASPE-funded grantees studying welfare leavers, several researcher-initiated grants to study welfare outcomes, and some other longer-term projects. This chapter includes both findings from completed projects and some interim results or products from continuing projects.
A substantial proportion of our prior years' welfare outcomes funding has been devoted to partnering with states and counties through grants to study the experiences of people who left the TANF program ("leavers") or were diverted from welfare. Another sizable portion of our FY 1999 and 2000 funding was used to support competitively selected researcher-initiated proposals to study a variety of welfare outcomes questions. Below are highlights of findings on leavers as well as more detailed findings from other projects, including very early findings from the diversion studies. Details of grantee findings on welfare leavers are included in Appendix B.
[ Go to Contents ]
All of the 1998 grantees and one of the 1999 grantees(1) studying welfare leavers have released reports(2) based on linked administrative data sets that tracked families who left welfare. In addition, 12 of the 15 leavers grantees have released final reports that incorporate more detailed findings based on information gathered through follow-up surveys of samples of former recipients. Highlights from these reports are presented below, with a focus on outcomes in employment and earnings, recidivism and program participation, and household income and material hardship. Despite some methodological differences in study design (and a few outliers), these reports show a surprising amount of consistency among findings across sites and different TANF programs, particularly in the areas of employment and recidivism.
In general, employed leavers tended to work 40 hours a week, when working, and typically earned between $6.50 and $9.00 an hour. Employment was intermittent, however, and median quarterly earnings of employed leavers ranged from $1,900 to $3,400 across the 15 studies in the first quarter after exit. Earnings rose in every location over the course of the year following exit.
State and local reports showed a wider range of outcomes across the studies with respect to post-exit use of Medicaid and Food Stamps.
Only about one-fifth to one-third of leavers had employer-sponsored or other medical insurance, indicating that large numbers of leavers had no health insurance. The percentage of adult leavers without insurance ranged from 7 to 45 percent across nine states; uninsurance rates for children ranged from 8 to 33 percent.
Among studies that collected information on leavers' receipt of other program benefits, commonly received forms of government assistance included free school lunches, the federal Earned Income Tax Credit, and housing assistance.
Although household income is difficult to measure, eight studies provided information on household income. In addition, four studies estimated poverty rates, and all 12 studies with surveys gathered information on material hardship and family well-being.
Estimated poverty rates of families who left welfare ranged from 41 to 58 percent, depending in part on whether food stamps were included in measures of family income. Evidence from one study suggests that leavers had lower poverty rates and higher incomes than a sample of families remaining on welfare.
Studies were split as to whether food and housing shortages were greater before or after exit from welfare. None of the studies reported a significant change in the use of homeless shelters before and after exit, or in experiences with separations of children from the family. When asked about overall economic well-being, between half and two-thirds of leavers in five studies reported being better off after leaving TANF than before leaving TANF.
In sum, findings across the 15 studies showed that about three-fifths of leavers were working, generally 40 hours per week. Former recipients experienced intermittent spells of unemployment and financial hardship, however, and about one-fourth to one-third returned to welfare at least once in the first year after exit in most states studied. Although quarterly earnings rose over time, total household incomes remained fairly low, averaging about $1,400 or less per month. Access to health insurance and food stamps appeared problematic for some recipients, and there also were reports of food shortages and inability to get needed medical attention. Evidence was mixed as to whether material hardships were greater before or after exit; families generally reported that they were better off overall after exit from welfare.
A more detailed synthesis of findings from ASPE-funded leavers studies is attached as Appendix B.
[ Go to Contents ]
Appropriations conference report language accompanying the targeted welfare outcomes research funding for Fiscal Years 1998 and 1999 included the recommendation that the Department submit its research plan to the National Academy of Sciences (NAS) to receive guidance on research design and recommendations for further research. Accordingly, we provided over $1 million in Fiscal Year 1998, 1999 and 2000 funding to the NAS to convene an expert panel to evaluate current and future welfare reform research.
The Panel on Data and Methods for Measuring the Effects of Changes in Social Welfare Programs released an interim report in September 1999, Evaluating Welfare Reform: A Framework and Review of Current Work, Interim Report, which provided a framework for conducting evaluations of welfare program changes, reviewed current Departmental efforts to evaluate these changes, and provided the Panel's initial conclusions and recommendations. The short-run recommendations for welfare evaluation strategies were consistent with the Department's research on welfare reform, and many of the recommended steps were already being taken.
Findings from the Panel's final report, Evaluating Welfare Reform in an Era of Transition, were released April 5, 2001. The report discussed how best to measure and track program eligibility, participation, child well-being, and other outcomes; data, research designs, and methods for the study of welfare reform outcomes; and needed areas and topics of research. The report also addressed alternative federal and state data sources, the limitations of currently available data, and appropriate evaluation design and methods for analysis. In brief, while the report applauded the Department for a welfare reform research agenda that "is impressive in scope, volume and diversity," it highlighted the need for further improvements and expansions in data collection, development of research questions, and methodological work, as shown in the recommendations below. Highlights of the Panel's recommendations follow.
Broad Data Issues
Program Issues and Research Questions
Methodological Issues
Copies of the forthcoming report are available through the Academy's website at <www.nas.edu>.
ASPE awarded approximately $807,000 in grants in FY 1999 to support seven researcher-initiated proposals to study important questions related to the outcomes of welfare reform. Through these grants, we supported efforts to analyze a variety of information about low-income individuals (both adults and children) and their families, including their economic and non-economic well-being and their participation in government programs. Final reports have been received from four of the grantees and are summarized below.
RAND Corporation: A Stock-Flow Analysis of the Welfare Caseload: Insights from California's Economic Conditions (1999)
This technical study by researchers at the RAND Corporation examined the methods used in previous studies to explain changes in welfare caseloads in the context of economic expansion and major welfare policy changes. The authors modeled the welfare caseload (stock) as the net outcome of past flows onto and off assistance and explored the implications of such a stock-flow perspective for understanding the determinants of caseload size and its evolution over time. This methodology suggests that the economy has had a greater effect on caseload reduction than suggested by other economic models. Researchers found that approximately half the caseload decline in California could be attributed to the changing economic conditions as measured by the unemployment rate.
Resources for Human Development, Inc.: An Evaluation of Six Welfare-to-Work Programs in Philadelphia (1999)
Resources for Human Development, Inc. (RHD) is a large community agency in Philadelphia that operates six Welfare-to-Work (WtW) programs, which are designed to assist hard-to-serve TANF recipients and their families. The study, completed in November 2000, found that:
SPHERE Institute: Caseload Dynamics and the Business Cycle: Implications for Welfare Policy (1999)
This study built on research the SPHERE Institute conducted under contract with the Public Policy Institute of California to model caseload dynamics using aggregate county caseload counts. It explored the role of economic conditions and caseload characteristics on the role of program performance in California. The author examined cash aid recidivism and the take-up of other forms of assistance by welfare leavers in California. Three separate cohorts of families were tracked - those leaving welfare in 1988, 1993, and 1998 - for a period of 18 months following their exit from the program. Outcomes for the 1998 cohort were compared across different regions of California. Key findings from the report are:
University of Kentucky Research Foundation: The Impacts and Outcomes of Welfare Reform across Rural and Urban Places in Kentucky (1999)
This study by the University of Kentucky Research Foundation examined the impact of the differential spatial distribution of economic opportunities on the outcomes of current and former AFDC/TANF recipients, including employment and earnings. Findings indicated that patterns of assistance, such as the length of time on TANF and the rate of entry into TANF, reflect urban/rural differences as well as differences across rural areas. Compared to the rest of the state, the rate of caseload decline was lowest in the most remote rural areas.
University of Michigan School of Social Work: Work and Well-Being among Welfare Leavers and Stayers (1999)
This project used data from the Women's Employment Survey (WES) to examine the impacts of welfare reform on economic outcomes as well as on measures of non-economic well-being among specific subgroups of recipients, such as racial minorities and women exposed to domestic violence. WES is a longitudinal data set tracking single mother welfare recipients in an urban Michigan county. Three reports analyzing data from 1997 and 1998 waves of the WES have been released. The first one examines the association of health, mental health, and domestic violence problems with employment, and finds that women who reported depression and serious physical limitations worked less. The second report examines associations between employment and changes in health status, and finds that women who were physically less healthy were also more likely to suffer from major depression. With the exception of a decline in the rate of depression, there was little overall change in the health status of the women during the study period. The third report focuses on domestic violence, and finds that women who had recent and persistent experiences with domestic violence were more likely to suffer from economic hardship than women who had not.
The Urban Institute: Living Arrangements, Work, and Welfare Decisions Among Single Mothers (1999)
This report by the Urban Institute examined the factors affecting single mothers' living arrangements and how these arrangements affect single mothers' decisions regarding work and welfare. The study found that single mothers who live with their parents are less likely to rely on welfare than those who live independently. Living with parents also increased the likelihood that a single mother worked or attended school. When single mothers who live independently are compared with those living with adults other than parents or partners, there is no difference in their welfare and work choices. The authors suggest that policies aimed at encouraging single mothers to live with their parents may reduce welfare use and increase work effort among single mothers.
In fiscal year 1997, ASPE funded the University of Wisconsin Institute for Research on Poverty (IRP) to conduct an administrative data study of the outcomes of families who left AFDC in Wisconsin during 1995. In this 1999 follow-up study, the Institute tracked the outcomes for women in the first study further and the outcomes of a second group of women who left AFDC closer to the time of implementation of Wisconsin Works (known as W-2, Wisconsin's replacement for AFDC, which was implemented in the fourth quarter, 1997). As in the original project, the continuation analysis used linked administrative data from the state including: (1) AFDC data, food stamp data, and Medicaid data from the Client Assistance for Re-Employment and Economic Support administrative database (CARES), and (2) earnings and employment data from the Unemployment Insurance records database (UI).
The final report, Before and After TANF: The Utilization of Noncash Public Benefits by Women Leaving Welfare in Wisconsin, used analyses of linked state administrative data to examine food stamp receipt and Medicaid coverage among mother-headed families who stopped receiving cash welfare assistance for at least two months beginning in the last quarter of 1995 or 1997. The main findings from the study include:
In addition to pre- and post-TANF cohort comparisons, the study also examined the longer-term outcomes (i.e., three years after exit) of those women who left cash welfare in 1995. The following main points emerge from this analysis:
The Institute for Research on Poverty (IRP) issued the final report as an IRP Special Report in Spring 2001; further information on the study can be found at <www.ssc.wisc.edu>.
ASPE undertook a data project to create a set of data files to be used for comparing different definitions of the working poor population based on variations in the definitions of worker, family, the poverty threshold, and total income. The project, conducted by Mathematica Policy Research, Inc. (MPR), used data from the Survey of Income and Program Participation (SIPP) that allow analysts to vary the definition of poverty threshold to include several of the alternative definitions for poverty measurement proposed by the National Academy of Sciences(4). ASPE received data reports outlining the composition of the working poor population under different working poor definitions as well as cleaned and documented ASCII (plain text) data files to be used for further analysis and exploration. The resulting data files facilitate comparisons across working poor groups based on multiple definitions and lay the groundwork for future research on alternative poverty definitions and improved understanding of the characteristics of working poor families. MPR will be issuing an additional SIPP data extract file that includes additional poverty measurement variations.
This project estimates the impact of welfare reform on rural and small metropolitan regions since 1993. The report examines 12 rural and small metropolitan regions across the country. It identifies changes in wages and employment for the low-skill labor force over two periods: 1993 to 1996, and 1996 to 1998. The report finds that rural and small metropolitan labor markets easily absorbed welfare recipients who went to work, largely because the economy was experiencing strong growth. The number of new jobs was much greater than the number of welfare recipients who started to work. Wages for low-skill workers declined from 1993 to 1996 in 8 of the 12 regions, but recovered in the second period, from 1996 to 1998. There was little evidence of workers being displaced from their jobs by welfare recipients.
The Federal Parent Locator Service (FPLS) contains the complete national quarterly wage (unemployment insurance and federal employment) and new hire databases as well as registry of child support cases. It provides extensive opportunities for doing welfare and child support research using data from these records. The legislation governing the FPLS stipulates that the data contained in the system must be removed after two (2) years, but allows the creation of research samples which endure past that point. ASPE and ACF retained Social and Scientific Systems to propose design options for a research framework for such samples, which includes matching samples of cases in the system with other administrative data systems in order to get socio-demographic characteristics and program participation data for the samples.
The first step in this project was an analysis of recommended avenues of research using the FPLS. After conducting a series of consultations with prominent researchers around the county, a wide range of research opportunities were identified in a report released in May 2000. Research questions ranged from those that could be answered using only the FPLS database to those that could be answered by linking federal databases such as the TANF database, the Medicaid Statistical Information System (MSIS), or the Child Care Information System to those that required geographic-specific or state policy information in addition to the FPLS.
TANF-related research issues that could be addressed with data from the FPLS or a combined HHS database include characteristics of TANF leavers and TANF entrants over time; participation by TANF leavers in the child support enforcement (IV-D), unemployment insurance (UI), and Medicaid programs; and the relationship between Medicaid receipt, TANF receipt, and earnings.
Some of the child support research issues that could be addressed with data from the FPLS or a combined HHS database include variation in custodial and noncustodial parent employment and earnings based on order and paternity establishment, interaction between the receipt of public assistance (e.g., Medicaid, TANF) and child support order establishment and receipt, speed of order establishment, variation in custodial and noncustodial parent residence over time, and employment and earnings characteristics of noncustodial parents relative to custodial parents over time.
The second part of this project was a report proposing three database design options: 1) a unified welfare and child support research database centered on the MSIS that links in the FPLS and the TANF database; 2) a welfare research database centered around the TANF database, supplemented with FPLS and MSIS data; and 3) a child support research database centered around the Federal Case Registry, enhanced by linking to TANF database or the MSIS. These data provide extensive opportunities to conduct longitudinal welfare and child support operations monitoring, policy development, and research, and to look at the interaction between public programs. For example, an integrated database could tell us about interaction between the receipt of public assistance (e.g., TANF, Medicaid) and child support order establishment. An intra-agency work group has been convened by ACF to assess the proposed options.
Through an interagency agreement with the ACF's Office of Child Support Enforcement (OCSE), ASPE provided funds to support statistical research using matched new hire and quarterly wage data from the files of the National Directory of New Hires (NDNH) database. Use of NDNH data improves the quality of the information on employment outcomes, because this database captures employment in other jurisdictions, and with the federal government, which do not appear in state Unemployment Insurance records. ASPE funds supported programming time and other one-time infrastructure costs related to linkages between the NDNH data and samples drawn for research projects, such as the ASPE-funded grants to study welfare outcomes of former TANF recipients. OCSE performed this match for the District of Columbia, one of ASPE's FY 1998 welfare outcome grantees, and other grantees are considering requesting additional matches. (A link to the District's report, The Status of TANF Leavers in the District of Columbia, Final Report, is available at <http://aspe.hhs.gov/hsp/leavers99/reports.htm#dc.>)
Broad-based population data are essential to studying the well-being of the low-income population. The American Community Survey (ACS) is a new Census Bureau program that will make regular intercensal estimates of the distribution of characteristics of households, families and persons in small areas such as census tracts and for small population groups (for example, specific Asian or Hispanic nationality groups, specific age groups, and so forth). The ACS is currently being conducted in 31 diverse sites across the country. The Census Bureau expects to fully implement the survey in every county starting in 2003. ASPE and the Bureau of the Census jointly sponsored a conference on June 6-7, 2000, which convened a group of researchers, policy makers and local practitioners to explore the potential uses of this new data source and to explore the development of econometric models that combine ACS data with local area administrative data and local business economic data to provide local area data. A conference summary report and the conferees' recommendations are available from the Bureau of the Census.
[ Go to Contents ]
While the majority of ASPE-funded studies of TANF applicants and divertees are still in the data collection or analysis stage, some preliminary findings are available. The grantees that have either released reports or gathered preliminary data include: Florida, Illinois, South Carolina, Texas, Wisconsin, and the two consortia of counties in the Bay Area of California. A more complete picture of the circumstances of families who have applied for TANF will emerge throughout the coming months, as more findings from these studies become available. However, a few themes have emerged. First, based on data that have been reported to date, divertees and TANF applicants appear to be worse off, on average, than individuals and families leaving TANF. Fewer applicants are employed in the months following application, and applicants are more likely to rely on government assistance such as food stamps, Medicaid, and TANF. While these findings are preliminary, they are not surprising, as one would expect that individuals who are applying for TANF would have more economic difficulties than those who are leaving cash welfare. Second, the "applicant" population is harder to locate than the leavers population. While the typical ASPE-funded leavers study achieved response rates of 70 to 75 percent, most of the surveys of TANF applicants and divertees have been able to obtain responses from only about 55 to 60 percent of the sample. Finally, it will be even more difficult to make cross-state comparisons across these studies than among studies of TANF leavers. In both sets of studies, grantees had significant discretion over their research questions and construction of their surveys. However, while studies of TANF leavers used a common definition of leaver (as those who left TANF and remained off the rolls for at least two months), the definitions of "applicant" or "diverted" populations vary considerably by grantee, making comparisons across the studies more difficult.
The Project on Devolution and Urban Change being conducted by the Manpower Demonstration Research Corporation (MDRC), is an on-going, multi-disciplinary, longitudinal study that examines the implementation and effects of welfare reform in four large urban areas Cleveland, OH; Philadelphia, PA; Los Angeles, CA; and Miami, FL. The project brings together data from many sources: longitudinal administrative data for families dating back to 1992, survey data, an implementation study, neighborhood indicators, an institutional study focusing on local service providers, and an ethnographic study of families. This multi-component approach allows researchers, in the absence of experimental data, to capture effects that might be missed using only one approach, and to improve understanding of the strengths and weaknesses of each approach. The project is co-funded by numerous foundations, DHHS and USDA. Two reports have been released this year. A project description and links to all publications from the Urban Change project are available at: <http://www.mdrc.org/WelfareReform/UrbanChange.htm>.
Post-TANF Food Stamp and Medicaid Benefits: Factors that Aid or Impede Their Receipt (January 2001). This paper focuses on practices in welfare offices in the four cities to understand reasons for the decline in Food Stamp and Medicaid participation that occurred nationally between Fiscal Years 1996 and 1999. The study, which was conducted in early 2000, found that:
Since this study was conducted, both the Centers for Medicare and Medicaid Services (CMS)/ DHHS (formerly the Health Care Financing Administration) and USDA have taken steps to address these problems by improving information and removing some of the administrative hurdles for working families.
Social Service Organizations and Welfare Reform (February 2001). This report examines the knowledge, views, experiences, and expectations about welfare reform among staff in community-based organizations in urban neighborhoods with large concentrations of welfare recipients. The agencies included churches, small grassroots organizations, and larger established organizations. They provided various services including education and employment preparation, basic needs, child care, school and youth services, and health care.
The Kaiser Family Foundation released a research report in April entitled Caring for Immigrants: Health Care Safety Nets in Los Angeles, New York, Miami and Houston, which documents the results of a study conducted by the Urban Institute and sponsored jointly by the Kaiser Family Foundation and various federal agencies - including DHHS, the U. S. Department of Agriculture and the Immigration and Naturalization Service of the Department of Justice. Several reports already have been issued under this project. A final report is expected by the Fall of 2001. Kaiser publications on immigrant health policy can be found at <http://www.kff.org/content/2001/2241>.
Major findings include:
[ Go to Contents ]
1. Grants were awarded in FY 1998 to ten states and three large counties or consortia of counties (Arizona, the District of Columbia, Florida, Georgia, Illinois, Massachusetts, Missouri, New York, Washington, and Wisconsin; and Cuyahoga County, Ohio, Los Angeles County, California, and San Mateo, Santa Cruz, and Santa Clara Counties, California). Separate but comparable studies were also funded in Iowa (with FY 1999 funding) and South Carolina (in FY 1998 and 2000, as part of a longer-term project) resulting in a total of 15 studies with findings on former recipients as of spring 2001.
2. Links to reports from the ASPE-funded "leavers" grants to states and counties can be found at: <http://aspe.hhs.gov/hsp/leavers99/index.htm>.
3. Dates in parentheses following the title of each project identify the Fiscal Year(s) in which the study was funded.
4. In May 1995, in a report (Measuring Poverty: A New Approach) responding to a 1990 Congressional request, the National Academy of Sciences (NAS) Panel on Poverty and Family Assistance proposed a new approach for developing an official poverty measure for the United States, although it did not propose a specific set of dollar figures. The panel argued that the current poverty measure has weaknesses both in the implementation of the threshold concept and in the definition of family resources; that changing social and economic conditions over the last three decades have made these weaknesses more obvious and more consequential; and that, as a result, the current measure does not accurately reflect differences in poverty across populations and across time.
Top of Page
Contents
Main Page of Report |
Contents of Report
Home Pages:
Assistant Secretary for Planning and Evaluation
(ASPE)
U.S. Department of Health and Human Services
(HHS)