Search â–¸ Agenda item attachment
Transmitting Communication from Yi-An Huang, City Manager, relative to the appropriation of $500,000, from Free Cash, to the Public Investment Fund Executive Extraordinary Expenditures account to support an evaluation of the Rise Up Cambridge Cash Assistance for Families Program
RISE UP CAMBRIDGE STUDY
RESEARCH DESIGN
SEPTEMBER 7, 2023
1
Introduction1
In June of 2023, the City of Cambridge, Mayor Sumbul Siddiqui, in partnership with the
Cambridge Community Foundation and Cambridge Economic Opportunity Committee (CEOC)
launched the Rise Up Cambridge initiative. The initiative's goal is to address the growing
economic divide and racial inequities in Cambridge through direct cash transfers. The initiative
is an investment of $22M in American Rescue Plan Act funds. Cambridge households with
children under 21 years of age, earning at or below 250 percent of the Federal Poverty Level,
will receive $500 per month for 18 months. Families are also eligible to receive additional
services and wraparound supports through CEOC. A unique feature of this initiative is that all
Cambridge families with children under 21 and with low income are eligible to enroll. The
initiative has enrolled a total of 1,921 families, which represents the total number of eligible
families.
Rise Up Cambridge is one among over 30 guaranteed income initiatives that cities and counties
throughout the U.S. are implementing. The COVID-19 pandemic accentuated the existing
income divides and made it clear that many Americans are a step away from falling into
poverty. The response from the federal government and philanthropy to the immediate
pandemic crisis offered an opportunity to explore guaranteed income as a policy that adds to
existing safety net programs to support families with low incomes. For Cambridge families at or
below 250% of the federal poverty level, $500 a month has the potential to create significant
change. Cambridge is an incredibly high-cost city, with a median income for married couples
with children of nearly $190,000.2 Of Cambridge’s 47,777 households, 1,898 qualify for the Rise
Up Cambridge initiative. Of these families, 43% are headed by single mothers, and 44% are at or
below the FPL.3
In June 2023, the sponsors of Rise Up Cambridge selected MDRC to lead an evaluation of its
initiative.4 The main objectives that Rise Up Cambridge seeks through this effort are to: inform
policy change, (2) advance Cambridge anti-poverty practice, and (3) increase
knowledge/understanding of cash transfer programs. As detailed in MDRC’s proposal, the Rise
Up Cambridge study will examine how these cash payments help residents with low incomes,
how the money is utilized, and what are the benefits from the cash transfers. This project will
use a mixed-methods approach to quantify outcomes of the initiative and understand the
pathways through which these outcomes are achieved, as well how these outcomes change
over time. The project will use a comparative lens to capture how families experiencing
different circumstances benefit from the initiative and will center the voices of initiative. Later
sections of this design document will detail the merits of the evaluation approach and related
Important considerations.
1 This document is the product of a collaborative process with staff from the Cambridge Community Foundation
and the Cambridge Economic Opportunity Committee.
2 Cash Empowers: Rise Up Cambridge Bridges Gaps for Families. Data at a Glance, June 2023.
3 Cash Empowers, 2023.
4 MDRC is a nonprofit, nonpartisan research organization dedicated to building reliable evidence to improve
policies affecting people with low incomes (www.mdrc.org).
2
This document serves as a blueprint for the research that will be conducted for this initiative. It
builds on MDRC’s original proposal and incorporates evaluation ideas and goals brainstormed
with the research advisory team at CEOC and CCF. The document is divided into three sections.
In the first section, the document discusses how the study will add to the cash transfer policies
knowledge base and make contributions to the field. The next section presents the research
design for this project. This section includes the study’s comparative approach, methodological
approach and data collection, and analytical approach. The final section presents the ways this
project will engage community residents through its work with the Research Advisory Council
(RAC) and community researchers, the deliverables for the project, and a timeline that will
guide the work.
A. Guaranteed Income as a Policy to Support Financial Stability
Basic income policies that transfer cash to families “with no strings attached” represent a
conceptually simple but politically controversial approach to strengthening the nation’s safety
net, improving family well-being, and advancing equity. Unlike conditional cash transfers, which
require individuals to engage in specific activities to earn cash rewards, universal basic income
programs do not come with such requirements. The controversy around guaranteed basic
income often centers around concerns that such transfers will depress work effort, will be used
for unnecessary expenditures, will be too expensive for taxpayers if operated at scale, and may
not contribute to lifting the poorest families out of poverty. In the current policy environment,
and with some politicians now calling for deep cuts in the existing safety net, having strong,
reliable evidence that shows what basic income policies can accomplish is especially critical to
decisions about the future of these policies.
Interest in guaranteed income has grown, in both policy and academic circles, partly driven by
the evaluations accompanying the basic income initiatives springing up around the country.5
These initiatives vary in design -- some are conditional (requirements such as attending school
or working a number of hours) and others are unconditional.6 In addition, payments vary in
format, size, and frequency. Results emerging from these cash transfer programs focus on
outcomes such as poverty and expenditures, labor and employment, education, and health and
healthcare access.7 Much of the literature shows mixed or inconclusive results on outcomes
such as employment, education, health, and community effects. While one program may find
strong positive educational effects, another may find that the program had negative effects.
Some of these differences may be attributable to differences in program type, length, and
amount. Some of that evidence is reviewed here.
5 For example, The Stanford Basic Income lab, the Center for Guaranteed Income Research at the University of
Pennsylvania, and the Jain Family Institute’s Guaranteed Income Initiative are just a few of the institutions
currently conducting research on various guaranteed income initiatives throughout the U.S. Baker et al, 2021.
"Preliminary Analysis: SEED’s First Year.“ Stockton Economic Empowerment Demonstration, p.7.
6 Childs, Heneghan, & Neighly, 2022. “An Examination of Cash Transfers in the U.S. and Canada.” Economic Security
Project, p5
7 Hasdell, 2020 “What We Know About Universal Basic Income.” Stanford Basic Income Lab. p5
3
Overall, studies show that cash transfer payments enable families to invest in basic needs and
increase financial resilience. For example, in the 2022 – 2023 cohort of the Magnolia Mothers
Trust program, the percentage of recipients that reported always being able to pay their bills on
time without borrowing money increased from 17% to 49%. In addition to being able to pay
household expenses, about half (or 51%) of mothers reported that the cash helped them build
up savings.8 Although the program utilized lottery placement, this was a nonexperimental
mixed-methods study. During the COVID-19 pandemic, the stimulus checks were also used to
pay for basic needs and build up household resilience. Research suggests that time may play a
role in the ways families use cash payments. For instance, the first stimulus check was usually
spent on bills and household supplies, while later payments were used to decrease debt or
increase savings.9 Similarly, the Family Rewards Cash Transfer program, a conditional cash
transfer program, reduced housing related hardships and helped parents increase savings.10 It
will be critical to consider how spending on basic needs changes throughout the 18-month
period of cash payments.
Generally, unrestricted cash allows families to allocate more money to all pressing basic needs.
In some cash transfer studies, housing has arisen as one of the ways that households allocate
funds to these needs. In the Vancouver-based randomized control trial (RCT) New Leaf Project,
of those who received cash, days homeless dropped from 79% to 49% in the first month.
Recipients also moved out of homelessness faster than non-recipients, with non-recipients
lagging for 12 months.11 And of 87 mothers in the Magnolia Mother’s Trust program, 24 moved
out of subsidized housing during the year of payment (although this was not a statistically
significant difference).12 However, less evidence has emerged about longer-term housing
changes for those who receive cash.
One of the controversial aspects of cash transfer policies is the concern that cash will reduce
work effort for recipients. Previous experimental studies show that this is possible, but not
always the case. The B-MINCOME RCT in Spain found that households receiving cash were
significantly less likely to have at least one member working. This effect persisted until at least
six months after payments ended. However, these effects were mainly driven by households
with care responsibilities, which could lead to improvements in children's outcomes.13 In
contrast, another RCT in Stockton, California, showed that the cash transfer policies increased
the percentage of program recipients with full time employment rose by 12 percentage points
in one year, as compared to 5 points in the control group. The money participants received
removed material barriers such as reducing work at part-time jobs in order to apply for other
positions and completing job training.14 The experimental study of the Family Rewards cash
8 Campos et al., “Magnolia Mothers Trust 2022- 2023 Evaluation Report.”, p.23 – 24.
9 Childs et al., 2022. p.32.
10 Dechausay et al., 2013.“Conditional Cash Transfers in New York City: The Continuing Story of the
Opportunity NYC–Family Rewards Demonstration.” MDRC
11 2020. “Taking Bold Action on Homelessness.” Foundations for Social Change, p.11.
12 Campos et al., p.26.
13 Timo et al. 2023. The Employment Effects of Generous and Unconditional Cash Support.” SSRN Scholarly Paper.
14 Baker et al. 2021. "Preliminary Analysis: SEED’s First Year.“ Stockton Economic Empowerment Demonstration,
p.19.
4
transfer program found that the program increased the likelihood of self-reported full-time
employment but did not increase employment in or earnings from jobs covered by the
unemployment insurance system.15As we consider the employment outcomes generated by
the Rise Up Cambridge program, it will be critical to consider contexts such as increased care or
time applying to jobs that may accompany reduced working hours.
Like employment, educational outcomes from cash transfer programs have been mixed. A
literature review from the Stanford Basic Income Lab found that educational outcomes, such as
attendance and enrollment, tended to be positively impacted by these programs while student
learning achievement showed fewer improvements.16 Research on the Eastern Band of
Cherokee Indians Casino Dividends found that children from dividend receiving households
increased school attendance for about two and a half days a quarter. If the household was
previously in poverty, this effect almost doubled in size. The dividends were distributed to all
American Indian families on the Eastern Cherokee Reservation and had no foreseeable end
date. The program also increased educational attainment of 19-year olds, although participants
had an incentive to finish high school by 18 as to start receiving the payments themselves. In
this way, the program was similar to a conditional cash transfer program.17 Conditional cash
transfer programs have also been of special interest conditional cash transfer programs. Two
versions of the Family Rewards study, which MDRC conducted across a decade, found mixed
effects of conditional cash payments on educational and other outcomes. The 2007 version
found large positive effects on graduation and performance for ninth graders, while the 2011
version there were no educational effects.18
Studies show that cash transfer programs tend to improve both physical and mental health of
participants, although evidence is mixed. The Stockholm SEED program showed a small but
statistically significant improvement in mental health for the program participants.19 A variety
of studies have found positive effects of cash transfer programs such as increased life
expectancy and increased use of preventative care.20 Of course, some studies found negligible
effects on both physical and mental health, such as the Income Maintenance Experiments in
the late 20th century.21
The number of participants in Rise Up Cambridge suggests that there may be potential for
community-level change. Limited research currently exists on how cash transfer policies affect
communities. The lack of research is likely attributed to the low number of programs that
provide money to a substantial portion of a community. One example of where entire
communities received payments was as part of the Alaska permanent fund. One econometric
15 Childs et al.
16 Hasdell. p16
17 Akee Et al., 2010. ”Parents' Incomes and Children's Outcomes: A Quasi-Experiment Using Transfer Payments
from Casino Profits.” American Economic Journal: Applied Economics , January 2010, Vol. 2, No. 1
18 Dechausay et al., 2016. ”Effects of a Modified Conditional Cash Transfer Program in Two American
Cities.“ MDRC, p55.
19 Baker et al., p17
20 Childs et al.
21 Childs et al., p 124
5
study found that these payments actually increased income inequality. The rationale for this
finding was that as lower income recipients might spend the money on disposable goods (such
as winter coats) while upper classes may invest the money for long term growth.22 There is little
evidence of changes to the physical or sociocultural environments of communities through cash
transfer payments, and the results are inconsistent.23
While the literature has documented a diversity of outcomes, much remains to be known about
the pathways through which participants achieve these various outcomes. Moreover, there is
less known about how cash payment recipients think about these funds and how households’
decision-making processes shape outcomes. MDRC plans to explore these two topics through
rich quantitative and qualitative data. This study also provides the unique lens of a large-scale
unconditional cash transfer program, unlike some randomized control trial programs or smaller
non-experimental pilots. While this study will not be studying community-level effects,
individual effects many differ from smaller scale programs due to the wide network of other
recipients participants may gain support from. The project may also shed light on the potential
of implementing cash transfer programs at scale.
Very soon, the City of Cambridge will have evidence from its pilot effort, Cambridge RISE, an 18-
month guaranteed income pilot. The pilot is being evaluated using a two-group Randomized
Controlled Trial (RCT): 130 single (unmarried) Cambridge caregivers of at least one child under
the age 21 received $500 for 18 months and an additional 156 participants with the same
background as the treatment group. The study should provide unambiguous evidence about
the effects of the cash payments for the groups targeted for this initiative and important
context for the City’s scale of cash payments.
While the overall evidence suggests that guaranteed income programs are promising for
improving family wellbeing and advancing equity, the policy continues to elicit considerable
skepticism if not outright opposition. The rest of this document will lay out a roadmap for the
Rise Up Cambridge evaluation, the types of questions it will examine, and how it will contribute
to the growing body of evidence on guaranteed income.
B. Research questions
Building on the goals of Rise Up Cambridge and the evidence emerging from the field of
guaranteed income evaluations and related research, this project will explore four sets of
questions that are critical to understanding how the initiative contributes to advancing the
goals of the initiative: to help address the growing economic divide and racial inequities in
Cambridge through direct cash transfers.
22 Kozmanski, Kate and Baek, Jungho. 2017. “Can an Oil-rich Economy Reduce its Income Inequality? Empirical
Evidence from Alaska’s Permanent Fund Dividend.” In: Energy Economics, Vol. 65, pp. 98-104.
23 Hasdell et al., p21
6
Figure 1 provides a high-level conceptual framework for thinking about the pathways through
which guaranteed basic income and unconditional cash transfers may affect outcomes. The
types of outcomes and explored further in later sections of this document.
Figure 1: High-level Conceptual Framework For Thinking about GBIs and Outcomes
The overarching question for this study is: What is the role that cash transfer payments play in
the lives of families enrolled in the initiative while the cash payments are in effect?
1. What outcomes does the Rise Up initiative generate for families during the 18-month
period of cash payments and early months afterward?
â—Ź How do families utilize the cash payments transferred through the Rise Up
Cambridge initiative?
â—Ź How does the Rise Up Cambridge initiative contribute to reducing financial
insecurity, if at all?
â—Ź How does the Rise Up Cambridge initiative contribute, if at all, to advancing
economic mobility for families enrolled in the initiative?
â—Ź How does the Rise Up Cambridge initiative contribute to improving the well-
being of families, if at all?
7
â—Ź What types of supports services do families in the Rise Up Cambridge initiative
receive? And, how these services contribute to outcomes observed?
2. What are households perspectives about the initiative and cash payments?
â—Ź How do families think, talk, and make decisions around the cash payments?
â—Ź What meaning do families assign to the cash payments?
â—Ź How do families understand cash payments within a broader set of financial
strategies?
â—Ź How do families plan for the end of cash payments?
â—Ź Do families that were in the Cambridge RISE pilot, think of and plan differently
from families that only enrolled in the Rise Up Cambridge initiative?
● Does the initiative “feel” different for families compared to other safety net
programs?
3. How families with different characteristics and experiencing different circumstances
benefit and experience the initiative? Do some families benefit more than others?
â—Ź How do families with different levels of income experience the cash payments?
â—Ź How do families from different racial/ethnic backgrounds experience the cash
payments?
4. How is the initiative implemented and what is the policy context around this program
in Cambridge?
â—Ź What is the policy context within which the initiative is implemented?
â—Ź How do aspects of the initiative (flat benefit, amount of cash, length) shape
outcomes and experiences of the initiative?
â—Ź How is Rise Up Cambridge implemented?
â—Ź What are some implementation lessons for the field and design of cash transfer
programs?
The MDRC research team will also pay close attention to the results emerging from the
Cambridge RISE evaluation, both the pattern of findings and any unexpected findings, if any.
8
The next few sections outline core features of the study, designed as a descriptive and non-
experimental evaluation. The sections will core outcomes, the comparative analysis approach,
and methods. Our methodology utilizes both quantitative and qualitative methods, including in-
depth interviews and two survey waves delivered in collaboration with Aidkit, analyses of
program data, and focus groups.
Expected Effects and Timing
Rise Up Cambridge is hypothesized to produce a number of different intended effects and at
different points in time (see Figure 2). Immediately after receiving the cash payments, families
may use the cash to pay for household expenses such as rent or food or to payoff debt. Over
the first year after receiving the cash payments, families may use the cash payment for
education or training or may decide to save it up. The study will center on four main categories
of outcomes: (a) outcomes related to financial security, (b) economic mobility, (c) wellbeing,
and (d) self-efficacy and sense of agency. The study will look at these outcomes at the
household and individual (i.e., adults and children) levels.
Financial Security
The Aspen Institute defines financial security as “a state of being wherein a person can fully
meet current and ongoing financial obligations, can feel secure in their financial future, and is
able to make choices that allow them to enjoy life.”24 To say that a household is financially
secure means that it can weather unplanned financial shocks (for example, taking time off due
to illness or doing a home repair) without sacrificing other regular financial obligations such as
paying for rent and utilities. Achieving long-term financial security is usually a process that
starts with having enough month-to-month cash flowing into the household to be able to meet
immediate financial obligations, and being able to save for small, unexpected expenses. A cash
transfer program, like Rise Up Cambridge, may contribute to reduce income volatility by
providing a regular amount of cash into a household’s income. Having a steady source of
income may allow families to meet financial obligations and thus experience less financial
hardship and that can eventually lead to longer-term financial stability.
Achieving financial stability is not solely contingent on cash flows. It is, in part, contingent on
several other factors such as having employment, a living wage, access to safety net programs
(e.g., affordable housing, health insurance). As such, the study will pay attention to the policy
and contextual factors that may shape financial stability.
Economic mobility
Economic mobility refers to having some level of economic success such as increased levels of
income, long-term financial security, asset accumulation and employment with higher earnings
or better working conditions. The Rise Up Cambridge may serve as a steppingstone towards
economic success. For example, families may use their cash payments to pay off debt or
decrease reliance on predatory lending which may be an important step toward long-term
24 The Aspen Institute. 2020*. The State of Financial Security 2020: A Framework for Recovery and Resilience.
9
financial security. Similarly, families may invest cash payments in training or credentialing which
may contribute to obtaining employment with higher earnings or better benefits. Alternatively,
cash payments may allow some individuals to leave poor working conditions or simply search
for better employment. The cash payment may represent funds families can rely on while a
member of the family searches for new employment. Finally, families may invest cash
payments on the purchase of small assets like cars or appliances or save up funds for future
use. These too could represent steppingstones towards long-term economic success.
Wellbeing
Access to health care services and insurance are often associated with income. Those living in
poverty may postpone medical care, may not be able to buy prescription drugs or have health
insurance.25 Cash flow issues may be one reason why those living in poverty delay access to
health, which may have long term health and financial consequences. Thus, having regular
flows of cash in the form of a cash payment may contribute to addressing immediate health
care needs and potentially have longer term positive effects for individuals and families.
There is a bi-directional relationship between levels of poverty and income volatility, and
mental health. One possible reason for this is that people who experience income volatility may
be constantly preoccupied with making ends meet. As such, they may have less cognitive
capacity to focus on other things, have less sense of control over their financial lives, and
limited ability to plan for the future.26 Cash transfer programs may reduce income volatility and
thus, may also affect mental health outcomes like decrease anxiety and depression.27
Given the close link between poverty and residential segregation, many families living in
poverty live in neighborhoods with limited access to supermarkets or healthy food. Moreover,
some of these neighborhoods may also be the sources of stressors (social determinants of
health). As such, it will be important to understand how these environmental factors shape
experiences.
Self-efficacy
Self-efficacy represents a less tangible but equally significant potential outcome of cash
payments. Those receiving Rise Up payments may experience increased feelings of agency and
empowerment over their circumstances. The alleviation of financial strain can facilitate risk
taking, such as leaving a job to pursue a career change or requesting apartment improvements
from a negligent landlord. It can also manifest in changes to social networks, such as a
25 It should be noted that Massachusetts offers near universal healthcare. Thus, health related outcomes will take
into account this policy context.
26 West, Stacia, Castro, Amy and Doraiswamy, P. Murali. 2023. Recurring Cash Transfers to Enhance the Mental
Wellbeing of Americans. In: Nature Mental Health. Vol. 1, pp.148-150.
27 Health and well-being. https://www.stocktondemonstration.org/health-and-wellbeing
10
reduction in time spent in relationships or situations maintained under duress, such as tense
relationships with family in exchange for childcare.28
In addition to generating feelings of agency through the use of cash, the design of the Rise Up
Cambridge program also has the ability to stimulate this response. Unlike many other public
benefit programs, Rise Up participants experience no limits on how the money can be used or
what they have to do to receive it. As families prioritize and spend money over the 18 months,
they have the potential to increase their confidence around financial decision making and may
be able to plan for the future. Ultimately, the $500 monthly cash is fungible, and discerning
which cash resources Cambridge Rise Up participants spend on what will not always
straightforward. Through careful qualitative research, the study will explore the kinds of
“mental accounting” frameworks different families may construct, and whether those
frameworks guide how they think about and use their special cash payments – and whether
and how they shift over time.
Like any other outcome, self-efficacy is contingent on a number of other factors. These may
include existing social networks, existing benefit structures, and mental health. As such, the
study will need to explore these feelings and mindsets in the broader context of the household
and their existing support structures.
C. Comparative Analytic Approach
An overarching feature of our approach is to systematically compare the perspectives,
outcomes, and experiences of different types of households participating in the program. As
described below, the households enrolled in the Rise Up Cambridge are likely to vary widely
along a variety of dimensions that are often associated with income. And it is also likely that the
role that the cash transfers play in the lives of the participating households will also vary widely.
Thus, the comparative framework described below allows this study to dig deeper into the
diversity of their experiences – a strength of this design.
The relatively high-income eligibility set for the Rise Up Cambridge program (250% of the
federal poverty line) means that enrolled families are likely to vary widely in terms of their
income and connections to public benefit systems. In a CCF report on eligible Cantabrigians,
roughly half (44.6%) of those eligible for Rise Up Cambridge are below the poverty line, while
the other half fall between 101 – 250% of the Federal poverty level.29 Using income tiers as a
dimension of comparison will allow the research team to understand how this extra cash
affects those in extreme poverty versus those who have higher incomes. Moreover, given likely
income diversity, the eligible population may also vary widely along a variety of dimensions that
are often associated with income, such as race/ethnicity.
28 Baker at al.
29 Cambridge Community Foundation. 2023. Cash Empowers: Rise Up Cambridge Bridges Gaps for Families. pp.2
11
The enduring legacy of structural racism in Cambridge and throughout the United States make
it imperative to add race as a dimension of comparison. In Cambridge, 22.5% of Black and
African American residents are in poverty, close to 10 times as high as white, non-Latinx,
families. Of those eligible for Rise Up Cambridge, 40.6% are Black or African American, 21.7%
are White, 15.7% are Latinx, and 15.4% are Asian.30 Black Cambridge residents are generally
paying more of their income to housing, have less advanced degrees, and are in many cases
moving out of the city for lower costs of living.31 These barriers represent just some of the ways
that Black and other minority residents may use the cash differently than white residents.
As such, a comparative approach will allow us to capture the diversity of outcomes and
experiences of households enrolled in the program and the role that a cash transfer program
plays in their financial lives. The study will structure most comparisons along two key
dimensions: (1) income tiers based the federal poverty threshold that households are in when
they enter the program, and (2) households’ race/ethnic group identity. Exploring these two
dimensions is central to understanding how a guaranteed income program can help offset
growing economic divide and racial inequality. Moreover, these dimensions would allow the
research team to understand how Rise Up Cambridge families compare to families in other
guaranteed income programs like the Stockton Economic Empowerment Demonstration (SEED)
in Stockton, CA or the Chicago Resilient Communities Pilot in Chicago.
Another reason for giving primacy to households’ starting income tiers and race/ethnicity
directly relates the Rise Up Cambridge cash transfer structure. Because it will pay the same
monthly benefit amount ($500) to all qualifying households regardless of income or family size,
the relative value of the flat-rate benefit and its potential to change recipients’ living
conditions, financial strain, decision making, etc., may differ dramatically among households.
For example, a household with a $10,000 annual income receiving $6,000 in basic income
payments per year would see its annual income increase by 60%, whereas a qualifying
household with $60,000 annual income receiving the same flat payment would experience a
10% annual income gain. The same “one-size-fits-all” payment structure will also likely mean
something different to larger families than smaller families, and we expect that family size may
also be correlated to some degree with income level and race/ethnicity.32 Hence, trying to
understand how households in the different initial income tiers and race/ethnic groups in
Cambridge Rise Up respond both to the payment structure and the payment amount is
important for assessing how the initiative advances equity. It should also inform future
deliberations about critical design elements of this type of basic income policy.
30 Ibid., pp.5
31 Special focus: The State of Black Cambridge. Cambridge Community Foundation. Retrieved September 7, 2023,
from https://cambridgecf.org/ei-report/special-focus/
32 In two separate randomized trials, which transferred substantial amounts of cash to families over three years,
MDRC's Family Rewards demonstration found that the program’s success in reducing poverty and material
hardship was concentrated among families who entered the program with incomes below 50% of the poverty level
(i.e., those in deep poverty) compared with other families. The CCT program also distinctively led this group to
reduce its employment and earnings— although for many parents, that was because the extra cash allowed them
to address their own health problems or to care for other family members with health issues.
12
While the evaluation will mostly focus on these two core comparisons, there are several other
dimensions that will be relevant for exploration. These dimensions are household
composition/size, employment status, health status, education, neighborhood, services
received, receipt of other government benefits, and length of cash payments.
Household composition and size is an important dimension of comparison that is relevant for
understanding the role of Rise Up Cambridge . CCF’s report on Rise Up Eligible families notes
that single parent households headed by women tend to have the lowest average income
compared to other household types.33 Poverty rates for this group grew even further during the
pandemic. 43.5% households eligible for Rise Up Cambridge are headed by single mothers, as
opposed to married couples (48%), cohabitating couples (43.5%), and single fathers (1.1%). In
addition, 63.5% of the eligible population is 21 or younger, with the most common age group
being those 5 – 12 years old.34 Thus, it will be important for this study to pay particular
attention to households that have young children. Understanding how Rise Up Cambridge may
support households with different compositions adds another dimension and nuance to the
study.
Employment status is another dimension of comparison. While most eligible households
contain working adults, 17.5% of households contain no workers.35 The presence and number
of working adults will have a substantial effect on how families use the money, adding another
variation to our study sample.
Many highly skilled workers are underpaid in Cambridge, reflected by the highly educated Rise
Up Cambridge eligible population, with 46.5% of families holding either a Bachelor’s or Master’s
degree.36 These workers will have different advantages in the labor market. As such,
employment effects such as moving to a higher paying job may vary by education level.
Therefore, comparing results by education level will be important to understanding how
households benefit.
Neighborhood of residence is another important dimension of comparison for understanding
the different experiences participants may be having. In Cambridge, public housing and poverty
are not highly concentrated in specific neighborhoods. However, paying attention to
neighborhoods may lend additional context to the circumstances surrounding participants, such
as the presence of food deserts in neighborhoods.
Some participants of Rise Up Cambridge may have participated in the pilot program, Cambridge
RISE. Therefore, length of unconditional cash payments received is an important dimension to
consider as MDRC conducts their evaluation. Cambridge RISE operated for 18 months and
33 The median income for single mothers with children nis under $29,000 per year compared to $191,000 for
married couples with children. Cambridge Community Foundation. 2023.
34 Ibid., pp.4
35 Ibid., pp. 7
36 Ibid., pp.6
13
provided $500 to 120 residents.37 It will be important to look separately at those who
participated in both the pilot and Rise Up Cambridge, as this group of residents will have
received payments for three years and may be seeing outcomes only achievable by this longer
payment horizon. Some residents may also be receiving similar cash payments from other
programs, such as the Trust and Invest Collaborative, although these payments are much
smaller scale.
Recipients of Rise Up Cambridge are being offered additional services upon enrollment, such as
budgeting and financial management, employment-related support services and housing
assistance. Depending on the type and length of service offered, those seeking and receiving
additional services may see different outcomes than the rest of the families enrolled. Thus, it
will be important to explore this nuance as part of our study.
D. Data and Methods
The study proposes a mixed methods approach to address the key research questions of this
study. A mixed-methods approach will allow the research team to bring together a
comprehensive account of the ways in which Rise Up Cambridge may benefit families and how
they experience the initiative. Concretely, the study will use an iterative and multiphase mixed-
methods design. This design consists of various phases of data collection and analysis of
qualitative and quantitative data. During the first phase, the team collects and analyzes
qualitative data, followed by quantitative data collection and analysis and concludes with
another round of qualitative data collection and analysis. Each phase of the project helps
inform the next phase and allows for deeper exploration of some topics identified.38
Community members will be involved in this process of decision making and refining through
the Research Advisory Council and Community Researchers. The key research questions of this
project are interconnected, informed by each round of data collected and analyzed, and call for
both general understanding of the initiative’s outcomes and experiences, as well as
understanding of how outcomes come about and the nuances of experiences and perspectives.
Using a mixed-methods approach will allow us to quantify outcomes and at the same time
unearth mechanisms that underlay these outcomes. Moreover, the proposed methodological
approach can contribute to identify factors associated with positive outcomes and the meaning
that participants attribute to those outcomes. This iterative approach will allow the research
team to build on each phase and take advantage of the strengths of qualitative and quantitative
methods.
As shown in Figure 3, the study uses the following quantitative and qualitative data collection
methods:
Figure 3: Mixed Methods Approach Used in the Rise Up Cambridge Evaluation
37 "Join the movement for guaranteed basic income.“ Cambridge Community Foundation.
https://cambridgecf.networkforgood.com/projects/128827-cambridge-rise
38 Creswell. Mixed Methods Research – Ch. 3
14
Longitudinal in-depth interviews with a selected number (24 – 30) of participants enrolled in
Rise Up Cambridge. To capture key dimensions of comparison (income level and race/ethnicity),
the participants will be selected using purposive sampling. That is, the team will explicitly select
participants from across the different income tiers and race/ethnic groups (partially weighted
according to their distribution39). The research team may consider other criteria for selection.
Participants selected will be invited to participate in up to 4 one-hour interviews over the data
collection period (see Figure 3). The initial interview will provide a general overview of four
aspects of participants’ lives: (a) household characteristics and dynamics, (b) financial strategies
and decisions; (c) perspectives on the initiative, including reasons for enrolling; and (c) plans for
the cash payment. In subsequent interviews, the research team will obtain updates on the
household, financial strategies and decisions, and ways cash payments are used. Additionally,
interviews can have a module focusing on one aspect of the participants’ lives (i.e.,
employment history, use of safety net programs, meaning of the cash payment, etc.). This
approach allows us to capture events in participants’ lives relevant to financial decision-making;
and understand how and why they make certain financial decisions, including how to spend the
cash payment. Interviewing participants several times over 18 months that the cash payments
are disbursed, also allows us to build rapport and gain deeper understanding of their financial
lives, experiences and other factors that shape their decisions. It will also allow us to refine our
39 MDRC is entering into a data sharing agreement with Aidkit, and that data will help identify the families enrolled
that have agreed to participate in the evaluation. MDRC will draw samples for the in-depth interviews and follow-
up surveys from that pool of enrolled families.
15
research questions and hypothesis throughout the study. This method has the potential to
allow us to dig into all of our research questions through the questions we choose to ask and
highlight. For example, we plan to explore how families are experiencing program
implementation throughout our early interviews and how families plan for the end of the cash
in later interviews.
If time and resources permits, we hope to conduct a selected number of interviews two to
three months after payments conclude to learn about the experiences of families after the cash
ends.
Initial interviews will be conducted in-person. During the initial interview, the team will get
participants’ perspectives on the frequency and format for staying connected with the
researchers. Subsequent interviews will be conducted via phone or Zoom depending on
participant’s preferences. The final interview will be conducted in-person.
Focus groups: We will work with community researchers, the RAC and the Rise Up Cambridge
team to plan for and convene 6 focus groups. The purpose of the focus groups is to dig deeper
on specific topics of interest or to learn about perspectives from subgroups that may be of
particular interest (e.g., pilot participants, currently/formerly experiencing homelessness;
certain language groups; recent immigrants; formerly incarcerated, or young people to name a
few). The focus groups would be scheduled to occur at different phases of the study. This will
allow the research team and partners, including the RAC, to identify topics/populations of
interest that call for deeper understanding. If time permits, we hope to hold one or two focus
groups two to three months after payments end to learn about the experiences of families after
the cash ends. This method will allow us to explore selected research questions through the
lens of selected subgroups.
-
The research team will use storytelling as a method to center the voices of participants and
potentially build counter-narratives that may challenge existing perceptions of marginalized
individuals.40 This will be structured around three 2-hour sessions with a selected number of
participants (8-10 participants). Sessions are designed to build on each other and to allow
participants a space to reflect on their own stories and listen to each other’s stories. Each
session, participants engage in hands-on exercises to help individual and collective reflection.
For example, an early session could encourage participants to reflect on how people with low
incomes are usually portrayed in our society. Then, participants are encouraged to think of
ways their personal stories support or counter such narratives. The sessions could be structured
around 3 modules: (a) dominant narratives and) personal stories and counter-narratives, (b)
developing personal stories and listening to each other’s, (c) finalizing personal stories.
Additionally, the stories and reflections that come out of these sessions can provide important
40 Wagaman, Cabajjero Obejero, Gregory, 2018. “Countering the Norm, (Re)authoring Our Lives: The Promise
Counterstorytelling Hold as a Research Methodology With LGBTQ Youth and Beyond. International Journal of
Qualitative Methods. Vol17, pp, 1-11.
16
insights for interpreting other data sources (e.g., in-depth interviews, survey findings) and with
their permission, could be incorporated into the final report. These personal narratives could
explore how participants think and experience Rise Up Cambridge in contrast to other safety
net programs, for instance or the meaning assigned to the cash payment.
Interviews with Staff: For the implementation analysis, the research team will invite five staff
from CEOC and key partners to participate in semi-structured interviews to discuss issues
pertaining to recruitment, implementation, service provision and coordination, and ongoing
operations, described above. They will also help us understand the experiences of participants
and the operational views of the initiative from another perspective.
Application / intake data. A data-sharing agreement with AidKit will allow MDRC to access
selected enrollment data for those who agreed to participate in the study. This data will be
important to understand the characteristics of the households who enrolled in the study (and
how they differ, if at all, from those who opted out of the study). The enrollment data will be
examined for subgroup and multivariate analysis. This data will allow us to better understand
the different groups the study reaches and how generalizable our results may be.
Follow-up survey data: To complement the rich qualitative data, and to understand the lived
experiences of a wider group of households enrolled in Rise Up Cambridge, we have assumed
conducting two waves of online/web-based survey of participants.
The first, a 20-minute survey, will be fielded at about 6 months after the cash payments begin,
and would focus on capturing data on a range of outcome measures agreed to with the RAC
that encompass questions about families’ early experiences, use of the payments, use of other
services, receipt of safety net benefits, employment experiences, material hardship, children’s
circumstances, family health and well-being, and a range of other outcomes. The second survey
would capture data on similar outcomes to help us understand changes. In the absence of a
survey after the cash payments end (potentially a third survey), the second survey would be
fielded within a few months before the end of the cash transfers and include a few questions
on families’ plans for the loss of the cash transfers. During the design stage for each survey,
MDRC will outline the content prioritized for each survey – some of which could be informed by
the qualitative work – and assess the survey priorities and tradeoffs. Given the length of the
surveys, tough choices will need to be made about the range of topics and the depth within
each.
The first survey will be administered to about 500 households, and all the second one will be
administered to a larger group, everyone who consented to be in the study.
MDRC is in discussions with AidKit about fielding the surveys. The families will be familiar with
AidKit, view it as a trusted entity (and with less suspicion), which is important for achieving high
response rates. The budget estimates from AidKit assume that the survey would be
administered to one parent in every household, with a financial incentive offered for each
survey completed, and a 75% response rate for each wave. This is a higher response rate than is
typical for online surveys, but it is possible given AidKit’s (and the program’s) existing payment-
based relationship with the households. MDRC will monitor the survey response rates and, if
17
necessary, brainstorm with AidKit strategies for achieving the target response rates. The survey
will be administered in a total of four languages, including English and three other primary
languages most widely used among the Rise Up Cambridge households.41 Like longitudinal
interviews, the survey will allow us to speak to the core research questions.
E. Analysis and Approach
Baseline data
MDRC will rely on the baseline data collected by AidKit as part of the Rise Up Cambridge
application process.42 The form includes information such as educational background,
employment, housing status, health status, and income sources, which will be used to
understand the characteristics of the households in the initiative. The application is completed
before households are deemed eligible for the Rise Up Cambridge.
The application process includes a study consent script and will allow households to opt-out of
the study. MDRC will examine the opt-out rates and determine if there are any significant
differences between the characteristics of the households who enrolled in the study and those
who didn’t enroll in the study and what that means for interpreting the findings.
Follow-Up Survey(s)
Follow-up surveys will be conducted at two points in time during the follow-up period. These
surveys will permit data collection on outcomes of interest for a larger percentage of the
sample. The survey instrument will be informed by the goals of the initiative and the study
design. The survey will collect information about the participant’s experiences with the cash
payments and program. The survey will be particularly helpful for understanding dimensions of
hardship, such as households’ ability to cover food expenses and other necessary expenses.
Likely survey modules include: program experience and utilization of cash payments,
educational attainment; job history, work search, and barriers to employment; household
composition and child care; income, food security and material hardship; health status,
housing; children’s outcomes; and post-cash plans.
As noted above, the survey will allow the study to gather systematic data on a larger number of
families and allow the study to explore patterns and experiences for various groups of
participants. Despite the breadth of these quantitative data, they cannot be used to draw
41 As indicated in our proposal, we have not included analysis of administrative records as part of this study. One
reason is because matching to administrative data bases would be difficult if not impossible without SSNs, and we
know the program is intending not to collect SSNs. However, if the Research Advisory Council encourages including
an analysis of administrative records (e.g., UI wage records, SNAP and TANF records), we could make tradeoffs in
our budget to do so. MDRC has decades of experience acquiring and analyzing these types of data from states
across the country.
42 During the early design phase, MDRC collaborated with AidKit and the Rise Up Cambridge team on a few
additional measures for the application form.
18
conclusions about the effects of Rise Up Cambridge’s cash payments (as is the case of studies
that are structured as randomized controlled trials).
Thematic Analysis Approach for qualitative data
The team will use a thematic analysis approach to examine data from in-depth interviews and
focus groups. First, the team will conduct systematic coding of qualitative data collected. Initial
coding will be based on topics explored through interviews and focus groups. The goal of data
analysis is to refine and elaborate on these topics.
The team will code qualitative data from interviews and focus groups using NVivo, a qualitative
analysis software. First, one coder will apply structural codes, which are created based on the
topical sections and items that make up the interview and focus group guides (Guest,
MacQueen, and Namey, 2012), to all transcripts. The coder will look for the questions that were
included in interview guides and code each question, its response, and any probes and
additional responses associated with the question.
Once structural codes are applied, content codes are used to further categorize data and
identify themes within and between cases. Content codes are based on the analytic objective,
which in this case is to understand the role of cash payments in the lives of participants. Coding
for content may identify themes about:
1. Perspectives on the initiative and its benefits;
2. Meaning given to different outcomes;
3. Ways of thinking about cash transfer programs;
4. Pathways of change.
Two kinds of content codes will be created:
● “Concept-driven” codes are created a priori based on a theory about the concept
under study (Gibbs, 2007). Concept-driven codes for this study may be based on the
literature reviewed on cash transfer policies.
● “Data-driven” codes are created during analysis based on the categories that
emerge from reading of the data (Gibbs, 2007). Data-driven will be developed after
reading through a sub-set of the interview transcripts and assigning possible
“meanings” to portions of text.
All codes will be organized into a codebook that includes the code name, definition, and at least
one example quote that fits the definition. Coders will also write coding memos to document
questions and ideas about existing codes, relationships between codes, and the need for
additional codes. This is done to create a “paper trail” of code development.
The codebook will be refined through an iterative process of coding, checking for intercoder
reliability, discussing coding discrepancies, and revising codes. A first round of coding will be
completed to conduct a check on intercoder reliability. In this first round, two coders will code
the same transcripts using computer software. Intercoder reliability will be calculated using the
19
software (see below for an explanation of the plan for intercoder reliability). An “acceptable”
level of intercoder reliability that is as consistent as possible with the extant literature will be
determined. Once this “acceptable” level of intercoder reliability has been reached and there
are no fundamental disagreements between the coders about code definitions, the coders will
move onto the second round of the coding process and code the rest of the transcripts.
The team analyze coded data and will write memos based on the analysis. The memos will be
organized thematically based on the themes identified. The memo should include summary
bullets of themes identified, a narrative summary of the theme, and sources. The memo may
also include quotes that illustrate themes.
F. Role of the Research Advisory Council and Community Researchers
A primary goal of the study is to center and respect the perspectives of those living and working
in Cambridge and add to the capacity of community members to advocate for policies and
practices important to them. Thus, MDRC is assembling a Research Advisory Council and hiring
Community Researchers.
The primary aim of the research advisory council is to help shape and inform the study
that MDRC will conduct, including the research priorities, research processes (ensuring
that it is inclusive, culturally responsive) and simultaneously empowering those most
directly impacted by the program. The RAC will also add value to communities directly
impacted by providing data for advocacy and practice efforts. In doing so, the RAC will
act as an important cornerstone in our work to center equity, and particularly racial
equity. We anticipate RAC members providing insight on the research design,43 contributing to
development of data collection instruments, participating in sense making, and assisting in the
dissemination of findings. Participation on the RAC will be a way to empower those most
impacted by the initiative, acting as an important cornerstone in our work to center equity, and
particularly racial equity.
Community Researchers will also bring cultural knowledge and lived experience to the
evaluation. They will contribute to the project is diverse ways, such as by helping the team
ground research questions in lived experience, being thought partners in the process of data
collection planning and developing protocols, building initial rapport with participants through
scheduling and coordinating interviews, collecting certain types of data, attending Research
Advisory Council meetings, and helping interpret emerging findings (including via participation
in sense-making sessions, etc.).These part-time members of the research team will assist us in
further centering the perspectives of those with lived experience in Cambridge.
Figure 4. Role of Research Advisory Council Throughout the Study
43 At this point, the initial meeting with the RAC will take place during the design phase and after the research
design has been drafted. The MDRC team will brief the RAC on the stage of the research design and seek their
input on aspects of the design that need refinement.
20
G. Deliverables & Dissemination plan
We will produce a comprehensive final report, plus two short interim deliverables as part of this
evaluation.
â—Ź The two interim deliverables would take the form of easily accessible PowerPoint slide
decks or brief summary memos (incorporating data visualization), or some combination
of the two.
â—Ź The final report would present a comprehensive narrative and results from the full
range of quantitative and qualitative data, with observations in the voices of
participants themselves.
21
H. Timeline
Q2
Q3
Q4
Q1
Q2
Q3
Q4
Q1
Q2
Q3
Q4
Rise Up Cambridge
Enrollment
June 1- July 31st
Rise Up Cambridge
Payments
(18 months)
Research Advisory
Council Collaboration
Community
Researchers
Collaboration
Process and Analyze
Application/Intake Data
Survey Panel
Wave 1
(~6
months)
Wave 2
(~18
- 21
months)
Family Interviews - up
to 30 families
Interview
#1
(in-
person)
Interview
#2
(virtual)
Interview
#3
(virtual)
Focus Groups (6)
Three
(3)
Focus
Groups
Three
(3)
Focus
Groups
Storytelling Sessions
(3)
Three
(3)
Sessions
Staff Interviews - up to
5 staff
Deliverables
2 Interim and 1 Final
Interim
1*
Interim
2*
Final
Report
2023
2024
2025
*Estimated timeline, actual timing to be determined in collaboration with Rise Up Cambridge team
Interview
#4
(in-person)
Five (5) Staff
Interiews