Monday, 27 January 2014

Achieving Total
Customer Satisfaction
Through Six Sigma
Six Sigma is a concept for now and
well into the next century: focusing
on the customer, not the product
by Jane Erwin.
If
practice makes perfect
, then practicing the precepts of Six Sigma leads to
virtual perfection.
Six Sigma is a concept for now and well into the next century: It focuses on the
customer, not the product! And while philosophers debate and cynics doubt
whether anything can be truly flawless, the Six Sigma program developed by
Motorola Corp. is winning converts because it works. It brings about a cultural
change in a company, a paradigm shift toward expecting the highest quality, which
then drives a passion for continuous improvement by all players.
The Six Sigma concept matured during 1985 to 1986, growing out of various
quality initiatives at Motorola. The company's Land Mobile Products Sector first
established a single matrix for quality known as total defects per unit, which
dramatically changed the way management measured and compared quality
improvement rates for all divisions. Because all operations used the same
measurement, the goal for defect reduction could be uniformly applied to all
activities. For the first time, everyone spoke the same language.
"Sigma" is a statistical expression indicating how much variation there is in a
product. A performance level of Six Sigma equates to 3.4 defects per 1 million
opportunities--not perfect, but pretty close. A defect is defined as anything that
causes customer dissatisfaction. A unit is any unit of work--an hour of labor or a
circuit board, or even a keystroke.
Robert W. Galvin, chairman of the Motorola Management Board executive
committee, has said that Six Sigma signifies near perfection. The company, whose
education and training arm, Motorola University, teaches Six Sigma concepts and
courses, has saved billions of dollars for its worldwide corporation by practicing
what it preaches.
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 1 of 7
"It's irrelevant whether perfection is possible," comments Howie Berg, a senior
MU consultant. "Companies have reduced defect rates by factors of 10 and 20
annually when unshackled by presuppositions that it's impossible. Improve, and
improve aggressively, is the vision. That's doable."
MU Managing Consultant Bruce Hayes points to Six Sigma's
ability to address the ultimate bottom
line: survival. "If a company's
managers were to have the attitude,
'Why bother,' I would ask them what
they would do if they woke up
tomorrow morning and their No. 1
competitor announced it had
improved efficiency 10 times,
improved quality 10 times and is
committed to delivering a better
product with better service in half the
time--all at the same price," declares
Hayes. "Sound familiar? It happened
to Motorola, General Motors and
others in the 1970s, courtesy of
Japan."
Mission: quality
Wipro Corp. is one organization that
decided to change its tolerance level.
A diversified conglomerate
headquartered in Bangalore, India,
the company reports that using the Six
Sigma methodology during the past
15 months eliminated unnecessary
steps and decreased rework, leading
to an eightfold gain over the
investments made.
It wasn't a difficult decision for the
organization, notes Subroto Bagchi,
corporate vice president of mission
quality. "Our international software
services' customers depend on us for
mission-critical applications, which
we run on their behalf from halfway
across the globe via satellite links," he
says. "In the Indian market, we make
soaps, computers, hydraulic cylinders
and computerized tomography
scanners. Which customer is willing
to live with a defect? There's no
question of delivering anything less
than perfect."
Wipro executives had heard about Six
Sigma via the company's partnerships
with General Electric Co., so Bagchi
attended a quality briefing at
Coming to Terms with Sigma
Six Sigma may sound arcane and
mystical, but in reality it's a mathematical
formula. "Sigma" is a statistical term
indicating to what extent a process varies
from perfection. The number of units
processed is multiplied by the number of
potential defects per unit; the answer is
divided into the number of defects
actually occurring and then is multiplied
by 1 million. The result is the number of
defects per million operations. A
conversion table translates that number
into sigma:
6 sigma
= 3.4 defects per million
5 sigma
= 230 defects per million
4 sigma
= 6,210 defects per million
3 sigma
= 66,800 defects per million
2 sigma
= 308,000 defects per million
1 sigma
= 690,000 defects per million
Six Sigma is achieved through a process,
which is tracked using simple tools such
as the Pareto chart. This bar chart is
widely used as a data display tool in Six
Sigma because it identifies which
problems occur with the greatest
frequency or incur the highest cost.
Hence, it provides direct evidence about
what should be corrected first. Italian
economist Vilfredo Pareto, for whom the
chart is named, theorized that 20 percent
of possible causes are responsible for
80 percent of any problem.
Another way to test variance is by
performing the Chi2 test. With this
analytical process, a table is used to test
the relationship between two possible
causes of variation to determine the
relationship's statistical importance.
Design of experiments methodically
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 2 of 7
Motorola University in Chicago.
Afterward, in November 1996, an
MU team visited India to conduct a
business systems analysis.
Results were shared with top
management from Wipro's five
divisions, and they developed an 18-
month plan. The chairman and senior
management participated in a six-day
training retreat. Then 12 facilitators,
chosen from among successful line
managers, were trained. Together with MU personnel, these facilitators trained
nearly 800 people between May and November 1997. This year, about 1,000 more
employees will be trained.
"The entire scenario is like the fractal geometry exhibited in the petals of a
flower," observes Bagchi. "Certified trainers train people who, in turn, train
others, bringing a whole new change in the way we think and work."
Wipro's corporate goal is to reach Six Sigma in every process concerning
customer satisfaction by the year 2002.
Lofty, but not impossible.
Six Sigma is a stretch goal intended to spur continuous improvement. Success
doesn't come by radically restructuring a company or pumping new money into it;
Six Sigma is attainable through time and strong dedication.
Success doesn't come by radically restructuring a company or
pumping new money into it; Six Sigma is attainable through time
and strong dedication.
made better."
reduces process variation through a
sequence of experiments rather than
relying on a typical trial-by-error
approach. Following each experiment,
the combination of adjustments
becomes an equation that can either be
solved as a matrix or entered into a
computer for a solution. DOE users can
efficiently test a large number of variables
without the expense of manufacturing the
product totally.
New thought and manufacturing processes
Thinking outside the box also is important. "Before Six Sigma, we were interested
in continuous improvement, but we tended to accept quality levels that merely
mirrored our competitors'," notes Craig Erwin, quality engineering manager at
Motorola Semiconductor Products Sector in Phoenix, Arizona. "We were
somewhat internally focused and accepted the argument that things couldn't be
"When we started, many people, including me, thought Six Sigma was
unrealistic," he admits. "Once we understood that our management team was
serious about it, we accepted the challenge."
It's part of the SPS culture now. All new employees receive Six Sigma training
during their orientation. For those who went through training years ago, the
company also offers them an opportunity to recharge their commitment through a
combination of classes and a renewed emphasis by senior management. Various
customer satisfaction activities reward ideas and implementation.
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 3 of 7
"One thing we looked at was changes in our thought and manufacturing proc-esses
to eliminate rework," reveals Erwin. "In the short term, we saw some increased
costs, but in the long run, we've improved our processes and applied more
effective controls. We continue to see improvements in product reliability,
manufacturing yields and internal quality metrics, despite increasing product
complexity and higher customer expectations."
Product complexity continues to grow exponentially. Future products such as
semiconductors and software undoubtedly will contain tens of millions, even
billions, of elements. Creating more robust designs and reducing opportunities to
introduce defects into the final product represents a one-time expense. If it's not
done, however, repair, rework, excessive scrap costs and unhappy customers will
continue through the product's life. Thus, it's imperative that companies reduce
defect rates to a few parts per billion.
"Although Motorola has made huge reductions in defect rates, we still haven't
achieved Six Sigma overall," reports Berg. "Motorola considers itself a 5.7 sigma
company now. Six Sigma remains a very noble goal, but it's the rate of
improvement that's important. Six Sigma has saved the company billions of
dollars in terms of scrap and rework, enabling greater customer satisfaction--our
ultimate goal."
Six Sigma successes
After examining how various financial companies pursue quality, Citibank, the
international financial division of Citicorp, undertook the Six Sigma method in the
spring of 1997. Its goal: to reduce defects within its various divisions by a factor
of 10 during the first three years. The corporation already has seen reductions
ranging from five to 10 times.
"Six Sigma appealed because it's pretty straightforward," comments James Bailey,
Citicorp's executive vice president and corporate quality officer. "It also seemed
like a program that would involve everyone."
Previously, various businesses and divisions within Citibank had tried different
quality programs, but the company had never instituted a universal quality
language or method.
"Continuous improvement is our goal," maintains Bailey. "We started training
senior management in April 1997, and so far we've trained about 2,000 people
around the world." Besides the defect reductions, the company has recorded a
decreased response time for credit card applications and fewer errors in customer
statements.
"We're on track," he declares. "We're more customer-focused. We know it's a
long road, but we've made a reasonable start, and we're pleased."
GE, which launched a Six Sigma initiative in late 1995, says the $300 million
invested in quality improvement in 1997 will deliver some $400 million to $500
million in savings. "Quality improvement, under the disciplined rubric of Six
Sigma methodology, will define the way we work," the company announced in its
1996 annual report.
A three- to four-sigma level, average for most U.S. companies, can cost a
company as much as 10 percent to 15 percent of its revenues. For GE, that would
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 4 of 7
mean $8 billion to $12 billion.
"The methodologies of Six Sigma we learned from other companies, but the
cultural obsessiveness and all-encompassing passion for it is pure GE," states the
report. "The intensity level involved in our decade-long struggle to achieve a
boundary-less culture now seems 'laid-back' compared to the near monomania
with which we are approaching Six Sigma quality."
Wipro also reports successes in its first year. "First of all, we now have a common
language across our divisions," explains Bagchi. "People talk about the customer,
defects, sigma level and a plan for continuous improvement."
"In India, many people have difficulty giving up the old and embracing the new,
but the mind-set is changing. Six Sigma is making people look outward. We're
shifting from an organizational focus to a customer focus."
Wipro's trained teams have launched close to 30 projects, including three major
cross-functional undertakings. "Defects are steadily falling in cylinder
manufacturing," discloses Bagchi. "In the fixed deposits area of our Financial
Services division, we've established a process to eliminate nonvalue-added steps
and mistake-proof the system. We're also projecting a 30-percent cycle-time
reduction in our computer business. The estimated near-term gains will be six to
eight times the total investments we've made in Six Sigma."
The first step
Other reengineering programs often advocate tearing down an organization and
rebuilding from scratch. MU advises organizations to start where they are, build
on current successes and modify current processes. They must rely on the
interwoven concepts of defect reduction, which encourages employees to relate
more to each other, and cycle-time reduction, which eliminates unnecessary,
nonvalue-adding steps from processes.
Six Sigma requires more than a monetary investment, Erwin points out. "You
must have a plan, necessary resources, the commitment of everyone and
uncompromising matrixes," he says. "Then you set aggressive goals along the path
and hold people accountable."
The MU Six Sigma program emphasizes the following key components:
A goal of total customer satisfaction.
A common language throughout the organization.
Common, uniform quality measurement techniques for all business areas.
Goals with identical improvement rates, based on uniform matrixes.
Goal-directed incentives for both employees and management.
Coordinated training in "why" and "how" to achieve the goal.
No one set procedure will work when following the Six Sigma method. Every
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 5 of 7
company is different and must account for its strengths and weaknesses, then
leverage them accordingly.
"A clear, quantitative understanding of customer satisfaction typically is
accomplished through surveys," notes Hayes. "Surveys should identify gaps
between customer needs and a company's current performance level. Then,
through benchmarking, a company's core processes are compared to another bestin-
class performer. This is useful in determining the first layer of needed goals."
Motorola SPS statistician Skip Weed has been involved with Six Sigma since the
program began. "The major impact, especially when it first started, was on our
culture--the people and systems required to produce high-quality products and
services," he recalls. "Previously, there was minimal effort in preventing defects
rather than inspecting them out. The directive for the program came from our
highly respected CEO, who was strongly behind it, and everyone then began to
buy in."
Management by fact, not emotion
Ron Randall, quality improvement manager at Raytheon TI Systems, says his
company is impressed with Six Sigma's quantitative methods. "We looked at our
products and compared them to similar ones from Motorola," he explains. "We
were less than four sigma, and Motorola was close to six. We couldn't believe
someone was 2,000 times better than us. It really got our attention.
"Six Sigma really will work for anybody. It's management by fact, not emotion."
MU consultant Paul Zaura concurs. "In a math sense, Six Sigma is a known
quantity," he asserts. "As improvements increase, expectations increase. Customer
perceptions will change, and they will drive you to places you never new existed.
"You also must look at the cultural aspects and changing behaviors. Many
corporate cultures are fear-based; mistakes aren't tolerated, and people learn to
hide defects. Six Sigma flourishes in an open and safe environment."
Six Sigma champions say there are plenty of things to count, measure and
benchmark regardless of the type of business, whether it's an attorney's office or a
car rental company. And within a company, you can look at all kinds of divisions-
-personnel policies, warehousing, security, how to run the cafeteria.
"If you're not improving, you're going down," warns Zaura. "Six Sigma is a
philosophy of continuous improvement and measurement to drive the direction of
goals. Its concepts aren't earthshaking: Talk to customers and find out what the
defects are. Work on big errors first. Try to decide how they happen and how to
correct them permanently.
"Whether it's handling paperwork, an idea, a customer call or a hard product,
there must be a process for it. That's probably one of the biggest concepts for
people to grasp. Then you track your process using simple tools like Pareto
charts, cause-and-effect diagrams and benchmarking. You compare what you have
to a similar industry or process."
Perhaps Six Sigma's biggest mandate is
never rest.
Companies that are content with their current quality levels simply don't
understand quality's true challenge. They need to determine not only the defect
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 6 of 7
levels their customers experience but also internal defects that cause rework,
additional inspections and higher product costs. Once a company has fully assessed
itself, then improvement can really begin.
And no philosopher or cynic can quibble with improvement.
About the author
. .
Jane Erwin is a freelance writer and business media consultant from Houston,
Texas. For more information on Six Sigma and other quality programs, contact
Motorola University, Consulting and Training Services, at telephone (800) 446-
6744 or (847) 576-0096 Visit MU's Web site at
www.mot.com/mu
[Home Page] [Current] [ISO 9000 Database
] [Daily News] [Phil's Journal]
[Quality Management] ['98 Past Issues] [Resources] [Advertising]
[Subscribe] [Guestbook]
Copyright 1998 QCI International. All rights reserved. can be
reached by phone at (530) 893-4095.
Quality Digest
Please contact our
Webmaster with questions or comments.
ISO9000 ISO 9000 TQM management quality QC QA teams QS9000 QS-9000 quality digest juran deming baldrige
ISO9000 ISO 9000 TQM management quality QC QA teams QS9000 QS-9000 quality digest juran deming baldrige
ISO9000 ISO 9000 TQM management quality QC QA teams QS9000 QS-9000 quality digest juran deming baldrige
ISO9000 ISO 9000 TQM management quality QC QA teams QS9000 QS-9000 quality digest juran deming baldrige
ISO9000 ISO 9000 TQM management quality QC QA teams QS9000 QS-9000 quality digest juran deming baldrige
e-mail
Quality
Digest
Quality Digest Article 4/4/00 1:37 AM
http://www.qualitydigest.com/july98/html/sixsigma.html Page 7 of 7

Thursday, 23 January 2014

P
ATHFINDER INTERNATIONAL TOOL SERIES
Monitoring and Evaluation – 1
PREPARING A CASE STUDY:
A Guide for Designing and
Conducting a Case Study for
Evaluation Input
By
Palena Neale, PhD,
Senior Evaluation Associate
Shyam Thapa, PhD,
Senior Monitoring and Evaluation Advisor
Carolyn Boyce, MA,
Evaluation Associate
May 2006
P
ATHFINDER INTERNATIONAL TOOL SERIES
Monitoring and Evaluation – 1
PREPARING A CASE STUDY:
A Guide for Designing and
Conducting a Case Study for
Evaluation Input
By
Palena Neale, PhD,
Senior Evaluation Associate
Shyam Thapa, PhD,
Senior Monitoring and Evaluation Advisor
Carolyn Boyce, MA,
Evaluation Associate
May 2006
Acknowledgements
The authors would like to thank the following Pathfinder employees and partners for their
technical inputs into this document: Emmanuel Boadi (Pathfinder/Ghana), Anne Palmer
(Futures Group International), Ugo Daniels (African Youth Alliance (AYA)), Veronique
Dupont (Pathfinder/Extending Service Delivery (ESD)), Cathy Solter, Lauren Dunnington,
and Shannon Pryor (Pathfinder headquarters). Jenny Wilder and Mary Burket are also
thanked for their inputs and assistance in editing and producing this document.
2 P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY
What is a Case Study?
A case study is a story about something unique, special, or interesting—stories can be
about individuals, organizations, processes, programs, neighborhoods, institutions, and
even events.
1 The case study gives the story behind the result by capturing what happened
to bring it about, and can be a good opportunity to highlight a project’s success, or to
bring attention to a particular challenge or difficulty in a project. Cases
2 might be selected
because they are highly effective, not effective, representative, typical, or of special interest.
A few examples of case study topics are provided below—the case studies would describe
what happened when, to whom, and with what consequences in each case.
P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY 3
Case Study Examples Uniqueness/Point of Interest
Shifting Attitudes of Youth-Serving Your program was able to change service providers’ attitudes towards
Service Providers dealing with Adolescent Sexual and Reproductive Health (ASRH) needs in
an environment where provider’s attitudes have been a barrier to young
people accessing SRH services.
Integrating Youth-Friendly Services (YFS) Your program was effective in introducing YFS to the MOH and in
in the Ministry of Health (MOH) institutionalizing an YFS curriculum in a setting where the MOH did not
provide YFS.
Integrating HIV Prevention in Faith-Based Your program was able to integrate HIV prevention in several
Organization (FBO) Health Services Delivery FBO service delivery points in an environment that normally does not
include or welcome HIV prevention activities.
Developing Youth Leadership in Tanzania Your program built the leadership capacity of youth to advocate, promote,
and participate in decision making around ASRH. This transpired in a
setting that did not include ASRH on the agenda nor encourage youth
participation in general or in decision making in particular.
1
Yin, Robert K. (2003). Case Study Research: Design and Methods. Thousand Oakds: Sage Publications.
2
Case refers to the unit of analysis or topic chosen for study (i.e., the individual, organization, or program).
When is a Case Study Appropriate?
Case studies are appropriate when there is a unique or interesting story to be told. Case
studies are often used to provide context to other data (such as outcome data), offering a
more complete picture of what happened in the program and why.
What are the Advantages and Limitations of a Case Study?
The primary advantage of a case study is that it provides much more detailed information
than what is available through other methods, such as surveys. Case studies also allow one
to present data collected from multiple methods (i.e., surveys, interviews, document
review,
and observation) to provide the complete story. There are a few limitations and
pitfalls however, each of which is described below.
Can be lengthy:
Because they provide detailed information about the case in narrative form,
it may be difficult to hold a reader’s interest if too lengthy. In writing the case study, care
should be taken to provide the rich information in a digestible manner.
Concern that case studies lack rigor:
Case studies have been viewed in the evaluation and
research fields as less rigorous than surveys or other methods. Reasons for this include the
fact that qualitative research in general is still considered unscientific by some and in many
cases, case study researchers have not been systematic in their data collection or have
allowed bias in their findings. In conducting and writing case studies, all involved should
use care in being systematic in their data collection and take steps to ensure validity
3 and
reliability
4 in the study.
Not generalizable:
A common complaint about case studies is that it is difficult to generalize
from one case to another. But case studies have also been prone to overgeneralization,
which comes from selecting a few examples and assuming without evidence that they are
typical or representative of the population. Yin, a prominent researcher, advises case study
analysts to generalize findings to theories, as a scientist generalizes from experimental
results to theories.
5
4 P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY
3
Validity refers to the degree to which a study accurately reflects or assesses the specific concept that the researcher is attempting to measure.
4
Reliability is the extent to which an experiment, test, or any measuring procedure yields the same result on repeated trials.
5
Yin, Robert K. (2003). Case Study Research: Design and Methods. Thousand Oaks: Sage Publications.
What is the Process for Conducting a Case Study?
The process for conducting case study research follows the same general process as is
followed for other research: plan, collect data, analyze data, and disseminate findings. More
detailed steps are given below.
1. Plan
• Identify stakeholders who will be involved.
• Brainstorm a case study topic, considering types of cases and why they are unique or
of interest.
• Identify what information is needed and from whom (see “What are Potential
Sources of Information?” and “What are the Elements of a Case Study?”).
• Identify any documents needed for review.
• List stakeholders to be interviewed or surveyed (national, facility, and beneficiary
levels) and determine sample if necessary.
• Ensure research will follow international and national ethical research standards,
including review by ethical research committees. For more information, please see
the International Ethical Guidelines for Biomedical Research Involving Human
Subjects, available at http://www.cioms.ch/frame_guidelines_nov_2002.htm.
2. Develop Instruments
• Develop interview/survey protocols—the rules that guide the administration and
implementation of the interview/survey. Put simply, these are the instructions that
are followed to ensure consistency across interviews/surveys, and thus increase the
reliability of the findings. The following instructions for the should be included in
the protocol:
• What to say to interviewees when setting up the interview/survey;
• What to say to interviewees when beginning the interview/survey, including
ensuring informed consent of the respondent (see Appendix 1 for an example);
• What to say to respondent in concluding the interview;
• What to do during the interview (Example: Take notes? Audiotape? Both?); and
• What to do following the interview (Example: Fill in notes? Check audiotape for
clarity? Summarize key information for each? Submit written findings?).
• Develop an interview guide/survey that lists the questions or issues to be explored and
includes an informed consent form. Please note that you will likely need interview
guides/surveys for each group of stakeholders, as questions may differ.
• Where necessary, translate guides into local languages and test translation.
P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY 5
3. Train Data Collectors
• Identify and train data collectors (if necessary). (See “Training Tips for Data
Collectors”
6.) Where necessary, use interviewers that speak the local language.
4. Collect Data
• Gather all relevant documents.
• Set up interviews/surveys with stakeholders (be sure to explain the purpose, why the
stakeholder has been chosen, and the expected duration).
• Seek informed consent of each respondent (written or documented oral). Re-explain
purpose of interview, why the stakeholder has been chosen, expected duration of,
whether and how the information will be kept confidential, and the use of a note
taker/tape recorder.
• If the respondent has consented, conduct the interview/survey.
5. Analyze Data
• Review all relevant documents.
• Review all interview/survey data.
6. Disseminate Findings
• Write report (see “What are the Elements of a Case Study?”).
• Solicit feedback.
• Revise
• Disseminate
Training Tips for Data Collectors
Staff, youth program participants, or professional interviewers may be involved in data
collection. Regardless of what experience data collectors have, training should include:
• An introduction to the evaluation objectives,
• A review of data collection techniques,
• A thorough review of the data collection items and instruments,
• Practice in the use of the instruments,
• Skill-building exercises on interviewing and interpersonal communication, and
• Discussion of ethical issues.
6 P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY
6
Adamchak, S., et. al. (2000). A Guide to Monitoring and Evaluating Adolescent Reproductive Health Programs. Available at
http://www.pathfind.org/site/PageServer?pagename=Publications_FOCUS_Guides_and_Tools.
What are Potential Sources of Information?
Case studies typically rely on multiple sources of information and methods to provide as
complete a picture as possible. Information sources could include:
• Project documents (including meeting minutes)
• Project reports, including quarterly reports, midterm reviews
• Monitoring visits
• Mystery client reports
• Facility assessment reports
• Interviews
• Questionnaire/survey results
• Evaluation reports
• Observation
• Other
What are the Elements of a Case Study?
Case studies do not have set elements that need to be included; the elements of each will
vary depending on the case or story chosen, the data collected, and the purpose (for
example, to illustrate a best case versus a typical case). However, case studies typically
describe a program or intervention put in place to address a particular problem. Therefore,
we provide the following elements and example on which you might draw:
1. The Problem
i. Identify the problem
ii. Explain why the problem is important
iii. How was the problem identified?
iv. Was the process for identifying the problem effective?
2. Steps taken to address the problem
3. Results
4. Challenges and how they were met
5. Beyond Results
6. Lessons Learned
P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY 7
1. The Problem:
It is essential to identify what the problem was. Specifically:
i.
Identify the problem. For example, certain FBO leadership was opposed to including
HIV prevention activities within their programming. Specifically, they felt that
prevention activities would promote sex among youth and thereby increase the
incidence of HIV. In addition, the FBO felt that the promotion of condoms as a
form of prevention was morally wrong.
ii.
Explain why the problem is important. Following the same example, to provide a
comprehensive response to HIV/AIDS, prevention activities are an important part
of HIV programming, in addition to care and support. Addressing moral and
religious concerns and objections of FBO leaders in order to incorporate this
component greatly expands the prevention effort and offers a greater breadth and
depth in HIV programming.
iii.
How was the problem identified? It is likely that program staff will have an idea of
what general problems exist. For example, YFS is not integrated in the MOH,
FBOs do not include prevention activities, youth involvement does not occur, etc.
What was likely missing and required exploration were the details around this
general problem. In the case of working with FBOs, an initial project planning
meeting was held to discuss the specifics behind the problem. It was revealed
during this process that certain FBOs who conducted care and support activities
did not offer prevention activities, specifically condom promotion. The primary
reason given was religious objections; another reason identified but not explicitly
stated was stigma.
iv.
Was the process for identifying the problem effective? After additional one-on-one
discussions with FBO leaders, it was determined that the leaders had concerns
based on moral and religious grounds regarding prevention efforts, particularly
promoting condoms. Furthermore, discussions revealed that a number of leaders
had limited and/or erroneous information regarding transmission and
prevention options.
8 P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY
2. Steps Undertaken to Address the Problem:
What was done (activities/ interventions/
inputs), where, by whom, for whom?
In the case of integrating prevention in FBOs, an
illustrative outline of steps undertaken to address the problem is given below:
P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY 9
What was done? Where? By Whom? For Whom?
Phase 1: Sensitization
Sensitization of leadership:
activities included reviewing District/ National Project Staff FBO leaders
FBO policies and bylaws by program staff in order to
demonstrate to leadership that there were no constitutional
objections to prevention activities. Project staff engaged
liberal FBO leaders to supply quotes from the Bible to
build their evidence-based argument to convince other
leaders that there was in fact no biblical basis for the
preclusion of prevention activities.
Sensitization of facility managers:
meet with managers Facilities Project Staff Facility
to discuss leadership approval and present evidence-based Managers
arguments on why integration activities can be included.
Sensitization of community:
work with groups to explain Community Project Staff Community
that these activities have been approved by the FBO catchment areas members
leadership and where they can go to receive services.
Phase 2: Integration
Facility assessments
Selected facilities Project Staff, FBOs,
FBO representatives Project Staff
Training of service providers
Selected facilities Local Implementing Facility Staff
Partners (IPs)
Conduct staff orientations
Facilities Project Staff, Facility Staff
Facility Managers
Physical infrastructure improved
Facilities Contractor Facility
Phase 3: Outreach
Identify peers that you want to work with
Selected facilities Facility Staff Beneficiaries
Training
Facilities IPs Peers
Provide Tools
Project Peers
Supervision
Peer supervisors Peers
Phase 4: M&E
Reassessments
Sample of Project Staff, Facility,
selected facilities Facility Management, Project Staff
Youth
Mystery client interviews
Facilities Trained mystery clients
Monitoring visits
Facilities, Peers Project Staff, Facility staff,
Peer Supervisors Project Staff
3. Results:
What were the results of your intervention, particularly the significant or unique
results? For example: your activities resulted in the FBO including HIV prevention
activities in their programming, which contributed to an increase in condom distribution.
Or, your activities resulted in youth-serving service providers adopting a youth-friendly
attitude which contributed to improved services and an increase in youth visits. Church
leadership may have made a commitment and modified policies to include ASRH
activities, leadership talking about the issues publicly. Facility managers may make
financial commitments to refurbishments, training, etc.
4. Challenges and how they were met:
This focuses on what challenges or difficulties you
encountered and what you did to overcome them. One of the challenges in working with
FBOs may have been dealing with Catholic FBOs and your response could have been to
negotiate with them to include certain prevention activities like abstinence, and/or
providing a referral point to youth who may want to get information about condoms.
Another possible challenge is that not all FBOs who you had hoped to work with were
willing to come on board and this required additional attention.
5. Beyond Results: Are the results mentioned above sustainable?
Why or why not? For
example, an integrated approach to programming (which included a strong policy and
advocacy component) created an enabling policy environment with strong stakeholder
support that can be nurtured and leveraged beyond the project duration.
6. Lessons Learned:
What lessons were learned: programmatic, technical, financial,
process, etc.? For example, the experience showed that it was imperative for project staff
to have a very solid understanding of government policies to speak to these issues with
key stakeholders. In addition, it was important to have a good understanding of the
various religious beliefs in addition to their respective policies and by-laws for
developing and delivering advocacy arguments.
How are Case Studies Presented?
Case studies are flexible in that they can be presented in a number of ways—there is no
specific format to follow. However, like all evaluation results, justification and methodology of
the study should be provided, as well as any supporting information (i.e., copies of instruments
and guides used in the study). Case studies may stand alone or be included in a larger
evaluation report. If presented as a stand-alone report, the following report outline is suggested:
1. Introduction and Justification
2. Methodology
a. How was the process carried out? (Describe the process of selecting the case and
data collection sources, as well as how data was collected.)
b. What assumptions are there (if any)?
10 P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY
c. Are there any limitations with this method?
d. What instruments were used to collect data? (You may want to include some
or all in the appendix.)
e. What sample(s) is/are being used?
f. Over which period of time was this data collected?
3. The Problem
4. The Steps Taken to Address the Problem
5. The Results
6. The Challenges and How They were Met
7. Beyond Results
8. Lessons Learned
9. Conclusion
10. Appendices
Where Can More Information on Case Studies be Found?
Information on Case Study Research
Adamchak, S., et. al. (2000).
A Guide to Monitoring and Evaluating Adolescent Reproductive Health
Programs.
Available at http://www.pathfind.org/pf/pubs/focus/guidesandtools/PDF/Part%20II.pdf.
Patton, Michael Q. (2002).
Qualitative Research & Evaluation Methods. Thousand Oaks: Sage
Publications.
Stake, Robert E. (1995).
The Art of Case Study Research. Thousand Oaks: Sage Publications.
United States General Accounting Office, Program Evaluation and Methodology Division.
(1987).
Case Study Evaluations. Available at http://161.203.16.4/t2pbat22/132683.pdf.
Yin, Robert K. (2003).
Case Study Research: Design and Methods. London: Sage Publications.
Examples of Case Studies
Cornwall, A. and Welbourn, A. (2002). Realizing
Rights: Transforming Approaches to Sexual and
Reproductive Well-Being.
London: Zed Books.
Population Council.
Quality/Calidad/Qualité series. Available at
http://www.popcouncil.org/publications/qcq/default.htm.
SRI International. (2001).
The Organization of Learning in Community Technology Centers:
Learning with Technology in Six Communities.
Available at
http://www.americaconnects.net/research/SRI_case_study_report.pdf.
P
ATHFINDER INTERNATIONAL: WRITING A CASE STUDY 11
Appendix 1: Sample Informed Consent Form
12 P
ATHFINDER INTERNATIONAL: SAMPLE INFORMED CONSENT FORM
Key Components:
• Thank you
• Your name
• Purpose
• Confidentiality
• Duration
• How interview
will be conducted
• Opportunity for
questions
• Signature of
consent
I want to thank you for taking the time to meet with me today. My
name is ________________________ and I would like to talk to you
about your experiences participating in the African Youth Alliance (AYA)
project. Specifically, as one of the components of our overall program
evaluation we are assessing program effectiveness in order to capture
lessons that can be used in future interventions.
The interview should take less than an hour. I will be taping the session
because I don’t want to miss any of your comments. Although I will be
taking some notes during the session, I can’t possibly write fast enough
to get it all down. Because we’re on tape, please be sure to speak up so
that we don’t miss your comments.
All responses will be kept confidential. This means that your interview
responses will only be shared with research team members and we will
ensure that any information we include in our report does not identify
you as the respondent. Remember, you don’t have to talk about anything
you don’t want to and you may end the interview at any time.
Are there any questions about what I have just explained?
Are you willing to participate in this interview?
__________________ __________________ __________
Interviewee Witness Date
______________________________________
Legal guardian (if interviewee is under 18)
Pathfinder International
9 Galen Street, Suite 217
Watertown, MA 02472
USA
Tel: 617-924-7200
Email: Information@pathfind.org
05/06/500