Consumer survey as needs assessment method: a case study

Needs assessment methodology has grown remarkably as a necessary part of evaluating human service programs. The consumer survey method of needs assessment is reviewed. A case study in which the training needs of board members of the eleven community mental health agencies in a rural New England state were examined by a questionnaire requesting ratings of the importance and priority of 11 possible topics is presented. Sixty-five of 300 questionnaires were returned (21.66%). The results clearly support the view that training programs for boards are needed, and suggest that citizens can make reasonable decisions about program content if given the opportunity. A training project, based on the results of the survey is described. Problems in designing and implementing consumer surveys and training programs are discussed.     

The social “R & D” paradigm in child and youth services: Building knowledge convivially

Adaptation of agricultural and industrial research and development models offers new methods for bridging the worlds of research and practice in child and youth services. Social R & D methodologies provide effective means for generating new social technologies because they are product oriented and use a wide array of traditional and nontraditional data sources. This article discusses one social R & D paradigm—Developmental Research and Utilization. Permanency planning and community support systems research are used to illustrate the past and potential application of this methodology to the field of child and youth services.     

An evaluation case: The implementation and evaluation of a problem-solving training program for adolescents

This study recounts the implementation and evaluation of a problem-solving skills training program for adolescents. Sixty-six students from the seventh, eighth, and ninth grades of a local junior high school were identified by guidance counselors as needing problem-solving training—48 male and 18 female students between the ages of 11 and 16. The hypothesis that students included in the training sessions would demonstrate better problem-solving skills, a more internal locus of control, and a higher level of self-esteem than control group students was tested via a pretest-posttest Control Group Design. The results of a stepwise discriminant analysis of the data supported the hypothesis. An analysis of grade level differences indicated that the program had less effect on the seventh-grade training group. Implications for program modification and the limitations of the evaluation findings are discussed.     

Social work ethics and children: Protection versus empowerment

Evidence indicates that a growing proportion of children and adolescents experience traditional child protective services as intrusive, oppressive, and even exploitive. Professionals tend to deny the reality that youngsters experience, project their own perceptions and vulnerabilities onto youngsters, and refuse to recognize the ability and right of youngsters to control their own lives. Empowerment of minors is an ethical obligation of the social work profession and the only true protection from abuse and neglect.     

Employee counseling services evaluation system: design, issues and conclusions

Employee Counseling Services (ECS) programs have emerged as an effective method for dealing with employees whose job performance has deteriorated due to personal problems such as alcoholism or drug abuse. It is estimated that 18% of any work force is effected by such problems at any given time and that these employees cost industry billions of dollars annually in lost productivity, abuse of sick leave, etc. One of the critical concerns of this emerging field is the need for comprehensive evaluation that can demonstrate the cost-effectiveness and cost-benefits of ECS programs. This paper will describe the model Federal ECS developed at the U.S. Department of Health and Human Services as well as the components of the evaluation system designed to determine its effectiveness. The system is the first of its kind and will be a valuable contribution to the field. The paper then raises issues and develops conclusions about designing such an evaluation within the context of a large bureaucracy.     

The dangers of political naiveté and excessive complexity in evaluating delinquency prevention programs

The current demand for the assessment of programs designed to modify delinquent behavior may actually decrease the likelihood of achieving important long range goals. This article argues that the traditional experimental-control group procedures used in the evaluation of delinquency prevention programs are rarely successful, generate strains which have negative consequences, create hostility toward attempts to gain knowledge, and fail to create superior programs in the future. Furthermore, complex programs increase the likelihood of stress more than simple ones. If sophisticated research skills were directed toward the analysis of data gathered from larger numbers of cases and from more readily available data sources, many of these negative consequences could be minimized. The final theme is that the way in which findings are reported should be treated as an important factor in its own right. Objective, “hard-nosed” assessment may in fact damage promising projects without altering ineffective but entrenched programs.     

Behavioral epidemiology and social area analysis: The study of blackout looting

This article describes the use of social area analytic techniques in the study of the looting which occurred during the Con Edison power failure of July 13 and 14, 1977. Detailed procedures are outlined of the systematic collection and analysis of data which were developed from available data. Analyses contrasting competing explanatory theoretical models for blackout looting are presented. The central dependent variable is ratio of looted to retail stores. Both the numerator and denominator are aggregated to the census tract level.     

Documentation in evaluation research: Managerial and scientific requirements

Documentation in evaluation research consists of written material, in human- or machine-readable form, pertaining to the plans, activities, and results of the project. It is argued here that good documentation is essential for effective management of evaluations, and for responsible reporting of the research procedures and findings. Documentation relating to electronic data processing activity is especially important. The purpose of this paper is to stimulate consideration and discussion of documentation, and to emphasize its importance in evaluation research. The role of documentation in the planning and control functions of project management is reviewed, and the importance of documentation in the assessment of research quality with respect to objectivity, validity, and replicability is discussed. Reasons for poor documentation are considered. An outline of documentation required in different phases of research projects is provided, and recommendations for improving the quality of documentation are presented.     

An exploratory study of self-esteem and quality of care of 100 children in foster care

This small-scale research study examined children's perceptions of themselves, their situation, career aspirations and hopes for the future. One hundred San Francisco children in foster care were interviewed and filled out a questionnaire. 50 of the children lived in foster family care; 50 in group homes. The Department of Social Services in San Francisco cooperated in executing this study. Children ranged in ages from 8–18. Both male and female children participated. The questionnaire contained two standarized tests, Coopersmith Self-Esteem Inventory and Parks Career Role Inventory. A section was written by the authors to examine how children in care spend their time, and how they feel about where they live and their foster care status. The last part, an open-ended section asks them which foster care setting they liked best, why, and what they would suggest to improve the foster care system. An additional question “Why do you think you are in foster care?” was designed to elicit the children's understanding of why they lived in foster care rather than their biological home.     

Complexity of process and role in the evaluation of an interdisciplinary mental health education program: The deacon's masterpiece

Research and literature on program evaluation must attend to problems of application, which can have major effect on the outcome. Increasing numbers of innovative, multifaceted programs operating in complex settings are presenting for evaluation. Evaluation process must become flexible, creative, and multifaceted in order to produce valid and comprehensive results, and to meet the needs of this field. Evaluators and evaluation, the evaluated program, and the environment become a mutually interacting system in the process of evaluation. Evaluation goals and roles must be conceptualized, agreed upon, sanctioned, and appropriately implemented or conflict and ineffectiveness will result. Three models of evaluation emerge: objective and independent, objective but serving one interest, and pseudo-scientific public relations. Evaluation of an interdisciplinary mental health education program illustrates these issues. Evaluation technology, process, and roles must all be attended to or the weak link undermines the rest.     

Applicability of standards for evaluations of educational programs, projects and materials in an international setting: Qualitative research

Qualitative studies are much more the practice in Europe and increasingly elsewhere than in the United States. For an international audience, therefore, there needs to be much greater emphasis on qualitative techniques than there is in the standards report. The most difficult ethical problem arises from the conflict between the right to privacy of research subjects and the right to know of audiences. By its nature, qualitative research focuses on the particular, the detailed analysis of the specific incident. It is therefore often difficult to conceal the identity of the individual organisations and people concerned. Even a confidential report might work to the detriment of the subjects studied. Published reports pose the same problem. Have subjects the right to have material they believe to their disadvantage excised from a report even if that renders the report valueless? There are two technical points in the standards document that should be amplified. The first concerns the verification of data. We need to specify procedures to ensure credibility for qualitative studies. The second concern is the specification of quantitative techniques for the analysis of qualitative data. The statement in the standards document is too weak. We need to define much more clearly the steps that should be taken to ensure that qualitative data can be tested rigorously. Finally, there is the problem of collusion, the danger that the qualitative evaluators will select from their material the data which are in conformity with their own predilictions or presuppositions, the expectations of their audience, or the requirements of their sponsors. This problem may be acute in some parts of the world. To be of maximum international value, the standards report needs to be extended and to pay much greater attention to problems arising with qualitative evaluation.     

Gamesmanship for internal evaluators: Knowing when to “hold 'em” and when to “fold 'em”

This article discusses the ethical conflicts between an internal evaluator's altruistic social reform motivation and an organization's practical survival motivation. The internal evaluator might encounter (a) pressure to downplay negative and emphasize positive findings; (b) reinforcement for nonthreatening, routine evaluation activities; (c) greater interest in making the evaluation unit visible than in using evaluation results; or (d) reduced access to privileged information.     

The case study evaluation: A means for managing organizational and political tensions

This study of evaluation utilization identified organizational, political, and practical arrangements which facilitated wide use of The Interim Report Evaluation in policy making for California's Early Childhood Education program. In a program fraught by tensions, where evaluations had been political tools, this evaluation was special. The research used a field study approach. Analysis was guided by literature on organizations, policymaking, and evaluation utilization. It identified techniques for maintaining political support, marshalling organizational resources, and designing and disseminating an evaluation that used an ethnographic approach and that was directly applied to policy deliberations. Such techniques have significance when evaluators and researchers need to convince policymakers of their worth. This case study adds to knowledge of the research/policy intersect, on ethnographic evaluation, and on state education policymaking.     

Political participation: A comparative view of Israeli and American youth

This study explored the ways in which adolescents in Israel and the United States perceived government, politics, and public affairs. A series of open-ended interviews were conducted with approximately 300 high school students in each country immediately prior to the national elections in 1980–1981. Differences were found in regard to the extent to which the young people felt affected by and capable of affecting the larger political system, the extent to which voting was viewed as an important rite of passage to adulthood, and the extent to which they perceived having real choices in candidates and parties, with Israeli youth generally demonstrating more engagement in national governmental affairs. Finally, the conditions and factors that were likely to lead adolescents toward concern, interest, and participation in public affairs were offered.     

The private sector and urban housing production process in Nigeria: A study of small-scale landlords in Abuja

The private production system continues to supply the majority of housing to the population of Third World cities. In Nigeria, statistics show that the bulk of urban housing units is supplied for rent by small-scale private landlords. This paper examines the process of housing production among this category of producers using, as a case study, the peripheral settlements of Abuja, Nigeria's new capital city. A predominance of small-size sole proprietorships is established among the small-scale house building firms, mostly for reasons of maintaining operational flexibility and cost saving. It is also found that the greatest attraction of investing in rental housing by small entrepreneurs is the hedge it provides against inflation and the stability and permanence it introduces into the capital base of economic pursuits. A strong influence of traditional chiefs in land supply is revealed, together with the emergence of a commercialised land market, resulting in speculation and contributing to rising land prices. It is shown that building materials are the most problematic of the key building components to the housing production process. It is argued that small building firms would make more profit if they had access to formal sector working capital and that the practice of using casual workers in project execution has the advantage of enabling firms to survive periods of job drought, but does not encourage growth of the firms, apprenticeship training and skills development in the house construction industry. It is concluded that what is needed to enhance the operation of this category of producers is for government to accept an enabling role that will seek to minimise the financial burden and risks to which they are currently exposed.     

The behavior of the battered child: A behavioral deficiency syndrome resulting from developmental interferences and reactive learning

Behavioral observation of battered children reveals a generalized syndrome consisting of apathy, social isolation, emotional constriction, aggression, and intellectual, motor and language retardation. This syndrome is considered to be a ‘behavioral deficiency syndrome.’ Developmental interference imposed by abusive parents upon the child, and subsequent reactive learning by the child are discussed as etiological factors in the development of this syndrome. Implication of these etiological factors for therapy of the abusive family are also discussed.