Correlates of honor ratings in a clinical clerkship employing a faculty forum evaluation system

5he purpose of this study was to determine whether or not suspected variables affected a surgery clerk's chances of being awarded an honor rating. Findings indicated a significant relationship between a student receiving an honor rating and his or her preceptor's predetermined level of student advocacy, the number of completed patient interview and physical examination write-ups, and final examination scores. There was no significant relationship found between honor ratings and the preceptor's status, the sequence in which the student was discussed or the length of time spent discussing the student at the final evaluation meeting, or the number of clinical faculty present at the meeting. These results lend support to the faculty forum evaluation approach, but suggest a need for further scrutiny of some influencing variables to ensure all students are fairly considered and honor ratings judiciously awarded.     

Physician perceptions of medical malpractice and defensive medicine

Using judgments obtained in interviews with 33 Massachusetts physicians, the annual statewide volume of expenditures incurred for defensive medical reasons in 1982 was estimated to be $1.0 billion, 12% of all medical care expenditures. Estimates for the nation were $37 billion, 14% of expenditures. Nationally, 180,000 cesarean deliveries were thought to be performed for defensive motives. In their own institutions, respondents judged 43% of all skull x-rays following injury to be medically justified, 30% to be defensive medicine, 16% to be placebos, and 11% to be physician misjudgments. In considering the economic and noneconomic costs of medical malpractice procedures, the dollar costs of insurance were considered most serious, followed closely by defensive medicine, unfairness, and poorer relations with patients. Thirty-two percent of the responsibility for the negative aspects of malpractice processes was assigned to lawyers, 21% to physicians, 18% to legislatures and courts, 16% to patients, and 13% to insurance companies.     

Mental health program evaluation: Where you start?

Seduced by the elegance, sophistication and jargon characteristic of new developments in applied research, practicing evaluators are in danger of becoming distracted from achievement of their evaluative goal: that of providing timely, reliable and useful data to program management to facilitate rational data-based decision-making. To avoid such seduction, the author advocates adaptation of simple, inexpensive and efficient evaluative methods tailored to organizational needs and presentation of findings in language readily understood by constituent groups. Likewise, insistance by evaluators upon maintenance of a strict role boundary — that is, limiting role functioning exclusively to those tasks considered evaluation — may be dysfunctional. Rather than detract from accomplishment of his goals, the author maintains that such participation allows development of skills, insights and staff relationships which enhance the evaluator's effective functioning within the organizational context and contribute to organizational acceptance and use of his evaluative results.     

Program analysis using the client oriented cost outcome system.

The client oriented cost outcome system has been under development in Pennsylvania community and hospital programs since 1972. The system builds upon the behavioral and decision data generated with or on behalf of consumers. Flexibility for local program system design is permitted if the procedures of consumer intake, review, and termination document each consumer's (a) problems, resources, and goals, (b) overall functioning level in their ordinary community, and (c) services intended and rendered as related to (a), above. While the system's primary application is in providing feedback for local program quality assurance and evaluation procedures, aggregation of data permits program planning and evaluation at county, state, and federal levels in terms of (a) client demographic or diagnostic characteristics, and (b) program service characteristics and objectives.     

Network analysis in evaluation: some words of caution

Network analysis, a methodology derived from general systems' theory, can be utilized as a community mental health administrative-evaluation procedure. Evaluation parameters derived from analysis of patient data as they “flow” through a network of agency services, provide measures of systemic functioning. These parameters include “longest paths” and various ratio relationships as evaluation measures of service delivery. The limitations of network analysis are examined by means of conceptual analyses, and phenomena that emerged from research experience. The necessity for both quantitative and qualitative data to ensure a meaningful evaluation of mental health services is explained. Conclusions about the value of the network analysis approach are considered.     

Artifact in client satisfaction assessment: experience in community mental health settings

Artifact in client satisfaction assessment is discussed and the results of a study of three factors thought to mediate client satisfaction ratings; (a) general life satisfaction, (b) mode of administration, and (c) psychological symptomatology, are reported. A standard client satisfaction questionnaire (CSQ) was modified to yield parallel forms and was administered orally and in writing to 92 clients in two mental health day treatment programs. Satisfaction ratings obtained from these clients were quite similar to out-patient ratings obtained in previous studies conducted in this setting and using the same measures. Oral administration of the CSQ produced 10% higher satisfaction ratings than written administration (p less than .05) and less missing data (p less than .01). Satisfaction ratings were also obtained using a simple graphic instrument. Graphic ratings were comparable to CSQ ratings. Satisfaction with life in general and level of psychiatric symptoms together accounted for 25% of CSQ variance. The implication of these findings for future client satisfaction research is discussed.     

Involving constituents in agency priority setting: a case study

Many government agencies have "constituents" who believe the agencies should hear and consider their needs and desires in establishing program priorities. This article describes how one involves interested constituents (consumers, industry, medical professionals, and state organizations) in the agency's annual priority-setting process. This participation has produced a number of beneficial results-some expected and some unexpected.     

The effects of psychiatric symptoms on quality of life assessments among the chronic mentally ill

This study of chronically mentally disabled persons in community residences examined the discriminant validity of subjective quality of life indicators and self-report mental health indices to determine the potential confounding effects of psychopathology on the assessment of quality of life (QOL). Factor analyses and difference-score reliabilities identified a general QOL construct and a general mental health construct with 27% common variance. However, psychiatric symptoms did not significantly (p less than .05) alter the bivariate and multivariate relationships among the QOL ratings, except in the health domain in which the correlations of health-related QOL indicators with global QOL were significantly (p less than .05) attenuated after removing the effects of psychopathology. The results suggest that psychopathology does not introduce bias into the overall structure of QOL data, but they also indicate the importance of controlling for mental health effects in the assessment of patients' self-rated health and satisfaction with health care.     

The validity of indices for rural health manpower needs assessment

Population-to-practitioner ratios have long been the primary index in the designation of health manpower shortage areas. This paper documents that application of the widely used population-to-dentist index results in understatement of the need for dental health manpower in rural areas. Through the analysis of utilization data collected from a statewide health screening program in Colorado, the practice of sole reliance on the population-to-dentist indices as an indicator of need was tested. Another measure, the area-(square miles) to-dentist ratio was formulated, examined, and found to be a more useful referent of the need for additional health manpower in rural areas. Utilization of dental services in sparsely settled rural counties of Colorado was unrelated to population-to-dentist ratios. A strong, statistically significant association of utilization with land area-to-dentist ratios was found. The findings of this analysis suggest a need for reevaluation of needs assessment methodologies used in the designation of health manpower shortage areas. Indices more sensitive to consumer circumstance than to the number of health care providers available must be considered.