用户视角的教学资源库应用效果评价指标体系研究

在国家健全专业教学资源库的背景下,综合分析资源库建设背景、资源库建设现状及资源库应用存在问题,初步梳理以用户视角为出发点的教育资源库应用效果评价体系。依据德尔菲法归纳评价指标,利用层次分析法构建层次结构模型和判断矩阵,计算相应权重并进行一致性检验,形成由4个一级指标、8个二级指标和35个三级指标组成的职业教育专业教学资源库应用效果评价指标体系。     

津滨高速公路社会效益综合评价

一、高速公路建设项目社会效益评价方法 社会效益评价具有指标多、范围广、定量难等特点,各指标的描述方式也不尽相同。目前,国内外对多指标进行综合评价的常用方法有价值分析法、层次分析法、多层次模糊综合评价法及灰色关联度法等。笔者选用层次分析法和多层次模糊综合评价法对高速公路进行社会效益评价。     

城市对外公路客运交通换乘枢纽站内空间使用后评价——以重庆四公里交通换乘枢纽为例

在我国城市规划中设置的各个城市对外公路客运交通换乘枢纽建成后,人们对其使用后的满意程度如何,使用后的评价如何尚有待商榷。本文以使用后评价(POE)理论为立足点,采用层次分析法建立综合评价体系,深入调研分析了重庆四公里交通换乘枢纽,从定性和定量的角度评价其站内空间,找出建成后枢纽在使用中存在的问题,为今后同类型建筑提供参考和依据。     

基于AHP-模糊综合评价的慢行交通满意度评价方法研究——以上海市中心城区为例

该文以上海市中心城区为研究对象,利用层次分析法和模糊综合评价法,基于问卷调查数据,建立慢行交通满意度评价模型,对慢行系统的满意度进行分析.在此基础上,将"满意度"和"重要性"作为关键指标,构建一个2×2矩阵,利用四象限法分析下一阶段慢行交通优化的重点方向.该项研究可加深对慢行交通的满意度和使用者关注重点的认识,有助于更...     

旅游目的地生态环境评价——以重庆市武隆县为例

在旅游地开发与发展过程中,应注意到人与生态环境和谐相处,良性互动,并融为一体。本文根据复合生态理论,运用层次分析法,并以重庆市武隆县为实证分析对象,分别对该地的自然生态环境、经济生态环境,社会生态环境进行了定性与定量的评价,从而得出武隆县旅游生态环境的整体现状。     

吉林省二级中医医院绩效评价体系构建与应用研究

建立和完善以公益性为核心的绩效考核制度,是当前公立中医医院管理亟待解决的关键问题,而绩效考核评价指标体系则是建立绩效管理的基础。本研究采用了文献分析法、关键绩效指标法、专家会议法、层次分析法等多种科学研究方法,进行指标初选、关键评价指标确定,建立一套科学合理、客观公正、操作简便的以公益性为核心的二级中医医院绩效考核评价指标体系,并以此为基础提出具体应用建议。     

大学生身体综合素质评价的数学模型

通过查阅文献、专家咨询和对相关数据的分析，选取身体综合素质评价的指标，利用线性插值和数理统计的方法为所选指标制定评分标准。在此基础上利用层次分析法建立身体综合素质评价的数学模型，对大学生身体综合素质体评价方法进行了探索。     

基于熵权法和层次分析法的粤港澳大湾区社会工作服务评价体系研究

粤港澳大湾区社会工作服务评价体系的建设,是粤港澳大湾区社会工作组织发展进程中的关键环节,也是影响社会工作跨境服务的重要因素。大湾区社会工作组织在推进完善行业标准体系过程中,仍存在评价和考核标准不清晰等问题。本研究在评述社会工作服务评估标准的基础上,参考社会工作对象满意度评估指标的模型框架,建立粤港澳大湾区社会工作服务评估的综合指标体系,并综合运用熵权法和层次分析法对指标进行权重分析。研究发现：在指标体系综合权重中,服务质量、工作能力、工作方法和技巧三个指标所占的权重较高,其中服务质量所占权重最大,据此可为推动粤港澳大湾区社会工作融合发展提出切实可行的建议。     

关于经济责任审计评价体系的研究

近年来企事业单位相应的经济责任审计工作提上日程.考虑到企事业经营方式不同的特点,在设计其经济责任审计评价指标时,采用了分板块和业务类型设计.为此,本文引入层次分析法,建立层次分析模型,通过对审计对象的综合评价,得出科学、直观的评价结果,为企事业单位管理和考核提供有效的方法.     

高职院校毕业生社会适应能力评价指标体系构建研究

利用文献资料法及专家咨询法分析并选取高职院校毕业生社会适应能力的评价指标,通过层次分析法及Matlab软件对评价指标进行定量计算得出其相应权重,构建高职院校毕业生社会适应能力评价指标体系,为高职院校在人才培养模式及内涵建设等方面提供理论依据及指导建议。     

城市病评价指标体系构建及应用研究

通过城市病的主要表现来对我国的9座主要城市的城市病情况进行综合评价，首次将城市病的情况以量化的形式表现出来。根据已有的研究成果选定了城市病综合评价体系的构成指标及将城市病分为五个等级，并确定其相应的标志值，运用层次分析法确定了各个指标的权重，采用这九座城市统计年鉴中的数据测算出各城市相应的城市病情况。本文的基本结论是：在这九座城市中，北京市的城市病综合情况最为严重，其后依次是南京、上海、武汉、天津、石家庄、广州、重庆及杭州；通过综合评价的结果，可以发现各个城市的城市病特征不尽相同，所以在治理城市病时切忌“一刀切”。     

Applying national survey results for strategic planning and program improvement: The National Diabetes Education Program

Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.     

Interviewer as instrument: accounting for human factors in evaluation research

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.     

A comparison of linear and systems thinking approaches for program evaluation illustrated using the Indiana Interdisciplinary GK-12

Logic models are based on linear relationships between program resources, activities, and outcomes, and have been used widely to support both program development and evaluation. While useful in describing some programs, the linear nature of the logic model makes it difficult to capture the complex relationships within larger, multifaceted programs. Causal loop diagrams based on a systems thinking approach can better capture a multidimensional, layered program model while providing a more complete understanding of the relationship between program elements, which enables evaluators to examine influences and dependencies between and within program components. Few studies describe how to conceptualize and apply systems models for educational program evaluation. The goal of this paper is to use our NSF-funded, Interdisciplinary GK-12 project: Bringing Authentic Problem Solving in STEM to Rural Middle Schools to illustrate a systems thinking approach to model a complex educational program to aid in evaluation. GK-12 pairs eight teachers with eight STEM doctoral fellows per program year to implement curricula in middle schools. We demonstrate how systems thinking provides added value by modeling the participant groups, instruments, outcomes, and other factors in ways that enhance the interpretation of quantitative and qualitative data. Limitations of the model include added complexity. Implications include better understanding of interactions and outcomes and analyses reflecting interacting or conflicting variables.     

A model for evaluation of enterprise architecture quality

Today, most organizations use an enterprise architecture (EA) approach as a tool to increase the power of management on the organization's information technology. Enterprise architecture is a set of processes that helps an organization to translate its vision into an effective change in the organization's scope by providing a clear understanding of its current state. The purpose of this research is to identify EA quality attributes and its evaluation indicators in the organization. This study was conducted by using mixed method, including qualitative and quantitative parts. In the qualitative section, a variety of EA evaluation indicators were identified by a systematic literature review (SLR) approach, then in the quantitative section the survey data were collected by a questionnaire prepared based on the qualitative part and then exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed. This research presents an EA evaluation model that has seven main quality attributes including alignment and integrity, quality of EA products and services, security, maintainability and portability, reliability, reusability and scalability, and 30 indicators that address all aspects of enterprise architecture. Through this model, organizations can evaluate the quality of implemented EA or AS-IS status of EA and take steps to improve it.     

Monitoring and evaluation design of Malawi’s Right Foods at the Right Time nutrition program

Child stunting is a public health problem in Malawi. In 2014, the Government of Malawi launched the Right Foods at the Right Time (RFRT) program in Ntchisi district delivering nutrition social and behavior change communication, a small-quantity lipid-based nutrient supplement to children 6–23 months, and nutrition sensitive activities. Monitoring and evaluation (M&E) systems are key aspects of successful program implementation. We describe these and the methodology for an impact evaluation that was conducted for this program. Two monitoring systems using traditional and electronic platforms were established to register and track program delivery and processes including number of eligible beneficiaries, worker performance, program participation, and to monitor input, output, and outcome indicators. The impact evaluation used comparative cross-sectional and longitudinal designs to assess impact on anthropometric and infant and young child feeding outcomes. Three cross-sectional surveys (base-, mid-, and end-line) and two longitudinal cohorts of children followed in 6-month intervals from 6 to 24 months of age, were conducted in sampled households in the program and a neighboring comparison district. Additional M&E included qualitative studies, a process evaluation, and a cost-effectiveness study. The current paper describes lessons from this program’s M&E, and demonstrates how multiple implementation research activities can inform course-correction and program scale-up.     

The relationship between implementation fidelity and educational outcomes in a school-based family support program: development of a model for evaluating multidimensional full-service programs

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of multi-component family support programs for improving educational outcomes for at risk youth, and to assess the relationship between program implementation and outcomes. The qualitative evaluation involved prolonged engagement to identify common program domains or mediators. Using a method called Innovation Configuration Analysis, levels of implementation of program domains were explicated as well as an overall Implementation Fidelity Index. Strong positive relationships were found between overall program implementation and program-level outcomes achieved by student participants.     

Quality of life and sustainability issues as seen by the population of low-income housing in the region of Campinas, Brazil

This paper presents a study on quality of life and sustainability indicators relating to site-planning parameters for low-income public housing projects in the region of Campinas, Brazil. The study is based on a post-occupancy-evaluation (POE), conducted in five housing developments. Most of these housing projects are based on a repetitive model and are devoid of urban infrastructure. Users act on their own in providing for some elements considered necessary to create an identity and community spirit. Results show that the population relates quality of life to economic factors and sustainability is associated to reduce utility bills. Houses are preferred to apartments and satisfaction with the present housing conditions is high, despite low feelings of security in the neighbourhood. This work is part of a broader study, which aims to develop design evaluation tools. Most sensitive quality of life and sustainability indicators related to site-planning should permeate these tools and establish design guidelines. The inclusion of a large number of qualitative design issues into the decision-making process and the questioning of existing standardized solutions are seen as essential means to increase local housing quality.     

Applying RE-AIM to evaluate two community-based programs designed to improve access to eye care for those at high-risk for glaucoma

IntroductionGlaucoma is a leading cause of vision loss and blindness in the U.S. Risk factors include African American race, older age, family history of glaucoma, and diabetes. This paper describes the evaluation of a mobile eye health and a telemedicine program designed to improve access to eye care among people at high-risk for glaucoma.MethodsThe RE-AIM (reach, efficacy, adoption, implementation, and maintenance) evaluation framework was used to harmonize indicators. Both programs provided community-based eye health education and eye services related to glaucoma detection and care. Each program reported data on participants and community partners. An external evaluator conducted site visit interviews with program staff and community partners. Quantitative and qualitative data were integrated and analyzed using the RE-AIM dimensions.DiscussionBy targeting high-risk populations and providing comprehensive eye exams, both programs detected a large proportion of new glaucoma-related cases (17–19%) – a much larger proportion than that found in the general population (<2%). The educational intervention increased glaucoma knowledge; evidence that it led people to seek eye care was inconclusive.ConclusionsEvaluation findings from the mobile eye health program and the telemedicine program may provide useful information for wider implementation in public health clinics and in optometrist clinics located in retail outlets.