Rating Methodological Quality: Toward Improved Assessment and Investigation

Assessing methodological quality is considered essential in deciding what investigations to include in research syntheses and in detecting potential sources of bias in meta-analytic results. Quality assessment is also useful in characterizing the strengths and limitations of the research in an area of study. Although numerous instruments to measure research quality have been developed, they have lacked empirically-supported components. In addition, different summary quality scales have yielded different findings when they were used to weight treatment effect estimates for the same body of research. Suggestions for developing improved quality instruments include: distinguishing distinct domains of quality, such as internal validity, external validity, the completeness of the study report, and adherence to ethical practices; focusing on individual aspects, rather than domains of quality; and focusing on empirically-verified criteria. Other ways to facilitate the constructive use of quality assessment are to improve and standardize the reporting of research investigations, so that the quality of studies can be more equitably and thoroughly compared, and to identify optimal methods for incorporating study quality ratings into meta-analyses.     

Rating methodological quality: toward improved assessment and investigation

Assessing methodological quality is considered essential in deciding what investigations to include in research syntheses and in detecting potential sources of bias in meta-analytic results. Quality assessment is also useful in characterizing the strengths and limitations of the research in an area of study. Although numerous instruments to measure research quality have been developed, they have lacked empirically-supported components. In addition, different summary quality scales have yielded different findings when they were used to weight treatment effect estimates for the same body of research. Suggestions for developing improved quality instruments include: distinguishing distinct domains of quality, such as internal validity, external validity, the completeness of the study report, and adherence to ethical practices; focusing on individual aspects, rather than domains of quality; and focusing on empirically-verified criteria. Other ways to facilitate the constructive use of quality assessment are to improve and standardize the reporting of research investigations, so that the quality of studies can be more equitably and thoroughly compared, and to identify optimal methods for incorporating study quality ratings into meta-analyses.     

Cognitive-Behavioral Therapy for Anxious Symptoms in Persons of African Descent: A Meta-Analysis

Despite the social origin or race, there are a number of historical and experiential differences between persons of African descent and members of other cultures which could potentially moderate outcomes in psychotherapeutic research. The goal of the meta-analysis was to determine the effect of cognitive-behavioral therapy (CBT) used to treat anxiety in persons of African descent. A systematic review was conducted. A standardized mean difference meta-analysis used a random effects model for meta-analytic results. Moderator analyses were used to examine heterogeneity. Bonferroni corrections were used to adjust for type I errors. Of the 12 included studies, two meta-analytic models and a sensitivity analysis had large statistically, significant summary effects favoring CBT in the treatment of anxious symptoms in persons of African descent. Clinical implications regarding active ingredients of CBT vs. common factors are discussed. Areas for future research including fidelity, culturally adaption, and research design are described as well.     

Meta-Analysis as a Research Synthesis Methodology: Cause for Concern

ABSTRACT

The use of meta-analysis is growing in popularity. It is based on the fundamental notion of the effect size, and a critical assumption is that effect sizes based on different measures are directly comparable. In this article it is argued that the direct comparability of effect sizes across measures implies the invariance of the effect sizes across these measures. A model of standardized mean difference (SMD) effect size invariance is developed, based on multifacet generalizability theory, which shows that SMD effect size invariance requires certain validity invariance conditions to hold. One implication of these findings is that the direct comparability of SMD effect sizes based on different measurement procedures is an empirical matter requiring testing prior to conducting a meta-analysis. Findings are also discussed suggesting that violations of one of these conditions—universe score validity invariance—can bring about substantial differences across SMD effect sizes as a function of measurement procedure. These findings suggest the need for a more refined use of meta-analysis since meta-analytic results may be adversely impacted by the lack of direct comparability of effect sizes based on different measures.     

A Meta-Analysis of Culturally Sensitive Interventions Designed to Reduce High-Risk Behaviors Among African American Youth

ABSTRACT

This study sought to determine the effectiveness of culturally sensitive interventions (CSIs) in reducing high risk behaviors with African American youth. A meta-analysis was conducted to assess the effectiveness of CSIs across seven studies. African American youth who participated in CSIs were less likely to engage in high risk behaviors compared to those who did not participate. The effect size was moderate (g = .35). Although the findings should be considered tentative, the results provide an initial quantitative assessment of CSI effectiveness that future evaluations and meta-analyses can build upon as CSI research expands.     

Is the trend to publish reviews and clinical trials related to the journal impact factor? Analysis in dentistry field

ABSTRACT

It is generally accepted that the Journal Impact Factor is a quality criterion. The objective was to determine the evolution along the period 2010–2016 of number of different types of papers, reviews and clinical trials, published by dental journals, as well as if they are related with the quartile occupied in the Journal Impact Factor 2017 ranking. To this end, ten journals per quartile belonging to the field Dentistry, Oral Surgery and Medicine in the 2017 Journal Citation Reports were randomly selected. For each journal and year, the total number of narrative reviews, systematic reviews (with and without meta-analysis), meta-analysis, clinical trials and randomized controlled trials were obtained from Pubmed. To achieve our goal, the slope of these variables over time was estimated using the least squares method, after which one-way analysis of variance of mean values was performed. In Dentistry, the journals of the top quartiles show a trend to publish increasing amounts of systematic reviews and meta-analysis, than the ones of the third and fourth quartile. On the other hand, globally, there was virtually no increase in narrative reviews, clinical trials and randomized controlled trial. Possible causes of this behavior are also discussed in this article.     

Health informatics for older people: a review of ICT facilitated integrated care for older people

Growing demands on welfare services, arising from expanding populations of older people in many countries, has led policy makers to consider the use of information and communications technologies (ICTs) as a means to transform the cost-effective delivery of health and social care. The evidence for these claims is examined by reporting the main findings of a review of worldwide published literature documenting the adoption of health informatics applications to improve health and social care for older people. It focuses around two dimensions of the UK government's programme for 'modernising' public services, which emphasise the use of ICTs to facilitate the sharing of health and social services information and its potential to foster person-centred approaches to independent living. Findings suggest that there is little evidence that these dimensions have been realised in practice and the perceived incompatibility between them is more likely to produce expensive and ineffective health informatics outcomes.     

Meta-Analytic Methods for Comparative and Exploratory Policy Research: An Application to the Assessment of Regional Tourist Multipliers

This article addresses the question how meta-analytic methods can be used to draw quantitative economic inferences on case studies (or phenomena) when actual information is scarce. It argues that the recently developed rough set theory may offer an operational contribution to impact assessment on the basis of transferability of research findings from previous case study research findings on similar phenomena. This approach is able to identify band widths of plausible outcomes in light of prior knowledge. This new analysis framework is illustrated by means of an empirical investigation into the size of tourist income multipliers in various tourist areas, with a particular focus on the Greek island Lesvos.     

Today's Studies,Tomorrow's Meta-Analyses: Implications for Evidence Informed Decision–Making in Social Work

ABSTRACT

Meta-analyses play an important role in understanding aspects of human functioning and program effectiveness. Meta-analyses also inform practice and policy decision making in areas of interest to social work. This study examined the degree to which recent quantitative reports in top social work journals are eligible for inclusion in future meta-analytic studies based on method rigor. The results suggest a mixed picture. Articles in top social work journals typically present sufficient information on participant characteristics, p values, and Mean values, yet they often fail to present sufficient information on variance indicators or the precise numbers of participants, which limits the ability to calculate effect sizes. Furthermore, less than 10% of the reports utilized randomized experimental designs or tested for group equivalence. To enhance social work's ability to make evidence-based decisions by producing more meta-analyses, researchers should provide more detail in study reports and use stronger research designs.     

从本体论到伦理学——勒维纳斯他者伦理学对西方哲学的批判性变革

勒维纳斯提出"他者"范畴的目的在于把伦理学确立为第一哲学,取代本体论作为第一哲学的传统地位.勒维纳斯批判了源自古希腊的、具有两千多年传统的本体论哲学,并对本体论哲学的理论根据及其后果进行了清理和批判,其策略是以"他者"的差异性突破本体论的同一性,最终目的则在于探讨伦理形而上的可能性.勒维纳斯针对西方文化病灶所开出的伦理药方对当代中国文化建设的伦理价值路向具有一定的借鉴意义.     

Common ratio using delay

We present an experiment in which we add a common delay in a choice between two risky prospects. The results show that delay produces the same change in preferences as in the well-documented common ratio effect in risky lotteries. The added common delay acts as if the probabilities were divided by some common ratio. Moreover, we show that there is a strong magnitude effect, in the sense that the effect of delay depends on the magnitude of the outcome. The results are consistent with the recently introduced probability time trade-off (PTT) model by Baucells and Heukamp. We present a parameterization of the model based on the experimental results, showing that the value function exhibits increasing relative risk aversion, the weighting function is s-shaped, and the intrinsic discount rate is decreasing.     

The misuse of statistics: concepts,tools, and a research agenda

This paper presents concerns regarding misuse of statistics in scientific work, especially in biomedical research. The paper discusses what is meant by "misuse." It appears that misuse arises from various sources: degrees of competence in statistical theory and methods, honest error in the application of methods, egregious negligence, and deliberate deception (misconduct.) The incidence of error is partly due to a perceived need to meet artificial statistical criteria for acceptance of research reports for publication by journals. There has been no systematic research into the prevalence of misuse or its breakdown by type. Nonetheless, there are ways to encourage, or even to enforce, good statistical practice. These can be greatly supported by use of available statistical ethics documents. This article suggests lines of further research that could define the problem more explicitly and that might lead to additional corrective measures.     

记忆研究的“社会-文化”范式:对“哈布瓦赫-阿斯曼”研究传统的解读

通过分析“哈布瓦赫-阿斯曼”研究路径中有关社会、文化等概念,可以得出一个较为清晰的记忆研究的“社会-文化”范式,从而弥补当下记忆研究无范式的缺陷。这一范式尤其体现在与神圣记忆密切相关的“社会框架论”、社会品质,以及卡农、神话、节日等概念中。从社会学角度看,能够促发人们回忆的社会力来自涂尔干所谓的“神圣社会”。哈布瓦赫记忆理论中的“社会框架论”和“社会品质”概念是涂尔干的“社会本体论”思想的核心表现,由此形成一种哈布瓦赫的“神圣记忆观”。扬·阿斯曼文化记忆理论中的重要概念“卡农”,也是一种神圣记忆。卡农等概念是扬·阿斯曼对哈布瓦赫的“社会框架论”的继承和推进。上述要素构成记忆研究的“社会-文化”范式的基础。从“取向”讨论转向“范式”分析,有助于推进社会记忆研究传统的生成和发展。     

The Misuse of Statistics: Concepts,Tools, and a Research Agenda

This paper presents concerns regarding misuse of statistics in scientific work, especially in biomedical research. The paper discusses what is meant by "misuse." It appears that misuse arises from various sources: degrees of competence in statistical theory and methods, honest error in the application of methods, egregious negligence, and deliberate deception (misconduct.) The incidence of error is partly due to a perceived need to meet artificial statistical criteria for acceptance of research reports for publication by journals. There has been no systematic research into the prevalence of misuse or its breakdown by type. Nonetheless, there are ways to encourage, or even to enforce, good statistical practice. These can be greatly supported by use of available statistical ethics documents. This article suggests lines of further research that could define the problem more explicitly and that might lead to additional corrective measures.     

道德统计学的社会观:塔尔德与涂尔干之争再考察

鲜有人考察19世纪法国的两位重要社会学家塔尔德和涂尔干之间的争论。本文以两人都倚重的统计学方法为切入口,深入考察两人论辩的实质问题,并力图呈现论辩背后的社会观差异以及各自对社会秩序之基础的思考。塔尔德试图以客观概率的方式去捕捉作为主观变量的社会秩序的生成过程,涂尔干则秉承以凯特莱为代表的道德统计学传统,试图通过纯粹客观的统计数据来捕捉具体社会结构及其功能的正常状态。通过对两人统计学基础的不断追索,本文认为,两人的实质差异在于：塔尔德试图超越社会本体论思考,用单子论的方式把握和理解现代社会特征和秩序的基础,而涂尔干仍然从社会本体的角度做社会学式思考,探寻现代社会的秩序基础。     

The beginning of the end of Robert H. Schuller's Crystal Cathedral Ministry: A towering failure in crisis management as reflected through media narratives of financial crisis,family conflict,and follower dissent

In 2010–2011, the Crystal Cathedral Ministry, one of the world's most respected Christian megachurches (Frankl, 1990), endured a series of crisis events culminating with a court ordered sale of its property. This signaled the end of Robert H. Schuller's ministry. This research analyzes dozens of news stories published during the crisis, documenting that the ministry failed to effectively use the media to communicate on vital issues. This failure exacerbated the crisis by allowing, unchecked, a proliferation of news stories portaying the ministry as out of touch, and Schuller family members as quarreling spendthrifts. Despite Schuller's decades of service, national prominence, and ‘positive thinking’ focus, his ministry was overcome by the materialism he purported to stand against. The rapid downfall is an extraordinary event within Christian televangelism. Examining media reporting of it allows important conclusions to be reached about any organization's communication with media gatekeepers in a time of crisis.     

The Value of a Statistical Life: A Critical Review of Market Estimates Throughout the World

A substantial literature over the past thirty years has evaluated tradeoffs between money and fatality risks. These values in turn serve as estimates of the value of a statistical life. This article reviews more than 60 studies of mortality risk premiums from ten countries and approximately 40 studies that present estimates of injury risk premiums. This critical review examines a variety of econometric issues, the role of unionization in risk premiums, and the effects of age on the value of a statistical life. Our meta-analysis indicates an income elasticity of the value of a statistical life from about 0.5 to 0.6. The paper also presents a detailed discussion of policy applications of these value of a statistical life estimates and related issues, including risk-risk analysis.     

人类生存关系的诗意反思——论马丁·布伯的“我—你”哲学对近代主体哲学的批判

马丁·布伯是 2 0世纪声名斐然的犹太教哲学家。他提出了哲学的“关系本体论” ,或者说“我—你”哲学。从我—你关系出发 ,对传统哲学的“我—它”关系进行了批判。马丁·布伯的我—你哲学或关系本体论 ,是对人类生存的神学人本主义意义上的反思 ,同时也是对西方文化和社会危机的浪漫主义的批判。他的神学可以称之为浪漫神学。布伯的哲学思想具有很大的合理性 ,同时也具有很大的缺陷     

老子及其著述辨伪

老子是中国古代哲学本体论的创始者,"道"是其本体论的最高范畴,他对中国古代"哲学的突破"有着不可磨灭的功绩。然而,被奉为道家始祖的老子是哪个时代的人?《老子》又成书于何时?老莱子、太史儋与老聃是否为同一个人?这一连串的问题长期困扰着人们。因而澄清真假老子及其原作、伪作,对我们准确了解和把握老子的学说宗旨及其传承脉络无疑会有极大的帮助。同时,先秦思想文化的特点、演变轨迹以及道家与其他各家的相互关系等,也须在此基础上重新审视。     

Are antidepressant and antipsychotic drug trials registered? A cross-sectional analysis of registration and reporting of methodologic characteristics

Introduction: In 2005, the International Committee of Medical Journal Editors (ICMJE) proposed that all submitted trials in all 11 member journals must be prospectively registered in order to be considered for publication. Registering drug trials was meant to reduce the likelihood of selective reporting. The aim was to determine the proportion of antipsychotic and antidepressant trials that were registered.

Methods: We searched in Pubmed for all randomized controlled trials of any antidepressant or antipsychotic published between July and December 2014. The primary objective was to determine the proportion of trials that were registered. Secondary objectives included comparing the reporting of methodological details and positive study findings between registered and unregistered trials.

Results: Of the 67 studies identified, 58% were registered. 75% of the antipsychotic trials and 51% of the antidepressant trials were registered, respectively. Registered trials were more likely to report important methodological details associated with risk of bias in RCTs. There was no significant difference in trials reporting positive outcomes for the study intervention between registered and unregistered trials.

Conclusion: Approximately 60% of published antidepressant and antipsychotic drug trials during July to December 2014 were registered. Unregistered trials were less likely to report important methodological details.