Reliability and Validity of the Pathological Gambling Adaptation of the Yale-Brown Obsessive-Compulsive Scale (PG-YBOCS)

The Yale Brown Obsessive Compulsive Scale adapted for Pathological Gambling (PG-YBOCS) was developed to measure the severity and change in severity of pathological gambling symptoms. The PG-YBOCS is a 10-item clinician-administered questionnaire that measures the severity of PG over a recent time interval (usually within the past one/two week(s)). In order to assess and validate the scale, it was administered to 337 subjects: 188 pathological gamblers and 149 healthy controls. Internal consistency and correlations between individual items and total score were assessed for various permutations of the sample. Other scales were administered to assess convergent, discriminant and content validity. Sensitivity to change was evaluated in treatment studies with fluovoxamine, lithium, and valproate. Each item was frequently endorsed across a range of severity. Good inter-rater reliability and internal consistency were obtained. The PG-YBOCS showed high validity and reliability for total score, item-total correlations, and for each subscale (Thoughts/Urges and Behavior). PG-YBOCS scores correlated with global severity and South Oaks Gambling Screen (SOGS) scores. The scale was also sensitive to change in pathological gambling severity. PG-YBOCS thus appears to be a reliable and valid measure of pathological gambling severity, and can be regarded as an important tool for clinicians and researchers treating pathological gamblers.     

Development of the Sexual Five-Facet Mindfulness Questionnaire (FFMQ-S): Validation Among a Community Sample of French-Speaking Women

It has been recently demonstrated that mindfulness-based intervention may be particularly suitable for addressing sexual difficulties in women. Although the Five-Facet Mindfulness Questionnaire (FFMQ) is currently one of the most widely used scales to assess mindfulness, no adaptation and validation of the FFMQ to measure female sexual functioning has been published. The main aim of this study was to develop and validate a sexual version of the Five Facets Mindfulness Questionnaire (FFMQ-S) to specifically measure mindfulness in the context of sexual encounters. A total of 251 healthy, French-speaking female volunteers were administered the FFMQ-S, the original FFMQ, and the Female Sexual Distress Scale (FSDS-R). Confirmatory factor analyses indicated that the FFMQ-S exhibits a five-factor model, as implied by the original FFMQ. Good scale reliability was observed. The FFMQ-S showed significant correlations with the FSDS-R and the usual FFMQ. Scores on the FFMQ-S correlated significantly more negatively with the total FSDS-R score than with the total score of the original version of the FFMQ. These findings clearly support the relevance of developing a version of the FFMQ tailored to sexual functioning.     

Reliability,Validity, and Classification Accuracy of the DSM-5 Diagnostic Criteria for Gambling Disorder and Comparison to DSM-IV

The DSM-5 was published in 2013 and it included two substantive revisions for gambling disorder (GD). These changes are the reduction in the threshold from five to four criteria and elimination of the illegal activities criterion. The purpose of this study was to twofold. First, to assess the reliability, validity and classification accuracy of the DSM-5 diagnostic criteria for GD. Second, to compare the DSM-5–DSM-IV on reliability, validity, and classification accuracy, including an examination of the effect of the elimination of the illegal acts criterion on diagnostic accuracy. To compare DSM-5 and DSM-IV, eight datasets from three different countries (Canada, USA, and Spain; total N = 3247) were used. All datasets were based on similar research methods. Participants were recruited from outpatient gambling treatment services to represent the group with a GD and from the community to represent the group without a GD. All participants were administered a standardized measure of diagnostic criteria. The DSM-5 yielded satisfactory reliability, validity and classification accuracy. In comparing the DSM-5 to the DSM-IV, most comparisons of reliability, validity and classification accuracy showed more similarities than differences. There was evidence of modest improvements in classification accuracy for DSM-5 over DSM-IV, particularly in reduction of false negative errors. This reduction in false negative errors was largely a function of lowering the cut score from five to four and this revision is an improvement over DSM-IV. From a statistical standpoint, eliminating the illegal acts criterion did not make a significant impact on diagnostic accuracy. From a clinical standpoint, illegal acts can still be addressed in the context of the DSM-5 criterion of lying to others.     

Change in cytokine levels after administration of saikokaryuukotsuboreito or testosterone in patients with symptoms of late-onset hypogonadism

The purpose of this study was to evaluate plasma cytokine levels after treatment with saikokaryukotsuboreito (SKRBT), which is a herbal medicine, or androgen replacement treatment (ART), for patients with late-onset hypogonadism (LOH)-related symptoms. Thirty-one patients over 40 years of age with LOH-related symptoms were included in this study. SKRBT was given orally three times daily to a total of 7.5 g/day for 15 eugonadal patients and ART was give to 16 hypogonadal patients by intramuscular injection of testosterone enanthate at 125?mg each time every 2 weeks. Plasma levels of testosterone and 18 cytokines, as well as LOH-related symptoms scored according to the Aging Males' Symptoms (AMS) scale, were compared before and more than 2 months after treatment. In the ART group, the total AMS score was decreased and testosterone was increased significantly after treatment. No cytokine variables were altered significantly after the treatment. In the SKRBT group, although the total AMS score was significantly decreased, testosterone did not change. From the evaluation of cytokines, a significant increase was found in interleukin (IL)- 8, IL-13, interferon-γ and tumour necrosis factor-α. We conclude that SKRBT might improve LOH-related symptoms in eugonadal patients through the beneficial effect of cytokines, a mechanism that is quite different from ART.     

Self-efficacy in pathological gambling treatment outcome: development of a gambling abstinence self-efficacy scale (GASS)

A 21-item measure of gambling abstinence self-efficacy (GASS) was developed. A principal component analysis of 101 pathological gamblers supported the use of a total score that showed good internal (α=.93) and retest reliability (ICC (n=35)=.86) as well as four subscales: 1) winning/external situations (6 items, α=.91); 2) negative emotions (9 items, α=.87); 3) positive mood/testing/urges (3 items, α=.70); 4) social factors (3 items, α=.81). The total and subscales showed moderate relationships with single item ratings of confidence to abstain from gambling and weak or non-significance relationships with demographic and gambling-related variables. The total score and three of the subscales showed evidence of predictive validity for gamblers not currently involved with treatment. Higher self-efficacy was related to fewer days of gambling over a 12-month period. These results provide preliminary support for the reliability and validity of the GASS.     

Use of the International Prostate Symptom Score (IPSS) in Chinese male patients with benign prostatic hyperplasia

Purpose: To test the psychometric properties of the International Prostate Symptom Score (Hong Kong Chinese version 2) (IPSS) in Chinese male patients with benign prostatic hyperplasia (BPH) under secondary care.

Methods: A prospective longitudinal study was done by interviewing subjects at baseline, at 2 week after baseline for assessing test–retest reliability and at 26 week after baseline for assessing responsiveness. All subjects were interviewed to complete a structured questionnaire including IPSS, Short Form-12 Health Survey version 2 (SF-12v2) and Depression Anxiety Stress Scale (DASS).

Results: The IPSS HRQOL score had weak correlations with SF-12v2 summary and DASS domain scores. For reliability analysis, Cronbach’s alpha coefficient was 0.90 for the seven symptom-related items. The intraclass correlation coefficients of the IPSS total symptom score and HRQOL score were 0.90 and 0.86, respectively. For sensitivity, statistically significant differences were detected between the subjects with BPH and those without for IPSS total symptom score (effect size?=?0.68) but not the IPSS HRQOL score. The areas under ROC curves for the IPSS total symptom and HRQOL scores were 0.67 and 0.60, respectively.

Conclusions: The IPSS was valid, reliable instrument in Chinese patients with BPH. The IPSS total symptom score, but not the HRQOL score, is sensitive in differentiating subgroups.     

Development of a lateral mobility task to identify individuals at risk for mobility disability and functional decline

Lateral mobility is integral to many activities of daily living involving transfer from one position to another. The objective of this study was to develop and evaluate the validity and test-retest reliability of a lateral-mobility (LATMOB) task for older adults. Measurements of lateral mobility, balance, and strength and self-reported and performance-based physical functioning were obtained in 63 women and 77 men > or = 50 years of age. The LATMOB task was significantly correlated with age, knee-extensor strength, grip strength, functional reach, and one-leg-stance time. Test-retest reliability of the task was excellent. The LATMOB task was highly correlated with the car task. Balance was significantly correlated with time to get into and out of a car and performance on the LATMOB task. The LATMOB task was significantly correlated with the Short Physical Performance Battery score. The LATMOB task is valid and reliable, but additional work is needed to assess its sensitivity to change and predictive validity.     

Reliability of isokinetic and isometric knee-extensor force in older women

Because of the need for efficient, consistent strength measurements, the test-retest reliability of concentric, isometric, and eccentric strength; concentric work; and concentric power was determined in older women without a familiarization session. The reliability of measures derived from a single peak score were compared with those derived from an averaged score. On 2 occasions 25 older women with a mean age of 72 +/- 6 years performed 3 submaximal knee extensions and 5 maximal contractions on an isokinetic dynamometer at 90 degrees/s (CON), 0 degrees/s, and -90 degrees/s on both lower limbs. Statistical analyses for peak and averaged values (best 3 contractions of 5) exhibited good relative reliability (ICCs > .88), except for CON power. Typical error as a coefficient of variation and ratio limits of agreement for peak and averaged score values were larger than desired, with CON power scores demonstrating unacceptable error ranges. Although relative reliability of this 1-session assessment protocol was acceptable, further research is needed to determine whether additional practice trials could enhance absolute reliability.     

Reliability of the Demand-Control Questionnaire for sewing machine operators

The Demand-Control Questionnaire (DCQ), a 20-item scale that measures psychological work demands, job control and workplace social support, has frequently been used to assess occupational stress. The purpose of this study was to determine the test-retest reliability and internal consistency of the DCQ with sewing machine operators. Forty-six sewing machine operators completed the DCQ on two occasions with an 11-week time interval. A repeated measures analysis of variance model and subsequent application of generalizability theory were used to calculate the test-retest reliability of the subjects' ratings on the DCQ. Cronbach's alpha was used to determine the internal consistency of the scale. The test-retest reliability was 0.33 (95% confidence interval = 0.05-0.61), indicating fair reliability. Good internal consistency (Cronbach's alpha = 0.70) was found. The DCQ appears to be a reliable measure for assessing occupational stress in sewing machine operators. Workplaces need to place greater emphasis on the role of occupational stress in the prevention and treatment of musculoskeletal injuries among sewing machine operators.     

Determining the Appropriateness of the “What If” Situations Test (WIST) with Turkish Pre-Schoolers

Measurement instruments are needed to assess the child’s sexual abuse prevention program. The purpose of the study was to determine the reliability and validity of the WIST (What If Situations Test) for Turkish culture. Participants were children of the 3–6 age group attending pre-school education institutions and the sample size was identified by means of a power analysis. Seventy children were identified as the sample with 0.85 power and 0.05 type I error according to the power analysis. Language validity, content validity, internal validity coefficient (Cronbach alpha coefficient), and test–retest analyses were conducted in terms of validity and reliability in the scope of efforts for adaptation to Turkish culture. Firstly, Kendall W = 0.83 was the score for the expert opinions concerning the content validity of the language validity scale. It was found that the Cronbach alpha coefficients were between 0.68 and 0.90 for the scale sub-dimensions of appropriate and inappropriate recognition, saying, doing, telling, and reporting. The test–retest reliability of the scale was found to be r = 0.89 and the test–retest reliabilities for the sub-dimensions (appropriate recognition, inappropriate recognition, say skills, do skills, tell skills, and reporting skills) were between r = 0.48 and r = 0.92. The test–retest reliability for the Personal Safety Questionnaire (PSQ), as having complimentary items to the WIST, was found to be r = 0.82. The reliability and validity analysis of the ‘What If’ Situations Test (WIST), used to evaluate pre-schoolers’ skills regarding self-protection against sexual abuse, showed that the Test’s adaptation to Turkish culture was reliable and valid.     

Comparison of two methods of measuring physical activity in South African older adults

The aim of this study was to assess the validity and reliability of the Yale Physical Activity Survey (YPAS) and the short version of the International Physical Activity Questionnaire (IPAQ) in older South African adults. The YPAS includes measures of weekly energy expenditure (EE) for housework, yard work, caregiving, exercise, and recreation. The IPAQ measures total time and EE during vigorous and moderate activity, walking, and sitting. The instruments were administered twice for test-retest reliability (men, n = 52, 68 +/- 5.4 years, and women, n = 70, 66 +/- 5.8 years). Data for criterion validity were obtained from accelerometers. YPAS reliability ranged from r = .44 to.80 for men and r = .59 to .99 for women (p < .0001). IPAQ reliability was lower for men (r = .29 to .76) than for women (r = .46 to .77). Criterion validity of the YPAS was .31 to .54 for men and .26 to .29 for women. The YPAS and short IPAQ had comparable results for reliability and criterion validity.     

The Psychometric Properties of the Hypersexual Behavior Inventory Using a Large-Scale Nonclinical Sample

The conceptualization of hypersexuality has begun to converge as a result of proposed diagnostic criteria. However, its measurement is still diverse. The Hypersexual Behavior Inventory (HBI) is one of the most appropriate scales used to assess hypersexuality, but further examination is needed to test its psychometric properties among different clinical and nonclinical groups, including samples outside of the United States. The aim of the present study was to investigate the reliability and the generalizability of HBI and to determine a cutoff score on a large, diverse, online, nonclinical sample (N = 18,034 participants; females = 6132; 34.0%; M_age = 33.6 years, SD_age = 11.1). Confirmatory factor analysis (CFA) and reliability indices provided support for the structure of the HBI and demonstrated excellent reliability. Employing latent profile analysis (LPA), seven classes emerged, but they could not be reliably distinguished by objective sexuality-related characteristics. Moreover, it was not possible to determine an adequate cutoff score, most likely due to the low prevalence rate of hypersexuality in the population. HBI can be reliably used to measure the extent of hypersexual urges, fantasies, and behavior; however, objective indicators and a clinical interview are essential to claim that a given individual may exhibit features of problematic sexual behavior.     

A study of the utility of the child behavior checklist with residentially placed children

An evaluation study was conducted to determine the potential usefulness of the Child Behavior Checklist (CBCL) with children placed in residential settings. The CBCL, the Global Assessment Scale, the Progress Evaluation Scales, and the Jesness Behavior Checklist were completed for 97 children in community residential treatment. Children categorized by the CBCL as Externalizers were found to be more obtrusive, hostile, alienated, nonconforming, attention seeking, and sensitive, and less responsible, insightful, and considerate than were Internalizers. The total problem score, the Internalizing scale score, and the Externalizing scale score on the CBCL were significantly correlated with problem severity, predicted length of stay, and a measure of placement appropriateness. These three total scores proved to be useful measures of residentially placed children. Results suggest that a high score on the Externalizing scale may reflect the presence of behaviors difficult to deal with in a residential environment. A high score on the Internalizing scale may be no less serious, but involves behaviors less disruptive of the group setting. The potential value of the CBCL for evaluating residentially placed children is discussed.     

Validating Grant-Making Processes: Construct Validity of the 2013 Senior Corps RSVP Grant Review

Accountability in grant-making requires a valid, fair and transparent selection process. This study proposes a four-step framework for validating such a process: determine standards for qualified applicants, assess inter-reviewer reliability, assess factorial validity, and assess reliability. This framework is applied to the Corporation for National and Community Service’s 2013 RSVP grant-making process. The standards were close to the highest points of reliability. Inter-reviewer reliability was above 0.90, a common threshold for high-stakes measurement. After conducting confirmatory factor analysis, the final model merged two of the original five domains of selection criteria, resulting in four domains. The final model was found to have strict measurement invariance, high convergent validity, and measurement reliability between 0.88 and 0.93 for all domains. The results validate the 2013 review process and indicated that the scores exhibited high degrees of reliability, giving public assurance that the process was sufficiently objective and accurately reflected program priorities.     

Confirmatory Validation Of The Factor Structure And Reliability Of The Sexual Risk Survey In A Large Multiuniversity Sample Of U.S. Students

Objectives: The Sexual Risk Survey (SRS) is a measure of sexual risk behavior designed to comprehensively assess sexual risk taking among college students and has been found to have good psychometric properties. However, the SRS was created and validated within a sample of U.S. Midwestern university students and the factor structure and reliability may differ in other samples. The current study expands on existing research by examining the factor structure and reliability of the SRS in a large, diverse archival data set and also provides a standardized approach to scoring the SRS. Methods: Archival data included in this study were collected from 2006 to 2013 from 5,496 university students in 16 different American academic institutions in 11 states. Results: Confirmatory factor analysis supported the original 5-factor solution described by Turchik and Garske (2009). In comparing mean subscale scores across demographic characteristics—age, gender, race/ethnicity, sexual orientation, and religion—a number of demographic differences were found, although most differences were small in magnitude. Internal consistency reliability for the total scale was .90, and subscale alphas ranged from .63 to .90 for the total pooled sample. Conclusions: The factor analysis supported the original five-factor scale and new information is presented regarding demographics differences. Scoring guidelines have been updated and information to assist researchers with the standardized scoring of the SRS is presented.     

Reliability,Validity, and Cut Scores of the South Oaks Gambling Screen (SOGS) for Chinese

We examined the reliability, validity, and classification accuracy of the South Oaks Gambling Screen (SOGS) when adopted for use in Chinese. The DSM-IV criteria for pathological gambling served as the standard against which the classification accuracy of the SOGS was tested. A total of 283 Chinese adults in the community and 94 Chinese treatment-seeking gamblers were recruited. The internal reliability of the SOGS was satisfactory for the general sample and acceptable for the gambling sample. The SOGS was correlated with the DSM-IV criteria items as well as psychosocial and gambling-related problems. Relative to the DSM-IV criteria, the SOGS tended to overestimate the number of pathological gamblers in both samples. In general, we were relatively confident that individuals were not pathological gamblers if the SOGS scores were between 0 and 4 and were pathological gamblers if the SOGS were between 11 and 20. There was about 50–50 chance of being pathological gamblers if the SOGS scores were between 8 and 10. However, the probability of individuals being pathological gamblers was about 0.30 if the SOGS scores were between 5 and 7. We proposed a SOGS cut score of 8 to screen for probable pathological gambling in Chinese societies.     

The Gambling Self-Efficacy Questionnaire: An Initial Psychometric Evaluation

Instruments to assess individuals' self-efficacy for the control of addictive behaviors have been useful for monitoring behavior change, predicting maintenance of treatment gains, and identifying potential relapse situations. The Gambling Self-Efficacy Questionnaire (GSEQ) was developed to assess perceived self-efficacy to control gambling behavior. A demographically diverse sample of 309 adult gamblers completed an initial set of 42 items, of which 16 were selected to form the final version of the GSEQ. The GSEQ showed high internal consistency ( = .96) and good test-retest reliability (r = .86). A factor analysis provided some support for a unitary factor structure. As expected, GSEQ scores were negatively correlated with reports of problematic gambling behavior. Participants experiencing problems related to their gambling behavior scored significantly lower on the GSEQ than those who were not experiencing gambling problems. This psychometric examination of the GSEQ supported its potential utility for treatment planning and outcome evaluation with problem gamblers.     

Assessing Family Outcomes: Psychometric Evaluation of the Beach Center Family Quality of Life Scale

There is currently a lack of reliable scales with which to assess the construct of family quality of life, particularly for families who have children with disabilities. The current work presents 2 studies, including a total of 488 families with children with disabilities, which were conducted to complete the development of a scale to assess family quality of life. The measure was refined through confirmatory factor analyses into 25 items that assess 5 domains of Family Quality of Life: Family Interaction, Parenting, Emotional Well‐Being, Physical/Material Well‐Being, and Disability‐Related Support. Each subscale was found to be unidimensional and internally consistent. An initial examination of test‐retest reliability and convergent validity is also presented. Implications for future research, scale use, and policy are discussed.     

The inter-rater reliability and validity of self-report of risk factors for cumulative trauma disorders within the hand therapist population - a pilot study

OBJECTIVES: This study examined the validity of hand therapists' self-report of cumulative trauma disorder (CTD) risk factors by comparing the self-report to observations performed by the raters. Inter-rater reliability was also analyzed between the raters who observed the hand therapists. STUDY DESIGN: Two raters simultaneously observed each hand therapist during a splinting task at a therapy facility. Following this task, the raters and the hand therapist independently completed an identical assessment tool. Thirteen therapists were observed and a total of six raters observed the therapists. Responses from two categories of the self-assessment, "posture" and "mechanical stress", were compared. Percentage of agreement was calculated by dividing the number of like responses by the total number of possible responses for each category. RESULTS: Overall inter-rater reliability was 72%, significantly above the accepted minimum standard of 60-70%, and validity was 39%, significantly below the accepted minimum. CONCLUSION: The high percentage of inter-rater reliability established consistency and accuracy among the raters in their observations. However, the low percentage of validity should prompt hand therapists to investigate the accuracy of a patient's self-report before relying on it for treatment.     

Harnessing the reliability of outcome measures

A method is presented for engineering the necessary levels of measurement reliability for evaluating ongoing programs. Two studies of levels of client functioning at a community mental health center (CMHC), in which an outcome measure, the Global Assessment Scale (GAS), did not perform as expected, drew attention to the need for better control of outcome measure reliabilities. Drawing from generalizability theory, a study was conducted of three sources of GAS score variance — clients, raters, and training in the use of the scale. Several estimates of reliability (ERs) were developed, depending on the manner in which the GAS ratings were, or would be, obtained in the CMHC. The differences among these ERs clarified why the GAS had lower reliability when used in our setting. Finally, two hypothetical examples are described to illustrate the utility of applying generalizability theory to achieve higher reliabilities for outcome measures.