Expert consensus in solo voice performance evaluation

Experts were interviewed to identify criteria for evaluation of vocal performance. A scale was then constructed and inter- and intrajudge reliability assessed. Experts listened to 19 different performances, plus 6 presented a second time. Interjudge reliability for one judge was modest, but increased dramatically as the size of the judge panel increased. The most reliable items were overall score and intonation accuracy. Diction was less reliable than other items. Intrajudge reliability was higher for overall score than for any other item. A factor analysis on the test items yielded factors labelled intrinsic quality, execution, and diction. Another factor analysis, using the experts as variables, revealed two underlying evaluative dimensions. It was found that 13 experts were primarily influenced by execution, and that 8 were mainly affected by intrinsic quality. Interjudge and intrajudge reliabilities of these two groups differed.     

Differences in Self-Rated, Perceived, and Acoustic Voice Qualities Between High- and Low-Fatigue Groups

Objectives

The present study was performed to examine which factors among self-rated scales, perceptual evaluations, and acoustic parameters, calculated from sustained vowels, are reliable indicators of physical and mental fatigues.

Methods

A total of 73 volunteers (male:female, 52:21), aged 19–24 years, were enrolled in this study. We defined the high- and low-fatigue groups using the Chalder Fatigue Scale score. For assessment of self-rated symptoms, each subject was asked to complete Voice Handicap Index (VHI) and Voice Rating Scale (VRS). For perceptual evaluations, three clinicians assessed each subject’s vocal quality on the Grade, Roughness, Breathiness, Asthenia, Strain Scale. For acoustic analysis, each subject was asked to produce sustained vowels /a/, /e/, /i/, /o/, and /u/ for 3 seconds. Then, the habitual fundamental frequency (F₀), jitter, shimmer, F₀ tremor, mean F₀, standard deviation of F₀, maximum F₀, minimum F₀, normalized noise energy, harmonic-to-noise ratio (HNR), signal-to-noise ratio (SNR), amplitude tremor, and ratio within 2–4 kHz were calculated using Dr. Speech software.

Results

In men, VHI, VRS, F₀ tremor, shimmer, HNR, SNR, and amplitude tremor were related to mental fatigue. In women, only VHI was related to physical fatigue, and none of the acoustic parameters was related to the fatigue score. Perceptual evaluations were not related to fatigue in men or women.

Conclusions

These findings suggest that self-rated symptoms and acoustic parameters related to voice quality are indicative of mental fatigue, and these features are prominent in men.     

Rating the raters in a mixed model: An approach to deciphering the rater reliability

Rating the raters has attracted extensive attention in recent years. Ratings are quite complex in that the subjective assessment and a number of criteria are involved in a rating system. Whenever the human judgment is a part of ratings, the inconsistency of ratings is the source of variance in scores, and it is therefore quite natural for people to verify the trustworthiness of ratings. Accordingly, estimation of the rater reliability will be of great interest and an appealing issue. To facilitate the evaluation of the rater reliability in a rating system, we propose a mixed model where the scores of the ratees offered by a rater are described with the fixed effects determined by the ability of the ratees and the random effects produced by the disagreement of the raters. In such a mixed model, for the rater random effects, we derive its posterior distribution for the prediction of random effects. To quantitatively make a decision in revealing the unreliable raters, the predictive influence function (PIF) serves as a criterion which compares the posterior distributions of random effects between the full data and rater-deleted data sets. The benchmark for this criterion is also discussed. This proposed methodology of deciphering the rater reliability is investigated in the multiple simulated and two real data sets.     

Correspondence between two types of rating indices for the heavy weight floor impact sound insulation of residential buildings

Of the two types of rating indices for the heavy weight floor impact sound insulation, the method of utilizing a rubber ball impact source combined with A-weighted sound level and the method utilizing a tire impact source combined with L-rating curve, the advantage of the former has been reported. In order to extend the advantage, the possibility was studied of estimating the rating utilizing the rubber ball impact source, based on the measurement results utilizing the tire impact source, especially for the case of a double leaf wooden floor. The correlation between the indices is not high enough to estimate one of them directly from the other with an accuracy not incorrectly estimating the rating grade of 5 dB step. The use of predictor variables, such as the special specifications of the double leaf wooden floor, for example, the use of sound insulation sheet, and the floor impact sound levels in the 31.5-Hz, 63-Hz and 125-Hz bands, is possibly able to increase the accuracy. Three principal types of multiple regression equation were derived through the analysis of measurement results in existing residential buildings.     

A dynamic paired comparisons model: Who is the greatest tennis player?

We present a methodology for fitting time-varying paired comparisons models in which the parameters are allowed to vary deterministically, as opposed to stochastically, with time. Our dynamic paired comparisons model is based on a new closed-form for Stern’s continuum of paired comparisons models which include the Bradley–Terry model and the Thurstone–Mosteller model. The dynamic element of our model is facilitated by utilising barycentric rational interpolants BRIs. An incidental result of our work is to show that BRIs often provide a better fit to data than the obvious alternative of spline interpolation. We use our model to shed light on the debate of who is the greatest tennis player of the Open Era of men’s professional tennis since 1968. Constructing a single rankings list from our model is not trivial as there are many alternative metrics that could be used to identify which player was the best ever. We present three alternative rankings lists derived from our model. In general our rankings lists largely agree with the rankings list based on number of Grand Slam titles won, which, to some extent, validates our choice of metrics. So who is the greatest tennis player of the Open Era? Roger Federer seems like the most likely candidate, with Bjorn Borg and Jimmy Connors close behind.     

Random effects model for credit rating transitions

This paper proposes a random effects multinomial regression model to estimate transition probabilities of credit ratings. Unlike the previous studies on the rating transition, we applied a random effects model, which accommodates not only the environmental characteristics of the exposures of a rating but also the uncertainty not explained by such factors. The rating category specific factors such as retained earning and market equity are included in our proposed model. The random effects model provides less diagonally dominant matrix, where the transition probabilities are over-dispersed from the diagonal elements. Our study is expected to incorporate potential chances of rating transitions due to extra random variations.     

On the methodology of the World Competitiveness Report

A nation with its natural resources, human capabilities, research and educational institutions, government organizations, financial systems, and cultural and social values provides an environment in which firms are created, organized, and managed. The competitive environment a nation provides influences the performance of its firms at home and abroad. Therefore, it is of prime importance for both governments and firms to study the competitive environment of a country in comparison with those of the others. The World Competitiveness Report (WCR), a report annually produced by the Institute for Management Development (IMD) and the World Economic Forum (WEF), both based in Switzerland, is a study that rates and ranks the competitiveness of a certain group of countries (OECD plus 15 newly industrialized countries) and is a widely quoted study in the international media. Although some essence of its methodology is given for a general understanding, details are not provided, perhaps for proprietary reasons since the report is a commercial enterprise itself. The objective of this paper is to uncover the methodology used by the WCR. For this purpose, the methodological information provided in the WCR is used to the fullest extent. However, for the steps where the information is missing or when different interpretations are possible, an approach based on mathematical programming is employed to ‘guess’ the methodology.