Search Word: Reliability, Search Result: 85
1 Analysis of reliability and error sources of judges’ rating in rhythmic gymnastics
Tae-Koo Lee ; Joo-Hyun Kwak ; Hee-Won Yang ; Han-Joo Lee Vol.28, No.2, pp.337-350 https://doi.org/10.24985/kjss.2017.28.2.337
초록보기
Abstract

Purpose The purpose of this study was (1) to analyze judges’ evaluation on rhythmic gymnastics performance by applying generalizability theory and (2) to suggest recommendations to improve judges' rating. Methods Data were 34 players’ scores from Senior Part at 29th KGA President’s Cup National Rhythmic Gymnastics Championship in Korea. Difficulty and execution scores in ball, clubs, hoop and ribbon event were analyzed. Analysis models containing components of area and reputation rank were designed and multivariate generalizability theory were used for analysis. Results The G-study results showed (1) that the error source about players has more significant impact to evaluation than other error sources in analysis model containing components of only player and judge, (2) that the error source about players has more significant impact to evaluation than other error sources in analysis model adding components of area, but the error source about area has more significant impact to evaluation of clubs event than other error sources, (3) that the error source about players has more significant impact to evaluation than other error sources in analysis model adding components of reputation rank, but the error source about reputation rank has more significant impact to evaluation of hoop event than other error sources in analysis model adding components of area. The D-study results showed generalizability coefficient was stable in analysis model without components of area and reputation rank, but generalizability coefficient in analysis model containing components of area and reputation rank not stable in some event. Conclusion Recommendations for improving judging were discussed.


2 Analysis of the Interrater Reliability and Agreement of Breaking Battles in the 2018 Buenos Aires Youth Olympics
Jin Su Suk ; Kyung Bae Jun Vol.34, No.2, pp.210-226 https://doi.org/10.24985/kjss.2023.34.2.210
초록보기
Abstract

PURPOSE This study aimed to establish a standardized evaluation of the consistency and reliability of the results of the 2018 Buenos Aires Youth Olympics. METHODS The results of the preliminary and the final rounds of the individual Boys and Girls competition of the 2018 Buenos Aires Youth Olympics were collected. Data were organized using Microsoft Windows Excel 2021. Windows SPSS 26.0 was used for descriptive statistics. Intraclass correlation coefficient calculation was used to analyze the evaluation score. The winner/loser decision, and the evaluation interrater agreement was confirmed using Fleiss' kappa. RESULTS There was a difference in the scores given by the judges in both the preliminary and final rounds of both competitions. A low correlation was observed between the decided winner of the judges, and the point variance for each item. CONCLUSIONS In the trivium value system, differences in the evaluation strategies of the judges may exist. Thus, improvements to standardize evaluation should be implemented. In addition, this scoring system considers various factors in the evaluation process, and the scoring system is complicated. Therefore, there may be a need to revise the evaluation system and find the optimal number of judges to create a better evaluation.

3 Analysis of Error Sources and Estimation of Reliability in Peer Review of Forced Connection Method-Sportscasting by Applying Generalizability Theory
Tae-Koo Lee ; Heewon Yang Vol.27, No.2, pp.345-361
초록보기
Abstract

The purpose of this study which is follow up study of Lee and Kim(2015b)'s was to analyse error sources and estimation of reliability in peer review of forced connection method-sportscasting by applying generalizability theory. Generalizability theory quantify error sources of the data measured under certain specific situation set by the researchers. It is an analysis method that the relative influences of each error sources taking from score is determined(G-study), and the effective measurement condition future applicable is provided(D-study). Participants were 10th high school students(N=216). Data were collected from student's peer review results and analyzed using univariate and multivariate generalizability theory. Results showed that error source for video have a more significant impact than other error sources. But the result by analyzing the gender difference was that error source for the interaction of video and participants have a more significant impact than other error source in the case of girls. Peer review used in this study showed high generalizability coefficient and even when reducing the number of video or participants it can maintain the adequate reliability. But generalizability coefficient of boys was higher than girls and specific measurement conditions leading to enhanced reliability were different when analyzing by gender difference. Also, method of analysis which cannot reflect measurement conditions properly estimates the reliability excessive. Discussions were provided in term of the relative influences of each error sources, the effective measurement condition maintaining the Generalizability coefficient of a certain level, and the comparison the Generalizability coefficient with the way of estimation traditional reliability applying univariate and multivariate Generalizability theory taking from score in peer review of forced connection method-sportscasting.


4 Developing the Estimating Equations for Muscle Power by Analysis of Reliability and Validity on Different Versions of Wingate Anaerobic Test Setting
Bongju Sung ; Byounggoo Ko ; Kwangkyu Lee Vol.32, No.3, pp.419-428 https://doi.org/10.24985/kjss.2021.32.3.419
초록보기
Abstract

PURPOSE The purpose of this study was to develop the estimating equations for 4 types of Wingate Anaerobic test setting. METHODS 80 male elite athletes performed 4 trials of the Wingate Anaerobic test by each type. Subjects were conducted the retest one week later. Data collected from the Wingate Anaerobic test included mean power, peak power, and power drop for 30s were measured. Coefficient of correlation was used for validity of type 1(DOS version) and the other types(ver. 2.24, 3.3.0, and 3.2.1). Pearson’s correlation coefficient was used to examine the reliability of test and retest. Simple regression analysis was used for calculating the estimating equation. RESULTS There was significant correlation for absolute value(Watt, p<.01) and relative value(Watt/kg, p<.01) of mean power, absolute value(W, p<.01), relative value(Watt/kg, p<.05), and power drop rate(%, p<.01). Test and retest reliability was excellent for all test variables(p<.01). CONCLUSIONS From the all results, the estimating equation was calculated to convert all outputs from each type to the other types of the Wingate Anaerobic test setting. These findings suggest that the estimating equations are compatiable to 4 types of Wingate Anaerobic test setting.

5 Development and validation of the psychic energy management inventory for athletes (PEMI)
Sungwon Woo ; Dongwon Yook ; Sunghoon kim Vol.30, No.3, pp.582-600 https://doi.org/10.24985/kjss.2019.30.3.582
초록보기
Abstract

Purpose The purpose of this study was to develop a psychic energy management scale that construct a concept and based on extracted contents of structural validity and reliability of university athlete psychic energy management inventory. Methods To develop the scale, the researches were completed <research ⅰ; constructing sub-factors of Psychological Energy Management, ⅱ; developing scales of psychic energy management, ⅲ; verifying validity of psychic energy management>. The results shown are a follows. Results The psychic energy management inventory contents of the university athlete were categorized into five categories ; team energy, game energy, environment energy, leisure energy and body energy. Through statistical procedures and factor analysis, the psychic energy management inventory was developed with 4 factors 18 items (coach energy 4 question items, game/environment energy 6 question items, colleague energy 4 question items, body energy 4 question items). Conclusion Convergent validity and discriminant validity was demonstrated through the external validity, the multi-group analysis confirmed the structural equivalence of the scale between the school grades.

6 Analysis of inter-rater agreement of latin american and modern dance sport
Seung-hun Lee ; Mi-sun Kim Vol.31, No.4, pp.830-839 https://doi.org/10.24985/kjss.2020.31.4.830
초록보기
Abstract

Purpose The purpose of this study is to identify the consistency and correlation of referee evaluation according to the judging characteristics in the preliminary and semi-final of the Latin event of dance sports, thereby deriving the problem of referee reliability and suggesting alternatives for improvement. Methods The method of study is Based on the performance data of 54 amateur Latin dances match organized by the Korea Dance Sports Federation for a total of three years 11,850(preliminary rounds & semi-final). Based on the Kappa statistics and the degree of agreement(pa), the difference in the group of examination characteristics was derived and the correlation between the five Latin events was analyzed. Results As a result of through this study, the consistency of the dance sports referee and the characteristics of the judging in the event were confirmed, and the number of judges tended to be higher when the number of judges was seven, the more the number of subjects was, and the highest level of agreement was more than 70 percent of the judges. In addition, the higher the concordance of each of the five detailed items, the higher the correlation tendency. Conclusion Differences in visual aspects between dance sports judges and the difference in the judges' ratings due to the revision of the rules, the decrease in the number of competitors participating in the competition, the number of people to be eliminated in each round, and the proportion of judges with experience in the competition are different, and these differences affect the judges and show up in the scores. The Latin dance sports events based on objectivity and reliability to improve the correct standards of judges to find the same raters, work will be required and an assessment element. With a systematic way in and to carry out the review curriculum and educational development is considered necessary.

7 Analysis of Judges’ Judging in Figure Skating
Tae-Koo Lee ; Han-Joo Lee ; Jae-Eun Chung ; Hee-won Yang Vol.27, No.4, pp.756-769
초록보기
Abstract

The purpose of this study was (1) to analyze judges’ evaluation on figure skating performance and statistical analysis and (2) to make recommendation to improve judges' performance. Data were 62 figure skaters’ scores from Senior Woman 1 Group Part at 2015 The National Figure Skating Championship in Korea. Data of presentation part in Short Program were analyzed. Presentation part consists of skating skills, transitions/linking footwork/movement, performance/execution, choreography/composition and interpretation. Nine judges evaluate skater's presentation with the score 10.0 for each factor. Generalizability theory, descriptive statistics and ANOVA were utilized. Results showed that generalizability coefficient of presentation part was over 0.9, therefore stable reliability was secured. The error source about players has more significant impact to evaluation than other error sources. Generalizability coefficient was stable when reducing the number of judges up to 2. Also, judges generally represented aspects of similar evaluation, but different aspects appeared on a few judges’ assessment in the components of presentation. Discussions were provided in terms of the reliability of the judging method for the presentation part of figure skating and the effective measurement condition.


8 Research trend of Measurement and Evaluation in Physical Education and Sports Science
Seung-yun Shin Vol.26, No.2, pp.205-218
초록보기
Abstract

When the long-awaited KSME in PESS was established in 1998, KSME faced a turning point in its growth. Following the changes in both quality and quantity of the society's researches since its establishment and seeking for future themes is important for the society. This research analyzed the society's research trend using mainly the Korean Journal of ME in PESS. Then, by examining the physical fitness test, it proposed possible future themes for the KSME. This research also looked into the American Kinesmetrics’ contribution to Kinesiology, its research trend and future researches The KSME's recent researches show refined quality, diversified themes and reinforcements in practical researches. Regarding the themes, the reliability and validity of tests became predominant, sports analysis and physical activity emerged, and interest in measurement and evaluation in school PE was low. Possible research themes in the future are measurement and evaluation in school PE, game analysis and sport big data. The recent interest of the American Kinesmetrics was the cross validation of criterion-referenced physical fitness cut-off score, the validation of the guideline for physical activity, and the relationship between sedentary behavior and health. Possible future research themes of the American Kinesmetrics were the refinement of test methods, the effectiveness of the physical fitness test award system, and the application of the ubiquitous wearable technology.

9 Crisis communication strategies of professional baseball teams : Focusing on message appeal type and message delivery method
Bon-Uk Koo ; Dong-Chun Won ; Choong Hoon Lim Vol.28, No.3, pp.608-622 https://doi.org/10.24985/kjss.2017.28.3.608
초록보기
Abstract

Purpose The purpose of this research was to investigate the influence of professional baseball teams' message appeal type (emotional vs. rational) and message delivery method (article with photo vs. article without photo) on consumers' acceptance of the message. The hypotheses were two folds. First, compared with a rational apology article, a professional team's emotional apology article affected consumers' acceptance more positively. Second, a professional team's apology article with a photo attached influenced consumers' acceptance more positively than one without a photo. Methods To achieve the purpose of this study, the authors utilized a 2 (Message Appeal Type: emotional vs. rational) × 2 (Message Delivery Method: article with photo vs. article without photo) factorial experiment. An existing baseball team was selected and was assumed to have been involved in a game fixing situation. Out of 340 participants, 325 were used in the final analysis. Two-way ANCOVA of SPSS 23.0 was conducted to analyze the data. Results Findings revealed when a professional baseball team issued an emotional apology article, consumers were more positive about it than a rational one. Also when a professional team delivered an article with a photo, consumers accepted the article more positively than the one without a photo.


10 The Mediating Effects of Consumption Emotion within the Relationship of Fitness Selection Attribute and Customer Satisfaction for Fitness Centers
Bumgyu Im ; Hyung-Hoon Kim Vol.25, No.3, pp.480-493
초록보기
Abstract

The purpose of the study was to provide managers and owners of fitness center with new marketing strategies for distinction strategies of quite competitive Korean fitness industry with analysis of mediating effects of consumption emotion within the relationship of fitness selection attribute and customer satisfaction. This paper chose fitness center customers as population of this study who registered in each 5 fitness centers in Seoul and Gyeonggi using convenience sampling. For this study, 400 questionnaires were given fitness center customer. For the analysis of data, 376 questionnaires were used using SPSS 15.0 Windows and Amos 7.0. To examine respondents demographics traits, frequency analysis was processed and reliability analysis, confirmatory factor analysis and correlation analysis for relationship among the variables were conducted. For the verification of model suitability and research hypotheses, the mediating effects were tested by using Bootrapping method and Aroian-test through structure equation modeling. The significance level was set at α=.05, and the results are as follows. First, Among fitness selection attribute variables, structural strategy, cost, a trainer and program had significant influence on customer satisfaction, but, atmosphere and facilities had not significant on customer satisfaction. Second, Among fitness selection attribute variables, structural strategy, cost, a trainer and atmosphere had significant influence on consumption emotion, but, facilities and program had not significant on consumption emotion. Third, consumption emotion had significant influence on customer satisfaction. Fourth, consumption emotion fully mediated in the relationship between fitness selection attribute and customer satisfaction.


logo