Psychometric Properties of the Polish Version of the Social Interaction Anxiety Scale and the Social Phobia Scale: Validity, Reliability and Factor Structure
Factor structure, reliability, and validity
DOI:
https://doi.org/10.12775/PBE.2025.0035Keywords
social anxiety, Social Phobia Scale, Social Interaction Anxiety Scale, bifactor models, adulthoodAbstract
Social anxiety is the experience of stress and discomfort associated with social situations and the fear of negative evaluation by others. The aim of this study was to assess the psychometric properties of the Polish version of two related scales: Social Interaction Anxiety Scale (SIAS)
and Social Phobia Scale (SPS). The study was conducted on a non-clinical sample of 698 people (M=26.1; SD=8.18; 55% female). Factor structure, internal consistency and content validity, criterion convergent and discriminant validity were assessed for the SIAS and SPS, analysed separately and together. Reliability of the scales was high. Values of all Cronbach’s α and McDonald’s ωt coefficients were > 0.90. The factor structure of the scales was confirmed. The
fit indices had acceptable values for the single factor SIAS model, three factor SPS model and for the bifactor model for the combined SIAS + SPA scales. It was found that the Polish versions of the SIAS and SPS scales are tools with good psychometric properties and can be used together to assess social anxiety in general or employed separately as reliable measures of two aspects of social anxiety: fear of interaction (SIAS) and fear of negative evaluation (SPS).
References
aan het Rot, M., Friederici, C., Krause, S., & de Jong, P. (2022). Interpersonal Responses To Facial Expressions of Disgust, Anger, and Happiness in Individuals with Varying Levels of Social Anxiety. PLoS ONE, 17(4), e0263990, doi:10.1371/journal.pone.0263990.
American Psychiatric Association (APA) (2013). Diagnostic And Statistical Manual of Mental Disorders (5th ed.), doi: 10.1176/appi.books.9780890425596.
Arend, M., & Schafer, T. (2019). Statistical Power in Two-Level Models: A Tutorial Based on Monte Carlo Simulation. Psychological Methods, 24(1), 1–19, doi: 10.1037/met0000195.
Brown, E., Turovsky, J., Heimberg, R., Juster, H., Brown, T., & Barlow, D. (1997). Validation of the Social Interaction Anxiety Scale and the Social Phobia Scale Across the Anxiety Disorders. Psychological Assessment, 9(1), 21–27, doi: 10.1037//1040-3590.9.1.21.
Caballo, V., Salazar, I., Irurtia, M., Arias, B., & Nobre, L. (2013). The Assessment of Social Anxiety Through Five Selfreport Measures, LSAS-SR, SPAI, SPIN, SPS, & SIAS: A Critical Analysis of Their Factor Structure. Behavioral Psychology/Psicologia Conductual, 21(3), 423–448.
Caplan, S. (2003). Preference for Online Social Interaction: A Theory of Problematic Internet Use and Psychosocial Well-Being. Communication Research, 30(6), 625–648, doi: 10.1177/0093650203257842.
Carleton, R., Collimore, K., & Asmundson, G. (2007). Social Anxiety And Fear of Negative Evaluation: Construct Validity of the BFNEII. Journal of Anxiety Disorders, 21(1), 131–141, doi:10.1016/j.janxdis.2006.03.010.
Carleton, R., Collimore, K., Asmundson, G., McCabe, R., Rowa, K., & Anthony, M. (2009). Refining And Validating the Social Interaction Anxiety Scale and the Socia Phobia Scale. Depression and Anxiety, 26, 71–81, doi: 10.1002/da.20480.
Carter, M., Sbrocco, T., Tang, D., Rekryt, F., & Condit, C. (2014). Psychometric Properties of the Social Phobia and Social Interaction Anxiety Scales: Evidence of Construct Equivalence in an African American Sample. Journal of Anxiety Disorders, 28, 633–643, doi: 10.1016/j.janxdis.2014.07.003.
Chen, F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling, 14, 464–504, doi: 10.1080/10705510701 301834.
Chen, J., Short, M., & Kemps, E. (2020). Interpretation Bias in Social Anxiety: A Systematic Review And Meta-Analysis. Journal of Affective Disorders, 276, 119–1130, doi:10.1016/j.jad.2020.07.121.
Cichoń, E., Kiejna, A., Kokoszka, A., Gondek, T., Rajba, B., Lloyd, C., & Sartorius, N. (2020). Validation of the Polish Version of WHO-5 As a Screening Instrument for Depression in Adults with Diabetes. Diabetes Research and Clinical Practice, 159, 1–10, doi: 10.1016/j.diabres.2019.107970.
Ciżkowicz, B. (2018). McDonald’s Omega As an Alternative To Cronbach’s α in Estimating The Reliability of Test Results. Polish Psychological Forum, 23(2), 311–329, doi: 10.14656/PFP20180206.
Cook, S., Moore, S., Bryant, C., & Phillips, J. (2022). The Role of Fear of Positive Evaluation in Social Anxiety: A Systematic Review and Meta-Analysis. Clinical Psychology: Science and Practice, 29(4), 352–369, doi: 10.1037/cps0000082.
De Beurs, E., Tielen, D., & Wollmann, L. (2014). The Dutch Social Interaction Anxiety Scale and the Social Phobia Scale: Reliability, Validity, and Clinical Utility. Psychiatry Journal, 1–9, 360193, doi: 10.1155/2014/360193.
De Jong Gierveld, J., & Kamphuis, F. (1985). The Development of a Rasch-Type Loneliness Scale. Applied Psychological Measurement, 9, 289–299, doi: 10.1177/014662168500900307.
Deros, D., Racz, S., Lipton, M., Augenstein, T., Karp, J., Keeley, L., Qasmieh, N., Grewe, B., Aldo, A., & De Los Reyes, A. (2018). Multi-Informant Assessments of Adolescent Social Anxiety: Adding Clarity by Leveraging Reports from Unfamiliar Peer Confederates. Behaviour Therapy, 49(1), 84–98, doi: 10.1016/j.beth.2017.05.001.
Essau, C., Conradt, J., & Petermann, F. (1999). Frequency and Comorbidity of Social Phobia and Social Fears in Adolescents. Behaviour Research and Therapy, 37, 831–843, doi: 10.1016/S0005-7967(98)00179-X.
Fergus, T., Valentiner, D., McGrath, P., Gier-Lonsway, S., & Kim, H. (2012). Short Forms of the Social Interaction Anxiety Scale and the Social Phobia Scale. Journal of Personality Assessment, 94, 310–320, doi: 10.1080/00223891.2012.660291.
Gomez, R., & Watson, S. (2017). Confirmatory Factor Analysis of the Combined Social Phobia Scale and Social Interaction Anxiety Scale: Support for a Bifactor Model. Frontiers in Psychology, 8(70), 1–15, doi: 10.3389/fpsyg.2017.00070.
Google Scholar. (2024). Mattick: Development and Validation of Measures of Social Phobia Scrutiny and Social Interaction Anxiety. Retrieved 7 April 2024 from: https://scholar.google.com.
Grygiel P., Humenny G., Rębisz S., Świtaj P., & Sikorska-Grygiel, J. (2013). Validating the Polish Adaptation of the 11-Item De Jong Gierveld Loneliness Scale, European Journal of Psychological Assessment, 29(2), 129–139, doi: 10.1027/1015-5759/a000130 .
Heimberg, R., Brozovich, F., & Rapee, R. (2014). A Cognitive Behavioural Model of Social Anxiety Disorder: Update and Extension. In: S. Hofmann, & P. DiBartolo (Eds.), Social Anxiety: Clinical, Developmental, and Social Perspectives (3rd ed.), (pp. 706–729). New York: Elsevier.
Jefferies, P., & Ungar, M. (2020). Social Anxiety in Young People: A Prevalence Study in Seven Countries. PLoS ONE, 15(9), e0239133, doi: 10.1371/journal.pone.0239133.
Jorgensen, T., Pornprasertmanit, S., Schoemann, A., & Rosseel, Y. (2022). SemTools: Useful Tools for Structural Equation Modeling. R Package Version 0.5-6. Retrieved 7 April 2024 from: https://CRAN.R-project.org/package=semTools.
Kearney, C. (2005). Social Anxiety and Social Phobia in Youth Characteristics Assessment and Psychological Treatment. Springer, New York.
Kline, R. (2015). Principles and Practice of Structural Equation Modelling (4th ed.). Guilford Press.
Kroenke, K., Spitzer, R., Williams, J., & Lowe, B. (2009). An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ-4. Psychosomatics, 50, 613–621, doi: 10.1176/appi.psy.50.6.613.
Larionow, P., & Mudło-Głagolska, K. (2023). The Patient Health Questionnaire-4: Factor Structure, Measurement Invariance, Latent Profile Analysis of Anxiety and Depressive Symptoms and Screening Results in Polish Adults. Advances in Cognitive Psychology, 19(2), 123–137, doi: 10.5709/acp-0384-9.
Liebowitz, M. (1987). Social Phobia. Modern Problems of Pharmacopsychiatry, 22, 141–173, doi: 10.1159/000414022.
MacCallum, R., Browne, M., & Sugawara, H.. (1996). Power Analysis and Determination of Sample Size for Covariance Structure Modelling. Psychological Methods, 1(2), 130–149, doi: 10.1037/1082-989X.1.2.130.
Mattick, R., & Clarke, J. (1998). Development and Validation of Measures of Social Phobia Scrutiny Fear, and Social Interaction Anxiety. Behaviour Research and Therapy, 36, 455–470, doi: 10.1016/s0005-7967(97)10031-6.
McDonald, R. (1999). Test Theory: A Unified Treatment. Mahwah, NY: Erlbaum.
Mortberg, M., Reuterskiold, L., Tillfors, M., Furmark, T., & Ost, L. (2017). Factor Solution of the Social Phobia Scale (SPS) and the Social Interaction Anxiety Scale (SIAS) in a Swedish Population. Cognitive Behaviour Therapy, 46(4), 300–314, doi: 10.1080/16506073.2016.1258723.
Oztekin, G. (2024). The Effects of Social Anxiety on Subjective Well-Being Among Adolescents: The Mediating Roles of Mindfulness and Loneliness. Iğdır Universitesi Sosyal Bilimler Dergisi, 36, 220–236, doi: 10.54600/igdirsosbilder.1433959.
Peters, L., Sunderland, M., Andrews, G., Rapee, R., & Mattick, R. (2012). Development of a Short Form Social Interaction Anxiety (SIAS) and Social Phobia Scale (SPS) Using Nonparametric Item Response Theory: The SIAS-6 and the SPS-6. Psychological Assessment, 24, 66–76, doi: 10.1037/a0024544.
Reise, S., Bonifay, W., & Haviland, M. (2013). Scoring and Modelling Psychological Measures in the Presence of Multidimensionality. Journal of Personality Assessment, 95(2), 129–140, doi: 10.1080/00223891.2012.725437.
Revelle, W. (2022). Psych: Procedures for Psychological, Psychometric, and Personality Research (Version 2.2.9). Retrieved 7 April 2024 from: https://CRAN.R-project.org/package=psych.
Rodriguez, A., Reise, S., & Haviland, M. (2016). Evaluating Bifactor Models: Calculating and Interpreting Statistical Indices. Psychological Methods, 21(2), 137–150, doi: 10.1037/met0000045.
Safren, S., Turk, C., & Heimberg, R. (1998). Factor Structure of the Social Interaction Anxiety Scale and the Social Phobia Scale. Behaviour Research and Therapy, 36(4), 443–453, doi: 10.1016/s0005-7967(98)00032-1.
Schermelleh-Engel, K., & Moosbrugger, H. (2003). Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. Methods of Psychological Research, 8(2), 23–74, doi: 10.23668/psycharchives.12784.
Schmid, J., & Leiman, J. M. (1957). The Development of Hierarchical Factor Solutions. Psychometrika, 22, 53–61, doi: 10.1007/BF02289209.
Šipka, D., Brodbeck, J., Schulz, A., Stolz, T., & Berger, T. (2023). Factor Structure of the Social Phobia Scale (SPS) and the Social Interaction Anxiety Scale (SIAS) in a Clinical Sample Recruited from the Community. BMC Psychiatry, 23(646), 1–11, doi: 10.1186/s12888-023-05142-8.
Smith, E., Garety, P., Harding, H., & Hard, A. (2021). Are There Reliable and Valid Measures of Anxiety for People with Psychosis? A Systematic Review of Psychometric Properties. Theory, Research and Practice, 94, 173–198, doi: 10.1111/papt.12265.
Stanley, T., Carter, E., & Doucouliagos, H. (2018). What Meta-Analyses Reveal About the Replicability of Psychological Research. Psychological Bulletin, 144(12), 1325–1346, doi: 10.1037/bul0000169.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Barbara Ciżkowicz
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Stats
Number of views and downloads: 227
Number of citations: 0
