Temporal stability of the Zulliger test in brazilian adults
DOI:
https://doi.org/10.1590/1982-4327e3304Keywords:
test validity, longitudinal studies, projective technique, psychological assessment, test reliabilityAbstract
The reliability of a test obtained over time is an indispensable measure to ensure the use of the instrument. This study aims to explore the temporal stability of the Zulliger test in Brazilian adults. A total of 20 participants, aged 18 to 59 years, answered a sociodemographic questionnaire and the Zulliger in Comprehensive System (ZCS). Data collection took place from 2009 to 2019 (Test) and in 2021 (Retest). ANOVA did not show differences between the values of 90 (99%) ZCS variables analyzed between test and retest; 68% of the variables showed agreement between 0.40 and 1.00, and 18% (Fr+rf; M; FM; Ma; WSumC; FM+m; AdjD; Rlam 01; Cl; es; Blends; Art; Cop; Sum6; WSum6; NotaD) denoted high and excellent stability levels (ICC ≥ 0.70). The ZCS demonstrates temporal stability, reliability, and psychometric properties that support its safe use.
Downloads
References
Bornstein, R. F. (2017). Evidence-based psychological assessment. Journal of Personality Assessment, 99(4), 435-445. doi:10.1080/00223891.2016.1236343
Cardoso, L. M., Gomes, G. V. A., Pacheco, F. P., & Viana, J. L. D. (2018). Análise da produção de artigos científicos brasileiros sobre o Teste de Zulliger [Analysis of the production of Brazilian scientific articles on the Zulliger Test]. Interação em Psicologia, 22(3), 139-150. doi:10.5380/psi.v22i3.45821
Chnaider, J., & Nakano, T. C. (2021). Avaliação psicológica e envelhecimento humano: Revisão de pesquisas [Psychological assessment and human aging: Research review]. Interação em Psicologia, 25(3), 371-383. doi:10.5380/riep.v25i3.72089
Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284-290. doi:10.1037/1040-3590.6.4.284
Cohen, R. J., Swerdlik, M. E., & Sturman, E. D. (2014). Testagem e avaliação psicológica: Introdução a testes e medidas [Testing and psychological assessment: Introduction to tests and measurements] (M. C. G. Monteiro, Trans., 8th ed.). Porto Alegre, RS: AMGH.
Conselho Federal de Psicologia. (2018, de 2 de maio). Resolução No. 9, de 25 de abril de 2018 [Resolution No. 9, 2018 April 25]. Estabelece diretrizes para a realização de Avaliação Psicológica no exercício profissional da psicóloga e do psicólogo, regulamenta o Sistema de Avaliação de Testes Psicológicos - SATEPSI e revoga as Resoluções No. 002/2003, No. 006/2004 e No. 005/2012 e Notas Técnicas No. 01/2017 e 02/2017. Diário Oficial da União, seção 1. Retrieved from https://www.in.gov.br/en/web/dou/-/resolucao-n-9-de-25-de-abril-de-2018-12526419
Exner, J. E., Jr. (2003). The Rorschach: A comprehensive system: Vol. 1. Basic foundations and principles of interpretation. New York, NY: Wiley & Sons.
Gonçalves, A. P., & Villemor-Amaral, A. E. (2020). Zulliger R-Optimized in the evaluation of depressive characteristics. Paidéia (Ribeirão Preto), 30, e3023. doi:10.1590/1982- 4327e3023
Gonçalves, A. P., Zuanazzi, A. C., & Villemor-Amaral, A. E. (2019). Aplicação R-Otimizada no Zulliger: Evidências de validade com pacientes depressivos [R-Optimized application in Zulliger: Evidence of validity with depressive patients]. Avaliação Psicológica, 18(2), 111-120. doi:10.15689/ap.2019.1802.16215.01
Grazziotin, J. B. D. D., & Scortegagna, S. A. (2018). Convergent validity of Zulliger-CS with the social skills inventory for the elderly. Paidéia (Ribeirão Preto), 28, e2832. doi:10.1590/1982-4327e2832
Grazziotin, J. B. D. D., & Scortegagna, S. A. (2021). Validity of Zulliger-SC in the cognitive assessment of elderly and long-lived adults. Psico-USF, 26(3), 571-583. doi:10.1590/141382712021260314
Hosseininasab, A., Meyer, G. J., Viglione, D. J., Mihura, J. L., Berant, E., Resende, A. C., … Mohammadi, R. M. (2019). The effect of CS administration or an R-Optimized alternative on R–PAS variables: A meta-analysis of findings from six studies. Journal of Personality Assessment, 101(2), 199-212. doi:10.1080/00223891.2017.1393430
Hulley, S. B., Cummings, S. R., Brower, W. S., Grady, D. G., & Newman, T. B. (2015). Delineando a pesquisa clínica [Outlining clinical research] (M. S. Duncan & A. G. Islabão, Trans., 4th ed.). Porto Alegre, RS: Artmed.
Resende, M. A., & Nascimento, E. (2019). Z-SEP: Teste de Zulliger no Sistema Escola de Paris [Zulliger Test in the Paris School System]. São Paulo, SP: Hogrefe.
Seitl, M., Dočkalová, J., Dostál, D., Kolařík, M., Hasoňová, V., Palová, K., & Fryštacká, K.
(2018). Standardizace počtu odpovědí v Zulligerově testu: První krok při vývoji nového evidence-based systému [The Standardization of the number of responses in Zulliger test: The first step towards developing a new evidence-based system]. E-Psychologie, 12(4), 1-15. doi:10.29364/epsy.328
Souza, A. C., Alexandre, N. M. C., & Guirardello, E. B. (2017). Propriedades psicométricas na avaliação de instrumentos: Avaliação da confiabilidade e da validade [Psychometric properties in the evaluation of instruments: Evaluation of reliability and validity]. Epidemiologia e Serviços de Saúde, 26(3), 649-659. doi:10.5123/s1679-49742017000300022
Sultan, S., Adronikof, A., Réveillère, C., & Lemmel, G. (2006). A Rorschach stability study in a nonpatient adult sample. Journal of Personality Assessment, 87(3), 330-348. doi:10.1207/s15327752jpa8703_13
Sultan, S., & Meyer, G. (2009). Does productivity impact the stability of Rorschach scores? Journal of Personality Assessment, 91(5), 480-493. doi:10.1080/00223890903088693
Vaz, C. E., & Alchiere, J. C. (2016). Z-Teste Coletivo e Individual - Técnica de Zulliger [Z-Test Collective and Individual - Zulliger technique]. São Paulo, SP: Hogrefe.
Villemor-Amaral, A. E., & Gomes, G. V. A. (2020). Comparação de indicadores patológicos e saudáveis do Zulliger com administração R-Otimizado [Comparison of pathological and healthy Zulliger indicators with R-Optimized administration]. Psicologia: Teoria e Prática, 22(3), 37-54. doi:10.5935/1980-6906/psicologia.v22n3p37-54
Villemor-Amaral, A. E., Machado, M. A. S., & Noronha, A. P. P. (2009). O Zulliger no sistema compreensivo: Um estudo de fidedignidade [The Zulliger in the Comprehensive System: A study of reliability]. Psicologia: Ciência e Profissão, 29(4), 656-671. doi:10.1590/S1414-98932009000400002
Villemor-Amaral, A. E., & Primi, R. (2009). Z-SC: Teste de Zulliger no sistema compreensivo: Forma individual [Z-SC: Zulliger test in the comprehensive system ZSC-Individually] São Paulo, SP: Casa do Psicólogo.
Wechsler, S. M., Hutz, C. S., & Primi, R. (2019). O desenvolvimento da avaliação psicológica no Brasil: Avanços históricos e desafios [The development of psychological assessment in Brazil: Historical advances and challenges]. Avaliação Psicológica, 18(2), 121-128. doi:10.15689/ap.2019.1802.15466.02
Downloads
Published
Versions
- 2023-05-04 (2)
- 2024-05-04 (1)
Issue
Section
License
Copyright (c) 2023 Paidéia (Ribeirão Preto)

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Regarding the availability of contents, Paideia adopts the Creative Commons License, CC-BY. With this licence anyone is allowed to copy and redistribute the material in any medium or format, as well as to remix, transform, and create from the material for any purpose, even commercial, giving the proper copyright credits to the journal, providing a link to the licence and indicating if changes have been made.
Partial reproduction of other publications
Quotations of more than 500 words, reproductions of one or more figures, tables or other illustrations must have written permission from the copyright holder of the original work for the reproduction specified in the Paidéia journal. Permission should be addressed to the author of the submitted manuscript. Secondarily obtained rights will not be transferred under any circumstance.