An Empirical Study on the Adaptation and Automation of a Cancellation Test for Children


  • Renata  Cascaes UFPA
  • Kalill  Lameira UFPA
  • Ricardo  Sarmanho UFPA
  • Suzane  Santos UFPA
  • Kelly  Pinheiro UFPA
  • Marcelle  Pereira Mota UFPA
  • Antônio  Pereira UFPA
  • Nelson Cruz Sampaio Neto UFPA



Cancellation test, Visual exploration, Automated testing tool


Tests that evaluate individual strategies of visual exploration may be useful for uncovering deviations from typical development, such as autism spectrum disorder and dyslexia. One subgroup of visual exploration tests, called cancellation tests, requires the identification of specific targets surrounded by distractors. However, the lack of automated versions of these tests limits their availability to a broader audience. In the present paper, we present an automated version of a cancellation test: the cars’ test. The test is designed to be used by specialists, optimizing both its application and the analysis of collected data. First, we evaluated the cars’ test in a group of six to nine-years-old children enrolled in a private school, 22 children in total. Then, after some modifications based on the observations made during the first test (increase in the number of targets and distractors on the screen, for example), a second test was performed in a public school with a larger group of children, 82 participants, allowing a better statistical analysis of the collected data. The results suggest that the cars’ test is useful in providing information about visual exploration strategies adopted by children and is in agreement with the results of similar tests found in the literature.


Download data is not yet available.


J. R. Dowdall, A. Luczak, and M. S. Tata, "Temporal variability of the n2pc during efficient and inefficient visual search", Neuropsychologia, vol. 50, no. 10, pp. 2442-2453, 2012.
T.-Y. Wang, H.-C. Huang, and H.-S. Huang, "Design and implementation of cancellation tasks for visual search strategies and visual attention in school children", Computers & Education, vol. 47, no. 1, pp. 1-16, 2006.
M. A. O'riordan, K. C. Plaisted, J. Driver, and S. Baron-Cohen, "Superior visual search in autism." Journal of Experimental Psychology: Human Perception and Performance, vol. 27, no. 3, p. 719, 2001.
Y.-P. Wuang and C.-Y. Su, "Correlations of sensory processing and visual organization ability with participation in school-aged children with down syndrome", Research in Developmental Disabilities, vol. 32, no. 6, pp. 2398-2407, 2011. Disponível em:
L. M. Greenberg and I. D. Waldmant, "Developmental normative data on the test of variables of attention (t.o.v.a.™)", Journal of Child Psychology and Psychiatry, vol. 34, no. 6, pp. 1019-1030, 1993. Disponível em:
S. M. D. Brucki and R. Nitrini, "Cancellation task in very low educated people", Archives of Clinical Neuropsychology, vol. 23, no. 2, pp. 139-147, 2008.
C. d. O. Cardoso, R. F. C. d. Silva, and R. P. Fonseca, "Teste de cancelamento dos sinos: comparação entre duas versões", Gerais: Revista Interinstitucional de Psicologia, vol. 4, no. 1, pp. 73-80, 2011.
R. F. d. Lima, C. A. S. Azoni, and S. M. Ciasca, "Atenção e funções executivas em crianças com dislexia do desenvolvimento", Psicologia em Pesquisa, vol. 7, no. 2, pp. 208-219, 2013.
Y. Zhou, C. McBride-Chang, and N. Wong, "What is the role of visual skills in learning to read?" Frontiers in Psychology, vol. 5, p. 776, 2014. Disponível em:
D. A. Byrd, P. Touradji, M.-x. Tang, and J. J. Manly, "Cancellation test performance in african american, hispanic, and white elderly", Journal of the International Neuropsychological Society, vol. 10, no. 3, pp. 401-411, 2004.
N. Lowery, D. Ragland, R. C. Gur, R. E. Gur, and P. J. Moberg, "Normative data for the symbol cancellation test in young healthy adults", Applied Neuropsychology, vol. 11, no. 4, pp. 216-219, 2004.
R. F. C. d. Silva, "Teste de cancelamento dos sinos: estudo comparativo quanto à variável escolaridade", Master's thesis, Pontifícia Universidade Católica do Rio Grande do Sul,, 2010.
A. L. Cancela, "As implicações da dislexia no processo de aprendizagem na perspectiva dos professores do 1o. ciclo do ensino básico", Ph.D. dissertation, Universidade Fernando Pessoa,, 2014.
G. Coutinho, P. Mattos, C. Araújo, and M. Duchesne, "Transtorno do déficit de atenção e hiperatividade: contribuição diagnóstica de avaliação computadorizada de atenção visual", Revista de Psiquiatria Clínica, vol. 34, no. 5, pp. 215-222, 2007.
R. M. Joseph, B. Keehn, C. Connolly, J. M. Wolfe, and T. S. Horowitz, "Why is visual search superior in autism spectrum disorder?" Developmental science, vol. 12, no. 6, pp. 1083-1096, 2009.
E. Kalanthroff, L. Goldfarb, and A. Henik, "Evidence for interaction between the stop signal and the stroop task conflict." Journal of Experimental Psychology: Human Perception and Performance, vol. 39, no. 2, p. 579, 2013.
K. Koldewyn, P. Hanus, and B. Balas, "Visual adaptation of the perception of "life": Animacy is a basic perceptual dimension of faces", Psychonomic bulletin & review, vol. 21, no. 4, pp. 969-975, 2014.
K. Nayar, J. Franchak, K. Adolph, and L. Kiorpes, "From local to global processing: The development of illusory contour perception", Journal of experimental child psychology, vol. 131, pp. 38-55, 2015.
T. Lachmann, A. Schmitt, W. Braet, and C. van Leeuwen, "Letters in the forest: global precedence effect disappears for letters but not for non-letters under reading-like conditions", Frontiers in psychology, vol. 5, p. 705, 2014.
M. F. Soriano, A. J. Ibáñez-Molina, N. Paredes, and P. Macizo, "Autism: Hard to switch from details to the whole", Journal of abnormal child psychology, pp. 1-13, 2017.
J. F. d. Salles, R. P. Fonseca, C. C. Rodrigues, C. B. d. Mello, T. Barbosa, and M. C. Miranda, "Desenvolvimento do instrumento de avaliação neuropsicológica breve infantil neupsilin-inf", PsicoUSF. Bragança Paulista, SP. Vol. 16, n. 3 (set./dez. 2011), p. 297-305., 2011.
V. Barray, N. Biard, D. Gadolet, C. Guillot, D. Templier, and M. Lounis, "Voitures: analyse quantitative et qualitative des résultats d'un test d'exploration visuelle", Expériences en ergothérapie, 2002.
R. Cascaes, K. Lameira, R. Sarmanho, K. Pinheiro, M. P. Mota, A. Pereira, and N. C. S. Neto, "Adaptation and automation of a cancellation test for evaluation of exploratory visual behavior", in Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems, ser. IHC 2018. New York, NY, USA: ACM, 2018, pp. 5:1-5:9. Disponível em:
N. Donnelly, R. Guest, M. Fairhurst, J. Potter, A. Deighton, and M. Patel, "Developing algorithms to enhance the sensitivity of cancellation tests of visuospatial neglect", Behavior Research Methods, Instruments, & Computers, vol. 31, no. 4, pp. 668-673, 1999.
Y.-H. Wu, J.-S. Vidal, J. de Rotrou, S. A. Sikkes, A.-S. Rigaud, and M. Plichart, "Can a tablet-based cancellation test identify cognitive impairment in older adults?" PloS one, vol. 12, no. 7, p. e0181809, 2017.
Y.-H. Wu, J. de Rotrou, J.-S. Vidal, C. Jeandel, A.-S. Rigaud, E. KesseGuyot, and O. Hanon, "The kt cancellation test in the older adults: Normative data and construct validity", Aging, Neuropsychology, and Cognition, vol. 20, no. 4, pp. 429-442, 2013.
D. Reid, H. Babani, and E. Jon, "Development of a computerized visual search test", International Journal of Rehabilitation Research, vol. 32, no. 3, pp. 205-212, 2009.
E. S. Dalmaijer, S. Van der Stigchel, T. C. Nijboer, T. H. Cornelissen, and M. Husain, "Cancellationtools: All-in-one software for administration and analysis of cancellation tasks", Behavior research methods, vol. 47, no. 4, pp. 1065-1075, 2015.
A. Elliott and W. Woodward, Statistical Analysis Quick Reference Guidebook: With SPSS Examples, ser. Online access: Sage Sage Research Methods Online. SAGE Publications, 2007.
F. J. Gravetter and L. B. Wallnau, Essentials of Statistics for the Behavioral Sciences (PSY 200 (300) Quantitative Methods in Psychology).
S. Weinberg and S. Abramowitz, Statistics Using SPSS: An Integrative Approach. Cambridge University Press, 2008.
I. H. Witten, E. Frank, M. A. Hall, and C. J. Pal, Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, 2016.
P. Gurevich, H. Stuke, A. Kastrup, H. Stuke, and H. Hildebrandt, "Neuropsychological testing and machine learning distinguish alzheimer's disease from other causes for cognitive impairment", Frontiers in aging neuroscience, vol. 9, p. 114, 2017.




How to Cite

CASCAES, R.; LAMEIRA, K.; SARMANHO, R.; SANTOS, S.; PINHEIRO, K.; PEREIRA MOTA, M.; PEREIRA, A.; CRUZ SAMPAIO NETO, N. An Empirical Study on the Adaptation and Automation of a Cancellation Test for Children. Journal on Interactive Systems, Porto Alegre, RS, v. 10, n. 2, p. 82–95, 2019. DOI: 10.5753/jis.2019.555. Disponível em: Acesso em: 23 oct. 2021.