A Vote Tallying System Based on Computer Vision

  • Paulo Victor Fernandes Sousa UFSJ
  • Julio Cesar da Silva Rodrigues UFSJ
  • Charles Figueredo de Barros UFSJ


In this paper, we describe an ongoing project on a vote tallying system based on computer vision. The core idea consists of recording the votes into paper ballots containing markings that can be read by a software using computer vision. The software reads the markings from a video recorded during the elections. The video can be made publicly available, so that any interested party can check that the tallying is correct.


Adida, B. (2008). Helios: Web-based open-audit voting.

Aranha, D. F., Barbosa, P. Y., Cardoso, T. N., Araujo, C. L., and Matias, P. (2019). The return of software vulnerabilities in the brazilian voting machine. Comput. Secur., 86(C):335–349.

Calandrino, J. A., Feldman, A. J., Halderman, J. A., Wagner, D., Yu, H., and Zeller, W. P. (2007). Source code review of the Diebold voting system.

Chaum, D., Carback, R. T., Clark, J., Essex, E., Popoveniuc, S., Rivest, R. L., Ryan, P. Y. A., Shen, E., Sherman, A. T., and Vora, P. L. (2009). Scantegrity ii: end-to-end verifiability by voters of optical scan elections through confirmation codes. IEEE Transactions on Information Forensics and Security, page 13.

El Gamal, T. (1985). A public key cryptosystem and a signature scheme based on discrete logarithms. In Proceedings of CRYPTO 84 on Advances in Cryptology, pages 10 – 18, Berlin, Heidelberg. Springer-Verlag.

HONORATO, L. B. and MILANO, D. d. (2010). Visão computacional. Universidade Estadual de Campinas (UNICAMP).

Prasad, H. K., Alex, J., Gonggrijp, H. R., Wolchok, S., Wustrow, E., Kankipati, A., Krishna, S., and Yagati, S. V. (2010). Security analysis of india’s electronic voting machines.

Rivest, R. (2006). The threeballot voting system.

Rivest, R. L. and Wack, J. P. (2008). On the notion of software independence in voting systems. PHIL. TRANS. R. SOC. A, pages 3759–3767.

Ryan, P. Y. A., Bismark, D., Heather, J., Schneider, S., and Xia, Z. (2009). Preta voter: A voter-verifiable voting system. Trans. Info. For. Sec., 4(4):662 – 673.
SOUSA, Paulo Victor Fernandes; RODRIGUES, Julio Cesar da Silva; BARROS, Charles Figueredo de. A Vote Tallying System Based on Computer Vision. In: WORKSHOP DE TRABALHOS DE INICIAÇÃO CIENTÍFICA E DE GRADUAÇÃO - SIMPÓSIO BRASILEIRO DE SEGURANÇA DA INFORMAÇÃO E DE SISTEMAS COMPUTACIONAIS (SBSEG), 22. , 2022, Santa Maria. Anais [...]. Porto Alegre: Sociedade Brasileira de Computação, 2022 . p. 226-233. DOI: https://doi.org/10.5753/sbseg_estendido.2022.224595.