Augmented Reality-Assisted Manual Packing Optimization
Resumo
The process of packing—organizing products within a container to optimize available space—is often performed manually without technological assistance, which can lead to inconsistent efficiency and occasional errors. While augmented reality (AR) has been explored to support packing tasks, prior research has largely relied on static final-pose overlays and has rarely integrated advanced packing optimization algorithms. This paper presents OPTAR, a novel packing assistance system that combines a 3D packing optimization algorithm with trajectory-based AR pose guidance, deployed on the Microsoft HoloLens 2. We describe the system’s design, implementation, and evaluation through experiments comparing two methods: a packing operation with and without OPTAR. Results indicate that OPTAR assistance significantly improves space utilization, eliminates misplaced items, though with longer task completion times during initial use. To strengthen the generalizability of our findings to industrial applications, future work will extend testing to real industrial environments, involve professional packing operators, and larger sample sizes.
Palavras-chave:
Packing Optimization, Augmented Reality, HoloLens 2, Manual Packing, Space Utilization, Industry 5.0
Referências
L. Haitao and K. Womer. Optimizing the supply chain configuration for make-to-order manufacturing. European Journal of Operations Research, 221(1):118–128, 2012.
K. Li, S. Khaday, and L. Peng. Assessments of order-picking tasks using a paper list and augmented reality glasses with different order information displays. Applied Sciences, 13(22):12222, 2023.
V. Sohrabpour, D. Hellstrom, and M. Jahre. Packaging in developing countries: identifying supply chain needs. Journal of Humanitarian Logistics and Supply Chain Management, 2(2):183–205, 2012.
M. Christopher. Logistics and supply chain management. Pearson UK, 2022.
N. Techasarntikul, P. Ratsamee, and H. Takemura. Guidance and visualization of optimized packing solutions. Journal of Information Processing, 28:193–202, 2020.
T. Plewan, B. Mattig, and G. Rinkenauer. Exploring the benefits and limitations of augmented reality for palletization. Applied Ergonomics, 90:103250, 2021.
H. Poncelet. Augmented reality combined with 3D packing algorithm as tool for container loading. 2022.
V. Reljic, S. Dudic, Z. Trisic, B. Jekic, V. Jurosevic, and I. Milenkovic. Augmented reality as a support to solve pallet loading problem. Springer Science and Business Media Deutschland GmbH, pages 261–270, 2023.
A. Jaoua, E. Negri, S. Bhar Layeb, and Z. Ayed. Framework for smart online 3D bin packing using augmented reality. IC ASET, IEEE, pages 01–06, 2023.
N. Dakic, V. Jurosevic, and J. Sulc. Augmented reality system for instructed and visualized pallet loading. Acta Polytechnica Hungarica, 21:263–284, 2024.
T. T. Yang, Y. P. Tsang, and S. S. M. Yuen. Mixed reality-based online 3D pallet loading problem to achieve augmented intelligence in e-fulfilment processes. Operations Management Research, 2023.
N. Romero-Olarte, S. Amezquita-Ortiz, J. W. Escobar, and D. Alvarez Martinez. Decision support system to solve single-container loading problem considering practical constraints. Mathematics, pages 1–16, 2025.
G. Wascher, H. Haussner, and H. Schumann. An improved typology of cutting and packing problems. European Journal of Operations Research, 183(3):9–30, 2007.
T. Yang, Y. Tsang, C. Wu, and K. Chung. Mixed reality-based online 3D pallet loading problem to achieve augmented intelligence in e-fulfilment processes. Operations Management Research, pages 1–16, 2023.
F. Lorson, A. Fugener, and A. Hubner. New team mates in the warehouse human interactions with automated and robotized systems. IISE Transactions, 55:36–53, 2023.
D. Cuellar-Usaquen, G. A. Camacho-Munoz, C. Quiroga-Gomez, and D. Alvarez-Martinez. An approach for the pallet-building problem and subsequent loading in a heterogeneous fleet of vehicles with practical constraints. IJIEC, 12(3):329–344, 2021.
A. Montes-Franco, J. Martinez-Franco, A. Tabares, and D. Alvarez-Martinez. A hybrid approach for the container loading problem for enhancing the dynamic stability representation. Mathematics, 13(5):869, 2025.
J. Pachon, J. Martinez, and D. Alvarez. SIC: An intelligent packing system with industry-grade features. SoftwareX, 20:101241, 2022.
J. Martinez, E. Cespedes, and D. Alvarez. PackageCargo: A decision support tool for the container loading problem with stability. SoftwareX, 12:100601, 2020.
I. Araya and M. Riff. A beam search approach to the container loading problem. Computers & Operations Research, 43:100–107, 2014.
M. Alonso, R. Alvarez-Valdes, J. Tamarit, and F. Parreno. A reactive grasp algorithm for the container loading problem with load-bearing constraints. European Journal of Operations Research, 8(5):669–694, 2014.
D. Martinez, R. Alvarez-Valdes, and F. Parreno. A grasp algorithm for the container loading problem with multi-drop constraints. Pesquisa Operacional, 35:1–24, 2015.
G. Pantoja, F. Parreno, and D. Alvarez-Martinez. Integrating grasp and beam search for the container loading problem under practical constraints. Article in press.
M. Lorenz, F. Pfeiffer, and P. Klimant. Augmented reality for pack optimization using video and depth data. In ISMAR-Adjunct 2020, IEEE, pages 21–23, 2020.
Salvador S. Agati, Rudieri D. Bauer, Marcelo da S. Hounsell, and Aleksander S. Paterno. Augmented reality for manual assembly in industry 4.0: Gathering guidelines. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR), IEEE, pages 179–188, 2020.
J. Cohen. Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, 2nd edition, 1988.
F. Satterthwaite. An approximate distribution of estimates of variance components. Biometrics Bulletin, 2(6), 1946.
A. Daios, N. Kladovasilakis, and I. Kostavelis. Mixed palletizing for smart warehouse environments: Sustainability review of existing methods. Sustainability, 16(3):1278, 2024.
G. Camacho-Munoz, Nope S. H. Loaiza-Correa, Silva J. and R. Alves. Evaluation of the use of box size priors for 6D plane segment tracking from point clouds with applications in cargo packing. EURASIP Journal on Image and Video Processing, 2024(17), 2024.
K. Li, S. Khaday, and L. Peng. Assessments of order-picking tasks using a paper list and augmented reality glasses with different order information displays. Applied Sciences, 13(22):12222, 2023.
V. Sohrabpour, D. Hellstrom, and M. Jahre. Packaging in developing countries: identifying supply chain needs. Journal of Humanitarian Logistics and Supply Chain Management, 2(2):183–205, 2012.
M. Christopher. Logistics and supply chain management. Pearson UK, 2022.
N. Techasarntikul, P. Ratsamee, and H. Takemura. Guidance and visualization of optimized packing solutions. Journal of Information Processing, 28:193–202, 2020.
T. Plewan, B. Mattig, and G. Rinkenauer. Exploring the benefits and limitations of augmented reality for palletization. Applied Ergonomics, 90:103250, 2021.
H. Poncelet. Augmented reality combined with 3D packing algorithm as tool for container loading. 2022.
V. Reljic, S. Dudic, Z. Trisic, B. Jekic, V. Jurosevic, and I. Milenkovic. Augmented reality as a support to solve pallet loading problem. Springer Science and Business Media Deutschland GmbH, pages 261–270, 2023.
A. Jaoua, E. Negri, S. Bhar Layeb, and Z. Ayed. Framework for smart online 3D bin packing using augmented reality. IC ASET, IEEE, pages 01–06, 2023.
N. Dakic, V. Jurosevic, and J. Sulc. Augmented reality system for instructed and visualized pallet loading. Acta Polytechnica Hungarica, 21:263–284, 2024.
T. T. Yang, Y. P. Tsang, and S. S. M. Yuen. Mixed reality-based online 3D pallet loading problem to achieve augmented intelligence in e-fulfilment processes. Operations Management Research, 2023.
N. Romero-Olarte, S. Amezquita-Ortiz, J. W. Escobar, and D. Alvarez Martinez. Decision support system to solve single-container loading problem considering practical constraints. Mathematics, pages 1–16, 2025.
G. Wascher, H. Haussner, and H. Schumann. An improved typology of cutting and packing problems. European Journal of Operations Research, 183(3):9–30, 2007.
T. Yang, Y. Tsang, C. Wu, and K. Chung. Mixed reality-based online 3D pallet loading problem to achieve augmented intelligence in e-fulfilment processes. Operations Management Research, pages 1–16, 2023.
F. Lorson, A. Fugener, and A. Hubner. New team mates in the warehouse human interactions with automated and robotized systems. IISE Transactions, 55:36–53, 2023.
D. Cuellar-Usaquen, G. A. Camacho-Munoz, C. Quiroga-Gomez, and D. Alvarez-Martinez. An approach for the pallet-building problem and subsequent loading in a heterogeneous fleet of vehicles with practical constraints. IJIEC, 12(3):329–344, 2021.
A. Montes-Franco, J. Martinez-Franco, A. Tabares, and D. Alvarez-Martinez. A hybrid approach for the container loading problem for enhancing the dynamic stability representation. Mathematics, 13(5):869, 2025.
J. Pachon, J. Martinez, and D. Alvarez. SIC: An intelligent packing system with industry-grade features. SoftwareX, 20:101241, 2022.
J. Martinez, E. Cespedes, and D. Alvarez. PackageCargo: A decision support tool for the container loading problem with stability. SoftwareX, 12:100601, 2020.
I. Araya and M. Riff. A beam search approach to the container loading problem. Computers & Operations Research, 43:100–107, 2014.
M. Alonso, R. Alvarez-Valdes, J. Tamarit, and F. Parreno. A reactive grasp algorithm for the container loading problem with load-bearing constraints. European Journal of Operations Research, 8(5):669–694, 2014.
D. Martinez, R. Alvarez-Valdes, and F. Parreno. A grasp algorithm for the container loading problem with multi-drop constraints. Pesquisa Operacional, 35:1–24, 2015.
G. Pantoja, F. Parreno, and D. Alvarez-Martinez. Integrating grasp and beam search for the container loading problem under practical constraints. Article in press.
M. Lorenz, F. Pfeiffer, and P. Klimant. Augmented reality for pack optimization using video and depth data. In ISMAR-Adjunct 2020, IEEE, pages 21–23, 2020.
Salvador S. Agati, Rudieri D. Bauer, Marcelo da S. Hounsell, and Aleksander S. Paterno. Augmented reality for manual assembly in industry 4.0: Gathering guidelines. In 2020 22nd Symposium on Virtual and Augmented Reality (SVR), IEEE, pages 179–188, 2020.
J. Cohen. Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, 2nd edition, 1988.
F. Satterthwaite. An approximate distribution of estimates of variance components. Biometrics Bulletin, 2(6), 1946.
A. Daios, N. Kladovasilakis, and I. Kostavelis. Mixed palletizing for smart warehouse environments: Sustainability review of existing methods. Sustainability, 16(3):1278, 2024.
G. Camacho-Munoz, Nope S. H. Loaiza-Correa, Silva J. and R. Alves. Evaluation of the use of box size priors for 6D plane segment tracking from point clouds with applications in cargo packing. EURASIP Journal on Image and Video Processing, 2024(17), 2024.
Publicado
30/09/2025
Como Citar
RONDON-USMA, Angie Valeria; CAMACHO-MUÑOZ, Guillermo A.; ÁLVAREZ-MARTINEZ, David.
Augmented Reality-Assisted Manual Packing Optimization. In: SIMPÓSIO DE REALIDADE VIRTUAL E AUMENTADA (SVR), 27. , 2025, Salvador/BA.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2025
.
p. 169-178.
