TriCache: Providing three-tier caching for time series data in serverless healthcare services
Resumo
Healthcare services and IoT, as highlighted by Hu et al. [9], generate enormous volumes of time series data. Using caching in serverless functions can significantly reduce latency and improve performance when storing frequently accessed data in memory. Although several approaches offer improvements, such as the use of in-memory caching, data prediction, and distributed systems, none of them fully addresses the need for a robust and efficient system for time series in healthcare, leaving a gap in necessary data availability and optimization. The TriCache model proposes a three-tier caching system to optimize storage and access to time series data in healthcare serverless functions, using a combination of memory in the serverless function, in-memory cache, and disk storage, in addition to predictive intelligence. The main contribution of the model is the significant reduction in latency and the improvement in the hit rate by efficiently predicting and allocating data across different cache layers. Experiments demonstrated a notable reduction in response time, with a 110 millisecond decrease in the 99th percentile. Additionally, the model performed significantly, achieving a 93% hit rate, compared to the 78% observed in the traditional model.
Palavras-chave:
cloud computing, cache, data time series, response time
Referências
Michel Albonico, Adair Rohling, Juliano Santos, and Paulo Varela. 2021. Mining Evidences of Internet of Robotic Things (IoRT) Software from Open Source Projects. In Proceedings of the 15th Brazilian Symposium on Software Components, Architectures, and Reuse (Joinville, Brazil) (SBCARS ’21). Association for Computing Machinery, New York, NY, USA, 71–79. DOI: 10.1145/3483899.3483900
Rohan Basu Roy and Devesh Tiwari. 2024. StarShip: Mitigating I/O Bottlenecks in Serverless Computing for Scientific Workflows. SIGMETRICS Perform. Eval. Rev. 52, 1 (jun 2024), 79–80. DOI: 10.1145/3673660.3655082
Edwin F Boza, Xavier Andrade, Jorge Cedeno, Jorge Murillo, Harold Aragon, Cristina L Abad, and Andres G Abad. 2020. On implementing autonomic systems with a serverless computing approach: The case of self-partitioning cloud caches. Computers 9, 1 (2020), 14.
Gabriel Souto Fischer, Gabriel de Oliveira Ramos, Cristiano André da Costa, Antonio Marcos Alberti, Dalvan Griebler, Dhananjay Singh, and Rodrigo da Rosa Righi. 2024. Multi-Hospital Management: Combining Vital Signs IoT Data and the Elasticity Technique to Support Healthcare 4.0. IoT 5, 2 (2024), 381–408. DOI: 10.3390/iot5020019
Gartner. 2022. Quadrante Mágico para infraestrutura em nuvem e serviços de plataforma. Disponível em: [link]. Acesso em: 16 junho 2023.
Bishakh Chandra Ghosh, Sourav Kanti Addya, Nishant Baranwal Somy, Shubha Brata Nath, Sandip Chakraborty, and Soumya K Ghosh. 2020. Caching techniques to improve latency in serverless architectures. In 2020 International Conference on COMmunication Systems & NETworkS (COMSNETS). IEEE, Bengaluru, India, 666–669.
Onur Göksel and Tolga Ovatman. 2021. Collaborative Path Prediction in Cache Pre-fetching for Distributed State Machines. In 2021 6th International Conference on Computer Science and Engineering (UBMK). IEEE, Ankara, Turkey, 489–493.
J. A. Herrera-Ramírez, M. Treviño-Villalobos, and L. Víquez-Acuña. 2021. Hybrid storage engine for geospatial data using nosql and sql paradigms. Revista Tecnología en Marcha 34, 1 (2021), 40 – 54. DOI: 10.18845/tm.v34i1.4822
Chaochen Hu, Zihan Sun, Chao Li, Yong Zhang, and Chunxiao Xing. 2023. Survey of Time Series Data Generation in IoT. Sensors 23, 15 (2023), 19 pages. DOI: 10.3390/s23156976
Seyedeh Shabnam Jazaeri, Parvaneh Asghari, Sam Jabbehdari, and Hamid Haj Seyyed Javadi. 2023. Composition of caching and classification in edge computing based on quality optimization for SDN-based IoT healthcare solutions. The Journal of Supercomputing 79, 15 (01 Oct 2023), 17619–17669. DOI: 10.1007/s11227-023-05332-x
Rajalakshmi Krishnamurthi, Adarsh Kumar, Sukhpal Singh Gill, and Rajkumar Buyya. 2023. Serverless Computing: Principles and Paradigms. Vol. 162. Springer Nature, Berlim, German.
Chen Li, Xiaoyu Wang, Tongyu Zong, Houwei Cao, and Yong Liu. 2023. Predictive edge caching through deep mining of sequential patterns in user content retrievals. Computer Networks 233 (2023), 109866.
Luís Manuel Meruje Ferreira, Fabio Coelho, and José Pereira. 2024. Databases in Edge and Fog Environments: A Survey. ACM Comput. Surv. 56, 11, Article 285 (jul 2024), 40 pages. DOI: 10.1145/3666001
Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, and Ricardo Bianchini. 2021. Faa$T: A transparent auto-scaling cache for serverless applications. In Proceedings of the ACM Symposium on Cloud Computing. ACM, Seattle, USA, 122–137.
Lacey-Anne Sanderson, Carolyn T Caron, Reynold L Tan, and Kirstin E Bett. 2021. A PostgreSQL Tripal solution for large-scale genotypic and phenotypic data. Database 2021 (08 2021), baab051. DOI: 10.1093/database/baab051 arXiv: [link]
Josip Stanešić, Zlatan Morić, Vedran Dakić, and Matej Bašić. 2023. PREVENTION OF DNS AMPLIFICATION ATTACKS. 34th DAAAM Symposium 34, 1 (2023), 83 – 87.
Jie Sun, Mengyao Wang, Xuesong Zhu, Xiwei Zhang, and Jinsong Xue. 2023. A Survey on Cache Evaluation Metrics. Comput. Surveys 56, 4 (2023), 1–37. DOI: 10.1145/3505168
Yang Tang and Junfeng Yang. 2020. Lambdata: Optimizing serverless computing by making data intents explicit. In 2020 IEEE 13th International Conference on Cloud Computing (CLOUD). IEEE, Beijing, China, 294–303.
AoWang, Jingyuan Zhang, Xiaolong Ma, Ali Anwar, Lukas Rupprecht, Dimitrios Skourtis, Vasily Tarasov, Feng Yan, and Yue Cheng. 2020. INFINICACHE: exploiting ephemeral serverless functions to build a cost-effective memory cache. In Proceedings of the 18th USENIX Conference on File and Storage Technologies (Santa Clara, CA, USA) (FAST’20). USENIX Association, USA, 267–282.
Xin Xing, LiWang, YiWang, and Yang Liu. 2022. Frequency of data transmission in wearable healthcare devices: A systematic review. Journal of Medical Systems 46, 12 (2022), 513.
L. Yang, C. Chi, C. Pan, and Y. Qi. 2021. An intelligent caching and replacement strategy based on cache profit model for space-ground integrated network. Mobile Information Systems 2021 (2021), 1–13. DOI: 10.1155/2021/7844929
Matin Yarmand, Chen Chen, Michael V. Sherer, Yash N. Shah, Peter Liu, Borui Wang, Larry Hernandez, James D. Murphy, and Nadir Weibel. 2024. Enhancing Accuracy, Time Spent, and Ubiquity in Critical Healthcare Delineation via Cross-Device Contouring. In Proceedings of the 2024 ACM Designing Interactive Systems Conference (IT University of Copenhagen, Denmark) (DIS ’24). Association for Computing Machinery, New York, NY, USA, 905–919. DOI: 10.1145/3643834.3660718
Yujiao Zhang, Jinghan Zhang, Yan Liu, Xiaodong Chen, and Xiangyang Liu. 2021. A survey on data collection and transmission in healthcare IoT. IEEE Transactions on Industrial Informatics 17, 12 (2021), 7627–7640.
Rohan Basu Roy and Devesh Tiwari. 2024. StarShip: Mitigating I/O Bottlenecks in Serverless Computing for Scientific Workflows. SIGMETRICS Perform. Eval. Rev. 52, 1 (jun 2024), 79–80. DOI: 10.1145/3673660.3655082
Edwin F Boza, Xavier Andrade, Jorge Cedeno, Jorge Murillo, Harold Aragon, Cristina L Abad, and Andres G Abad. 2020. On implementing autonomic systems with a serverless computing approach: The case of self-partitioning cloud caches. Computers 9, 1 (2020), 14.
Gabriel Souto Fischer, Gabriel de Oliveira Ramos, Cristiano André da Costa, Antonio Marcos Alberti, Dalvan Griebler, Dhananjay Singh, and Rodrigo da Rosa Righi. 2024. Multi-Hospital Management: Combining Vital Signs IoT Data and the Elasticity Technique to Support Healthcare 4.0. IoT 5, 2 (2024), 381–408. DOI: 10.3390/iot5020019
Gartner. 2022. Quadrante Mágico para infraestrutura em nuvem e serviços de plataforma. Disponível em: [link]. Acesso em: 16 junho 2023.
Bishakh Chandra Ghosh, Sourav Kanti Addya, Nishant Baranwal Somy, Shubha Brata Nath, Sandip Chakraborty, and Soumya K Ghosh. 2020. Caching techniques to improve latency in serverless architectures. In 2020 International Conference on COMmunication Systems & NETworkS (COMSNETS). IEEE, Bengaluru, India, 666–669.
Onur Göksel and Tolga Ovatman. 2021. Collaborative Path Prediction in Cache Pre-fetching for Distributed State Machines. In 2021 6th International Conference on Computer Science and Engineering (UBMK). IEEE, Ankara, Turkey, 489–493.
J. A. Herrera-Ramírez, M. Treviño-Villalobos, and L. Víquez-Acuña. 2021. Hybrid storage engine for geospatial data using nosql and sql paradigms. Revista Tecnología en Marcha 34, 1 (2021), 40 – 54. DOI: 10.18845/tm.v34i1.4822
Chaochen Hu, Zihan Sun, Chao Li, Yong Zhang, and Chunxiao Xing. 2023. Survey of Time Series Data Generation in IoT. Sensors 23, 15 (2023), 19 pages. DOI: 10.3390/s23156976
Seyedeh Shabnam Jazaeri, Parvaneh Asghari, Sam Jabbehdari, and Hamid Haj Seyyed Javadi. 2023. Composition of caching and classification in edge computing based on quality optimization for SDN-based IoT healthcare solutions. The Journal of Supercomputing 79, 15 (01 Oct 2023), 17619–17669. DOI: 10.1007/s11227-023-05332-x
Rajalakshmi Krishnamurthi, Adarsh Kumar, Sukhpal Singh Gill, and Rajkumar Buyya. 2023. Serverless Computing: Principles and Paradigms. Vol. 162. Springer Nature, Berlim, German.
Chen Li, Xiaoyu Wang, Tongyu Zong, Houwei Cao, and Yong Liu. 2023. Predictive edge caching through deep mining of sequential patterns in user content retrievals. Computer Networks 233 (2023), 109866.
Luís Manuel Meruje Ferreira, Fabio Coelho, and José Pereira. 2024. Databases in Edge and Fog Environments: A Survey. ACM Comput. Surv. 56, 11, Article 285 (jul 2024), 40 pages. DOI: 10.1145/3666001
Francisco Romero, Gohar Irfan Chaudhry, Íñigo Goiri, Pragna Gopa, Paul Batum, Neeraja J Yadwadkar, Rodrigo Fonseca, Christos Kozyrakis, and Ricardo Bianchini. 2021. Faa$T: A transparent auto-scaling cache for serverless applications. In Proceedings of the ACM Symposium on Cloud Computing. ACM, Seattle, USA, 122–137.
Lacey-Anne Sanderson, Carolyn T Caron, Reynold L Tan, and Kirstin E Bett. 2021. A PostgreSQL Tripal solution for large-scale genotypic and phenotypic data. Database 2021 (08 2021), baab051. DOI: 10.1093/database/baab051 arXiv: [link]
Josip Stanešić, Zlatan Morić, Vedran Dakić, and Matej Bašić. 2023. PREVENTION OF DNS AMPLIFICATION ATTACKS. 34th DAAAM Symposium 34, 1 (2023), 83 – 87.
Jie Sun, Mengyao Wang, Xuesong Zhu, Xiwei Zhang, and Jinsong Xue. 2023. A Survey on Cache Evaluation Metrics. Comput. Surveys 56, 4 (2023), 1–37. DOI: 10.1145/3505168
Yang Tang and Junfeng Yang. 2020. Lambdata: Optimizing serverless computing by making data intents explicit. In 2020 IEEE 13th International Conference on Cloud Computing (CLOUD). IEEE, Beijing, China, 294–303.
AoWang, Jingyuan Zhang, Xiaolong Ma, Ali Anwar, Lukas Rupprecht, Dimitrios Skourtis, Vasily Tarasov, Feng Yan, and Yue Cheng. 2020. INFINICACHE: exploiting ephemeral serverless functions to build a cost-effective memory cache. In Proceedings of the 18th USENIX Conference on File and Storage Technologies (Santa Clara, CA, USA) (FAST’20). USENIX Association, USA, 267–282.
Xin Xing, LiWang, YiWang, and Yang Liu. 2022. Frequency of data transmission in wearable healthcare devices: A systematic review. Journal of Medical Systems 46, 12 (2022), 513.
L. Yang, C. Chi, C. Pan, and Y. Qi. 2021. An intelligent caching and replacement strategy based on cache profit model for space-ground integrated network. Mobile Information Systems 2021 (2021), 1–13. DOI: 10.1155/2021/7844929
Matin Yarmand, Chen Chen, Michael V. Sherer, Yash N. Shah, Peter Liu, Borui Wang, Larry Hernandez, James D. Murphy, and Nadir Weibel. 2024. Enhancing Accuracy, Time Spent, and Ubiquity in Critical Healthcare Delineation via Cross-Device Contouring. In Proceedings of the 2024 ACM Designing Interactive Systems Conference (IT University of Copenhagen, Denmark) (DIS ’24). Association for Computing Machinery, New York, NY, USA, 905–919. DOI: 10.1145/3643834.3660718
Yujiao Zhang, Jinghan Zhang, Yan Liu, Xiaodong Chen, and Xiangyang Liu. 2021. A survey on data collection and transmission in healthcare IoT. IEEE Transactions on Industrial Informatics 17, 12 (2021), 7627–7640.
Publicado
30/09/2024
Como Citar
RIGHI, Adriano Zavareze; FISCHER, Gabriel Souto; RIGHI, Rodrigo da Rosa; COSTA, Cristiano André da; ROEHRS, Alex.
TriCache: Providing three-tier caching for time series data in serverless healthcare services. In: SIMPÓSIO BRASILEIRO DE COMPONENTES, ARQUITETURAS E REUTILIZAÇÃO DE SOFTWARE (SBCARS), 18. , 2024, Curitiba/PR.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
2024
.
p. 81-90.
DOI: https://doi.org/10.5753/sbcars.2024.3867.
