A Proposal for a Parallel Programming Support for Multi-LAN platforms
Resumo
In the first part of this article, we present our proposal for a distributed shared memory system (DSM) for an interconnection of local-area networks (LANs). Our multi-LAN DSM will be composed of a set of per LAN lazy release consistency (LRC) memory model DSM systems. For controlling shared-memory updates, the LRC protocol of cach DSM will use the barrier-lock logical clocks, instead of the traditional per processor vector ones. This replacement provides modularity and scalability to some extent. The other enhancements to be added to the protocol aim the reduction of the number of messages and the volume of data exchanged between LANs for the sake of applications' performance. Data pre-fetching, simulation of a LAN-level cache and hierarchical execution of barriers are some of the strategies to be adopted. In the second part of the paper, we discuss the advantages of using the CPAR language for the development of parallel applications which run on top of shared-memory hierarchical platforms such as multi-LAN DSMs.
Palavras-chave:
Distributed shared memory, multi-LAN platform, parallel programming language, hierarchical approach, modularity, scalability, logical clocks
Referências
C. Amza. A. L. Cox. S. Dwarkadas. P. Keleher, H. Lu, R. Rajamony; W. Yu and W. Zwaenepoel. TreadMarks: shared memory computing on networks of workstations. IEEE Computer. 29(2): 18-28, February 1996.
C. Amza. L. Cox, S. Dwarkadas. J. Jin, K. Rajamani; W. Yu and W. Zwacnepoel. Adaptive protocols for software distributed shared memory. Proceedings of the IEEE. 87(3):467-475, March 1999.
L. Arantes, and L. Sato. CPAR-DSM: a suppon for parallel programming on top of DSM. In Proceedings of the International Conference on Parallel and Distributed Techniques and Applications, Las Vegas, July 1998.
L. Arantes. B. Folliot. and P. Sens. A customized logical clock for timestamp-based relaxed consistency DSM systems. In Proceedings of the 1999 Workshop on Software Distributed Shared Memory held in conjunction with ICS'99 (ACM/SIGARCH) Rhodes. Greece, pages 1-6. June 1999.
L. Arantes. B. Folliot, and P. Sens. A node-count independant logical clock for scaling Lazy Release Consistency Protocol. To appear in the Proceedings of Europar'99. Toulouse. France, Septembree 1999.
O. Bailey. J. Barton, T. Lansinski, and H. Simon. The NAS parallel benchmark. Technical Repon 103863. NASA. July 1993.
H. Bal. A. Plaat. M. Bakkcr. P. Dozy and R. Hofman. Optimizing parallel applications for wide-area clusters. In Proceedings of the 12th International Parallel Processing Symposium, Orlando, April 1998.
A. Bilas, L. Iftode. R. Samanta and J. P. Singh. Supporting a coherent shared address space across SMP nodes: An application-driven investigation IMA Volumes in Mathematics and its Applications (Algorithms for Parallel Processing), 105. Springer-Verlag, New York. 1998.
A.Cox. S. Dwarkads, H. Lu and W. Zwanenepoel. Evaluating the Performance of Distributed Shared Memory as a Target for Parallelizing Compilers. In Proceedings of the IIth International Parallel Processing Symposium, pages 447-482, April. 1997.
A.Cox. Y. Hu, H. Lu and W. Zwanenepoel. OpenMP on Networks of SMPs. In Proceedings of the 13th International Parallel Processing Symposium, April 1999.
S. Dwarkadas, H. LU. A. Cox. R. Rajamony and W. Zwaenepoel. Combining Compile-Time and Ruo-Time Support for Efficient Software Distributed Shared Memory. Proceedings of the IEEE.87(3), March 1999.
C. Fidge Logical Time in Distributed Computing Systems. IEEE Computer, pages 28-33. July 1991.
L. Iftode, C. Dubnicki, E. Felten and K. Li. Improving Release Consistency Shared Virtual Memory using Automatic Update. In Proceedings of the 2nd IEEE Symposium on High-Performance Computer Architecture, February 1996.
W. Hu. W. Shi and Z. Tang. Reducing System Overheads in Homebased Software DSMs. In Proceedings of the 13th International Parallel Processing Symposium. April 1999.
D. Khandekar. Quarks: distributed shared memory as a building block for complex parallel and distributed systems. Master's Thesis. Department of Computer Science, University of Utah. Salt Lake City, (EUA). 1996.
P. Keleher. Lazy release consistency for distributed shared memory. Ph.D. Thesis. Rice University. January 1995.
P. Kelcher and C. Tseng. Enhancing Software DSM for Compiler-Parallelized Applications. In Proceedings of the IIth International Parallel Processing Symposium. April, 1997.
H. Lu. S. Dwarkadas. A. L. Cox and W. Zwanenepoel. Quantifying the Performance Differences Between PVM and TreadMarks. Journal of Parallel and Distributed Computation. 43(2):65-78. June 1997.
H. Lu. Y.C. Hu. and W. Zwanenepoel. OpenMP on Networks of Workstation. In Proceedings of Supercomputing'98. Orlando, EUA. Novcmber 1998.
Mattern. Virtual time and global states of distributed systems. In Parallel and Disttributed Algorithms. Elsevier Science Publishers, 1989.
L. R. Monnerat and R. Bianchini. Efficiently Adapting to Sharing Patterns in Software DSMs. In Proceedings of the 4th Symposium on High Performance Computer Architecture, January. 1998.
R. Samanta. A. Bilas. L. Iftode and J. Singh. Home-based SVM protocols for SMP clusters: Design and Performance. In Proceedings of the 4th Symposium on High Performance Computer Architecture. February 1998.
L. M. Sato. Programming language for multiprocessor systems with memory hierarchy. In: Simpósio Nipo-brasileiro de Ciência e Tecnologia, pages 227-35. São Paulo. Brazil, 1994.
L. M. Sato. Ambientes de Programação para Sistemas Paralelos e Distribuídos. Tese de livre docência. Escola Politécnica da Universidade de São Paulo. São Paulo (Brazil). I 995.
P. Singh, W. Weber and A. Gupta. SPLASH: Stanford parallel applications for shared-memory. Technical Report. Stanford University. April 1991.
R. Stets. S. Dwarkadas. N. Hardavellas. G. Hunt, H. Kontothannassis. S. Parhasarathy and M. Scott. Cashmere-2L: Software Coherent Shared Memory on a Clustered Remote Write-Network. In Proceedings of the 16th ACM Symposium on Operating Systems Principies, October 1997.
F.Torres-Rojas and M. Aharnad. Plausible Clocks: Constant Size Logical Clocks for Distributed Systems. In Proceedings of the 10th Jnternational Workshop on Distributed Algoritms. WDAG96, Bologna. ltaly, October 1996.
C. Amza. L. Cox, S. Dwarkadas. J. Jin, K. Rajamani; W. Yu and W. Zwacnepoel. Adaptive protocols for software distributed shared memory. Proceedings of the IEEE. 87(3):467-475, March 1999.
L. Arantes, and L. Sato. CPAR-DSM: a suppon for parallel programming on top of DSM. In Proceedings of the International Conference on Parallel and Distributed Techniques and Applications, Las Vegas, July 1998.
L. Arantes. B. Folliot. and P. Sens. A customized logical clock for timestamp-based relaxed consistency DSM systems. In Proceedings of the 1999 Workshop on Software Distributed Shared Memory held in conjunction with ICS'99 (ACM/SIGARCH) Rhodes. Greece, pages 1-6. June 1999.
L. Arantes. B. Folliot, and P. Sens. A node-count independant logical clock for scaling Lazy Release Consistency Protocol. To appear in the Proceedings of Europar'99. Toulouse. France, Septembree 1999.
O. Bailey. J. Barton, T. Lansinski, and H. Simon. The NAS parallel benchmark. Technical Repon 103863. NASA. July 1993.
H. Bal. A. Plaat. M. Bakkcr. P. Dozy and R. Hofman. Optimizing parallel applications for wide-area clusters. In Proceedings of the 12th International Parallel Processing Symposium, Orlando, April 1998.
A. Bilas, L. Iftode. R. Samanta and J. P. Singh. Supporting a coherent shared address space across SMP nodes: An application-driven investigation IMA Volumes in Mathematics and its Applications (Algorithms for Parallel Processing), 105. Springer-Verlag, New York. 1998.
A.Cox. S. Dwarkads, H. Lu and W. Zwanenepoel. Evaluating the Performance of Distributed Shared Memory as a Target for Parallelizing Compilers. In Proceedings of the IIth International Parallel Processing Symposium, pages 447-482, April. 1997.
A.Cox. Y. Hu, H. Lu and W. Zwanenepoel. OpenMP on Networks of SMPs. In Proceedings of the 13th International Parallel Processing Symposium, April 1999.
S. Dwarkadas, H. LU. A. Cox. R. Rajamony and W. Zwaenepoel. Combining Compile-Time and Ruo-Time Support for Efficient Software Distributed Shared Memory. Proceedings of the IEEE.87(3), March 1999.
C. Fidge Logical Time in Distributed Computing Systems. IEEE Computer, pages 28-33. July 1991.
L. Iftode, C. Dubnicki, E. Felten and K. Li. Improving Release Consistency Shared Virtual Memory using Automatic Update. In Proceedings of the 2nd IEEE Symposium on High-Performance Computer Architecture, February 1996.
W. Hu. W. Shi and Z. Tang. Reducing System Overheads in Homebased Software DSMs. In Proceedings of the 13th International Parallel Processing Symposium. April 1999.
D. Khandekar. Quarks: distributed shared memory as a building block for complex parallel and distributed systems. Master's Thesis. Department of Computer Science, University of Utah. Salt Lake City, (EUA). 1996.
P. Keleher. Lazy release consistency for distributed shared memory. Ph.D. Thesis. Rice University. January 1995.
P. Kelcher and C. Tseng. Enhancing Software DSM for Compiler-Parallelized Applications. In Proceedings of the IIth International Parallel Processing Symposium. April, 1997.
H. Lu. S. Dwarkadas. A. L. Cox and W. Zwanenepoel. Quantifying the Performance Differences Between PVM and TreadMarks. Journal of Parallel and Distributed Computation. 43(2):65-78. June 1997.
H. Lu. Y.C. Hu. and W. Zwanenepoel. OpenMP on Networks of Workstation. In Proceedings of Supercomputing'98. Orlando, EUA. Novcmber 1998.
Mattern. Virtual time and global states of distributed systems. In Parallel and Disttributed Algorithms. Elsevier Science Publishers, 1989.
L. R. Monnerat and R. Bianchini. Efficiently Adapting to Sharing Patterns in Software DSMs. In Proceedings of the 4th Symposium on High Performance Computer Architecture, January. 1998.
R. Samanta. A. Bilas. L. Iftode and J. Singh. Home-based SVM protocols for SMP clusters: Design and Performance. In Proceedings of the 4th Symposium on High Performance Computer Architecture. February 1998.
L. M. Sato. Programming language for multiprocessor systems with memory hierarchy. In: Simpósio Nipo-brasileiro de Ciência e Tecnologia, pages 227-35. São Paulo. Brazil, 1994.
L. M. Sato. Ambientes de Programação para Sistemas Paralelos e Distribuídos. Tese de livre docência. Escola Politécnica da Universidade de São Paulo. São Paulo (Brazil). I 995.
P. Singh, W. Weber and A. Gupta. SPLASH: Stanford parallel applications for shared-memory. Technical Report. Stanford University. April 1991.
R. Stets. S. Dwarkadas. N. Hardavellas. G. Hunt, H. Kontothannassis. S. Parhasarathy and M. Scott. Cashmere-2L: Software Coherent Shared Memory on a Clustered Remote Write-Network. In Proceedings of the 16th ACM Symposium on Operating Systems Principies, October 1997.
F.Torres-Rojas and M. Aharnad. Plausible Clocks: Constant Size Logical Clocks for Distributed Systems. In Proceedings of the 10th Jnternational Workshop on Distributed Algoritms. WDAG96, Bologna. ltaly, October 1996.
Publicado
29/09/1999
Como Citar
ARANTES, Luciana; FOLLIOT, Bertil; SATO, Liria M.; SENS, Pierre.
A Proposal for a Parallel Programming Support for Multi-LAN platforms. In: INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD), 11. , 1999, Natal.
Anais [...].
Porto Alegre: Sociedade Brasileira de Computação,
1999
.
p. 197-204.
DOI: https://doi.org/10.5753/sbac-pad.1999.19790.
