Scalable Parallel Implementation of Bayesian Network to Junction Tree Conversion for Exact Inference

• Vasanth Krishna Namasivayam University of Southern California
• Animesh Pathak University of Southern California
• Viktor K. Prasanna University of Southern California

Abstract

We present a scalable parallel implementation for converting a Bayesian network to a junction tree, which can then be used for a complete parallel implementation for exact inference. We explore parallelism during the process of moralization, triangulation, clique identification, junction tree construction and potential table calculation. For an arbitrary Bayesian network with n vertices using p processors, the worst-case running time is shown to be O(n2w/p+-wrwn/p+n log p), where w is the clique width and r is the number of states of the random variables. Our algorithm is scalable over 1 les p les nw/log n. We have implemented our parallel algorithm using OpenMP and experimented with up to 128 processors. We consider three types of Bayesian networks: linear, balanced and random. While the state of the art PNL library implementation does not scale, we achieve speedups of 31, 29 and 24 for the above graphs respectively on the DataStar cluster at San Diego Supercomputing Center

Keywords: Bayesian methods, Parallel algorithms, Inference algorithms, Libraries, Computer networks, Parallel processing, Random variables, Artificial intelligence, Medical diagnosis, Application software