Project in Brief

GridMPI is an implementation of the MPI (Message Passing Interface) standard designed for high performance computing in the Grid. It establishes a synthesized cluster computer by binding multiple cluster computers distributed geographically. Users are able to seamlessly deploy their application programs from a local system to the Grid environment for processing a very large data set, which is too large to run on a single system.

GridMPI targets to make global communications efficient, by optimizing the behavior of protocols over the links with non-uniform latency and bandwidth, and also to hide the details of the lower-level network geometry from users. The GridMPI project is working on to provide variations of collective communication algorithms and an abstract layer to hide network geometry, and an interface to the TCP/IP communication layer to make it adaptive to those algorithms.

PSPacer is a precise software pacer of IP traffic for Linux, which controls IP traffic to regulate bandwidth and smooth bursty traffic. It is implemented as a Linux loadable kernel module, but it controls the traffic at a very high precision (less than a micro-second!) which was only possible by using a special hardware. PSPacer is a standalone module and not bound to GridMPI. Its application varies widely, for example, high-bandwidth TCP/IP streaming, and traffic control of low-bandwidth lines.

GridMPI and PSPacer are open-source free-software. The software is downloadable from the download page.

News

PSPacer version 3.0 is Released on Mar 31, 2010. This is a major release and includes dectd 1.0.1. For more information, see the PSPacer Project page.

Dectd version 1.0.0 is Released on Dec 22, 2009. This is an extra utility package of PSPacer. Dectd (dynamic execute and configure traffic control command daemon) is a daemon program that automatically configures the Linux traffic control mechanism so as to support IP flow-based traffic control. The traffic control mechanism of the Linux operating system is basically based on the class-based QoS. To achieve the flow-based QoS on top of the class-based QoS mechanism, the issue of the high operational cost when the number of flows is large should be solved. In this system, the system administrator specifies simple rules (e.g., range of IP addresses and port numbers) in advance. The system detects IP flows by interposing system calls and automatically configure flow queues (combination of a qdisc and a filter) according to the specified rules. In this way, the operational cost is significantly reduced. For more information, see the PSPacer Project page.

PSPacer version 2.1.2 is Released on Aug 19, 2009. This is a minor release and fixes the installation problem on x86_64 machines. For more information, see the PSPacer Project page.

GridMPI version 2.1.3 is released on Mar 17, 2009. This minor release includes some bug fixes. GridMPI version 2.1.3 is fully tested in a heterogeneous environment for combinations of Linux/IA32, AIX/Power, and Solaris/SPARC64V.

GridMPI version 2.1.1 is released on Apr 10, 2008. This minor release includes some bug fixes. GridMPI version 2.1.1 is fully tested in a heterogeneous environment for combinations of Linux/IA32, AIX/Power, and Solaris/SPARC64V.

GridMPI version 2.1 is released on Mar 31, 2008. This minor release includes some enhancements and bug fixes. GridMPI version 2.1 is fully tested in a heterogeneous environment for combinations of Linux/IA32, AIX/Power, and Solaris/SPARC64V.

GridMPI version 2.0 is released on Nov 10, 2007. This is a major release for the first time in one and half years. GridMPI version 2.0 is fully tested in a heterogeneous environment for combinations of Linux/IA32, AIX/Power, and Solaris/SPARC64V.

PSPacer version 2.1 is Released on Mar 15, 2007. PSPacer version 2.1 provides libnl (netlink library) support and minor bug fixes. For more information, see the GridTCP Project page.

PSPacer version 2.0.1 and 1.2 are Released on Apr 17, 2006. PSPacer version 2.0 supports a new feature: dynamic pacing mode. PSPacer version 1.2 is a stable release. And both releases include pspd (PSPacer control daemon) support. The source tarball and the binary RPM for FedoraCore 5 are available. For more information, see the GridTCP Project page.

GridMPI version 1.0 is released on Apr 13, 2006, after eleven minor releases of version 0.x series. GridMPI version 1.0 is fully tested in a heterogeneous environment for combinations of Linux/IA32, AIX/Power, and Solaris/SPARC64V. It now includes major MPI-2.0 features.

PSPacer version 1.1 is Released on Sep 20, 2005. Some bugs are fixed. If you use the older version, please update it. The source tarball and the binary RPM for FedoraCore 4 are available. For more information, see the GridTCP Project page.

PSPacer version 1.0.2 is Released on Jul 25, 2005. A new version of PSPacer is available. The binary RPM for FedoraCore 4 is also available. For more information, see the GridTCP Project page.

PSPacer version 1.0.1 is Released on Jun 22, 2005. A new version of PSPacer is available. The binary RPM for FedoraCore 4 is also available. For more information, see the GridTCP Project page.

PSPacer version 1.0 is Released on Jun 6, 2005. Precise Software Pacer (PSPacer) achieves precise network bandwidth control and smoothing of bursty traffic without any special hardware. PSPacer is implemented as a Linux loadable kernel module. Therefore, it is independent of the device driver, and kernel re-compilation is not required for the installation.

PSPacer is an open-source free-software, and the software is distributed under the GNU GPL License. For more information, see the GridTCP Project page and the press release (in Japanese).

GridMPI version 0.2 is Released on Nov 7, 2004. The first release of GridMPI is on the public. It is a full MPI-1.2 implementation and supports both cluster systems and collections of multiple clusters. It supports the IMPI (Interoperable MPI) protocol for connecting multiple clusters over TCP/IP. GridMPI is an extension to YAMPI, an MPI library for cluster systems, which is independently developed by Yutaka Ishikawa Laboratory of the University of Tokyo.

• For more information, see the Software Release Page.
• For more information on YAMPI, please visit the YAMPI Official Home Page.

Disclaimer

DISCLAIMER

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, OF SATISFACTORY QUALITY, AND FITNESS FOR A PARTICULAR PURPOSE OR USE ARE DISCLAIMED. THE COPYRIGHT HOLDERS MAKES NO REPRESENTATION THAT THE SOFTWARE, MODIFICATIONS, ENHANCEMENTS OR DERIVATIVE WORKS THEREOF, WILL NOT INFRINGE ANY PATENT, COPYRIGHT, TRADEMARK, TRADE SECRET OR OTHER PROPRIETARY RIGHT.

LIMITATION OF LIABILITY

THE COPYRIGHT HOLDERS SHALL HAVE NO LIABILITY TO LICENSEE OR OTHER PERSONS FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL,CONSEQUENTIAL, EXEMPLARY, OR PUNITIVE DAMAGES OF ANY CHARACTER INCLUDING, WITHOUT LIMITATION, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES, LOSS OF USE, DATA OR PROFITS, OR BUSINESS INTERRUPTION, HOWEVER CAUSED AND ON ANY THEORY OF CONTRACT, WARRANTY, TORT(INCLUDING NEGLIGENCE), PRODUCT LIABILITY OR OTHERWISE, ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

Credit

Developers
YUTAKA ISHIKAWA (provided YAMPII)
MASAHIKO EDAMOTO, YOSHITAKA KANEO
HIDETAKA KOIE, MOTOHIKO Z. MATSUDA
FUMIHIRO OKAZAKI, MASAYA SAITOU,
RYOUSEI TAKANO

This work is being done at the National Institute of Advanced Industrial Science and Technology (AIST), Japan, under the contract with the National Research Grid Initiative, NAREGI, Project.

• Grid Technology Research Center, National Institute of Advanced Industrial Science and Technology (AIST)
• Yutaka Ishikawa Laboratory of the University of Tokyo; Graduate School of Information Science and Technology, University of Tokyo
• YAMPI Official Home Page: An open-source MPI implementation project page
• National Research GRID Initiative (NAREGI)

Grid Technology Research Center, AIST

National Institute of Advanced Industrial Science and Technology (AIST)

National Research GRID Initiative (NAREGI)

GridMPI is a registered trademark in Japan.