Building a Grid with Perl, Part 4: Submission and distribution

Splitting up a grid into simpler, smaller, elements makes the whole process of building a grid much easier. Grids are not mystic, they just require careful planning and a degree of flexibility in their operation and structure to allow work to be split up and divided among the different components in the grid. In this fourth part of a series on building a grid with Perl, I look at the issues of submitting information into a resource grid and how this is stored and prepared for distribution to a specific storage node.Read the full Tutorial.

Building a grid with Perl, Part 3: Metadata

This tutorial is the third in a series of tutorials looking at how you can develop a grid solution with Perl. This series looks at building a framework for a grid system while also creating a distributed image storage/retrieval system as a sample grid application. This tutorial concentrates on the metadata — data about data — which is used in a grid to control its operation.Read the full tutorial.

Building a Grid with Perl, Part 2: Exchanging information

In this tutorial series, we’re using Perl to build a resource grid that stores and manipulates photos and images. Communication drives the grid process, and in this tutorial we’ll look at the communication requirements in our grid, including the need for efficient data transfer of the large files we’ll be exchanging, the background communication requirements for managing and using the grid, and the effects of the communication system on the network performance, bandwidth requirements and other issues. We’ll also look at the different modules that we’ll be using to implement our grid communication system.Read the full Tutorial.

Perl and the grid infrastructure

Whether you want to develop a standalone grid or just want to provide an interface to an existing one, Perl can help. Through its extensible architecture and support for many of the protocols and systems that make up the modern grid, Perl is an ideal candidate either during submission or calculation and computation.Perl remains one of the most popular and prolific of the available general-purpose scripting languages. Its Web focus remains one of its strongest selling points and you can exploit that, along with a number of other functionality enhancements, such as cross-platform support, extensive database services and connectivity options, to help build grid services.In this article I look at the mechanics of Perl as a Web services platform, an important step if you want to integrate Perl into OGSI-based grid applications and services, including looking at some of the supporting communications tools, database utilities, and Web interface components.Read the full article.

Build Python grid applications with the Globus Toolkit Tutorial

Building grid applications can be complicated – there are so many different aspects and components to the system that it’s impossible to simply leap in the process. However, there are toolkits out ther and available that can help you. The most mature and best known of these grid toolkits is the Globus Toolkit. But usig the toolkit can be complex, so using a nice, easy to use language like Python can make the process significantly easier.In this tutorial I start with the basics of the Globus system and show how to build the Globus kit, the Python interface, and and how to use the interface to build basic Python grid servbices and applications.You can read the full article.

The Future of Grid Services

Grid services are undergoing a veritable explosion of growth at the moment. But how do you choose a grid solution? Do you look for standards, Web services compatibility, development environment compatibility, or just marketing hype? With so much conflicting information out there on grid services and platforms, it can be difficult to identify whether a specific company is providing a service or a toolkit for building your own service. In this article I’m going to look at the various grid development platforms available, and some grid initiatives and companies that provide ready-to-run grid services.Read the full article.

Bandwidth Management in Grids

One of the problems with distributing work around a group of machines is that it can become difficult to track the distribution of work, which can lead to problems with bandwidth. This doesn’t mean bandwidth in terms of network performance, although that can be an issue, but in terms of the distribution of work to clients and providers, the overall bandwidth performance of the grid, how work is distributed, and the servers that handle the distribution. In this article I look at how to get the best performance out of your grid.Read the full article.

Merging grids and web services

Two of the hottest technologies at the moment are Grid computing and Web services, but are the two compatible? In this article, Martin C. Brown looks at how the two systems are actually very compatible and describes the benefits of using Web services in grid applications.To determine whether Grid computing and Web services are compatible with each other, we need to look at how Grid computing works and whether we can really resolve a typical grid system down into a number of relatively discrete units. The Grid computing architecture relies on fairly basic principles, sending simple requests between clients and servers. Web services rely on processing simple requests from a client to a server.Just in case you don’t see how this can fit into your existing grid structure, this article looks at the two most common grid systems: the request and dispatch architectures. Request systems rely on clients to ask for work, while dispatch systems rely on the broker to supply the clients directly with work. The two systems have different issues when used with Web services, which will be examined as well.Read the full article.

Grid computing — moving to a standardized platform

One of the problems with any computing technology is getting the different components to talk to each other. This is why we have standards. But how do we apply standards in Grid computing? What standards are available? And how much can you really gain from using standard solutions in your grid applications? In this article, Martin C. Brown answers these questions and provides a history of where grids have come from and where grids should be going.Read the full article.