Showing posts with label CFD. Show all posts
Showing posts with label CFD. Show all posts

Performance and Productivity of an HPC Cluster (3)

My last blog described the results of implementing a refreshed 32-node CFD (computational fluid dynamics) cluster by using a completely different solution from the one implemented in the previous cluster. Using Platform HPC for the refresh, the new cluster significantly reduced its job failure rate and had a 15% usage increase and 25% throughput increase.


After the HPC cluster was in production with happy users, the management team began making plans to further improve application performance and user productivity. They were able to start to investigate and plan for the future. GPU adoption and a new ways to speed up the design process are two areas identified.


GPU Use


Using GPU to accelerate applications is what this organization is looking at next. Some commercial applications ISVs have already released applications that support GPU acceleration, for example, ANSYS. Adding GPU to the cluster could dramatically reduce the application run time. However, it will obviously increase the cluster complexity. Fortunately Platform HPC can help reduce such complexity. With Platform HPC, it’s much easier for administrators to deploy GPU required software. Platform Computing has repackaged NVIDIA’s CUDA software into a format that can be automatically deployed across all compute nodes in a cluster by leveraging the cluster management capability of Platform HPC. The workload scheduler in Platform HPC is also GPU aware so it can schedule GPU resources such that users running GPU jobs don’t need to worry about which node has GPUs or if the GPUs are used by other users. These capabilities would go a long way to helping this organization overcome the hurdles of adopting GPU technology.


Design Process Acceleration


After users transferred from using the command line interface to the web interface, they still had some complex scripts that they needed to automate job flows. These scripts were originally built by a few power users. New users typically just copied them and wrapped the scripts with a few lines of code as required. But when there was a problem, it was very difficult to debug. One technology they are evaluating to help alleviate this problem is Platform Process Manager. Platform Process Manager allows users to program a flow in a graphical way without writing scripts. It can be integrated with Platform HPC’s web interface. Once a flow is developed, users can click a button to launch the flow. Job dependencies are taken care of by the Platform Process Manager. This company is exploring the possibility of using Platform Process Manager as a technology to automate their job flow to further increase user productivity. The graphical view of the flow also makes the job flows much easier to maintain and improve, which can also be used to document best practices in their engineering process.


The partnership with Platform Computing allows this design firm to advance digital design efficiency with increased user productivity. By doing more simulations to improve the quality of the design, high performance computing gives them the competitive advantage to be leading edge.

HPC from A-Z (part 4) - D

Today’s HPC ABC will focus on the letter D.

Design – HPC computing is a great environment for Computer Aided Design. It allows designers to perform complex analyses that can result in a range of benefits – from more efficient aircraft design to faster cars and complex architectural renderings.

Simpson Strong-Tie produces structural products for building safer, stronger homes and buildings and has done for nearly 50 years. Concrete modelling might not seem very hi-tech but the team rely on HPC to simulate the strength of designs in rapid time. The alternative, manually building physical models, involves a lot more effort, a lot more concrete and takes 14 times longer.

What does the future hold for HPC and design? Maybe I’ve watched too many science fiction films, but I can see a time when HPC can help us in our mission to reach distant planets that are outside our solar system, by aiding spacecraft design. Who knows, maybe we’ll scrap traditional urban planning and just use HPC to model entire cities, using building designs that withstand extreme weather and earthquakes.

The sky is the limit when it comes to HPC and design; the possibilities are endless. I really believe that HPC is a great playground for creative people. As Margaret Atwood said, “The techno-scientific world has some of the most creative people you'll ever meet”.

Next week we’ll look at HPC and the letter E.

Performance and Productivity of an HPC Cluster (2)

In my last blog, I described an audit we recently did for a small manufacturing company on their 32-node CFD (computational fluid dynamics) cluster. The objective of the audit was to both evaluate the efficiency of the cluster and develop an upgrade plan. In this blog, I will describe their experience and the results they had after deploying Platform HPC.


As a refresher, through the auditing process, we identified that the company had less than optimal cluster usage, with 40% of the cluster value wasted and an 18% loss of user productivity.


The solution for making the refreshed cluster more efficient was geared towards shorter set-up time, higher cluster utilization and creating quick troubleshooting processes. Platform HPC Enterprise was selected for the company’s upgrade. After the cluster hardware was installed and connected, it took less than one day to install all the software components on the head node, together with the operating systems and management software components provisioned on all compute nodes. It took another day to get ANSYS Fluent and ANSYS Mechanical integrated with the MPI library (Platform MPI) and Platform HPC web portal. After these steps, the cluster went in production almost immediately. Platform HPC Enterprise did the heavy lifting for the management software installation and application integrations. Similar tasks that previously took two months to complete were now completed within three days.


One of the improvements we made was in the application license configuration process, where we removed group specific application license reservations. This was one of the reasons contributing to the low cluster utilization. The license reservation system was supposed to guarantee application licenses for mission critical user groups. Rather than using a reservation system, Platform HPC allows dynamic license preemption. This means jobs with high priority can stop low priority jobs, pre-empting application licenses if necessary. The low priority jobs do not die. Instead, they resume when high priority jobs are completed and licenses are freed up. We saw a 15% increase in cluster usage using this configuration.
Another performance boost came as a result of the web-based interface in Platform HPC, because users do not need to deal with scripts. Using the web interface, they can manage their CFD jobs, as well as the data. This dramatically reduced job failure rates for the simulation. Administrators also got relief from dealing with user problems, thus resulting in a 10% time savings. This allows the administrator to now spend time on other duties.


The new cluster also uses Voltaire Fabric Collective Accelerator (FCA), which speeds up communication among all tasks for an MPI job. With the integration between Platform MPI and Voltaire FCA, ANSYS Fluent performance increased by 10-20%.


After the initial deployment and performance tuning, we saw a 25% job throughput improvement, a 15% license usage increase, and a 10% reduction in administration effort overall. This is a significant improvement over the previous cluster.


In the next blog, I will discuss the next steps planned for this site to further improve user productivity.

Santa and HPC

“So just how does Santa manage to travel the earth in just one evening and deliver all those presents” is a question you might get asked this Christmas. Sure, you can opt for the “magic” answer but perhaps Santa has a really awesome HPC environment up there at the North Pole?

Red Bull Racing is using HPC software to significantly accelerate its computer-aided design and engineering processes for its winning Formula One Cars. If Red Bull can use HPC to optimise designs that maximise the downforce and reduce the drag cars create on the track, then why can’t Santa use HPC for his sleigh design?

As Santa is going to experience some turbulent and icy conditions on his route this year, I’d like to think his elves have been running simulations via HPC to ensure his sleigh can cope with these adverse conditions, without sacrificing on speed. Throw into the mix the rising cost of gasoline, in monetary and environmental terms, Santa’s going to have to ensure his sleigh is energy efficient too. Of course the rise in population is something he needs to keep in mind, Santa now needs to make far more stops that he did many years ago, and can take advantage of HPC to analyze all those naughty and nice lists to take the most efficient route possible.

The design conundrum outlined above really does point toward the need for an HPC environment at the North Pole. Santa just can’t afford to take a risk with the design of his sleigh. There would just be too many disappointed children to imagine.

So when you’re faced with the “just how does Santa do it” question, why not take this as an opportunity to introduce the child to the infinite possibilities of High Performance Computing!



Note: All opinions in this blog are my own and not officially endorsed by other people named Saint Nick.

Platform HPC Enterprise Edition Launched

Application performance is no longer relying on the computer clock speed – parallelization is the only way to dramatically scale application performance. Referred to as a cluster, it is the foundation to scale an application, but unlike an operating system on single machine (i.e., Linux), setting up and using a cluster remains a daunting task for many users. Why? First, there are multiple software components that are required to run the applications in a cluster environment. This includes parallelization libraries (MPI), job distribution workload management, and administrative cluster management. Second, all these components must be integrated to work together. Though they seem to install fine, they often break in production. So, can these software components be packaged, integrated, and tested together up-front to behave more reliably like an operating system?


Pre-assembling cluster software with hardware has been tried in the past by many different user organizations and usually resulted in complicated, time-consuming systems to manage. Platform Computing has taken on this challenge to solve this problem. The launch of Platform HPC Enterprise Edition is a more complete offering, as compared to their previous launch of Platform HPC Workgroup Edition last year. What I like is their unique seamless integration between cluster management and workload management along with their MPI library and system monitoring. In my experience, now both users and administrators can get their job done by interfacing through a single unified web portal. This makes a cluster more like a single operating system. The product’s single install and single user interface makes a highly technical and complex high performance Linux cluster easy to use for the average cluster user.


Join Platform on May 26, 2010, at 11:00 a.m. ET for a webinar to discuss the product features, capabilities and benefits of the new Platform HPC Enterprise Edition.

Making the HPC lifecycle easier

Last week, I attended the IDC HPC User Forum in the Detroit area. Among the many interesting topics discussed at the Forum was how HPC helps manufacturing firms remain competitive. Large organizations are definitely in leading positions when it comes to HPC. After many years of investment, there is a lot of well established HPC expertise within large companies. IDC data shows the main hurdle for HPC getting penetration beyond those large
organizations is the cost of dealing with complexity of HPC systems. This includes cluster setup and getting applications optimized to take advantage of the latest hardware.


Many HPC vendors provide open source software stacks so that users can avoid hunting down their own components. This helps simplify HPC system setup to a certain degree. However, because many HPC software components are not designed to work together by their nature, users still face the challenge of integrating them to get them work together seamlessly. I talked to many of the attendees of IDC HPC User Forum, and they’ve all spent a tremendous amount of time and effort setting up their HPC environments. Many of them admitted this would be an impossible mission for average manufacturing firms.


With the goal of simplifying HPC cluster life cycle management, Platform’s HPC Suite, which includes HPC Enterprise Edition and HPC Workgroup Edition, provides one-stop shopping for those who don’t have the expertise to deal with the complexity of the HPC system software stack and application integrations. Offered through Platform Computing’s hardware partners, the HPC Suite (or HPC Workgroup Edition) helps average users get applications up and running with optimized performance. The key differentiator of this offering is that it provides the necessary software components to connect the OS to applications in an HPC cluster environment. By working closely with our hardware partners, we’re in the process of certifying he solution and and optimizing it for their specific hardware. With the application integrations, users can start to run parallel applications right away.

For more on the HPC Suite, check our products page here.

Red Bull Racing Heading for #1

Last week I had the opportunity to join a scrum of reporters on a tour of Red Bull Racing’s design facility outside of London, England. For our non-racing audience, Red Bull Racing is one of about a dozen Formula 1 racing teams that compete globally. Last year the Red Bull Racing Team came in 2nd overall, and this year they appear to be the team to beat. Their facility in England employs about 600 designers, engineers and other staff dedicated to building really fast cars. This year they will design, test and build three new Formula 1 cars to compete during in the 2010 season.

Platform Computing is one of Red Bull Racing’s Innovation Partners, and together our two organizations are developing ways to get more out of their computing environment, which they use to design their cars. The governing body of Formula 1 racing, the FIA, has put restrictions on how much compute horsepower teams can use; so getting the most out of their computer grid gives Red Bull Racing a huge competitive advantage.

One of the biggest uses of Red Bull’s grid is to run software simulations of fluid dynamics tests (called Computational Fluid Dynamics or CFD). Traditionally these tests would be performed in wind tunnels with scale models of the cars; done on computer grids, the cost of testing can be reduced dramatically and the number of designs and conditions tested can be increased vastly. This is the same technology that many of our other customers, including GM and Audi, use to design their cars to make them more streamlined and subsequently more energy efficient.

In the case of Red Bull Racing, CFD is used for very complex simulations. Besides reducing the profiles of their Formula 1 cars they are also trying to make the cars hug the ground more tightly for better traction. This is done by designing the car like an upside-down wing. Oh, and did I mention that companies like Airbus and Boeing use CFD software (also run on Platform grids) to design jets? Same deal only with the “lift” used in reverse.
I must admit I’m more of an NFL fan, but this year I will be watching Formula 1 racing and cheering for the Red Bull Racing – Platform Computing team, naturally.



Stephen Mounsey of Scientific Computing World admires the surreal design of one of Red Bull Racing’s famous Formula 1 cars.
(Photo Credit: Tom Zsolt)