Supercomputers are for dreams

I was invited to the 2012 NCSA Annual Private Sector Program (PSP) meeting in May. In my few years of attending, this has always been a great meeting (attendance by invitation only), with an unusually high concentration of real HPC users and managers from industry.

NCSA have recently released streaming video recordings of the main sessions - the videos can be found  as links on the Annual PSP Meeting agenda page.

Bill Gropp chaired a panel session on "Modern Software Implementation" with myself and Gerry Labedz as panellists.

The full video (~1 hour) is here but I have also prepared a breakdown of the panel discussion in this blog post below.

Some fun for ISC12

I have written a guest blog post for the ISC'12 website - "Are you an ISC veteran?". The article is intended to raise a few serious observations amongst the fun.

I also wrote an earlier guest blog post for the ISC'12 website - "Is co-design for exascale computing a false hope?"

I've added these two links to my page on this site "Interviews, Quotes, Articles" (which lists my various articles, interviews, etc. in other locations around the internet).

The power of supercomputers - energy, exascale and elevators

Paul Henning has written on his blog (HPC Ruminations) about the growing issue of power requirements for large scale computing. Paul's blog post - "Familiarity Breeds Complacency" - is partly in response to my article at HPCwire - "Exascale: power is not the problem" and my follow-up disucssion on here - "Supercomputers and other large science facilities".

Paul makes several good points and his post is well worth reading. He ends with an observation that I've noted before (in my own words):

One of supercomputing's biggest strengths - it's ability to help almost all areas of science and engineering - is also one of it's greatest weaknesses - because there a portfolio of cases rather than a single compelling champion to drive attention and investment.

PS - I've added Paul's new blog to my list of HPC blogs and news sites.

Looking ahead to ISC'12

I have posted my preview of ISC'12 Hamburg - the summer's big international conference for the world of supercomputing over on the NAG blog. I will be attending ISC'12, along with several of my NAG colleagues. My blog post discusses these five key topics:

• GPU vs MIC vs Other
• What is happening with Exascale?
• Top 500, Top 10,
• Tens of PetaFLOPS
• Finding the advantage in software
• Big Data and HPC 

Read more on the NAG blog ...

Cloud computing or HPC? Finding trends.

I posted "Cloud computing or HPC? Finding trends." on the NAG blog today. Some extracts ...

Enable innovation and efficiency in product design and manufacture by using more powerful simulations. Apply more complex models to better understand and predict the behaviour of the world around us. Process datasets faster and with more advance analyses to extract more reliable and previously hidden insights and opportunities.

... and ...

High performance computing (HPC), supercomputing, computational science and engineering, technical computing, advanced computer modelling, advanced research computing, etc. The range of names/labels and the diversity of the audience involved mean that what is a common everyday term for many (e.g. HPC) is an unrecognised meaningless acronym to others - even though they are doing "HPC".

... and then I use some Google Trends plots to explore some ideas ...

Read the full article ...

My SC11 diary index

Here is a handy index to the ten entries in my diary of the weeks leading up to SC11.

1. "The big HPC event of the year - lots of news, people & meetings. Busy week."
2. "schedule certainty, locations, spare time & hard work"
3. "SC11 news deluge, the missing HPC world"
4. "how do you do it?"
5. "navigation, rope and choosing wisely"
6. "fog and sports events"
7. "not everyone will be in Seattle"
8. "ppt, professionals, preparation & precipitation"
9. "printing, SC12, hopping and mischief"
10. "the final word"

Enjoy.

My SC11 diary 10

It seems I have been blogging about SC11 for a long time - but it has only been two weeks since the first SC11 diary post, and this is only the 10th SC11 diary entry. However, this will also be the final SC11 diary blog post.

I will write again before SC11 in HPC Wire (to be published around or just before the start of SC11).

And, then maybe a SC11 related blog post after SC11 has all finished.

So, what thoughts for the final pre-SC11 diary then? I'm sure you have noticed that the pre-show press coverage has started in volume now. Perhaps my preview of the SC11 battleground, what to look out for, what might emerge, ...

My SC11 diary 9

I mentioned yesterday about preparation for SC11. I thought today I'd add a few miscellaneous tips I've gathered over the years. In no sensible order or grouping ...

My SC11 diary 8

It turns out I have to actually do some talking at SC11 as well as listen to others. So one of today's jobs was to start preparing some presentations I will be giving at SC11. My normal habit is to have a custom version of a slide set for each audience/customer. I try to avoid simply re-using the same slide deck for each talk. Obviously I do re-use large chunks of previous presentations but update it, or add/remove content to get the right focus.

My SC11 diary 7

As a cursory glance at #SC11 on twitter today will tell you, it is now only two weeks until SC11 (or less if you count the parts of the show that start over the weekend).

So perhaps this is a good time to consider the many supercomputing people who won't be joining the hordes in Seattle this year.

My SC11 diary 6

Today was supposed to be a day away from the email, laptop, phone, etc. But it didn't quite turn out that way. Among other things, SC11 planning required some attention. Will try harder tomorrow (there won't be a diary entry tomorrow for example).

Which raises a question  - do you find time for a day off at SC? Some people arrive over the weekend and take a day away from supercomputing to do some local tourism. Others stay on an extra day or two after the end of SC for the same reason. Personally, unless flight schedules force an extra day or two, I don't normally do this.

My SC11 diary 5

I enjoy seeing the reactions of people attending SC for the first time. Perhaps being used to only attending other HPC events around the world, they are unprepared for the scale of the event.

Especially the exhibition. I am sure people get lost in there - properly lost, not just the few minutes disorientation that we all get several times in the SC11 week as we traverse the show floor looking for a specific booth or exit. Each year, I remember by about the 3rd day (but not the 1st!) that the booth numbers are partly logical - they are related to the rows/columns of the booth location within the hall. How handy for navigation!

My SC11 diary 4

Another good day with the SC11 schedule today - a good increase in the proportion of nailed down meetings.

Something that comes up during the process of arranging meeting at SC is the different logistics. There seems to be quite a variety of opinion as to the best way to attend SC week.

My SC11 diary 3

Well, shock, today so far has not been dominated by SC11! "Normal" work (and admin) has been the focus so far today. It is easy at this time of year to scan the headlines in the main HPC news outlets such as HPC Wire, InsideHPC, twitter (!), ... and assume SC is the only thing the HPC world is thinking of right now. The same is true of article preparation emails circulating for specialist publications like The Exascale Report. And it is even true to some extent for publications with a broader remit - e.g. Scientific Computing.

My SC11 diary 2

One goal for the end of each week leading up to SC11 is to have a net increase in certainty of my schedule for SC11 week itself. That means I hope for a reduction in the number of schedule entries labelled "hold for ..." or "tentative", etc. Of course, this usually also means an increase in the number of confirmed meetings, breakfast meetings, dinner meetings and so on. I also look for confirmation of my speaking slots, time to visit bits of the technical program, any media duties, and social events.

My SC11 diary 1

The SC11 conference, or just "supercomputing", will be held in Seattle this November. For many in the high performance computing community, SC is the big event of the year. Certainly it is the one that attracts the most press (and press releases), the most attendees, the biggest exhibition, and absorbs the most amount of time in planning before we even get there. It is the event where we get to meet with many of our customers, most of our potential suppliers, and many friends and collaborators.

Supercomputers and other large science facilities

In my recent HPCwire feature, I wrote that I occasionally say, glibly and deliberately provocatively, that if the scientific community can justify (to funders and to the public) billions of dollars, large power consumptions, lots of staff etc for domain specific major scientific intrusments like LHC, Hubble, NIF, etc, then how come we can’t make a case for a facility needing comparable resources but can do wonders for a whole range of science problems and industrial applications?

There is a partial answer to that ...

Big Data and Supercomputing for Science

It is interesting to note the increasing attention “big data” seems to be getting from the supercomputing community.

Data explosion

We talk about the challenges of the exponential increase in data, or even an “explosion of data”. This is caused by our ever-growing ability to generate data. More powerful computational resources deliver finer resolutions, wider parameter studies, etc. The emergence of individual scale HPC (GPU etc.) that is both cost-viable and effort-viable gives increased data creation capability to the many scientists not using high end supercomputers. And instrumental sources continue to improve in resolution and speed.

So, we are collecting more data than we have before. We are also increasing our use of multiple data sources – fusion from various sensors and computer models to form predictions or study scientific phenomena.

It is also common to questions such as: are we drowning in volume of data? Is this growth in data overwhelming our ability to extract useful information or insight? Is the potential value of the increased data lost by our inability to manage and comprehend it? Does having more data mean more information – or less due to analysis overload? Do the diversity of formats, quality, and sources further hinder data use?

Summer season big changes - football or supercomputing?

The world of supercomputing has gone mad.

So it seems as I catch up on the news around the HPC community after a week's vacation. Just today the news of IBM walking away from half a decade's work on Blue Waters and the story of an unknown organisation [now revealed to be NVidia] tempting Steve Scott to leave his Cray CTO role have been huge news but thinking back over the summer months there has been more.

The immediate comparison to me is that of the European football summer season (soccer for my American readers). Key players are signed by new clubs, managers leave for pastures new (or are pushed), and ownership takeover bids succeed or fail. It feeds a few months of media speculation, social gossip, with occasional breaking news (i.e. actual facts) and several major moves (mostly big surprises, but some pre-hyped for long before). But clubs emerge from the summer with new teams, new ambitions, and new odds of achieving success.

The world of HPC has such a summer I think.

ISC11 Review

ISC11 - the mid-season big international conference for the world of supercomputing - was held this week in Hamburg.

Here, I update my ISC11 preview post with my thoughts after the event.

I said I was watching out for three battles.

GPU vs MIC vs Fusion

The fight for top voice in manycore/GPU world will be one interesting theme of ISC11. Will this be the year that the GPU/manycore theme really means more than just NVidia and CUDA? AMD has opened the lid on Fusion in recent weeks and has sparked some real interest. Intel's MIC (or Knights) is probably set for some profile at ISC11 now the Knights Ferry program has been running a while. How will NVidia react to no longer being the loudest (only?) noise in GPU/manycore land? Or will NVidia's early momentum carry through?

Review: None of this is definitive, but my gut reaction is that MIC won this battle. GPU lost. Fusion didn't play again. My feeling from talking to attendees was that MIC was second only to the K story, in terms of what people were talking about (and asking NAG - as collaborators in the MIC programme - what we thought). Partly because of the MIC hype, and the K success (performance and power efficient without GPUs), GPUs took a quieter role than recent years. Fusion, disappointingly, once again seemed to have a quiet time in terms of people talking about it (or not). Result? As I thought, manycore is now realistically meaning more than just NVidia/CUDA.

Exascale vs Desktop HPC

Both the exascale vision/race/distraction (select according to your preference) and the promise of desktop HPC (personal supercomputing?) have space on the agenda and exhibit floor at ISC11. Which will be the defining scale of the show? Will most attendees be discussing exascale and the research/development challenges to get there? Or will the hopes and constraints of "HPC for the masses" have people talking in the aisles? Will the lone voices trying to link the two extremes be heard? (technology trickle down, market solutions to efficient parallel programming etc.) What about the "missing middle"?

Review: Exascale won this one hands down, I think. Some lone voices still tried to talk about desktop HPC, missing middles, mass usage of HPC and so-on. But exascale got the hype again (not necessarily wrong for one of the year's primary "supercomputing" shows!)

Software vs Hardware

The biggie for me. Will this be the year that software really gets as much attention as hardware? Will the challenges and opportunities of major applications renovation get the profile it deserves? Will people just continue to say "and software too". Or will the debate - and actions - start to follow? The themes above might (should) help drive this (porting to GPU, new algorithms for manycore, new paradigms for exascale, etc). Will people trying to understand where to focus their budget get answers? Balance of hardware vs software development vs new skills? Balance of "protect legacy investment" against opportunity of fresh look at applications?

Review: Hardware still got more attention than software. Top500, MIC, etc. Although ease-of-programming for MIC was a common question too. I did miss lots of talks, so perhaps there was more there focusing on applications and software challenges than I caught. But the chat in the corridors was still hardware dominated I thought.

The rest?

What have I not listed? National flag waving. I'm not sure I will be watching too closely whether USA, Japan, China, Russia or Europe get the most [systems|petaflops|press releases|whatever]. Nor the issue of cloud vs traditional HPC. I'm not saying those two don't matter. But I am guessing the three topics above will have more impact on the lives of HPC users and technology developers - both next week and for the next year once back at work.

Review: Well, I got those two wrong! Flags were out in force, with Japan (K, Fujitsu, Top500, etc) and France (Bull keynote) waving strongly among others. And clouds were seemingly the question to be asked at every panel! But in a way, I was still right - flags and clouds do matter and will get people talking - but I mainatin that manycore, exascale vs desktop, and the desperation of software all matter more.


 What did you learn? What stood out for you? Please add your comments and thoughts below ...