Log in

entries friends calendar profile Previous Previous Next Next
Alcohol leads to sustainability and other truisms - Jef"I am the pusher robot"Spaleta
ramblings of the self-elected Fedora party whip
Alcohol leads to sustainability and other truisms
The NSF workshop on software sustainability for cyberinfrastructure has been pretty good.

There are a few key ideas that are cropping up in the talks and discussions.

First, there is an immense tension in the scientific software ecosystem between the need for multi-year stability and the rate of innovation.  More so than general computing...because researchers looking for stability in some areas..are the very same people are innovating software up the stack.  It's a weird mix of production and prototyping and there's no clear distinction right now.

This is the crux of the problem. Grant funding is short term in nature, and it may fund major software developments like shared frameworks or specific science codes...but seldom prices in long term maintenance with the understanding that the environments in which software is being used move faster than the expected timescales over the useful lifetime of a science codebase. If real-world datasets are expected to be available for 10 years as a primary resource for scientific analysis. Can we build codes that we can expect to run 10 years after the data is collect in our current environment where we know that underlying hardware and software will change drasticly in that time?  Can we expect grad students who never studied software engineering in a serious way to write these codes?

Open source is a working assumption in all discussions as to how the research community is going to reach sustainability...but....its complicated.  Without institutional support can independent science researchers get together to sustain software even if they aren't funded to do it?  Open source does have benefits for the science community, peer review, reproducibility...things that go to the heart of science.  Open source is a win, but cost benefits may not be the the biggest win compared to other benefits accessibility and the openness of knowledge exchange.  The real issue here is are we doing as good a job of measuring the value going into the software tools that researchers are building.

Testing is hard. Testing matters.  We don't do enough of it, and we don't teach science researchers how to test the codes they write...especially the science areas not traditionally associated with CS. Do we give biologists in undergraduate enough software engineering experience before they go on to running and adapting numerical simulation codes? 

Software lifecycle. Science codes do not die. Forever is unsustainable. If as a community science researchers want to focus on sustainable...we will need to come with grips with end-of-life and actually focus on a better release model across the board.

Software patents...suck.  Are academic and institution signing up as members of the Open Invention Network patent mafia? If not why not?
If we are going to have shared open science software..and we want people to reuse code...how do we protect individual reseachers and institutes from the exact same liability that Red Hat as a corporate entity is already dealing with?

How do existing open source communities help the NSF deal with this and all the associated questions? There's a lot in the webcasts for everyone to chew on.  Far more than I can blog about.

2 comments or Leave a comment
From: sheilajoyce Date: March 27th, 2009 08:36 pm (UTC) (Link)

Alcohol / Software / Research ?

Jef: Forgive me, but I'm old, granted, never went to University, granted, but what in the world are you trying to say here, that's got anything to do with Alcohol ? Much less the lack of any sustainability therein, what-so-ever ??

I've no idea where this is leading/going !?!

jspaleta From: jspaleta Date: March 27th, 2009 09:04 pm (UTC) (Link)

Re: Alcohol / Software / Research ?

the title is of the post is one of the witty comments from one of the conference talks from the NSF workshop on cyberinfrastructure sustainability.


In one of the talks the presenter made a comment about the best way to get honest feedback from the academic scientific research users of the software he was helping to write was to buy them beer at research conferences and get them to talk about the problems using the software. Hence the joke in the title. The point being science codebase development as it is currently done isn't consistently doing a good of a job as they could closing the feedback loop with users.

Hopefully they will make the webcasts available as downloadable archive of videos. There are slides available for some of the talks. I'll post again to encourage people to view the videos as soon as I know they are available. There was a lot discussed.


2 comments or Leave a comment