Here’s the first one: Whatever Happened to Programming @ The Reinvigorated Programmer, and here’s it’s second part: It May Not Be As Bad as All That.

Pay special attention to the addendum in that second article. The money quote for me was in the big pull from a comment by jdeitrich on HackerNews:

We talk about ‘flow’ quite a lot in software and I just have to wonder what’s happening to us all in that respect. Just like a conversation becomes stilted if the speakers keep having to refer to their phrasebooks and dictionaries, I wonder how much longer it will be possible to retain any sort of flowful state when writing software. Might the idea of mastery disappear forever under a constant torrent of new tools and technologies?

It’s the death of the hobbyist programmer. There’s a new framework release in Symfony or Zend Framework every time I re-surface a week or two later. Even with 10 years experience with programming, unit tests, and a decent level of comfort from the experience with 0.x versions and up of these frameworks, I spend all the time I *should* be coding with my nose in the docs updating code that’s been deprecated or migrated. Just keeping up in one framework can be a full time job.

How can anything get done like this?

Sun has some of the best ideas in the world. From a creativity point of view, they’re pretty amazing. From an implementation point of view, with some notable exceptions (ex: Fishworks), they’re pitiful. Sun couldn’t get laid in a whorehouse wearing a suit made of hundred dollar bills.

Half of Sun’s ideas were half-baked. (Either go fully baked, a’la Steve Jobs, or lay off whatever writes you make bad haiku, mmkay?) The x45xx line of servers is a wonderful idea and a wonderful form factor, and Sun overcame significant engineering challenges to develop it. Unfortunately, the first gen fell down hard under load and were practically unusable. The second gen is still suffering from some high replacement part and add-on costs that don’t justify the price in many cases. The integration of ZFS and SSDs as ZIL/L2ARC is wonderful, but there are a ton of technical problems that customers keep running into and Sun keeps refusing to acknowledge. It took three months to solve the problem I was having with SSDs and ZIL. I place the blame for the former on poor management controls, and the latter on excessive outsourcing of core competencies. Both are failures of management to execute the brilliant ideas that engineers come with.

It’s nice to see a company with a reputation for being able to execute and capitalize on new ideas come in. Oracle’s already started to cut, and all of the cuts I know of so far in my various interactions with the company have been well-justified. I’m really excited, from the point of view of someone with several relationships with the company, to see what comes of this merger.

RHN Fail

Yeah, that’s what you see when you visit rhn.redhat.com — which you need to use to administer redhat subscriptions. I can’t get my servers to subscribe while the site’s down, and I can’t manage my entitlements or buy new ones.

One of my consulting projects has been on hold for days while RHN sorts itself out. Worse, you can’t even log in to report the problem. If you click on the “contacting us” link, you get taken to a page with a couple of mailing lists. Well, why join a mailing list? I know the site’s down. I want to file an engineering report. I click the last option, which is supposed to allow me to file such a report. It says I need to log in to file a report. FAIL.

It does seem that there’s some awareness of the problem. Poking around in the rest of the redhat.com domain, I got messages like this:

Why’s Redhat losing market share? They can’t even run a website well. Who’s going to trust their server distro when they can’t get a website right?

The thing that speaks volumes to me about these problems are a few key quotes.

Clark says that the problem with the nuisance warnings has been their diverse nature, but “the common thread” is the software. He says Airbus executive vice-president programmes Tom Williams and his team “have sat in my office many times and said they can’t identify trends, which is the worst possible thing”.

Clark blames the software’s design. “There was a philosophy of utopia – I suspect that Airbus was blessed with some boffins who said ‘we’ve got to make this absolutely perfect – no flexibility’. The slightest surge causes one [sensor] to trip and then six more as they’re all linked,” he says.

Anyone willing to take guesses about the type of architecture and software developers at Airbus?

Briefly, chatter about the evacuation caused the word “Bryan” to trend into the top ten topics on Twitter.

As an observer, safely on the edges of the affected area, there were several interesting points that arose out of the incident. In particular, the role of traditional media took a backseat for many during the event compared to internet “crowdsourced” channels like Twitter, Facebook, and a local internet forum.

Commercial media sources were slow to jump on the story. The warehouse was destroyed at approximately 12:05pm, possibly in an explosion that was heard throughout the area. (I heard an unusual loud noise at that time, 20 miles away, but no one has officially stated that there was an explosion and there were thunderstorms in the area.) Within 30 minutes, there was a post on TexAgs.com’s Aggieland forum, which locals use to discuss current events and gossip. Before the Bryan, TX government had even managed a press release, the community forum had correctly identified the location of the fire from scanner traffic and had looked up what the facility supplied. There was a chemistry grad student talking about the toxicity of the chemicals involved and other materials and chemicals that may also be stored in the facility.

Throughout the first six hours of the incident, a community of casual onlookers with no particular expertise reported the news faster, more accurately, and in greater detail than traditional media sources.

When news and television sources did get on the story (at about 1:40 to 2pm, 2 hours after the event), they initially reported some wildly inaccurate information — locating the source of the blaze on the incorrect side of town (2 miles to the east of the freeway as opposed to 2 miles west) and that the evacuation was within a 3 mile radius instead of a 1/2 to 3/4 mile radius. The online community noted and mocked those errors. In a more serious incident, these errors could have panicked or killed thousands.

With all of this information at the community’s disposal, few people were tuning in to major news stations. The internet was talking about the exact source and likely makeup of the smoke, and had identified the streets within the evacuation zone. The television news was still broadcasting ‘Ellen’ without so much as a scrolling banner. Which would you listen to? In short, “crowdsourced” or “new media” carried the day.

A feather in the cap of Twitter: Several authoritative groups were using twitter to disseminate information to great effect. Bryan Fire Department, City of College Station, The Eagle, and KBTX News all were tweeting regularly. The City of College Station also updated their Facebook page regularly with news and updates. These sources were essential to some of the ‘refugees’, especially people who had the foresight to route those source updates to their mobile phones as SMS messages. The local cell tower infrastructure did fine on my Sprint service, although data was quite slow.

—

After things had quieted down for the night, I got an email from KBTX’s station manager. Someone had cut and paste a few of my comments from the forum thread to him, and knowing my ‘true identity’, provided my email address. He asked me if I could describe how the station didn’t live up to my expectations, and how they could improve. He explained that they are tied to official information sources that aren’t at all interested in talking to reporters and have to wait for information to be released to them. How can I explain: It’s not KBTX, or any other one news source that fell short. It’s the entire industry that’s failing to deliver.

As the KBTX manager pointed out for me, news reporters have forgotten how to investigate and interpret what they’re reporting. Smile pretty, fluff your hair, and parrot what the press release says! Investigation and the input of subject matter experts is an opportunity to provide added value that can’t be gleaned from a stream of twitter posts or a web forum. This opportunity is frequently being missed.

Let’s back up and examine “free” for a moment, because part of this is a money thing. The attitude of many content providers is that they’re now providing their product for free, or at a lower price (and lower profit) than they used to. Apparently, none have realized their service has become a commodity and is no longer valuable. Wire service news, television, and newspapers were novel and valuable in the days when information traveled slowly and expertise or interpretative ability was hard to come by. Now that traditional media is slower than the internet and no longer provides unique points of view or in-depth reporting, where is the value?

On the other hand, the The New Yorker has gained readership by raising it’s rates (as has the Economist and many others), and David Simon has pointed out in the Columbia Journalism Review that “giving things away” isn’t a good business plan. Professional news sources “of record” do have one valuable nature over ‘crowdsourced’ news: legitimacy. Compare it to selling bottled water. Bottled water is supposed to be pure. Tap water is questionable and tastes bad; anything less is sewage. But extending our examples above, magazines like The Economist provide a level of in-depth reporting that goes beyond water. So does the fact checking staff behind The New Yorker. Champagne will always cost more than water. What your average local newspaper, wire service, or news television provides is just plain ol’ tap water… with a “local color” spot of some puppies before they fade to the advertisements. Who would pay for that?

(Humorously enough, The Associated Press is still trying to shut the barn door long after the horses have been turned into Salami de Cavallo. Wire services are just water delivered quickly. There’s no value to be had there anymore. It’s a commodity with universal distribution.)

Beyond a misstated value, traditional media has missed the boat in a number of ways. This has been tackled (to death, ad nauseum) by several notables over the past several months: Steve Johnson, “Old Growth Media And The Future Of News”, Clay Johnson, “Newspapers and Thinking the Unthinkable”, and in the form of a compiled series of tweets, Dan Johnson, “The Following Account of My Short Career at The New Yorker”. Long story short: The end is nigh for many traditional media organizations, and by and large, not many are adjusting gracefully.

The amount of information that’s available via the internet is immense. Steven Johnson, in the above linked article, puts it well when he walks readers through the amount of information he had available 20 years ago compared to today. His information lead time went from months to weeks to minutes within a decade. At the same time, the amount of information and interpretive commentary on any one topic increased exponentially, from a couple thousand words per month to tens of thousands per day.

It doesn’t matter how much video that modern television stations, radio stations, and newspapers stream. It doesn’t matter how much they use twitter, facebook, or how many blog posts or podcasts they publish. They’re just not getting it in their hearts. Like a cargo cult, most are aping the actions of Gawker and MacRumors in the hopes that the rewards will be delivered from on high. There is absolutely no comprehension of the depth of the change — there are excuses about how much content they’re “giving away” online, how many new technologies they’ve adopted or tried, and strategies they’re now trying to attract or retain “market share.” But they still have the same damned Netflix pop-unders on their website. Is the picture clear yet? No? Try adjusting the rabbit ears.

Oh, there are solutions. Gawker is a great example of a flat, accurate, profitable, fast-moving internet investigative media source that has broad viewership. Look at the much-maligned Drudge Report. Even CNN does an excellent job with their websites, despite the insufferable cheesiness of iReport. Can your local news do all those things? You bet. It’s even possible without tearing the entire organization apart! Unfortunately, it’s not likely to happen that way.

Newspapers, radio, and television stations, and traditional commercial media sources in general, are still operating at the bandwidth of a telephone and are ‘reporting’ by talking to people one at a time. Despite the amazing array of sources, stories, and information floating around that’s accessible without leaving one’s home, these highly trained journalists are failing to get basic facts right with millions of dollars in equipment and support staff. Trying the same old things over isn’t working. From the outside, it’s obvious that they’re just providing a dribble of plain old tap water and trying to sell it. The internet is a raging torrent where anyone with a decent filter can make as much of their own potable water as they want.

The next step gets pretty obvious when you put it that way, doesn’t it?

Addendum:

• The White House has issued press passes to at least one blogger, and the city of New York may soon do so as well.
• Some of the above mentioned commentary about the Bryan plant blaze was lost in the swirling mass of sewage that is the General Board. I won’t link there, you don’t want to go.
• You really need to read the piece by Steven Johnson. Here’s the link again. He says what I said, but in far more illustrative and elegant words..
• 1August2009: Slight correction: Apparently the fire began around 11am and first responders were on the scene within five minutes. Hazmat teams were notified by 11:30 that they were going to be called up; there was a TEEX exercise happening at Kyle Field.
• 1August2009: A firsthand account from a firefighter: “About the time I pulled up, the smoke changed from orange to green briefly. The wind picked up and blew some of the smoke at a tree, and you could just see birds plummeting to the ground. That’s when I knew we had a serious problem on our hands.”

• Malcom Gladwell’s 2000 profile of Ron Popeil
• Vanity Fair’s profile of Joseph Ades, the “Gentleman Grafter”

If you’re looking to get into sales, these guys are who you should learn from.