Ian Murdock’s Weblog

What’s the single biggest advancement Linux has brought to the industry?

It’s an interesting question, and one that in my opinion has a very simple answer: Package management—or, more specifically, the ability to install and upgrade software over the network in a seamlessly integrated fashion—along with the distributed development model package management enabled.

It used to be that operating systems were big, monolithic products, and applications were big, monolithic products you put on top of them. If you wanted to deploy, say, a web application, you sourced the middleware stack (which itself was probably several big products too), you sourced the operating system, and you (often painfully) had to integrate the two yourself (or pay a big company lots of money to do it for you).

These days, you increasingly just “apt-get install whatever“.

In this world, where does the operating system end and the application begin? The line is increasingly blurred—for when applications are deployed using an OS facility, seamlessly integrated with the OS itself, is the result an application or a feature of the operating system? In fact, in a very real way, all software looks to become part of the operating system—or, at least, this has certainly been the trend in the Linux world.

What does this shift mean to the industry? For one thing, those of us that build operating systems as monolithic products have to change—it’s what users expect, and with a componentized operating system rather than a wad of stuff, it becomes far easier to push new innovations out into the marketplace and generally evolve the OS over time. Indeed, refashioning Solaris as a “distro” is the essence of Project Indiana—and package management is the key technology that will hold it all together.

So, the next time you read about how Project Indiana aims to make Solaris more “Linux-like”, keep in mind that what we’re actually “copying” is the distro model, not Linux itself—which, after all, is a kernel, and has nothing to do with the package management and so forth the distros (you know, like Debian) built above it. This, better than anything else, highlights the opportunity for Solaris: What people really know when they say they know “Linux” is the environment that exists around the Linux kernel—the distro—all of which Solaris can deliver, and more.

Anonymous: “So the problems started happening when we added the 7th wireless stack to the [Linux] kernel…” (Via Greg K-H.)

Quick poll: What do you think of when you hear the name “OpenSolaris”?

It’s an operating system? The community version of Solaris? Right?

Not quite. Like Linux, OpenSolaris is a kernel. Except that it’s more than a kernel. Or, rather, more than a kernel but not quite a complete operating system. Are you confused yet?

This comment from a recent Register article sums up the problem quite nicely:

If you go to the OpenSolaris web site, all bright eyed and eager to download a new operating system, you will walk away in bitter disappointment. Sure, it says the word “open” in two dozen languages on the web page, but when you go hunting for an installer disk to download, suddenly you are cast into a maze. Nevada builds? What the hell is Nevada? Oh, it’s what they’re calling the OpenSolaris code base. You’ll need to download these components and build them. Well, how do I install it? Oh, you can’t do that, you need to have a Solaris machine up already to build on. But you can get started if you go to Sun’s site and download their Solaris Express Enterprise Pro Champion Edition (after dutifully registering), and then enjoy that pleasant install experience. And when that’s done, you still have the work ahead of you of getting ON (what the hell is that? Oh, OS and Network. Sorry, I don’t work at Sun) built and updated. Did I miss anything? We haven’t gotten to packages to make the system usable yet.

Now, I’m willing to wager most of you reading this have probably heard about DTrace, ZFS, Zones, and the other great stuff Solaris has to offer, not to mention that Solaris is about as enterprise grade as they come, having been at the heart of the data center longer than many of the alternatives have even existed. And don’t forget about more mundane but critical things like backward compatibility, where Solaris has excelled for a very long time.

But how many of you have actually experienced this great stuff first hand? How many hands go down if you’re under 30 and don’t remember the Sun workstation—i.e., you’re one of the many for whom Linux = Unix for as long as you’ve been in the computer business? How many of you would take Solaris for a spin if doing so was as easy as, say, downloading the latest version of Ubuntu and installing it?

In other words, with all the buzz about making Solaris more familiar to Linux users, it turns out the widest part of the familiarity gap isn’t even technological.

So, how do we bridge it?

We need to make “OpenSolaris” something you can touch, something you can “Download Now!” and run on your laptop to try out the latest and greatest from the OpenSolaris community.

We need to clearly articulate the link between Solaris and OpenSolaris in ways the industry understands—namely, that OpenSolaris is the rapidly moving version that delivers the latest innovations, and that Solaris is the enterprise-grade, supported-for-many-years, backward-compatibility- guaranteed version for the data center. Furthermore, the link needs to be more than just “OpenSolaris as upstream for Solaris”. Given how many more copies of Fedora and Ubuntu are running in the world than the enterprise Linuxes, there is significant opportunity here if we can get the model right.

In short, to make OpenSolaris (and, by extension, Solaris) more familiar to Linux users, the first thing we need to do is make it a “distro” in the Linux sense of the word. After all, when people say they know “Linux”, that’s what they’re talking about—how many people really care about the Linux kernel underneath? What they care about is the GNU tools, the desktop, the development environment, and all the other things their favorite distro bundles—and the package system that holds it all together. There’s no reason in the world why (Open)Solaris can’t deliver those same things. Oh yeah, and DTrace, ZFS, Zones, enterprise grade security/scalability/performance/etc., backward compatibility, etc. too.

Put this way, it’s easy to imagine what OpenSolaris needs to look like. That’s why the issues here are not primarily technological.

This is the essence of the Project Indiana you’ve read so much about in the past several weeks. Our goal is to create a binary distribution of OpenSolaris that simultaneously delivers what people have come to expect from “Linux” alongside the great stuff that make Solaris unique.

What comes next? We’re working that out in real time. If you’re interested in following along, participating, or just giving us your two cents, I encourage you to join the indiana-discuss mailing list we just created. We’re particularly interested in hearing from you if you consider yourself a “Linux user” and have been interested in taking Solaris for a spin but, for whatever reason, have considered the gap too wide. What would it take to get you running Solaris?

Matthew Garrett: “[I]f you create procedures before you create community, the people who end up enforcing the procedures tend to be the sort of people who find enforcing procedures to be the interesting part of the job rather than the ones who see them as necessary evils to enforce moderately sensible community development.”

Cote’: “Check out the sausage being made…”

I’ll be making my first big appearance as a Sun employee next Monday at CommunityOne in San Francisco (this is the day before JavaOne). In addition to participating in the keynote with Tim O’Reilly, Rich Green, and Tim Bray, I’ve put together a track called Linux vs. Solaris? designed to show that the gap between Linux and Solaris isn’t as wide as one might think:

All too often, technologies are pitted against each other in the popular imagination, and Linux and Solaris are no exception—”Linux vs. Solaris” certainly does make a catchy soundbyte.

Despite the juxtaposition, Linux and Solaris have much in common—both are open source, have common ancestry, and are similar enough that both users and developers can move back and forth between them with comparative ease. The “vs.” mentality is caused as much by lack of understanding of the “other side” as anything else.

In this track, we will focus on the similarities between Linux and Solaris rather than the differences, the goal being to increase understanding of Solaris among Linux users and developers and vice versa. Where we discuss differences, these differences will be expressed in terms of “how we can learn from each other”. We will also discuss the migration up the stack of developer platforms and address the question, “Do operating systems still matter?” The ultimate goal of the track is to change the conversation: Not Linux vs. Solaris, but open vs. closed.

The track includes four sessions. I’ll kick things off by answering the burning question: “What’s a Linux guy doing at Sun?” Next, Jeff Bailey of Canonical and Bart Smaalders of Sun will take us “inside the sausage factory” to show how Ubuntu and Solaris, respectively, get made. Next, Don Kretsch of Sun and Joe Little of Stanford will show us Solaris Express Developer Edition and Nexenta, two very different takes on OpenSolaris. And last but certainly not least, Josh Berkus, Robert Lor, Harpreet Singh, Tim Bray, and Greg Luck will highlight why the OS still very much matters even as software development moves up the stack.

Of course, there are a number of other great tracks as well. If operating systems are your bag, you should also check out the OpenSolaris track. Fortunately, my times don’t overlap with Ben Rockwood’s introduction to OpenSolaris, nor will I have to miss the opportunity to see the amazing Bryan Cantrill, Adam Leventhal, and Mike Shapiro educate, entertain, and gesticulate wildly!

If you’re in San Francisco or the Bay area or are already planning to be at JavaOne, you should definitely plan to attend CommunityOne too. Register today! (P.S. - It’s free!)

It’s been a crazy few weeks. I’ve heard the phrase “drinking from the fire hose” many times, and while I’ve never actually tried to do that, I suspect the experience is something like this. I’m having a blast though. A few quick first impressions:

1. First things first: The lead up to the announcement was remarkable—not at all what I expected from a big company. As Jim Grisanzio pointed out, the PR people did a great job coordinating everything, but the bloggers were very much in the lead here. In fact, I was given so little (OK, no) guidance on what “the message” was supposed to be that I sent a draft of what I was going to post to Jonathan, and he replied, no one is allowed to run their posts by me, just speak your mind, that’s what we all do. The message: Sun really is as transparent as it appears from the outside perspective.
2. In the other direction, the people here are not only open to the outside perspective, they want to hear it. That’s a big part of the reason I’m here now. Solaris has lost a lot of developer mindshare to Linux over the past 5-10 years. There are important lessons to be learned from that, and we (yes, I feel like it’s “we” already) are intent on doing just that.
3. Maybe it’s just the people I’m working with, but this place feels like a startup. There’s a lot of positive energy, a real sense of urgency, and people genuinely seem to love what they’re doing. The difference: It’s a startup with actual resources. You know, like 30,000+ people. A potent combination indeed.

Regular blogging should resume shortly.

The timing could have been better (since some will no doubt connect my words to today’s other news), but an interview I did with Linux Format at last month’s LinuxWorld Open Solutions Summit was published today, and quickly found its way to Slashdot, where I figured it would end up (read the interview—it’s right in there :-). I knew midway through that I was about to step in it, but these are things that needed to be said, and I’m pleased with how it ended up. Before you throw me to the wolves, read it all the way through, and think about it.

I saw my first Sun workstation about 15 years ago, in 1992. I was a business student at Purdue University, and a childhood love for computers had just been reawakened. I was spending countless hours in the basement of the Math building, basking in the green phosphorescent glow of a Z29 and happily exploring every nook and cranny of the Sequent Symmetry upstairs. It didn’t take too long to discover, though, just a short walk away in the computer science building, several labs full of Sun workstations. Suddenly, the Z29 didn’t have quite the same allure. A few months later, I walked over to the registrar’s office and changed my major to computer science. (OK, advanced tax accounting had something to do with it too.)

Everything I know about computing I learned on those Sun workstations, as did so many other early Linux developers; I even had my own for a while, after I joined the University of Arizona computer science department in 1997. But within a year, the Suns were starting to disappear, replaced by Pentiums running Red Hat Linux. More and more people coming through university computer science programs were cutting their teeth on Linux, much as I had on Sun. Pretty soon, Sun was increasingly seen by this new generation as the vendor who didn’t “get it”, and Sun’s rivals did a masterful job running with that and painting the company literally built on open standards as “closed”. To those of us who knew better, it was a sad thing to watch.

The last several years have been hard for Sun, but the corner has been turned. As an outsider, I’ve watched as Sun has successfully embraced x86, pioneered energy efficiency as an essential computing feature, open sourced its software portfolio to maximize the network effects, championed transparency in corporate communications, and so many other great things. Now, I’m going to be a part of it.

And, so, I’m excited to announce that, as of today, I’m joining Sun to head up operating system platform strategy. I’m not saying much about what I’ll be doing yet, but you can probably guess from my background and earlier writings that I’ll be advocating that Solaris needs to close the usability gap with Linux to be competitive; that while as I believe Solaris needs to change in some ways, I also believe deeply in the importance of backward compatibility; and that even with Solaris front and center, I’m pretty strongly of the opinion that Linux needs to play a clearer role in the platform strategy.

It is with regrets that I leave the Linux Foundation, but if you haven’t figured out already, Sun is a company I’ve always loved, and being a part of it was an opportunity I simply could not pass up. I think the world of the people at the LF, particularly my former FSG colleagues with whom I worked so closely over the past year and a half: Jim Zemlin, Amanda McPherson, Jeff Licquia, and Dan Kohn. And I still very much believe in the core LF mission, to prevent the fragmentation of the Linux platform. Indeed, I’m remaining in my role as chair of the LSB—and Sun, of course, is a member of the Linux Foundation.

Anyway. Watch this space. This is going to be fun!

Stephen O’Grady: “[D]esktop Linux advocates should borrow a card from Apple, whose job is made infinitely easier by virtue of the fact that they only officially support one hardware platform - theirs…”