The fall term always gets a little overwhelming, as classes get into session and lectures need to be written, problem sets graded, exams created. I have an amazingly long backlog of things about which I want to write at this point but which I have not yet had the time to even get started. To top things off, my life appears to be changing forever. Most of these pieces get written on weekend afternoons while Lilah is napping. But the days of napping appear to be coming to a close.I understand intellectually that this is likely, after all, few 10 year olds nap, but I had never really stopped to think about the effect on my life. It’s not all bad; being able to pondering going out to do something with Lilah in the afternoon could be quite fun! But it will definitely gobble up my quiet afternoon writing time. But, today, after a late Halloween night and a no-doubt sugar-induced-early-morning wakeup, Lilah is currently snoozing away and I am going to now type as quickly as possible. Ready? Go! (Halloween? Yes, I started writing this almost a month ago, giving a perfect demonstration of the point I am trying to make.)
Back at the end of August I asked everyone to review my paper on Titan fog, and, to my surprise, many people took the task extremely seriously. The paper was discussed in classes and in on-line forums and was stared at by many eyes. If you recall back in August one of the reasons for attempting this open review was the fear that having only a single official reviewer leads to a huge random factor as to whether or not you will get anything useful out of the process. In this case, I have to say that the official review was pretty difficult to decipher. The reviewer commented on a few typos, complained about the location of the references, and said that the paper was generally incomprehensible.
Incomprehensible? Now, I will admit to having written papers that are incomprehensible before (how about this one; I can barely understand it myself 20 years later), but I actually thought that the paper was pretty clear. What’s more, of the many comments I had gotten from outside the official review process, no one had quite said “incomprehensible.” So what was going on here?
I reread the paper several dozens of times, and reread all of the comments that I had gotten, and realized, I think, the source of the problem. I think I was much too terse in my explanation of what I had actually done. Sure, I discussed fog and its discovery in gory detail. But I perhaps did not do a great job of describing how I really sorted through all of the data to find fog. It’s a pretty crucial step. If you don’t provide enough details in your paper that someone else could come after you and reproduce precisely what you did, you have failed an important point of having a paper in the first place.
One reason for describing all of this poorly was that the real process was actually quite different from the way I attempted to describe it in the paper. The real process consisted of this: I was looking at a bunch of pictures of Titan and said “Whoa; what the heck is that?” That turned out to be fog. I suspect that many discoveries are made that way, but if you read scientific papers you will rarely learn that fact. If you read my paper, you will find something like “Fog is very important so one fine day we decided to go look for fog on Titan. And we found it.”
OK, partially this description is true. After the first few times of accidentally seeing the fog we did, one fine day, systematically search through the entire data set. But that description was all pretty muddled.
The solution was a nearly complete rewrite of the paper. Had I just gotten the official review I would have fixed the typos and reworded a few things here and there and wondered what the heck the reviewer was talking about, but with the strength of the large number of comments, I could really tell what people were seeing and reading and I could make it significantly better. At least I think it is. But don’t take my word for it. Remind yourself of the first version, here. And now go read the new version here as it is about to appears in this week's Astrophysical Journal Letters. You still will not read the new version and realize that the real way we found fog is that we stumbled on it accidentally, but you will at least, I think, have a better idea of precisely what we did and how we did it. Want to go find fog yourself? I think the roadmap is now significantly more clear.
My conclusion from this experiment? I can’t tell you whether this system will always lead to such dramatic improvements in the quality of a paper, but in this particular case there is no doubt that when you read the two versions of the paper and you note any improvements almost all of those improvements came from the open review, rather than the official review. All of the comments that were sent to me were incorporated in one way or another. And for that, I would like to say a hardy THANK YOU to everyone.
But wait, there’s more!
Fresh on the heels of the Titan fog paper, I have submitted a paper to the Astronomical Journal called “The size, density, and formation of the Orcus-Vanth system in the Kuiper belt.”
This paper, I will admit, is less accessible than the paper about fog on Titan, yet, still, would you give it a read? It’s been posted online for a week and one reader already pointed out a rather stupid math error (thanks Alan Martin) of the sort that creeps into papers when you work on them one hour a week for 3 months (the error is still there, until we fix it in the next round of reviews, so feel free to go track it down and marvel at how stupid I sometimes can be).
Normally I would spend a few pages here telling you what the paper is about but, conveniently, I did that last spring, when we were searching for an appropriate name for the moon of Orcus. Go back and reread the post about coming up with names for the moon of Orcus, where I talk about the strange characteristics of what we now call Vanth. And, with a bit of continued Lilah napping over the weeks to come, stay tuned for thoughts about searching for the real Planet X, why I hate the 5 dwarf planets, and strategies for Lilah-weekend-nap-inducement.
And look! Lilah is done with her nap, and ready to start in on last night’s candy. Back to the sugar frenzy. (and with that, Lilah was awake, and we were off, and now it is a month later and Lilah is settled into a post-Thanksgiving nap and I finally have a spare moment to finish and post. Classes end next week for the year, so I look forward to a bit more time for reflection soon. Stay tuned.)
- Lilah Brown's Planets, Part II (or, Season II preview) [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Snow White needs a bailout [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- To the moon [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- S/1 90482 (2005) needs your help [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- We'll always have Regulus [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Orcus Porcus [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Kant's Crowded Universe [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Look up! [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Baby Pictures [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Encore: Yelping at Saints [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Godspeed [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Heavens above! [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Homeward bound [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Sony Pictures and the end of the world [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Thank you from the future [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Lunar dreams [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The first of the Pluto books! [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Don't try to blame it on Rio [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Rio roundup [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The long road to a Titan storm [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Planetary Placemats [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Fog! Titan! Titan Fog! (and a peer review experiment) [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Millard Canyon Memories [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- The problem with science [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- P.S. on the problem with science [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- How Big is 10 TB? [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Showing You Your Servers [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Pick Your Partnership: Referral Partners, Resellers and Affiliates [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Server Form Factors: Towers v. Rack-Mounts [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Lights-Out in the Data Centers [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Disruptive Technologies: Virtualization and The Cloud [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Know Thy Backups – Part I [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Know Thy Backups – Part II [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Boo Bash 2009 – Desktop Costume Included! [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- Why No One Will Talk About “Cloud Computing” in 10 Years [Last Updated On: November 8th, 2009] [Originally Added On: November 8th, 2009]
- We Love ‘Server Huggers’ [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- All About the Cloud: An Interview with Dell’s Cloud Evangelist [Last Updated On: December 13th, 2009] [Originally Added On: December 13th, 2009]
- Happy Solstice [Last Updated On: December 21st, 2009] [Originally Added On: December 21st, 2009]
- A ghost of Christmas past [Last Updated On: December 31st, 2009] [Originally Added On: December 31st, 2009]
- Learning from a Blender [Last Updated On: January 5th, 2010] [Originally Added On: January 5th, 2010]
- Changing my world [Last Updated On: January 6th, 2010] [Originally Added On: January 6th, 2010]
- A Server. From Scratch. [Last Updated On: January 7th, 2010] [Originally Added On: January 7th, 2010]
- The Planet Sand Castle: Upgrade Your Sandbox [Last Updated On: January 12th, 2010] [Originally Added On: January 12th, 2010]
- Hosting for Haiti [Last Updated On: January 20th, 2010] [Originally Added On: January 20th, 2010]
- Redefining Value [Last Updated On: January 26th, 2010] [Originally Added On: January 26th, 2010]
- My Experience as a Newbie at The Planet [Last Updated On: January 28th, 2010] [Originally Added On: January 28th, 2010]
- Confessions of Another New Planeteer [Last Updated On: February 1st, 2010] [Originally Added On: February 1st, 2010]
- How I Learned to Stop Worrying and Love Permissions [Last Updated On: February 11th, 2010] [Originally Added On: February 11th, 2010]
- Where at The Planet is Rachel? [Last Updated On: February 15th, 2010] [Originally Added On: February 15th, 2010]
- The Planet Storage Cloud: FYI [Last Updated On: February 19th, 2010] [Originally Added On: February 19th, 2010]
- Meet us in March [Last Updated On: February 25th, 2010] [Originally Added On: February 25th, 2010]
- The Planet in “The Channel” [Last Updated On: March 2nd, 2010] [Originally Added On: March 2nd, 2010]
- The Planet Server Challenge [Last Updated On: March 13th, 2010] [Originally Added On: March 13th, 2010]
- The Definitive Guide to Finding The Planet at SXSW [Last Updated On: March 13th, 2010] [Originally Added On: March 13th, 2010]
- The SXSW Iron Geek Champion! [Last Updated On: March 15th, 2010] [Originally Added On: March 15th, 2010]
- Drinking from the Fire Hose [Last Updated On: March 16th, 2010] [Originally Added On: March 16th, 2010]
- The Fastest Hands at SXSW [Last Updated On: March 17th, 2010] [Originally Added On: March 17th, 2010]
- System.out.println(“Hello World!”); [Last Updated On: March 22nd, 2010] [Originally Added On: March 22nd, 2010]
- Westmere – Get it Here [Last Updated On: March 23rd, 2010] [Originally Added On: March 23rd, 2010]
- Orbit on Your iPhone: A Sign of Things to Come [Last Updated On: March 24th, 2010] [Originally Added On: March 24th, 2010]
- #ShowMeMyServer 2.0 [Last Updated On: March 25th, 2010] [Originally Added On: March 25th, 2010]
- Get to Know Your Visitors [Last Updated On: March 30th, 2010] [Originally Added On: March 30th, 2010]
- The Next Big Thing in Hosting: The Hostatulator [Last Updated On: April 1st, 2010] [Originally Added On: April 1st, 2010]
- Storage Cloud and the City [Last Updated On: April 4th, 2010] [Originally Added On: April 4th, 2010]
- American Heart – Why I Walk [Last Updated On: April 7th, 2010] [Originally Added On: April 7th, 2010]
- The Cake Shouldn’t Be a Lie [Last Updated On: April 8th, 2010] [Originally Added On: April 8th, 2010]
- April Showers Bring May Flowers [Last Updated On: April 9th, 2010] [Originally Added On: April 9th, 2010]
- First at The Planet: Nehalem EX 4-Socket Servers [Last Updated On: April 15th, 2010] [Originally Added On: April 15th, 2010]
- Intel Guest Blog: Xeon 5600 [Last Updated On: April 16th, 2010] [Originally Added On: April 16th, 2010]
- Inside the Office: A Birthday Surprise [Last Updated On: April 18th, 2010] [Originally Added On: April 18th, 2010]
- The Planet @ Cloud Expo East [Last Updated On: April 19th, 2010] [Originally Added On: April 19th, 2010]
- The Planet @ ad:tech SF [Last Updated On: April 22nd, 2010] [Originally Added On: April 22nd, 2010]
- ad:tech Server Challenge [Last Updated On: April 22nd, 2010] [Originally Added On: April 22nd, 2010]
- ad:tech Panel: Developing Communities Online [Last Updated On: April 23rd, 2010] [Originally Added On: April 23rd, 2010]
- The Planet @ Interop Las Vegas [Last Updated On: April 27th, 2010] [Originally Added On: April 27th, 2010]
- Overflowing With Value: 10TB is Back! [Last Updated On: April 28th, 2010] [Originally Added On: April 28th, 2010]
- The Cloud is NOT the Revolution [Last Updated On: April 29th, 2010] [Originally Added On: April 29th, 2010]
- The Importance of Orbit 2.0 [Last Updated On: May 5th, 2010] [Originally Added On: May 5th, 2010]
- The Planet @ Web 2.0 Expo [Last Updated On: May 6th, 2010] [Originally Added On: May 6th, 2010]
- We Rock Hosting, Not Boats [Last Updated On: May 7th, 2010] [Originally Added On: May 7th, 2010]