Tagged: TV Guide Toggle Comment Threads | Keyboard Shortcuts

  • Michael Krakovskiy 4:41 pm on November 17, 2009 Permalink | Reply
    Tags: Algorithm, , , , , COBOL programmer, Coders at work, , , , , , Enterprise Application Software, exaustive algorithms, hapless developer, Lawson Software, Literate programming, , , Pete Cambell, , , , , , , Salesforce.com, sane IT manager, site supervisor, , TV Guide,   

    Semi-literate Programming 

    I recently finished “Coders at Work“, a series of interviews with famous programmers.

    On one hand, reading a book like this is a downer: it’s very clear to me that I occupy a place that is very close to the median of the bell curve, and the skill level of programmers is a very steep non-linear curve in itself. I’ll never be as good as JWZ or Brad Fitzpatrick. But I knew that before, and I am ok with it. On the other hand, this book inspired me to read more code.

    The programmers in the book disagree on many points, but they mostly agree on the importance of writing readable code and educating yourself by reading other people’s code. I make my living writing in scripting languages, and I haven’t written a line of C or C++ since college. But there’s nothing preventing me from downloading and taking a look at the source of Apache, PHP, MySQL.

    It’s important for me to understand “how the sausage is made” in the PHP stack, and as it turns out, what happens between Apache PHP and MySQL in term of requests and timeouts is not as simple as one might think. I asked at StackOverflow about this, but all the diagrams that people pointed me at were of the very rudimentary type: “look, here’s a happy cow, it goes to Bovine University, look – it’s all shrink wrapped on the supermarket shelf” instead of “sausage farm/slaughterhouse/truck/factory tour, starting with cow insemenation”.

    When I downloaded the source code of mod_rewrite, arguably the most useful Apache module in the world, I was amazed to find out that it’s only 5000 lines of C with comments.

    The book ends with the interview of Donald Knuth, and another two major questions that the interviewer is asking everyone is – “have you read Knuth’s books and have you tried literate programming”. It was interesting to find out that most of the famous programmers use Knuth’s the same way that I do. The books sit on my bookshelf, I look at them, I sometimes try to read them, I skip most of the math. They serve as a constant reminder to me that I suck at computer science even more than I suck at programming, and luckily there are people out there who know all of this stuff who are not idiots like me.

    Here’s a photo of my cubicle at TV Guide circa 2002, Knuth’s books are holding a place of honor next to the mini fridge. By the way, taking pictures of the places where you work and live is something that you should not forget to do: years from now nobody will care about those pictures of flowers, shadows, and sunsets, but

    I’ve read the book about Literate Programming at the time, and was rather inspired by it. Ok, maybe I didn’t read it and more like skimmed it. I don’t think I understood what real literate programming is.

    The way I understand it, Literate Programming is a way to write programs as a narrative that is readable to computers and humans. My father, in his former career a site supervisor (a type of a contractor) is very fond of giving very detailed instructions to me, the same way he used to give instructions to construction workers. His instructions usually are exaustive algorithms, with error handling. I think that his instructions, expressed as a flow of conciousness, would work not only on me and construction workers, but on computers as well, and are similar to what Donald Knuth has in mind. All you really have to do is to build a layer of abstraction between these instructions and a computer language. Also, since computers don’t forget things, he would only need to repeat his instructions once.

    These days my dad is a COBOL programmer. Everybody dumps on COBOL, but in my mind it’s a language worth of a lot of respect. It has a syntax that is very English-like, something that makes reading COBOL code easy. Well, maybe it’s like reading some old-timer’s newsgroup post written in all caps, but it’s still much closer to English than most other computer languages.

    At the time I was reading “Literate Programming” I was using ASP 3.0, IIS, and SQL Server 97. My task was to write a system that would account for booked and pending business. This is something that had to be done since the age of Mad Men. You see, the dealings of clients, account executives (like Pete Cambell), their bosses, account coordinators, creative department, etc are rather convoluted. But in the end, to get paid, you have to have a system that will track who brought in what business, who handled what, and how the commissions need to be split.

    This is normally the realm of something called EAS (Enterprise Application Software). Back at the turn of the century, this area was still dominated by a company called SAP, but there were a few smaller players, like Salesforce.com that tried to package these applications. Any sane IT manager looks to see if an EAS solution can be purchased first. It turned out that TV Guide’s buseness logic was impossible to shoehorn into any existing solution. SAP folks said – yeah, no problem, we’ll build you what you want, but our prices start at $1M, and then there are consultant fees. ERM world is a crazy place, you can read about some true craziness in “Cube Farm”, an account of one hapless developer’s adventures at Lawson Software. It’s a truly riveting book, and I fell that every developer out there should read it. It’s literally Lovecraftian in nature, that book.

    In any case, it fell to me to develop the application from scratch. Inspired by Knuth, I decided to write some semi-literate code. Me and a project manager, Brad, went to the clients and interviewed them at length, documenting their existing process (aka the most complicated set of spreadsheets you’ve ever seen). In the past, before cheap computers, all you needed was a Joan Holloway, but I believe they stopped making them.

    Brad went on to go back and forth with a very terse document about 5 pages in length that described how the new system would work. He would sit down with the clients and go through the narrative, step by step, confirming that this is what they wanted. Meanwhile I created an object oriented library that made dealing with the database, creating forms and navigation elements much easier. This is similar to to what you might find in a CMS like Drupal, only a little cruder.

    When the document shaped up, I created the database schema, and then I took a big chunk of the document and pasted it into one huge comment block. I proceeded to break off chunks of that block and writing the code around it. Interestingly enough, as time went on, the project manager started helping me to write the code: enough of scary database abstration was hidden by simple classes and method, and there were tons of self-evident examples all around to copy and paste. I switched to writing reports that involved cubes, rollups and other fancy stuff. Stored procedures that did the reports also received comments from the document that described the reports.

    This wasn’t a monolythic system – I was writing it for 2 years or so, releasing a chunk after chunk. In the end it was handed off to another developer, the whole transfer took only a couple of hours. There weren’t any major bugs, maintanence issues (I believe I received only one phone call about it after several years of continuous use). All in all I was pretty pleased with this approach and can absolutely recommend it.

    I believe this is the reason why so many English majors become excellent programmers: if you can write for people, you can write for computers. Sometimes there are reasons why you can’t do both at the same time, but there’s no reason not to find some middle ground.

  • Michael Krakovskiy 12:10 pm on May 3, 2007 Permalink | Reply
    Tags: , , changing technologies, , , CueCat, , , , , , , Library 2.0, LibraryThing, Martin Eberhard, , , online tool, , , Social cataloging applications, , , Sony eInk, TV Guide, ,   


    When I attended a party thrown by Joel Spolsky at his apartment, I got to browse through his library. Joel’s library was somewhat bigger and better organized than mine, but with a significant overlap: on almost every shelf I encountered at least several books that I already had or had in my wishlist.

    Keeping a large library is something that I feel a little guilty about. Living space is precious and books take up a lot of it. One of my livejournal friends told me that he does not keep more than a small bookshelf of books at home (although he reads more than I do). Once he’s done with a book he either sells it at Half Price Books or gives it to a friend or acquaintance.

    So why do I keep all the books? Besides the obvious vanity: look how sophisticated and edjumacated I am, there are other, more subtle reasons. When I was little, my father had an even bigger library. It was a great: exploring hundreds of books right at home was a great joy. My bed was located right under a huge bookshelf – if I wanted some bedtime reading all I had to do was to stretch my hand.

    Joel put it best that evening: he feels that if somebody would read all the books that he has read, that person would start thinking similarly. A library is a sort of a mind dump, a memex chain. It becomes a part of who you are. Giving my library up would be extremely difficult for me. Call it the collector’s instinct, a fetish – it does not matter. Some poor people just are attached to physical books.

    One of the reasons I got a job at TV Guide was because at the time it purchased two most promising eBook companies, NuvoMedia and Softbook. It thought that the electronic revolution would finally happen and we’d be reading from small electronic tablets, like on Star Trek. I do love paper books, but the promise of instant gratification and the library in a chip that was promised to us so long ago was even more tempting.

    Sadly, the two companies were deprived of resources and smothered. I still think that the tablet reader is in our near future, and the Sony eInk tablet is a step in the right direction, although I am so displeased with Sony for a number of reasons (about which I’ll rant some other time) that I refuse to buy any of their products. In any case, my former co-worker Martin Eberhard, the founder of NuvoMedia (maker of the more successful and practical RocketBook) is now building awesome electric cars. I really wish I had a chance to interact with him at TVG — I share his fascination with Tesla and world changing technologies.

    Since the ebook revolution is not coming any time soon, I finally decided to do something about keeping my books organized and joined LibraryThing. LibraryThing is a great online tool that allows you to create a catalog of your books by either typing in an ISBN number or book title. The interface is super usable. To make cataloging even faster I dug out my good ‘ol CueCat that I “declawed” back in the day. Seeing how crappy it was, I broke down and bought a real usb laser barcode scanner off eBay. It works like a charm – there’s a rotating laser inside and everything. Indeed, you get what you pay for.

    I simply scan the barcode (if there’s one) or type in the title, add a tag that contains a shelf number – and that’s it. Now if I need to find a book I can simply search for it and find out which shelf it’s on. I don’t really need a more exact location. So far I’ve entered about 250 books. This covers the kitchen, bathroom and a couple of shelves in the living room. Altogether I have 2 Ikea Billys in the living room, 2 in one bedroom and 3 in another. In my estimation there should be at least 2000 books in my library, although a friend of mine thinks that it’s more like 1000. We’ll see who’s right once I’ll finish the catalog. My friend estimated (conservatively) that I spent about $5 per book, so my books must have cost me $5-10K. I feel kind of like Carrie from Sex and the City who had about $40K worth of Blahniks in her closet.

  • Michael Krakovskiy 6:07 pm on April 24, 2007 Permalink | Reply
    Tags: , , , , , Pyotr Andreyevich Tolstoy, , , , Tolstoy family, TV Guide   

    Dreamblog: Having a Ball 

    Two nights in a row I had dreams about attending balls. The first dream had me hanging out with Count Pyotr Andreyevich Tolstoy in 1700s. This is pretty easy to explain — I am reading a book about the Tolstoys.

    This morning I had another dream, where I was at a Newscorp ball at the Hilton and talked to Rupert Murdoch. He completely agreed with all the things that I proposed to be done at TV Guide and I woke up very pleased with myself.

Compose new post
Next post/Next comment
Previous post/Previous comment
Show/Hide comments
Go to top
Go to login
Show/Hide help
shift + esc