Here’s are the slides of my talk today on Early Tools For Thought.

Update: Recorded talk is here.

by Karen O’Brien and Brian Young, eds.

Get the book.

In Catalonia for the Hypertext Conference, we saw plenty of Roman ruins. Some, like Tarragona, I expected, but others (Emporias!) were a remarkable surprise. On the way home, I had a nice dip into the Decline and Fall. One night, wanting to look beyond my familiar reading stack, I grabbed this. What fun!

Gibbon published the start of The Decline And Fall of the Roman Empire in 1776. His cadences have the resonance of that era’s best writing, and he is a subtly funny writer, the master of adding a footnote or choosing an extra adjective to turn a statement on its head. This volume is filled with finely-written, accessible and engaging pieces on such topics as Gibbon’s style, his library and note-taking practices, and his knowledge of the city of Rome. More fun than a book like this has any right to be.

by Hope Jahren

Get the book.

The engaging autobiography of a paleo-botanist, Lab Girl is really the best portrait I know of the reality of contemporary research. Jahren is filled with doubts: the book opens with a dedication to Jahren’s mother, but it soon becomes clear that Jahren and her mother never got along. Jahren faces more than the usual share of academic obstacles, as she endures periodic episodes of psychosis in addition to conventional sexism on the way to tenure. Jahren emphasizes the poverty of so much contemporary science; through much of her career she was unable to pay her lab tech anything like a living wage, so he spent years teaching at major universities while sleeping in his car or under a lab bench. There’s a wonderful set-piece tribute to homemade scientific instruments, really the only thing I know that comes close to capturing the reality. “Do not over-tighten me,” says a tag on one fastener, a label of poetic conciseness to those of us who have been there.

by R. F. Kuang

Get the book.

A well-crafted alternative history of the British Empire and its industrial revolution, in which steam power only becomes practical after scholars have harnessed the magical powers of silver. Silver in this world has the ability to release the missing elements that separate words in different languages but share common roots: French treácle (antidote): English treacle (sweet), for example, is medicinal. Four young Oxford undergraduates arrive from the corners of Empire: Calcutta, Canton, Port-au-Prince, and the daughter of an admiral. Two are women. Two are black; the boy from Canton can sometimes pass. They are to be trained to supply the magic power that powers the empire.

The catch here is that the students know too many post-colonial ideas, and too little history. They’re entirely convincing until they speak about the political and economic ideas at the heart of the story. When they do, they suddenly sound like contemporary undergraduates at top schools who have learned to problematize and interrogate from a tender age. Kuang is absolutely convincing on 19th-century Oxford slang, and if anything minimizes its racism. But we’re a half-century before Shaw’s first plays — and Shaw saw himself as a radical. At the time of the novel, Frederick Douglass was only at the start of his career. The students are intended to be brilliant, but they seem to know W. E. B. Du Bois decades before his birth.

I was interviewed by information architect Jorge Arango on The Informed Life.

Here’s an interesting example of software development in practice.

A customer was experiencing intermittent Tinderbox crashes. I asked to see the crash logs and any future crash logs. This question sometimes clears up a problem, because sometimes the crashes stop! But not this time; over a few days, we accumulated a few logs.

The crash logs varied a bit, but all seemed to involve export. “Did it crash while you were exporting?” The user didn’t think so. (That was a head scratcher. It’s not uncommon for users who experience a crash to have no idea what they were doing before the crash, but Export is fairly unusual and sometimes takes a while because you might be building a site with hundreds of pages. You’d probably remember if you were waiting for Tinderbox to finish and instead it quit. Hmmmm.)

A number of the crash logs revealed a crash in TbxProgressBar. That was interesting, because it's not usually a place where Tinderbox has trouble. I studied the code, and there’s a reason for that: as far as I can make out, TbxProgressBar simply cannot crash. I bullet-proofed the code, which was already bullet-proofed. I wrote some tests. I hoped for the best. No luck!

This left some twilight zone possibilities. Was something fouling up the TbxProgressBar object? I remember one pesky bug, ages ago, that was tracked down to a faulty memory chip right where one object tended to wind up. Could I be looking at the wrong version of the TbxProgressBar code? Was this a time-bomb crash, somehow planted by code that ran earlier? (Time bombs used to be really common, back before OS X. I haven't seen one in years, but who knows?)

After far too long, I asked the customer to take a look at Activity Monitor. What was Tinderbox’s memory footprint? The footprint was huge. Now, worrying about activity monitor is often pointless: Tinderbox uses a lot of memory because you have lots of memory to use. You have lots of memory and not enough time. This was said to be a complicated document, but nonetheless, the footprint was too big.

Finally, wiring up the document to the profiler, the answer emerged at once: a memory leak in ExportPathAttribute. This is a seldom-used, read-only attribute that tells you where this page will wind up if it's exported to disk. For years, each use of ExportPathAttribute has leaked — not much, but a drip. If you were editing a weblog and then exporting to your server, well, you might have wasted some kilobytes, but you wouldn’t notice that at all.

In the last year or so, however, a new approach to Tinderbox notes has become popular; people write their notes in Markdown or HTML, and when they read their notes, they use the Preview pane. This Preview-led Tinderbox isn’t what I’d designed, and it sometimes feels like Obsidian-in-Tinderbox or something like that, but in skilled hands it can be pretty cool. And this customer was really skilled!

So, we had a complex Tinderbox document with lots of actions and lots of agents, that was spending a lot of time in Preview. That meant Tinderbox was responding to changes from rules and agents and running a new Preview every few seconds. Preview was reaching out to rebuild a complex page by assembling lots of individual notes in a big overview. A few kilobytes every 3 seconds is a few megabytes every 5 minutes. Leave that cooking for a day or two, and hilarity is bound to ensue.

Why TbxProgressBar? Because Tinderbox updates the progress bar a lot during preview. Too much, clearly, but again: if preview is fast enough, who cares if it's updating a hidden progress bar and doing extra work? But that’s where we often were when we wanted to reach for some memory and the system said, “More? You want more?”

And why did we have a leak in the first place? A decade or more back, Tinderbox adopted an optimistic approach to concurrency: agents ran in the background, and most of the time everything was OK. But “most of the time” isn’t really good enough, and perhaps four years ago I started to put this on a sounder basis. That meant taking a lot more care to make sure that we weren't writing a value in one thread at the same time we were reading it in another thread. That process has tests for all the common and tricky attributes like $Text, and most of the attribute classes are designed to handle everything themselves. But, somehow, ExportPathAttribute never got the memo.

It simply didn’t matter, until it did.