Content Feed

Discover interesting content about books and writing

Article Feb 7, 01:07 AM

Every Bestseller Formula Is a Lie — Here's the Proof

Every Bestseller Formula Is a Lie — Here's the Proof

In 2016, two researchers from Stony Brook University claimed they'd cracked the code. Feed a novel's text into an algorithm, and it could predict bestseller status with 84% accuracy. Publishers salivated. Writers panicked. And then absolutely nothing changed. Nobody started using the algorithm to greenlight manuscripts. No publishing house restructured its acquisitions around it. The bestseller formula is the literary world's perpetual motion machine — everyone claims to have built one, nobody can demonstrate it works, and yet the search never stops.

Let's be honest about why. The publishing industry loses money on roughly seven out of ten books it releases. Seven out of ten. Imagine running a restaurant where 70% of your dishes made customers leave. You'd be desperate for a recipe that worked, too. So when someone waves a formula around — whether it's an algorithm, a beat sheet, or a TED Talk about "the secret DNA of bestsellers" — publishers and writers alike lean in with the desperate hope of gamblers watching a roulette wheel.

The most famous attempt to bottle lightning is probably the Save the Cat method, adapted from screenwriting to fiction by Jessica Brody. It prescribes fifteen specific "beats" your novel must hit: an opening image, a catalyst at the 12% mark, a midpoint at exactly 50%, a "dark night of the soul" at 75%. It's neat. It's tidy. And if you apply it retroactively, sure, plenty of bestsellers seem to follow it. But here's what nobody mentions: plenty of spectacular failures follow it too. The formula doesn't distinguish between a hit and a flop because following a structural template has roughly the same predictive power as following a horoscope.

Consider the actual history. "Harry Potter and the Philosopher's Stone" was rejected by twelve publishers. Twelve separate teams of professionals, many of whom surely had their own internal formulas and market instincts, looked at what would become the most profitable literary franchise in history and said no. Bloomsbury finally published it, reportedly because the chairman's eight-year-old daughter read the first chapter and demanded more. That's not a formula. That's a child's enthusiasm overruling an industry's collective wisdom.

Or take "The Da Vinci Code." Dan Brown had already published three novels before it — "Digital Fortress," "Angels & Demons," and "Deception Point." Same author, same style, same formula of short chapters and cliffhanger endings. The first three sold modestly. The fourth sold 80 million copies. What changed? Was Dan Brown suddenly 80 million copies better at writing? Of course not. A constellation of factors aligned: timing, marketing, word of mouth, cultural moment, and a generous helping of pure dumb luck.

This is where formula evangelists perform their favorite magic trick: survivorship bias. They study the books that made it, reverse-engineer common traits, and present those traits as causal. It's like studying lottery winners, noticing that most of them bought their tickets on a Tuesday, and concluding that buying tickets on Tuesdays is the key to winning. Jodie Archer and Matthew Jockers did exactly this in their 2016 book "The Bestseller Code," which analyzed thousands of novels and identified patterns in successful ones. The patterns were real. The predictive power was an illusion. Because for every bestseller with a strong female protagonist navigating domestic themes — one of their key findings — there are thousands of unsold manuscripts with the exact same ingredients.

Here's what genuinely kills the formula theory: the books that define eras are almost always the ones that break every existing rule. Cormac McCarthy published "Blood Meridian" with almost no quotation marks, no chapter breaks in the traditional sense, and prose so dense and violent that it reads like the Old Testament on a bad day. It's now considered one of the greatest American novels. "Fifty Shades of Grey" started as Twilight fan fiction and became a global phenomenon despite prose that critics compared to an instruction manual. Andy Weir self-published "The Martian" after every agent rejected it, and it became a bestseller built on math equations and potato farming on Mars. No formula on earth would have greenlit any of these.

The uncomfortable truth is that the publishing industry operates much closer to venture capital than to manufacturing. In venture capital, you fund a hundred startups knowing that ninety-five will fail, four will break even, and one will return a thousand times your investment. Publishing works the same way. The blockbusters subsidize the flops. And just as no venture capitalist has a reliable formula for picking the next unicorn startup, no publisher has a reliable formula for picking the next unicorn book.

But wait — don't craft and skill matter? Absolutely. A well-written book with a compelling story and memorable characters has better odds than a poorly written one. That's not a formula, though. That's like saying a physically fit person has better odds in a marathon than someone who's never run. True, but it doesn't tell you who'll win. The gap between "good enough to potentially succeed" and "will definitely succeed" is a chasm that no formula has ever bridged.

What the formula-seekers consistently miss is the role of cultural timing. "To Kill a Mockingbird" landed in 1960, at the exact moment when America was grappling with civil rights in a way it never had before. "1984" was published in 1949, when the Cold War was crystallizing anxieties about totalitarianism. "Gone Girl" arrived in 2012, when a cultural conversation about the performance of marriage and female rage was reaching a boiling point. These books didn't just ride waves — they were the waves. And you cannot formula your way into being a wave. You can only write honestly and hope the ocean cooperates.

There's also the inconvenient matter of taste. Malcolm Gladwell popularized the idea in "The Tipping Point" that trends follow predictable patterns, but book trends are notoriously fickle. After "The Da Vinci Code," publishers frantically acquired every religious thriller they could find. Almost all of them tanked. After "Twilight," the market was flooded with paranormal romance. Most of it drowned. After "Gone Girl," every thriller needed an unreliable narrator and a twist ending. Readers got bored within two years. Chasing a formula based on what worked last time is like driving by looking only in the rearview mirror.

So what actually works? Here's the deeply unsatisfying answer: write something true. Not true as in factual, but true as in emotionally honest. Every enduring bestseller — from "Pride and Prejudice" to "Where the Crawdads Sing" — has at its core something the author genuinely cared about. You can feel it on the page. Readers aren't algorithms. They're messy, emotional, unpredictable humans who connect with other messy, emotional, unpredictable humans through the medium of story. No formula captures that.

The bestseller formula doesn't work because it's trying to solve the wrong problem. It treats books like products to be engineered when they're actually conversations to be had. And you can't engineer a conversation any more than you can engineer falling in love. You can show up, be interesting, be honest, and be brave enough to say something that might not land. Sometimes it works. Mostly it doesn't. But the times it does — those are the books that change the world. And no algorithm saw them coming.

Article Feb 7, 12:16 AM

The Bestseller Formula: A $28 Billion Lie the Publishing Industry Sells Itself

Every year, some data scientist or retired editor publishes a book claiming they've cracked the code — the secret recipe for a bestseller. Plug in a female protagonist, add a dash of trauma, sprinkle some short chapters, and boom: you're the next Gillian Flynn. There's just one problem. If the formula worked, publishers wouldn't reject 99% of manuscripts. And yet they do. Spectacularly.

The uncomfortable truth is that the publishing industry has a worse prediction record than a coin flip. The same houses that passed on Harry Potter twelve times now spend millions on algorithmic tools promising to identify the next big thing. Let that sink in for a moment: the people whose literal job it is to spot winners couldn't recognize the most profitable book franchise in human history when it landed on their desks. Twelve times.

But the formula-mongers persist. In 2016, Jodie Archer and Matthew Jockers published "The Bestseller Code," claiming their algorithm could predict bestsellers with 80% accuracy. Sounds impressive until you realize that if you simply predicted "this book will NOT be a bestseller" for every single book published, you'd be right about 99.5% of the time. Their algorithm was actually performing worse than pessimism. That's not cracking the code — that's expensive coin-flipping with a PhD attached.

The formula crowd loves to point at patterns. Short chapters sell! (Tell that to Donna Tartt, whose 800-page "The Goldfinch" won a Pulitzer and sold millions.) Relatable protagonists are key! (Humbert Humbert from "Lolita" would like a word — he's a literal monster, and Nabokov's novel is one of the most celebrated books of the twentieth century.) Write what you know! (Tolkien, famously, had never been to Middle-earth. Shocking, I know.)

Here's my favorite bit of formula mythology: the idea that you need a "hook" in the first page or readers will abandon you. Ernest Hemingway opened "A Farewell to Arms" with a description of dust on leaves. Tolstoy started "Anna Karenina" with an aphorism about happy families that has absolutely nothing to do with trains. Gabriel García Márquez began "One Hundred Years of Solitude" by telling you about ice. Ice! These openings break every rule in every "How to Write a Bestseller" seminar, and they're among the most successful novels ever written.

The real problem with the bestseller formula is that it confuses correlation with causation — the cardinal sin of anyone trying to reverse-engineer success. Yes, many bestsellers have certain features in common. Many bestsellers also have covers. Many bestsellers are printed on paper. The presence of shared features doesn't mean those features caused the success. This is like studying billionaires, noticing they all wear shoes, and concluding that shoes make you rich.

Consider the case of "Fifty Shades of Grey." No formula on earth would have predicted that Twilight fan fiction about BDSM, written in prose that made English teachers weep, would sell 150 million copies. Or that a Norwegian philosophy professor's novel about a girl receiving letters from a mysterious philosopher — "Sophie's World" by Jostein Gaarder — would become a global phenomenon. Or that a 1,079-page novel by an unknown writer about a tennis academy and a halfway house — David Foster Wallace's "Infinite Jest" — would become a generation's literary totem. These books have nothing in common except their total disregard for formulas.

The publishing industry's dirty secret is that bestsellers are, at their core, black swan events. Nassim Nicholas Taleb would have a field day with this industry. The distribution of book sales follows a brutal power law: a tiny fraction of titles generate the vast majority of revenue. In any given year, about 500 titles account for more than half of all trade book sales in the United States. That's 500 out of roughly 4 million titles published annually. You have better odds at some casino tables.

So why does the formula myth persist? Because it's comforting. Writing a book is an act of insane optimism — you're spending months or years of your life creating something that statistically almost nobody will read. The formula gives aspiring writers the illusion of control. Follow these seven steps, and you too can quit your day job. It's the literary equivalent of a get-rich-quick scheme, and it preys on the same human weakness: the desperate desire to believe that success is predictable and reproducible.

There's also a cynical business angle. The "how to write a bestseller" industry is itself a bestseller industry. James Patterson's MasterClass, countless writing seminars, shelves of craft books — all selling the dream that the code can be cracked. The irony is thick enough to choke on: the most reliable way to make money from the bestseller formula is to sell the formula, not to use it.

Now, does this mean that craft doesn't matter? Of course not. A well-structured story with compelling characters and clean prose has a better shot than an incoherent mess. But that's not a formula — that's just competence. The difference between a competent book and a bestseller is the difference between a competent singer and Freddie Mercury. You can teach technique. You cannot teach lightning.

What actually makes a bestseller? Timing. Cultural mood. Dumb luck. Word of mouth that catches fire for reasons nobody can predict or replicate. The right book landing in the right hands at the right moment. "Gone Girl" succeeded not because it followed a formula but because it arrived at a cultural moment when readers were hungry for stories about the darkness lurking inside marriages. "The Da Vinci Code" exploded because it combined conspiracy theories with religious controversy at a time when both were in the cultural water supply. You can't engineer these conditions. You can only stumble into them.

So here's my advice, worth exactly what you're paying for it: stop looking for the formula. Write the weird book. Write the book that doesn't fit neatly into a genre. Write the book that your MFA workshop would tear apart. Because the only books that have ever truly mattered — the ones that endured, the ones that changed how we see the world — were written by people who didn't give a damn about formulas. They were too busy being interesting to be strategic. And that, maddeningly, is the only pattern worth noticing.

Nothing to read? Create your own book and read it! Like I do.

Create a book
1x

"Write with the door closed, rewrite with the door open." — Stephen King