Insights & Perspectives
Ideas for real-world impact.
How Pharma Leaders Should Budget for AI
The usual approach pharma leaders take in building next year's budget breaks down completely when it comes to AI. Nobody knows where the frontier will be by April 2027, let alone 2028. Yet we see orgs locking in roadmaps this autumn that run to March 2028 because their planning loop has a two-year horizon. So, how to budget more appropriately for AI projects?
What Stays Useful After the Next Model
A pharma company that builds its own model to predict compound toxicity owns something valuable, but it'll be out of date within a few years. The same company likely also owns several things it will keep using after it retires the model, and it would struggle to replace any of them. These are assets worth investing in.
Nobody Can Tell You Where Your Data Goes
Pharma leaders running AI-assisted drug discovery are assuming that their contracts – with frontier labs and model providers – will keep their data safe. The truth is, even if the contract itself is solid and the vendor has the best of intentions, there is still significant risk to your data.
Stop Chasing Every AI Model
AI labs are pumping out models faster than anyone can meaningfully evaluate them. If you treat every viral launch as a priority, you’ll get exhausted, and your team will get distracted. Decide in advance which launches get your attention and which you let pass. Base your decision-making on the problems your team actually needs to solve, not how loud the launch was.
Stop Guessing About Your AI Maturity
Frontier AI labs are making massive leaps. There’s an explosion of research, accelerating in every industry. Then you look around at your own AI org, and progress feels... underwhelming. It’s easy to lay the blame on bad data, small budgets, or the wrong headcount, but the real problem is your org’s AI maturity — whether or not you understand the level you’ve reached, and what you need to work on next. We've built a tool to give you a clear picture of exactly these things — the AI Org Maturity Assessment.
Why Research Agility Is the Most Important AI Metric You’re Not Tracking
ML infrastructure is painfully finicky, and using it entails managing a dozen irrelevant technical details just to do basic research. There are ideas that researchers don’t let themselves have, because engaging with them would mean weeks of infrastructure-wrangling before anyone gets to learn a thing. Sooner or later, your infrastructure starts setting your research agenda. We measure this as Research Agility; and it might be the most important metric in your organization.
Data Is A Process, Not A Project
An uncomfortable claim: In pharma, biotech, and any serious applied AI, projects almost never fail because of the model. They fail because of the data. Everyone agrees that data matters, but not everyone is interested in funding the work needed to keep it useful. Data work has to run as a standing program, owned, scheduled, and budgeted, not as a one-time cleanup at the start of a project.
Are My Evals Lying to Me?
For any model tackling any problem, the hardest part of evaluation is keeping the metric aligned with reality. An evaluation is just a measurement tool, and tools can be miscalibrated, biased, or simply pointed at the wrong thing. The urgent question is less: “Are my evals lying to me?” (They are, or they soon will be.) Instead, it’s: “When my evals do lie, how will I know — and what can I do about it?”
Hiring Software Engineers in a ChatGPT World
While large language models (LLMs) have made many routine tasks easier, they have made hiring much harder. How can we discern the authentic candidates from the AI-generated ones?
Sweet and Simple: AI Techniques Explained
Just like success in business often comes down to fundamentals, there are a handful of AI techniques that power most modern business applications.
Crafting a Winning AI Strategy: Critical Questions for Executives
As an executive, you're likely facing the challenge of creating an AI strategy that drives real value for your organization. We've identified two levels of questions that can serve as the pillars of a robust AI strategy.
Four Truths About AI Strategies
Before building your AI strategy, it's helpful to consider some foundational truths. These are some things we believe about AI strategies that are not necessarily widely understood.
Unproductive Claims about AI in 2024
I'm all for reasonable disagreements, but I find a lot of the current conversation around generative AI relatively unproductive. Here are some of the phrases that people use almost axiomatically that I don't think are actually true.
How Does the Agile Manifesto Apply to Research Engineering?
Agile methodology is widely used and well understood in software engineering. However, there are some unique considerations when it comes to employing Agile within ML engineering specifically.
Online Connections Are a Remote Substitute for Real Life
Technology offers many benefits in our day-to-day lives, including social opportunities not possible without it. However, awareness of its limitations, as well as our fundamental need for real-life connection, is key to staying healthy.
Beyond Prompt Engineering: The Toolkit for Getting LLMs to Do What You Want, Part 2
Prompt engineering, fine tuning, and LLM chaining are most commonly considered in guiding LLM behavior. In this post, we cover three more tools, from de rigueur for complex LLM applications to speculative techniques that may not be production-ready for some time.
Beyond Prompt Engineering: The Toolkit for Getting LLMs to Do What You Want, Part 1
When creating LLM applications, a lot of emphasis is on the foundation model underpinning the app. Most likely you’ll want to modify the behavior of that model; here are some techniques for achieving that behavior modification, from well-trod to exploratory.
Hear Me Out: The Potential of Low-Latency Voice AI
Picture this: two users need advice on a health issue. One employs an AI text interface, resulting in a plan that leaves them feeling informed and empowered. A voice interface leads the other through a back-and-forth conversation with the AI; they feel cared for, supported. Same need, two very different experiences. All because of the interface.
Leashing Your LLM: Practical and Cost-Saving Tips for Staying on Topic
The general nature of LLMs makes them inherently powerful but notoriously difficult to control. Operators must defend against unintended and potentially risky interactions. Our team has investigated many of the relatively nascent solutions out there for this issue; we share what we’ve learned in this post.
The Most Important Uses for LLMs Aren’t Chatbots
We love chatbots – ChatGPT and others in its class are amazing tools – but, as an AI consultancy with a long history of projects in the space before the current mania, we’re sensitive to the conflation of LLMs and chatbots. Many of the most exciting potential uses for LLMs have little to do with the chatbot interface, and we think those should get more attention.