Discussion about this post

User's avatar
Hollis Robbins's avatar

This is excellent of course. Your claim about the research enterprise is roughly the same as I'm making about the higher ed enterprise: AI cannot produce knowledge that depends on particular people in particular places doing particular work under expert supervision. Universities are supposed to be where expert knowledge transfer happens but instead, most schools deliver generalities at scale.

Gavin's avatar

Great essay!

> Pre-empirical commitments, the values that orient a scientist toward a particular kind of explanation before the data can adjudicate: simplicity, fertility, unification, explanatory depth.

I think Nicholas Maxwell's Aim-Oriented Empiricism framework was a good attempt to make a general solution to this, at least for the domain of fundamental physics:

https://aeon.co/essays/bring-back-science-and-philosophy-as-natural-philosophy

https://www.amazon.com.au/dp/155778924X

> These systems are producing novel hypotheses by synthesizing across vast bodies of literature and data at a scale no individual could match.

It seems like LLMs basically end up doing the old idea of literature-based discovery (LBD) at scale, and it is very impressive. LBD formally relied on explicit linkages between concepts in the literature to infer new ideas, whereas it looks like LLMs can go a bit beyond that and infer new ideas from concepts that are only implicitly linked in the existing literature. But it's not clear how far a datacenter of LLM experts could push into the adjacent possible solely based on a very deep understanding of existing literature - I feel it will become very hallucination-prone and ungrounded from reality the further it goes, so I agree that causal connection with reality will be critical for developing fundamentally new knowledge.

> mechanisms that route practitioners’ surprises back to the researchers who can act on them.

Finding and engaging with communities of practice (or maybe professional societies as a first step) seems like a good way to do this!

5 more comments...

No posts

Ready for more?