Science Agents

AI Use-cases for Science

Literature

LLM extract data from papers

• 2024-14: From text to insight: large language models for chemical data extraction

AI finding links in literature

• 2019-07: Unsupervised word embeddings capture latent knowledge from materials science literature
• 2024-11: Large language models surpass human experts in predicting neuroscience results

Autonomous Ideation

• 2024-09: Mining Causality: AI-Assisted Search for Instrumental Variables
• 2024-12: Thinking Fast and Laterally: Multi-Agentic Approach for Reasoning about Uncertain Emerging Events
• 2024-12: LLMs can realize combinatorial creativity: generating creative ideas via LLMs for scientific research
• 2024-12: LiveIdeaBench: Evaluating LLMs' Scientific Creativity and Idea Generation with Minimal Context

Adapting LLMs to Science

• 2023-06: Domain-specific chatbots for science using embeddings
• 2024-10: Personalization of Large Language Models: A Survey
• 2024-11: Adapting While Learning: Grounding LLMs for Scientific Problems with Intelligent Tool Usage Adaptation

AI/ML Methods tailored to Science

Regression (Data Fitting)

• 2024-06: Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data: training on (x,y) pairs enables inferring underlying function (define it in code, invert it, compose it)
• 2024-12: OmniPred: Language Models as Universal Regressors

Tabular Classification/Regression

• 2025-01: Accurate predictions on small data with a tabular foundation model (code)

Symbolic Regression

• 2024-09: Symbolic Regression with a Learned Concept Library

Literature Discovery

• FutureHouse
  • hasanyone
  • PaperQA2
• Lumina
• Automated-AI-Web-Researcher-Ollama
• 2025-01: Search-o1: Agentic Search-Enhanced Large Reasoning Models (project, code)

Commercial

• Cusp AI: Materials/AI

AI/ML Methods co-opted for Science

Mechanistic Interpretability

Train large model on science data. Then apply mechanistic interpretability (e.g. sparse autoencoders, SAE) to the feature/activation space.

• Mechanistic interpretability for protein language models (visualizer, code, SAE)
• Markov Bio: Through a Glass Darkly: Mechanistic Interpretability as the Bridge to End-to-End Biology (quick description, background info on recent bio progress)
• 2023-01: Tracr: Compiled Transformers as a Laboratory for Interpretability (code)
• 2024-12: Towards scientific discovery with dictionary learning: Extracting biological concepts from microscopy foundation models
• 2024-12: InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders
• 2025-01: Insights on Galaxy Evolution from Interpretable Sparse Feature Networks

Uncertainty

• 2024-10: entropix: Entropy Based Sampling and Parallel CoT Decoding
• 2024-10: Taming Overconfidence in LLMs: Reward Calibration in RLHF

Science Benchmarks

• 2024-07: SciCode: A Research Coding Benchmark Curated by Scientists (project)
• 2024-11: AidanBench: Evaluating Novel Idea Generation on Open-Ended Questions (code)
• 2024-12: LiveIdeaBench: Evaluating LLMs' Scientific Creativity and Idea Generation with Minimal Context
• 2025-01: Humanity's Last Exam
• ScienceAgentBench

Science Agents

Reviews

• 2024-10: Empowering biomedical discovery with AI agents
• 2025-01: A review of large language models and autonomous agents in chemistry (github)

Specific

• 2024-01-13: ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterization (video)
• 2024-06-19: LLMatDesign: Autonomous Materials Discovery with Large Language Models
• 2024-08-12: Sakana AI: AI Scientist; The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery (code)
• 2024-09-09: SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning (code)
• 2024-09-11: PaperQA2: Language Models Achieve Superhuman Synthesis of Scientific Knowledge (𝕏 post, code)
• 2024-10-17: Rapid and Automated Alloy Design with Graph Neural Network-Powered LLM-Driven Multi-Agent Systems
• 2024-10-28: Large Language Model-Guided Prediction Toward Quantum Materials Synthesis
• 2024-12-06: The Virtual Lab: AI Agents Design New SARS-CoV-2 Nanobodies with Experimental Validation (writeup: Virtual lab powered by ‘AI scientists’ super-charges biomedical research: Could human–AI collaborations be the future of interdisciplinary studies?)
• 2024-12-11: Google Deep Research
• 2024-12-30: Aviary: training language agents on challenging scientific tasks

Science Multi-Agent Setups

• 2025-01: Agent Laboratory: Using LLM Agents as Research Assistants

AI Science Systems

• 2025-01: Dolphin: Closed-loop Open-ended Auto-research through Thinking, Practice, and Feedback

Inorganic Materials Discovery

• 2023-11: Scaling deep learning for materials discovery
• 2023-11: An autonomous laboratory for the accelerated synthesis of novel materials
• 2024-10: Open Materials 2024 (OMat24) Inorganic Materials Dataset and Models (code, datasets, checkpoints, blogpost)

Chemistry

• 2023-12: Autonomous chemical research with large language models (Coscientist)
• 2024-11: An automatic end-to-end chemical synthesis development platform powered by large language models
• 2025-01: Large language models for reticular chemistry[

Impact of AI in Science

• 2024-11: Artificial Intelligence, Scientific Discovery, and Product Innovation

Related Tools

Literature Search

• Perplexity
• ArXival

Data Visualization

• 2024-10: Data Formulator: Create Rich Visualization with AI iteratively (video, code)
• Julius AI: Analyze your data with computational AI

See Also

• AI agents
• Nanobot.chat: Intelligent AI for the labnetwork @ mtl.mit.edu forum