Difference between revisions of "AI research trends"

From GISAXS
Jump to: navigation, search
(Neural (non-token) Latent Representation)
(Updating Weights at Inference-time)
Line 48: Line 48:
  
 
=Updating Weights at Inference-time=
 
=Updating Weights at Inference-time=
 +
* 2024-10: [https://arxiv.org/abs/2410.23168 TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters]
 
* 2025-01: [https://arxiv.org/abs/2501.06252 Transformer<sup>2</sup>: Self-adaptive LLMs]
 
* 2025-01: [https://arxiv.org/abs/2501.06252 Transformer<sup>2</sup>: Self-adaptive LLMs]
  

Revision as of 11:28, 14 February 2025

Novel Tokenization and/or Sampling

System 2 Reasoning

See: Increasing AI Intelligence

Memory

LLM Weights Memory

Context Length

Extended Context

Retrieval beyond RAG

See also: AI tools: Retrieval Augmented Generation (RAG)

Working Memory

Episodic Memory

Updating Weights at Inference-time

Internal Thought Representation Space

Visual Thinking

Neural (non-token) Latent Representation

See Also