AI tricks

Prompt Engineering

• 2025-03: Prompting Science Report 1: Prompt Engineering is Complicated and Contingent
• 2024-06: The Prompt Report: A Systematic Survey of Prompting Techniques

In-Context Learning

• Language Models are Few-Shot Learners

Chain of Thought (CoT)

"Let's think step-by-step"

• TextGrad: Automatic "Differentiation" via Text

Multi-step

Tool-use, feedback, agentic

• ReAct: Synergizing Reasoning and Acting in Language Models

Retrieval-Augmented Generation (RAG)

• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

Generation

• Large Language Models for Data Annotation and Synthesis: A Survey