Awesome Prompt Engineering
repository·main·Indexed 27 days ago
https://github.com/promptslab/awesome-prompt-engineeringA curated repository of resources, research, and tools focused on Prompt Engineering and Context Engineering for Large Language Models (LLMs). It includes a learning path for beginners, surveys on prompting techniques, research on prompt optimization and compression, reasoning advances, agentic prompting, security and red-teaming tools, and a comprehensive list of prompt management, evaluation, and agent frameworks.
What's inside Awesome Prompt Engineering
- Awesome Prompt Engineering is a hand-curated collection of resources for Prompt Engineering and Context Engineering. It provides access to research papers, tools, models, APIs, benchmarks, courses, and communities specifically designed for working with Large Language Models (LLMs).
Explore Autonomous Research & Self-Improving Agents
mainThis section of the Awesome Prompt Engineering repository provides a curated list of tools, frameworks, and research papers focused on autonomous research and self-improving agents. It is categorized into several functional groups:
- General-Purpose Descendants: Frameworks for recursive self-improvement, autonomous research labs, and agentic optimization (e.g.,
recursive-improve,auto-research,gemini-autoresearch). - Research-Agent Systems: End-to-end pipelines designed for scientific discovery, from hypothesis generation to paper writing (e.g.,
AI-Scientist,AutoResearch-SibylSystem,AgentLaboratory). - Platform Ports & Hardware Forks: Implementations optimized for specific hardware like Apple Silicon (MLX), Windows (RTX), WebGPU, or Jetson AGX Orin.
- Domain-Specific Adaptations: Agents specialized for fields like genealogy, voice AI, trading, GPU kernel optimization, and software engineering.
- Evaluation & Benchmarks: Tools to measure agent performance in ML experimentation and general agentic tasks (e.g.,
MLAgentBench,mle-bench,AgentBench). - Related Resources: Curated lists of research papers and optimization methods.
- General-Purpose Descendants: Frameworks for recursive self-improvement, autonomous research labs, and agentic optimization (e.g.,
Find Prompt Engineering Communities
mainEngage with the community through the following channels:
Discord Servers
- Learn Prompting: Largest PE Discord (40k+ members).
- PromptsLab Discord: Community hub.
- Midjourney: Primary hub for text-to-image prompting.
- OpenAI / Anthropic / Hugging Face: Official developer communities.
Reddit Subreddits
- r/PromptEngineering: Techniques and discussions.
- r/LocalLLaMA: Technical discussions on running LLMs locally.
- r/ChatGPT / r/ClaudeAI: User-centric prompt sharing and model comparisons.
GitHub Organizations
- LangChain: LLM application framework.
- DSPy (Stanford NLP): Systematic prompt optimization.
- Hugging Face: Central hub for Transformers and Diffusers.
Deploy the Awesome Prompt Engineering website to Vercel
mainThe website can be deployed to Vercel. Ensure you set the Vercel root directory towebsite/. No additional configuration is required.Access Official Provider Prompt Engineering Guides
mainFor implementation-specific best practices, refer to the official documentation provided by major AI model providers:
- OpenAI: Covers GPT-4.1/5 prompting, reasoning models, structured outputs, and agentic workflows via the OpenAI Prompt Engineering Guide and the GPT-4.1 Prompting Guide.
- Anthropic: Focuses on iterative design, XML tags, chain-of-thought, and role assignment. Key resources include the Anthropic Prompt Engineering Overview, Claude 4 Best Practices, and Effective Context Engineering for AI Agents.
- Google: Provides Gemini Prompting Strategies for multimodal prompting via Vertex AI and AI Studio.
- Microsoft: Offers guidance on tool calling, function design, and prompt chaining via Azure AI Studio.
Set up the Awesome Prompt Engineering website for development
mainTo run the website locally, navigate to the
websitedirectory, install the dependencies, and start the development server.cd website npm install npm run devLearning Path for Prompt Engineering Beginners
mainIf you are new to prompt engineering, follow this recommended learning path:
- Learn the basics: Complete the ChatGPT Prompt Engineering for Developers course (free, ~90 min).
- Read the guide: Use the Prompt Engineering Guide by DAIR.AI for a comprehensive open-source resource.
- Study provider docs: Review official documentation from model providers:
- Understand field trends: Read Anthropic: Effective Context Engineering for AI Agents.
- Read the research: Study The Prompt Report for a taxonomy of over 58 prompting techniques derived from 1,500+ papers.
Explore Major Surveys in Prompt Engineering
mainThe repository provides a curated list of comprehensive surveys covering various aspects of prompt engineering, including taxonomies of techniques, efficiency-oriented methods, and reasoning topologies. Key surveys include:
- The Prompt Report: A systematic survey of 58 text and 40 multimodal techniques.
- Automatic Prompt Engineering (APE) Survey: Formalizes optimization methods as discrete, continuous, or hybrid problems.
- Efficiency-oriented Survey: Focuses on compression and optimization to reduce compute and latency.
- Reasoning Surveys: Covers Chain of Thought (CoT), Trees, and Graphs of Thoughts.
- Goal-oriented Survey: Focuses on prompts designed around explicit task goals.
Access Community Prompt Engineering Resources
mainUse these independent and community-driven resources for broad techniques and learning paths:
- Prompt Engineering Guide (DAIR.AI): A comprehensive open-source guide covering 18+ techniques and context engineering (promptingguide.ai).
- Learn Prompting: A structured platform for beginners to advanced users, including AI security (learnprompting.org).
- IBM 2026 Guide: Curated tools and Python-based tutorials (ibm.com/think/prompt-engineering).
- Anthropic Interactive Tutorial: A hands-on Jupyter notebook course (GitHub).
- OpenAI Cookbook: Official recipes for RAG, function calling, and complex workflows (GitHub).
Contribute to Awesome Prompt Engineering
mainYou can contribute to this repository by adding new resources or updating existing ones. Before submitting a contribution, review the contribution guidelines.
Accepted contributions include:
- New high-quality papers, tools, or resources (must include a brief description of their value).
- Updates to existing entries (fixing broken links or outdated information).
- Corrections to star counts, pricing, or model details.
- Translations and accessibility improvements.
Quality Standards:
- Tools: Must be actively maintained (updated within the last 6 months).
- Papers: Must be from peer-reviewed venues or have significant community adoption.
- Datasets: Must be publicly accessible.
- Descriptions: Every resource must include a one-line description explaining its value.
Prompt Management and Testing Tools
mainA collection of tools for managing, testing, and evaluating LLM prompts. Key tools include:
- Promptfoo: Open-source CLI for testing, evaluating, and red-teaming prompts using YAML configs and CI/CD integration.
- Promptify: Generates NLP task prompts for models like GPT and PaLM.
- Agenta: LLM developer platform for prompt management, evaluation, and deployment.
- PromptLayer: Tool for versioning, testing, and monitoring prompts and agents.
- Helicone: Production prompt monitoring and optimization.
- LangGPT: Framework for structured and meta-prompt design.
- ChainForge: Visual toolkit for building and comparing prompt responses without code.
- LMQL: A programmable query language for complex prompt logic.
- Promptotype: Platform for developing and managing structured prompts.
- PromptPanda: Workflow streamlining for prompt management.
- Promptimize AI: Browser extension to improve user prompts.
- PROMPTMETHEUS: Web-based IDE for iterative prompt creation.
- Better Prompt: Test suite for production-ready prompts.
- OpenPrompt: Framework for prompt-learning research.
- Prompt Source: Toolkit for creating and sharing natural language prompts.
- Prompt Engine: Microsoft's NPM utility for maintaining LLM prompts.
- PromptInject: Framework for analyzing robustness to adversarial attacks.
- LynxPrompt: Platform for managing AI IDE config files (e.g.,
.cursorrules,CLAUDE.md). - flompt: Visual AI prompt builder that uses semantic blocks to compile optimized XML.
Compare Meta (Llama) Model Architectures
mainMeta's Llama models are available via 25+ cloud partners, Hugging Face, and inference APIs. They include large-scale Mixture-of-Experts (MoE) architectures and dense models.
| Model | Architecture | Context | Key Feature | |:------|:------------|:--------|:------------| | Llama 4 Scout | 109B MoE / 17B active | 10M | Fits single H100, multimodal, open-weight | | Llama 4 Maverick | 400B MoE / 17B active, 128 experts | 1M | Beats GPT-4o, open-weight | | Llama 3.3 70B | Dense | 128K | Matches Llama 3.1 405B |