Awesome Prompt Engineering

repository·main·Indexed 27 days ago

https://github.com/promptslab/awesome-prompt-engineering

A curated repository of resources, research, and tools focused on Prompt Engineering and Context Engineering for Large Language Models (LLMs). It includes a learning path for beginners, surveys on prompting techniques, research on prompt optimization and compression, reasoning advances, agentic prompting, security and red-teaming tools, and a comprehensive list of prompt management, evaluation, and agent frameworks.

Tokens
11.9K
Snippets
14
Records
46
Agent score
42%

What's inside Awesome Prompt Engineering

  1. Overview of Awesome Prompt Engineering

    main
    Awesome Prompt Engineering is a hand-curated collection of resources for Prompt Engineering and Context Engineering. It provides access to research papers, tools, models, APIs, benchmarks, courses, and communities specifically designed for working with Large Language Models (LLMs).
  2. Explore Autonomous Research & Self-Improving Agents

    main

    This section of the Awesome Prompt Engineering repository provides a curated list of tools, frameworks, and research papers focused on autonomous research and self-improving agents. It is categorized into several functional groups:

    • General-Purpose Descendants: Frameworks for recursive self-improvement, autonomous research labs, and agentic optimization (e.g., recursive-improve, auto-research, gemini-autoresearch).
    • Research-Agent Systems: End-to-end pipelines designed for scientific discovery, from hypothesis generation to paper writing (e.g., AI-Scientist, AutoResearch-SibylSystem, AgentLaboratory).
    • Platform Ports & Hardware Forks: Implementations optimized for specific hardware like Apple Silicon (MLX), Windows (RTX), WebGPU, or Jetson AGX Orin.
    • Domain-Specific Adaptations: Agents specialized for fields like genealogy, voice AI, trading, GPU kernel optimization, and software engineering.
    • Evaluation & Benchmarks: Tools to measure agent performance in ML experimentation and general agentic tasks (e.g., MLAgentBench, mle-bench, AgentBench).
    • Related Resources: Curated lists of research papers and optimization methods.
  3. Find Prompt Engineering Communities

    main

    Engage with the community through the following channels:

    Discord Servers

    • Learn Prompting: Largest PE Discord (40k+ members).
    • PromptsLab Discord: Community hub.
    • Midjourney: Primary hub for text-to-image prompting.
    • OpenAI / Anthropic / Hugging Face: Official developer communities.

    Reddit Subreddits

    • r/PromptEngineering: Techniques and discussions.
    • r/LocalLLaMA: Technical discussions on running LLMs locally.
    • r/ChatGPT / r/ClaudeAI: User-centric prompt sharing and model comparisons.

    GitHub Organizations

    • LangChain: LLM application framework.
    • DSPy (Stanford NLP): Systematic prompt optimization.
    • Hugging Face: Central hub for Transformers and Diffusers.
  4. Access Official Provider Prompt Engineering Guides

    main

    For implementation-specific best practices, refer to the official documentation provided by major AI model providers:

  5. Learning Path for Prompt Engineering Beginners

    main

    If you are new to prompt engineering, follow this recommended learning path:

    1. Learn the basics: Complete the ChatGPT Prompt Engineering for Developers course (free, ~90 min).
    2. Read the guide: Use the Prompt Engineering Guide by DAIR.AI for a comprehensive open-source resource.
    3. Study provider docs: Review official documentation from model providers:
    4. Understand field trends: Read Anthropic: Effective Context Engineering for AI Agents.
    5. Read the research: Study The Prompt Report for a taxonomy of over 58 prompting techniques derived from 1,500+ papers.
  6. Explore Major Surveys in Prompt Engineering

    main

    The repository provides a curated list of comprehensive surveys covering various aspects of prompt engineering, including taxonomies of techniques, efficiency-oriented methods, and reasoning topologies. Key surveys include:

    • The Prompt Report: A systematic survey of 58 text and 40 multimodal techniques.
    • Automatic Prompt Engineering (APE) Survey: Formalizes optimization methods as discrete, continuous, or hybrid problems.
    • Efficiency-oriented Survey: Focuses on compression and optimization to reduce compute and latency.
    • Reasoning Surveys: Covers Chain of Thought (CoT), Trees, and Graphs of Thoughts.
    • Goal-oriented Survey: Focuses on prompts designed around explicit task goals.
  7. Access Community Prompt Engineering Resources

    main

    Use these independent and community-driven resources for broad techniques and learning paths:

    • Prompt Engineering Guide (DAIR.AI): A comprehensive open-source guide covering 18+ techniques and context engineering (promptingguide.ai).
    • Learn Prompting: A structured platform for beginners to advanced users, including AI security (learnprompting.org).
    • IBM 2026 Guide: Curated tools and Python-based tutorials (ibm.com/think/prompt-engineering).
    • Anthropic Interactive Tutorial: A hands-on Jupyter notebook course (GitHub).
    • OpenAI Cookbook: Official recipes for RAG, function calling, and complex workflows (GitHub).
  8. Contribute to Awesome Prompt Engineering

    main

    You can contribute to this repository by adding new resources or updating existing ones. Before submitting a contribution, review the contribution guidelines.

    Accepted contributions include:

    • New high-quality papers, tools, or resources (must include a brief description of their value).
    • Updates to existing entries (fixing broken links or outdated information).
    • Corrections to star counts, pricing, or model details.
    • Translations and accessibility improvements.

    Quality Standards:

    • Tools: Must be actively maintained (updated within the last 6 months).
    • Papers: Must be from peer-reviewed venues or have significant community adoption.
    • Datasets: Must be publicly accessible.
    • Descriptions: Every resource must include a one-line description explaining its value.
  9. Prompt Management and Testing Tools

    main

    A collection of tools for managing, testing, and evaluating LLM prompts. Key tools include:

    • Promptfoo: Open-source CLI for testing, evaluating, and red-teaming prompts using YAML configs and CI/CD integration.
    • Promptify: Generates NLP task prompts for models like GPT and PaLM.
    • Agenta: LLM developer platform for prompt management, evaluation, and deployment.
    • PromptLayer: Tool for versioning, testing, and monitoring prompts and agents.
    • Helicone: Production prompt monitoring and optimization.
    • LangGPT: Framework for structured and meta-prompt design.
    • ChainForge: Visual toolkit for building and comparing prompt responses without code.
    • LMQL: A programmable query language for complex prompt logic.
    • Promptotype: Platform for developing and managing structured prompts.
    • PromptPanda: Workflow streamlining for prompt management.
    • Promptimize AI: Browser extension to improve user prompts.
    • PROMPTMETHEUS: Web-based IDE for iterative prompt creation.
    • Better Prompt: Test suite for production-ready prompts.
    • OpenPrompt: Framework for prompt-learning research.
    • Prompt Source: Toolkit for creating and sharing natural language prompts.
    • Prompt Engine: Microsoft's NPM utility for maintaining LLM prompts.
    • PromptInject: Framework for analyzing robustness to adversarial attacks.
    • LynxPrompt: Platform for managing AI IDE config files (e.g., .cursorrules, CLAUDE.md).
    • flompt: Visual AI prompt builder that uses semantic blocks to compile optimized XML.
  10. Compare Meta (Llama) Model Architectures

    main

    Meta's Llama models are available via 25+ cloud partners, Hugging Face, and inference APIs. They include large-scale Mixture-of-Experts (MoE) architectures and dense models.

    | Model | Architecture | Context | Key Feature |
    |:------|:------------|:--------|:------------|
    | Llama 4 Scout | 109B MoE / 17B active | 10M | Fits single H100, multimodal, open-weight |
    | Llama 4 Maverick | 400B MoE / 17B active, 128 experts | 1M | Beats GPT-4o, open-weight |
    | Llama 3.3 70B | Dense | 128K | Matches Llama 3.1 405B |