https://github.com/dair-ai/Prompt-Engineering-Guide Skip to content Toggle navigation Sign up * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code + Explore + All features + Documentation + GitHub Skills + Blog * Solutions + For + Enterprise + Teams + Startups + Education + By Solution + CI/CD & Automation + DevOps + DevSecOps + Case Studies + Customer Stories + Resources * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles + Repositories + Topics + Trending + Collections * Pricing [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this organization All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} dair-ai / Prompt-Engineering-Guide Public * * Notifications * Fork 253 * Star 4.3k Guides, papers, lecture, and resources for prompt engineering License MIT license 4.3k stars 253 forks Star Notifications * Code * Issues 1 * Pull requests 1 * Actions * Projects 0 * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Security * Insights dair-ai/Prompt-Engineering-Guide This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. main Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags Name already in use A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch? Cancel Create 2 branches 0 tags Code * Local * Codespaces * Clone HTTPS GitHub CLI [https://github.com/d] Use Git or checkout with SVN using the web URL. [gh repo clone dair-a] Work fast with our official CLI. Learn more. * Open with GitHub Desktop * Download ZIP Sign In Required Please sign in to use Codespaces. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching Xcode If nothing happens, download Xcode and try again. Launching Visual Studio Code Your codespace will open once ready. There was a problem preparing your codespace, please try again. Latest commit @omarsar omarsar Merge pull request #22 from paulosalem/main ... 4a4f64d Feb 21, 2023 Merge pull request #22 from paulosalem/main Adds a new tutorial regarding building whole applications with GPT-3. 4a4f64d Git stats * 228 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time .github Create FUNDING.yml February 1, 2023 18:22 guides multimodal CoT February 21, 2023 01:15 img multimodal CoT February 21, 2023 01:15 lecture add lecture slides February 19, 2023 07:51 notebooks add lecture slides February 19, 2023 07:51 .gitignore more notes February 18, 2023 21:30 CITATION.cff Update CITATION.cff January 28, 2023 15:34 LICENSE.md Create LICENSE.md December 17, 2022 14:12 README.md Merge pull request #22 from paulosalem/main February 21, 2023 15:39 View code [ ] Prompt Engineering Guide Table of Contents Lecture Guides Papers Tools & Libraries (Sorted by Name) Datasets (Sorted by Name) Blog, Guides, Tutorials and Other Readings (Sorted by Name) README.md Prompt Engineering Guide This guide contains a set of recent papers, learning guides, and tools related to prompt engineering. The repo is intended as a research and educational reference for practitioners and developers. Announcements: * Prompt Engineering Lecture is live here! It Includes notebook and slides. * Join our Discord * Follow us on Twitter --------------------------------------------------------------------- Table of Contents * Lecture * Guides * Papers * Tools & Libraries * Datasets * Blog, Guides, Tutorials and Other Readings --------------------------------------------------------------------- Lecture We have published a 1 hour lecture that provides a comprehensive overview of prompting techniques, applications, and tools. * Video Lecture * Notebook with code * Slides --------------------------------------------------------------------- Guides The following are a set of guides on prompt engineering developed by us. Guides are work in progress. * Prompt Engineering - Introduction * Prompt Engineering - Basic Prompting * Prompt Engineering - Advanced Prompting * Prompt Engineering - Adversarial Prompting * Prompt Engineering - Miscellaneous Topics --------------------------------------------------------------------- Papers The following are the latest papers (sorted by release date) on prompt engineering. We update this on a daily basis and new papers come in. We incorporate summaries of these papers to the guides above every week. * Surveys / Overviews: + Augmented Language Models: a Survey (Feb 2023) + A Survey for In-context Learning (Dec 2022) + Towards Reasoning in Large Language Models: A Survey (Dec 2022) + Emergent Abilities of Large Language Models (Jun 2022) + A Taxonomy of Prompt Modifiers for Text-To-Image Generation (Apr 2022) + Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing (Jul 2021) * Approaches/Techniques: + Scalable Prompt Generation for Semi-supervised Learning with Language Models (Feb 2023) + Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints (Feb 2023) + A-la-carte Prompt Tuning (APT): Combining Distinct Data Via Composable Prompting (Feb 2023) + GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks (Feb 2023) + The Capacity for Moral Self-Correction in Large Language Models (Feb 2023) + SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domains (Feb 2023) + Evaluating the Robustness of Discrete Prompts (Feb 2023) + Compositional Exemplars for In-context Learning (Feb 2023) + Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discovery (Feb 2023) + Multimodal Chain-of-Thought Reasoning in Language Models (Feb 2023) + Large Language Models Can Be Easily Distracted by Irrelevant Context (Feb 2023) + Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models (Feb 2023) + Progressive Prompts: Continual Learning for Language Models (Jan 2023) + Batch Prompting: Efficient Inference with LLM APIs (Jan 2023) + On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning (Dec 2022) + Constitutional AI: Harmlessness from AI Feedback (Dec 2022) + Successive Prompting for Decomposing Complex Questions (Dec 2022) + Discovering Language Model Behaviors with Model-Written Evaluations (Dec 2022) + Structured Prompting: Scaling In-Context Learning to 1,000 Examples (Dec 2022) + PAL: Program-aided Language Models (Nov 2022) + Large Language Models Are Human-Level Prompt Engineers (Nov 2022) + Ignore Previous Prompt: Attack Techniques For Language Models (Nov 2022) + Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods (Nov 2022) + Teaching Algorithmic Reasoning via In-context Learning (Nov 2022) + Enhancing Self-Consistency and Performance of Pre-Trained Language Models through Natural Language Inference (Nov 2022) + Ask Me Anything: A simple strategy for prompting language models (Oct 2022) + ReAct: Synergizing Reasoning and Acting in Language Models (Oct 2022) + Prompting GPT-3 To Be Reliable (Oct 2022) + Decomposed Prompting: A Modular Approach for Solving Complex Tasks (Oct 2022) + Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought (Oct 2022) + Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples (Sep 2022) + Promptagator: Few-shot Dense Retrieval From 8 Examples (Sep 2022) + On the Advance of Making Language Models Better Reasoners (June 2022) + Large Language Models are Zero-Shot Reasoners (May 2022) + MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning (May 2022) + Toxicity Detection with Generative Prompt-based Inference (May 2022) + Learning to Transfer Prompts for Text Generation (May 2022) + The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning (May 2022) + A Taxonomy of Prompt Modifiers for Text-To-Image Generation (Apr 2022) + PromptChainer: Chaining Large Language Model Prompts through Visual Programming (Mar 2022) + Self-Consistency Improves Chain of Thought Reasoning in Language Models (March 2022) + Training language models to follow instructions with human feedback + Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? (Feb 2022) + Chain of Thought Prompting Elicits Reasoning in Large Language Models (Jan 2022) + Show Your Work: Scratchpads for Intermediate Computation with Language Models (Nov 2021) + Generated Knowledge Prompting for Commonsense Reasoning (Oct 2021) + Multitask Prompted Training Enables Zero-Shot Task Generalization (Oct 2021) + Reframing Instructional Prompts to GPTk's Language (Sep 2021) + Design Guidelines for Prompt Engineering Text-to-Image Generative Models (Sep 2021) + Making Pre-trained Language Models Better Few-shot Learners (Aug 2021) + Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity (April 2021) + BERTese: Learning to Speak to BERT (April 2021) + The Power of Scale for Parameter-Efficient Prompt Tuning (April 2021) + Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm (Feb 2021) + Calibrate Before Use: Improving Few-Shot Performance of Language Models (Feb 2021) + Prefix-Tuning: Optimizing Continuous Prompts for Generation (Jan 2021) + AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts (Oct 2020) + Language Models are Few-Shot Learners (May 2020) + How Can We Know What Language Models Know? (July 2020) * Applications: + Grimm in Wonderland: Prompt Engineering with Midjourney to Illustrate Fairytales (Feb 2023) + LabelPrompt: Effective Prompt-based Learning for Relation Classification (Feb 2023) + Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition (Feb 2023) + The Capacity for Moral Self-Correction in Large Language Models (Feb 2023) + Prompting for Multimodal Hateful Meme Classification (Feb 2023) + PLACES: Prompting Language Models for Social Conversation Synthesis (Feb 2023) + Commonsense-Aware Prompting for Controllable Empathetic Dialogue Generation (Feb 2023) + Crawling the Internal Knowledge-Base of Language Models (Jan 2023) + Legal Prompt Engineering for Multilingual Legal Judgement Prediction (Dec 2022) + Investigating Prompt Engineering in Diffusion Models (Nov 2022) + Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering (Sep 2022) + Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Language (Oct 2022) + Piloting Copilot and Codex: Hot Temperature, Cold Prompts, or Black Magic? (Oct 2022) + Plot Writing From Scratch Pre-Trained Language Models (July 2022) * Collections: + Chain-of-ThoughtsPapers + Papers with Code + Prompt Papers --------------------------------------------------------------------- Tools & Libraries (Sorted by Name) * AI Test Kitchen * betterprompt * DreamStudio * DUST * Dyno * EveryPrompt * GPT Index * GPTTools * hwchase17/adversarial-prompts * Interactive Composition Explorer * LangChain * LearnGPT * Lexica * loom * Metaprompt * OpenAI Playground * OpenPrompt * Playground * Prodia * Prompt Base * Prompt Engine * Prompt Generator for OpenAI's DALL-E 2 * Promptable * PromptInject * Prompts.ai * PromptSource * Scale SpellBook * sharegpt * ThoughtSource * Visual Prompt Builder --------------------------------------------------------------------- Datasets (Sorted by Name) * Anthropic's Red Team dataset, (paper) * Awesome ChatGPT Prompts * DiffusionDB * Midjourney Prompts * P3 - Public Pool of Prompts * PartiPrompts * Real Toxicity Prompts * Stable Diffusion Dataset * WritingPrompts --------------------------------------------------------------------- Blog, Guides, Tutorials and Other Readings (Sorted by Name) * 3 Principles for prompt engineering with GPT-3 * A beginner-friendly guide to generative language models - LaMBDA guide * A Complete Introduction to Prompt Engineering for Large Language Models * A Generic Framework for ChatGPT Prompt Engineering * AI Content Generation * Awesome ChatGPT Prompts * Best 100+ Stable Diffusion Prompts * Best practices for prompt engineering with OpenAI API * Building GPT-3 applications -- beyond the prompt * ChatGPT, AI and GPT-3 Apps and use cases * CMU Advanced NLP 2022: Prompting * Curtis64's set of prompt gists * DALL*E 2 Prompt Engineering Guide * DALL*E 2 Preview - Risks and Limitations * DALLE Prompt Book * DALL-E, Make Me Another Picasso, Please * Diffusion Models: A Practical Guide * Exploiting GPT-3 Prompts * Exploring Prompt Injection Attacks * Extrapolating to Unnatural Language Processing with GPT-3's In-context Learning: The Good, the Bad, and the Mysterious * Generative AI with Cohere: Part 1 - Model Prompting * Giving GPT-3 a Turing Test * GPT3 and Prompts: A quick primer * How to Draw Anything * How to get images that don't suck * How to write good prompts * Introduction to Reinforcement Learning with Human Feedback * In defense of prompt engineering * Language Models and Prompt Engineering: Systematic Survey of Prompting Methods in NLP * Learn Prompting * Methods of prompt programming * Mysteries of mode collapse * NLP for Text-to-Image Generators: Prompt Analysis * NLP with Deep Learning CS224N/Ling284 - Lecture 11: Promting, Instruction Tuning, and RLHF * Notes for Prompt Engineering by sw-yx * OpenAI Cookbook * OpenAI Prompt Examples for several applications * Pretrain, Prompt, Predict - A New Paradigm for NLP * Prompt Engineering 101 - Introduction and resources * Prompt Engineering 101: Autocomplete, Zero-shot, One-shot, and Few-shot prompting * Prompt Engineering 101 * Prompt Engineering - A new profession ? * Prompt Engineering by co:here * Prompt Engineering by Microsoft * Prompt Engineering: The Career of Future * Prompt engineering davinci-003 on our own docs for automated support (Part I) * Prompt Engineering Guide: How to Engineer the Perfect Prompts * Prompt Engineering in GPT-3 * Prompt Engineering Template * Prompt Engineering Topic by GitHub * Prompt Engineering: From Words to Art * Prompt Engineering with OpenAI's GPT-3 and other LLMs * Prompt injection attacks against GPT-3 * Prompt injection to read out the secret OpenAI API key * Prompting in NLP: Prompt-based zero-shot learning * Prompting Methods with Language Models and Their Applications to Weak Supervision * Prompts as Programming by Gwern * Reverse Prompt Engineering for Fun and (no) Profit * So you want to be a prompt engineer: Critical careers of the future * Simulators * Start with an Instruction * Talking to machines: prompt engineering & injection * the Book - Fed Honeypot * The ChatGPT Prompt Book * Using GPT-Eliezer against ChatGPT Jailbreaking * What Is ChatGPT Doing ... and Why Does It Work? --------------------------------------------------------------------- Feel free to open a PR if you think something is missing here. Always welcome feedback and suggestions. About Guides, papers, lecture, and resources for prompt engineering Topics deep-learning prompt-engineering Resources Readme License MIT license Stars 4.3k stars Watchers 91 watching Forks 253 forks Releases No releases published Sponsor this project Sponsor Learn more about GitHub Sponsors Packages 0 No packages published Contributors 11 * @omarsar * @JamesZhutheThird * @trigaten * @leondz * @ss18 * @dominiksipowicz * @chuanqisun * @mihail911 * @sadrab10 * @mikhail-bot * @thorbjoernheise Languages * Jupyter Notebook 100.0% Footer (c) 2023 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.