https://steveblank.com/2025/06/10/teaching-national-security-policy-with-ai/ * Home * About Steve * Startup Books * Slides/Videos * Fund Raising * Tools! * Secret History [cropped-10] [bg_header_] Steve Blank Entries RSS | Comments RSS [ ] [Search] * Email Subscription Enter your email address to subscribe to this blog and receive notifications of new posts by email. Email Address [ ] Sign me up! Join 56.1K other subscribers * Categories + 2 Minute Lessons (15) + Air Force (19) + Ardent (9) + Business Model versus Business Plan (64) + California Coastal Commission (9) + China (9) + Commencement Speeches (9) + Conservation (4) + Convergent Technologies (4) + Corporate/Gov't Innovation (131) + Covid-19/Recovery (10) + Customer Development (324) + Customer Development Manifesto (34) + E.piphany (13) + Educators Summit (7) + ESL (8) + Family/Career/Culture (80) + Gordian Knot Center for National Security Innovation (12) + Hacking For Defense (41) + Hacking for Diplomacy (10) + Hacking for Recovery (5) + Harvard Business Review (12) + Innovation Doctrine (3) + Innovation Outposts (4) + Investment Readiness Level (6) + Lean LaunchPad (117) + Life Sciences (NIH) (26) + Market Types (15) + Marketing (27) + MIPS Computers (2) + National Security (40) + Navy (6) + NIH (National Institutes of Health) (17) + NSF (National Science Foundation) (18) + Rocket Science Games (10) + Science and Industrial Policy (29) + Secret History of Silicon Valley (26) + SiriusXM Radio Show (50) + SuperMac (12) + Teaching (178) + Technology (86) + Technology Innovation and Great Power Competition (17) + Technology Innovation and Modern War (20) + Tesla (5) + Uncategorized (8) + Venture Capital (82) + Vertical Markets (5) + Zilog (5) * Get Steve Blank via your RSS Feed + RSS - Posts + RSS - Comments * Recent Posts + Teaching National Security Policy with AI + How the United States Gave Up Being a Science Superpower + How the U.S. Became A Science Superpower + Quantum Computing - An Update + How Saboteurs Threaten Innovation-and What to Do About It + What Does Product Market Fit Sound Like? This. + How To Find Your Customer In the Dept of Defense - The Directory of DoD Program Executive Offices + Security Clearances at the Speed of Startups + Why Large Organizations Struggle With Disruption, and What to Do About It + Lean LaunchPad @Stanford 2024 - 8 Teams In, 8 Companies Out * [ ] [Search] * Archives + June 2025 + May 2025 + April 2025 + October 2024 + September 2024 + August 2024 + July 2024 + June 2024 + May 2024 + April 2024 + March 2024 + February 2024 + January 2024 + December 2023 + November 2023 + October 2023 + September 2023 + August 2023 + July 2023 + April 2023 + February 2023 + January 2023 + November 2022 + October 2022 + September 2022 + June 2022 + May 2022 + April 2022 + March 2022 + January 2022 + December 2021 + November 2021 + October 2021 + September 2021 + August 2021 + July 2021 + June 2021 + May 2021 + April 2021 + March 2021 + February 2021 + January 2021 + December 2020 + November 2020 + October 2020 + September 2020 + August 2020 + July 2020 + June 2020 + May 2020 + April 2020 + March 2020 + February 2020 + January 2020 + December 2019 + November 2019 + October 2019 + September 2019 + June 2019 + May 2019 + April 2019 + March 2019 + January 2019 + December 2018 + November 2018 + October 2018 + September 2018 + August 2018 + July 2018 + June 2018 + April 2018 + March 2018 + February 2018 + January 2018 + November 2017 + October 2017 + September 2017 + August 2017 + July 2017 + June 2017 + May 2017 + April 2017 + March 2017 + February 2017 + January 2017 + December 2016 + November 2016 + October 2016 + September 2016 + August 2016 + July 2016 + June 2016 + May 2016 + April 2016 + March 2016 + February 2016 + January 2016 + December 2015 + November 2015 + October 2015 + September 2015 + August 2015 + July 2015 + June 2015 + May 2015 + March 2015 + February 2015 + January 2015 + December 2014 + November 2014 + October 2014 + September 2014 + August 2014 + July 2014 + June 2014 + May 2014 + April 2014 + March 2014 + February 2014 + January 2014 + December 2013 + November 2013 + October 2013 + September 2013 + August 2013 + July 2013 + June 2013 + May 2013 + April 2013 + March 2013 + February 2013 + January 2013 + December 2012 + November 2012 + October 2012 + September 2012 + August 2012 + July 2012 + June 2012 + May 2012 + April 2012 + March 2012 + February 2012 + January 2012 + December 2011 + November 2011 + October 2011 + September 2011 + August 2011 + July 2011 + June 2011 + May 2011 + April 2011 + March 2011 + February 2011 + January 2011 + December 2010 + November 2010 + October 2010 + September 2010 + August 2010 + July 2010 + June 2010 + May 2010 + April 2010 + March 2010 + February 2010 + January 2010 + December 2009 + November 2009 + October 2009 + September 2009 + August 2009 + July 2009 + June 2009 + May 2009 + April 2009 + March 2009 + February 2009 * Other Stuff + About Steve + Startup Tools + Secret History + Books for Startups + Slides/Videos + Raising Money Teaching National Security Policy with AI Posted on June 10, 2025 by steve blank The videos embedded in this post are best viewed on steveblank.com [AI-and-National-Security-picture]International Policy students will be spending their careers in an AI-enabled world. We wanted our students to be prepared for it. This is why we've adopted and integrated AI in our Stanford national security policy class - Technology, Innovation and Great Power Competition. Here's what we did, how the students used it, and what they (and we) learned. --------------------------------------------------------------------- Technology, Innovation and Great Power Competition is an international policy class at Stanford (taught by me, Eric Volmar and Joe Felter.) The course provides future policy and engineering leaders with an appreciation of the geopolitics of the U.S. strategic competition with great power rivals and the role critical technologies are playing in determining the outcome. This course includes all that you would expect from a Stanford graduate-level class in the Masters in International Policy - comprehensive readings, guest lectures from current and former senior policy officials/experts, and deliverables in the form of written policy papers. What makes the class unique is that this is an experiential policy class. Students form small teams and embark on a quarter-long project that got them out of the classroom to: * select a priority national security challenge, and then ... * validate the problem and propose a detailed solution tested against actual stakeholders in the technology and national security ecosystem The class combines multiple teaching tools. * Real world - Students worked in teams on real problems from government sponsors * Experiential - They get out of the building to interview 50+ stakeholders * Perspectives - They get policy context and insights from lectures by experts * And this year... Using AI to Accelerate Learning Rationale for AI Using this quarter to introduce AI we had three things going for us: 1) By fall 2024 AI tools were good and getting exponentially better, 2) Stanford had set up an AI Playground enabling students to use a variety of AI Tools (ChatGPT, Claude, Perplexity, NotebookLM, Otter.ai, Mermaid, Beautiful.ai, etc.) and 3) many students were using AI in classes but it was usually ambiguous about what they were allowed to do. Policy students have to read reams of documents weekly. Our hypotheses was that our student teams could use AI to ingest and summarize content, identify key themes and concepts across the content, provide an in-depth analysis of critical content sections, and then synthesize and structure their key insights and apply their key insights to solve their specific policy problem. They did all that, and much, much, more. While Joe Felter and I had arm-waved "we need to add AI to the class" Eric Volmar was the real AI hero on the teaching team. As an AI power user Eric was most often ahead of our students on AI skills. He threw down a challenge to the students to continually use AI creatively and told them that they would be graded on it. He pushed them hard on AI use in office hours throughout the quarter. The results below speak for themselves. If you're not familiar with these AI tools in practice it's worth watching these one minute videos. Team OSC Team OSC was trying to understand what is the appropriate level of financial risk for the U.S. Department of Defense to provide loans or loan guarantees in technology industries? The team started using AI to do what we had expected, summarizing the stack of weekly policy documentsusing Claude 3.5. And like all teams, the unexpected use of AI was to create new leads for their stakeholder interviews. They found that they could ask AI to give them a list of leaders that were involved in similar programs, or that were involved in their program's initial stages of development. See how Team OSC summarized policy papers here: If you can't see the video click here Claude was also able to create a list of leaders with the Department of Energy Title17 credit programs, Exim DFC, and other federal credit programs that the team should interview. In addition, it created a list of leaders within Congressional Budget Office and the Office of Management and Budget that would be able to provide insights. See the demo here: If you can't see the video click here The team also used AI to transcribe podcasts. They noticed that key leaders of the organizations their problem came from had produced podcasts and YouTube videos. They used Otter.ai to transcribe these. That provided additional context for when they did interview them and allowed the team to ask insightful new questions. If you can't see the video click here Note the power of fusing AI with interviews. The interviews ground the knowledge in the teams lived experience. The team came up with a use case the teaching team hadn't thought of - using AI to critique the team's own hypotheses. The AI not only gave them criticism but supported it with links from published scholars. See the demo here: If you can't see the video click here Another use the teaching team hadn't thought was using Mermaid AI to create graphics for their weekly presentations. See the demo here: If you can't see the video click here The surprises from this team kept coming. Their last was that the team used Beautiful.ai in order to generate PowerPoint presentations. See the demo here: If you can't see the video click here For all teams, using AI tools was a learning/discovery process all its own. By and large, students were largely unfamiliar with most tools on day 1. Team OSC suggested that students should start using AI tools early in the quarter and experiment with tools like ChatGPT, Otter.ai. Tools that that have steep learning curves, like Mermaid should be started at the very start of the project to train their models. Team OSC AI tools summary: AI tools are not perfect, so make sure to cross check summaries, insights and transcriptions for accuracy and relevancy. Be really critical of their outputs. The biggest takeaway is that AI works best when prepared with human efforts. Team FAAST The FAAST team was trying to understand how can the U.S. improve and scale the DoE FASST program in the urgent context of great power competition? Team FAAST started using AI to do what we had expected, summarizing the stack of weekly policy documents they were assigned to read and synthesizing interviews with stakeholders. One of the features of ChatGPT this team appreciated, and important for a national security class, was the temporary chat feature - data they entered would not be used to train the open AI models. See the demo below. If you can't see the video click here The team used AI do a few new things we didn't expect - to generate emails to stakeholders and to create interview questions. During the quarter the team used ChatGPT, Claude, Perplexity, and NotebookLM. By the end of the 10-week class they were using AI to do a few more things we hadn't expected. Their use of AI expanded to include simulating interviews. They gave ChatGPT specific instructions on who they wanted it to act like, and it provided personalized and custom answers. See the example here. If you can't see the video click here Learning-by-doing was a key part of this experiential course. The big idea is that students learn both the method and the subject matter together. By learning it together, you learn both better. Finally, they used AI to map stakeholders, get advice on their next policy move, and asked ChatGPT to review their weekly slides (by screenshotting the slides and putting them into ChatGPT and asking for feedback and advice.) The FAAST team AI tool summary: ChatGPT was specifically good when using images or screenshots, so in these multi-level tasks, and when you wanted to use kind of more custom instructions, as we used for the stakeholder interviews. Claude was better at more conversational and human in writing, so used it when sending emails. Perplexity was better for researchers because it provides citations, so you're able to access the web and actually get directed to the source that it's citing. NotebookLM was something we tried out, but it was not as successful. It was a cool tool that allowed us to summarize specific policy documents into a podcast, but the summaries were often pretty vague. Team NSC Energy Team NSC Energy was working on a National Security Council problem, "How can the United States generate sufficient energy to support compute/AI in the next 5 years?" At the start of the class, the team began by using ChatGPT to summarize their policy papers and generate tailored interview questions, while Claude was used to synthesize research for background understanding. As ChatGPT occasionally hallucinated information, by the end of the class they were cross validating the summaries via Perplexity pro. The team also used ChatGPT and Mermaid to organize their thoughts and determine who they wanted to talk to. ChatGPT was used to generate code to put into the Mermaid flowchart organizer. Mermaid has its own language, so ChatGPT was helpful, so we didn't have to learn all the syntax for this language. See the video of how Team NSC Energy used ChaptGPT and Mermaid here: If you can't see the video click here Team Alpha Strategy The Alpha Strategy team was trying to discover whether the U.S. could use AI to create a whole-of-government decision-making factory. At the start of class, Team Alpha Strategy used ChatGPT.40 for policy document analysis and summary, as well for stakeholder mapping. However, they discovered going one by one through the countless numbers of articles was time consuming. So the team pivoted to using Notebook LM, for document search and cross analysis. See the video of how Team Alpha Strategy used Notebook LM here: If you can't see the video click here The other tools the team used were custom Gpts to build stakeholder maps and diagrams and organize interview notes. There's going to be a wide variety of specialized Gpts. One that was really helpful, they said, was a scholar GPT. See the video of how Team Alpha Strategy used custom GPTs: If you can't see the video click here Like other teams, Alpha Strategy used ChatGPT to summarize their interview notes and to create flow charts to paste into their weekly presentations. Team Congress The Congress team was exploring the question, "if the Department of Defense were given economic instruments of power, which tools would be most effective in the current techno-economic competition with the People's Republic of China?" As other teams found, Team Congress first used ChatGPT to extract key themes from hundreds of pages of readings each week and from press releases, articles, and legislation. They also used for mapping and diagramming to identify potential relationships between stakeholders, or to creatively suggest alternate visualizations. When Team Congress weren't able to reach their sponsor in the initial two weeks of the class, much like Team OSC, they used AI tools to pretend to be their sponsor, a member of the defense modernization caucus. Once they realized its utility, they continued to do mock interviews using AI role play. The team also used customized models of ChatGPT but in their case found that this was limited in the number of documents they could upload, because they had a lot of content. So they used retrieval augmented generation, which takes in a user's query, and matches it with relevant sources in their knowledge base, and fed that back out as the output. See the video of how Team Congress used retrieval augmented generation here: If you can't see the video click here Team NavalX The NavalX team was learning how the U.S. Navy could expand its capabilities in Intelligence, Surveillance, and Reconnaissance (ISR) operations on general maritime traffic. Like all teams they used ChatGPT to summarize and extract from long documents, organizing their interview notes, and defining technical terms associated with their project. In this video, note their use of prompting to guide ChatGPT to format their notes. See the video of how Team NavalX used tailored prompts for formatting interview notes here: If you can't see the video click here They also asked ChatGPT to role play a critic of our argument and solution so that we could find the weaknesses. They also began uploading many interviews at once, and asked Claude to find themes or ideas in common that they might have missed on their own. Here's how the NavalX team used Perplexity for research. If you can't see the video click here Like other teams, the NavalX team discovered you can customize ChatGPT by telling it how you want it to act. If you can't see the video click here Another surprising insight from the team is that you can use ChatGPT to tell you how to write better prompts for itself. If you can't see the video click here In summary, Team NavalX used Claude to translate texts from Mandarin, and found that ChatGPT was the best for writing tasks, Perplexity the best for research tasks, Claude the best for reading tasks, and notebook LM was the best for summarization. Lessons Learned + Integrating AI into this class took a dedicated instructor with a mission to create a new way to teach using AI tools + The result was AI vastly enhanced and accelerated learning of all teams o It acted as a helpful collaborator o Fusing AI with stakeholders interviews was especially powerful + At the start of the class students were familiar with a few of these AI tools o By the end of the class they were fluent in many more of them o Most teams invented creative use cases + All Stanford classes we now teach - Hacking for Defense, Lean Launchpad, Entrepreneurship Inside Government - have AI integrated as part of the course + Next year's AI tools will be substantively better Share this: * Click to print (Opens in new window) Print * Click to email a link to a friend (Opens in new window) Email * * Tweet * * Click to share on Reddit (Opens in new window) Reddit * Click to share on WhatsApp (Opens in new window) WhatsApp * [pinit_fg_e] * Click to share on Telegram (Opens in new window) Telegram * Share on Tumblr * Pocket * Like this: Like Loading... Filed under: Customer Development, Gordian Knot Center for National Security Innovation, National Security, Technology Innovation and Great Power Competition | << How the United States Gave Up Being a Science Superpower Leave a ReplyCancel reply * Calendar + June 2025 M T W T F S S 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 << May * Customer Development + Customer Development Methodology - slides + Eric Ries on Customer Development + Four Steps to the Epiphany - the book + Stanford Entrepreneurial Leadership Talks by Steve Blank + The Lean Startup by Eric Ries & Steve Blank - slides * Secret History of Silicon Valley + The Secret History of Silicon Valley - Dec 2009 slides + The Secret History of Silicon Valley - video Powered by WordPress.com. WP Designer. Discover more from Steve Blank Subscribe now to keep reading and get access to the full archive. Type your email... [ ] Subscribe Continue reading Loading Comments... Write a Comment... [ ] Email [ ] Name [ ] Website [ ] [Post Comment] %d