https://github.com/bgavran/Category_Theory_Machine_Learning Skip to content Toggle navigation Sign up * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code + Explore + All features + Documentation + GitHub Skills + Blog * Solutions + For + Enterprise + Teams + Startups + Education + By Solution + CI/CD & Automation + DevOps + DevSecOps + Case Studies + Customer Stories + Resources * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles + Repositories + Topics + Trending + Collections * Pricing [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this user All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} bgavran / Category_Theory_Machine_Learning Public * Notifications * Fork 15 * Star 504 List of papers studying machine learning through the lens of category theory 504 stars 15 forks Star Notifications * Code * Issues 0 * Pull requests 0 * Actions * Projects 0 * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Security * Insights bgavran/Category_Theory_Machine_Learning This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. master Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags Name already in use A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch? Cancel Create 1 branch 0 tags Code * Local * Codespaces * Clone HTTPS GitHub CLI [https://github.com/b] Use Git or checkout with SVN using the web URL. [gh repo clone bgavra] Work fast with our official CLI. Learn more. * Open with GitHub Desktop * Download ZIP Sign In Required Please sign in to use Codespaces. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching Xcode If nothing happens, download Xcode and try again. Launching Visual Studio Code Your codespace will open once ready. There was a problem preparing your codespace, please try again. Latest commit @bgavran bgavran Update README.md ... ee7dcdd Mar 7, 2023 Update README.md ee7dcdd Git stats * 51 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time README.md Update README.md March 7, 2023 22:49 ct_intersection_ml.png updated chart January 23, 2023 23:11 paper_plot.py fixed typo September 25, 2022 15:39 View code [ ] Category Theory [?] Machine Learning Survey papers Deep Learning Graph Neural Networks Differentiable programming / automatic differentiation Probability theory Bayesian/Causal inference Topological Data Analysis Metric space magnitude Blog posts Automata Learning Misc README.md Category Theory [?] Machine Learning Category theory has been finding increasing applications in machine learning. This repository aims to list all of the relevant papers, grouped by fields. For an introduction to the ideas behind category theory, check out this link. [ct_intersection_ml] There might be papers missing, and some papers are in multiple fields. Feel free to contribute to this list - preferably by creating a pull request. Survey papers * Category Theory in Machine Learning --------------------------------------------------------------------- Deep Learning * Categorical Foundations of Gradient-Based Learning * Backprop as Functor * Lenses and Learners * Reverse Derivative Ascent * Dioptics * Learning Functors using Gradient Descent (longer version here) * Compositionality for Recursive Neural Networks * Deep neural networks as nested dynamical systems * Neural network layers as parametric spans * Categories of Differentiable Polynomial Circuits for Machine Learning Graph Neural Networks * Graph Neural Networks are Dynamic Programmers * Natural Graph Networks * Local Permutation Equivariance For Graph Neural Networks * Sheaf Neural Networks * Sheaf Neural Networks with Connection Laplacians * Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs * Graph Convolutional Neural Networks as Parametric CoKleisli morphisms * Learnable Commutative Monoids for Graph Neural Networks --------------------------------------------------------------------- Differentiable programming / automatic differentiation * Functorial String Diagrams for Reverse-Mode Automatic Differentiation * Differentiable Causal Computations via Delayed Trace * Simple Essence of Automatic Differentiation * Reverse Derivative Categories * Towards formalizing and extending differential programming using tangent categories * Correctness of Automatic Differentiation via Diffeologies and Categorical Gluing * Denotationally Correct, Purely Functional, Efficient Reverse-mode Automatic Differentiation * Higher Order Automatic Differentiation of Higher Order Functions * Space-time tradeoffs of lenses and optics via higher category theory --------------------------------------------------------------------- Probability theory * Markov categories * Markov Categories and Entropy * Infinite products and zero-one laws in categorical probability * A Convenient Category for Higher-Order Probability Theory * Bimonoidal Structure of Probability Monads * Representable Markov Categories and Comparison of Statistical Experiments in Categorical Probability * De Finneti's construction as a categorical limit * A Probability Monad as the Colimit of Spaces of Finite Samples * A Probabilistic Dependent Type System based on Non-Deterministic Beta Reduction * Probability, valuations, hyperspace: Three monads on Top and the support as a morphism * Categorical Probability Theory * Information structures and their cohomology * Computable Stochastic Processes * Compositional Semantics for Probabilistic Programs with Exact Conditioning --------------------------------------------------------------------- Bayesian/Causal inference * A category theory framework for Bayesian Learning * Causal Theories: A Categorical Perspective on Bayesian Networks * Bayesian machine learning via category theory * A Categorical Foundation for Bayesian probability * Bayesian Open Games * Causal Inference by String Diagram Surgery * Disintegration and Bayesian Inversion via String Diagrams * Categorical Stochastic Processes and Likelihood * Bayesian Updates Compose Optically * Automatic Backward Filtering Forward Guiding for Markov processes and graphical models * A Channel-Based Perspective on Conjugate Priors * A Type Theory for Probabilistic and Bayesian Reasoning * Denotational validation of higher-order Bayesian inference * The Geometry of Bayesian Programming * Relational Reasoning for Markov Chains in a Probabilistic Guarded Lambda Calculus --------------------------------------------------------------------- Topological Data Analysis * On Characterizing the Capacity of Neural Networks using Algebraic Topology * Persistent-Homology-based Machine Learning and its Applications - A Survey * Topological Expressiveness of Neural Networks --------------------------------------------------------------------- Metric space magnitude * Approximating the convex hull via metric space magnitude * Practical applications of metric space magnitude and weighting vectors * Weighting vectors for machine learning: numerical harmonic analysis applied to boundary detection * The magnitude vector of images --------------------------------------------------------------------- Blog posts * Neural Networks, Types, and Functional Programming * Towards Categorical Foundations of Learning * Graph Convolutional Neural Networks as Parametric CoKleisli morphisms * Optics vs Lenses, Operationally * Meta-learning and Monads --------------------------------------------------------------------- Automata Learning * Automata Learning: A Categorical Perspective * A Categorical Framework for Learning Generalised Tree Automata --------------------------------------------------------------------- Misc * Generalized Convolution and Efficient Language Recognition * General supervised learning as change propagation with delta lenses * From Open Learners to Open Games * Learners Languages * A Constructive, Type-Theoretic Approach to Regression via Global Optimisation * Characterizing the invariances of learning algorithms using category theory * Functorial Manifold Learning * Diegetic representation of feedback in open games * Assessing the Unitary RNN as an End-to-End Compositional Model of Syntax * Classifying Clustering Schemes * Category Theory for Quantum Natural Language Processing * Categorical Hopfield Networks About List of papers studying machine learning through the lens of category theory Topics machine-learning category-theory neural-networks lenses Resources Readme Stars 504 stars Watchers 31 watching Forks 15 forks Releases No releases published Packages 0 No packages published Contributors 4 * @bgavran bgavran Bruno Gavranovic * @darrenjw darrenjw Darren Wilkinson * @BBischof BBischof Bryan Bischof * @crisbodnar crisbodnar Cristian Bodnar Languages * Python 100.0% Footer (c) 2023 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.