https://github.com/fauxpilot/fauxpilot Skip to content Toggle navigation Sign up * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code + Explore + All features + Documentation + GitHub Skills + Blog * Solutions + For + Enterprise + Teams + Startups + Education + By Solution + CI/CD & Automation + DevOps + DevSecOps + Case Studies + Customer Stories + Resources * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles + Repositories + Topics + Trending + Collections * Pricing [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this organization All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} fauxpilot / fauxpilot Public * Notifications * Fork 380 * Star 8.5k FauxPilot - an open-source GitHub Copilot server License MIT license 8.5k stars 380 forks Star Notifications * Code * Issues 31 * Pull requests 4 * Discussions * Actions * Projects 0 * Wiki * Security * Insights More * Code * Issues * Pull requests * Discussions * Actions * Projects * Wiki * Security * Insights fauxpilot/fauxpilot This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. main Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags Name already in use A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch? Cancel Create 8 branches 0 tags Code * Local * Codespaces * Clone HTTPS GitHub CLI [https://github.com/f] Use Git or checkout with SVN using the web URL. [gh repo clone fauxpi] Work fast with our official CLI. Learn more. * Open with GitHub Desktop * Download ZIP Sign In Required Please sign in to use Codespaces. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching Xcode If nothing happens, download Xcode and try again. Launching Visual Studio Code Your codespace will open once ready. There was a problem preparing your codespace, please try again. Latest commit @arturhoo arturhoo Remove Gitlab VSCode Extension suggestion (#169) ... 770f56a Mar 15, 2023 Remove Gitlab VSCode Extension suggestion (#169) It is no longer supported: https://gitlab.com/gitlab-org/gitlab-vscode-extension/-/merge_requests/697 770f56a Git stats * 150 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time .github Dev (#148) February 15, 2023 09:17 converter Fix arg (#151) February 21, 2023 19:18 copilot_proxy Dev (#148) February 15, 2023 09:17 documentation Remove Gitlab VSCode Extension suggestion (#169) March 15, 2023 11:20 img doc: added logo image of FauxPilot November 4, 2022 14:39 python_backend Fix segfault issue November 19, 2022 18:32 tests/python_backend Dev (#148) February 15, 2023 09:17 .editorconfig Create .editorconfig October 23, 2022 05:03 .gitignore Ignore huggingface cache November 26, 2022 22:14 LICENSE add missing license August 3, 2022 09:42 README.md doc: added logo image of FauxPilot November 4, 2022 14:39 api.dockerignore Resolve conflicts February 13, 2023 16:52 docker-compose.yaml Dev (#148) February 15, 2023 09:17 launch.sh Fix docker compose invocation January 24, 2023 12:10 proxy.Dockerfile Reduce docker build context size February 13, 2023 16:05 setup.cfg Dev (#148) February 15, 2023 09:17 setup.sh fix: fixed an incorreect if statement (#158) March 13, 2023 10:00 shutdown.sh Now that launch.sh runs in the background, add shutdown.sh to stop th... October 19, 2022 17:37 triton.Dockerfile Reduce docker build context size February 13, 2023 16:05 triton.dockerignore Resolve conflicts February 13, 2023 16:52 View code FauxPilot Prerequisites Support and Warranty Setup Setting up a FauxPilot Server Client configuration for FauxPilot Terminology README.md FauxPilot This is an attempt to build a locally hosted version of GitHub Copilot. It uses the SalesForce CodeGen models inside of NVIDIA's Triton Inference Server with the FasterTransformer backend. [fauxpilot] Prerequisites You'll need: * Docker * docker compose >= 1.28 * An NVIDIA GPU with Compute Capability >= 6.0 and enough VRAM to run the model you want. * nvidia-docker * curl and zstd for downloading and unpacking the models. Note that the VRAM requirements listed by setup.sh are total -- if you have multiple GPUs, you can split the model across them. So, if you have two NVIDIA RTX 3080 GPUs, you should be able to run the 6B model by putting half on each GPU. Support and Warranty lmao Okay, fine, we now have some minimal information on the wiki and a discussion forum where you can ask questions. Still no formal support or warranty though! Setup This section describes how to install a Fauxpilot server and clients. Setting up a FauxPilot Server Run the setup script to choose a model to use. This will download the model from Huggingface/Moyix in GPT-J format and then convert it for use with FasterTransformer. Please refer to How to set-up a FauxPilot server. Client configuration for FauxPilot We offer some ways to connect to FauxPilot Server. For example, you can create a client by how to open the Openai API, Copilot Plugin, REST API. Please refer to How to set-up a client. Terminology * API: Application Programming Interface * CC: Compute Capability * CUDA: Compute Unified Device Architecture * FT: Faster Transformer * JSON: JavaScript Object Notation * gRPC: Remote Procedure call by Google * GPT-J: A transformer model trained using Ben Wang's Mesh Transformer JAX * REST: REpresentational State Transfer About FauxPilot - an open-source GitHub Copilot server Resources Readme License MIT license Stars 8.5k stars Watchers 83 watching Forks 380 forks Releases No releases published Packages 0 No packages published Contributors 11 * @moyix * @leemgs * @fdegier * @Frederisk * @thakkarparth007 * @petronny * @arturhoo * @jsoref * @akay * @claudiosv * @luanshaotong Languages * Python 80.0% * Shell 15.5% * Dockerfile 4.5% Footer (c) 2023 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.