https://github.com/missingstudio/ai Skip to content Toggle navigation Sign in * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code Explore + All features + Documentation + GitHub Skills + Blog * Solutions For + Enterprise + Teams + Startups + Education By Solution + CI/CD & Automation + DevOps + DevSecOps Resources + Learning Pathways + White papers, Ebooks, Webinars + Customer Stories + Partners * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles Repositories + Topics + Trending + Collections * Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Search [ ] Clear Search syntax tips Provide feedback We read every piece of feedback, and take your input very seriously. [ ] [ ] Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Name [ ] Query [ ] To see all available qualifiers, see our documentation. Cancel Create saved search Sign in Sign up You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} missingstudio / ai Public * Notifications * Fork 1 * Star 39 * A Reliable Open Source AI studio - Core infrastructure stack for building your AI workforce www.missing.studio License Apache-2.0 license 39 stars 1 fork Branches Tags Activity Star Notifications * Code * Issues 0 * Pull requests 0 * Discussions * Actions * Projects 0 * Security * Insights Additional navigation options * Code * Issues * Pull requests * Discussions * Actions * Projects * Security * Insights missingstudio/ai This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. main BranchesTags Go to file Code Folders and files Name Name Last commit Last commit message date Latest commit History 132 Commits .github .github assets assets common common docker docker docs docs gateway gateway playgrounds playgrounds .gitignore .gitignore CODE_OF_CONDUCT.md CODE_OF_CONDUCT.md LICENSE LICENSE Makefile Makefile README.md README.md SECURITY.md SECURITY.md docker-compose.yml docker-compose.yml go.work go.work View all files Repository files navigation * README * Code of conduct * Apache-2.0 license * Security Gateway Missing studio Introduction A Robust Open Source AI studio. A Universal API for inferencing 100+ LLMs(OpenAI, Azure, Cohere, Anthropic, HuggingFace, Replicate, Stable Diffusion). Supported Providers Provider Provider Support Supported Endpoints Name [o] OpenAI openai /chat/completions, /chat/ completions:stream [g] Groq groq /chat/completions, /chat/ completions:stream [a] Anyscale anyscale /chat/completions [d] Deepinfra deepinfra /chat/completions [t] Together togetherai /chat/completions AI Not supported (yet): images, audio, files, fine-tunes, moderations Run locally Missing studio can be deployed in a variety of ways. It is deployable on bare metal, or in dockerized environments. Prerequisites * Buf CLI is required for building proto. To start missing studio server, simply run the following command: make compose-dev Your AI Gateway is now running on http://localhost:8080 Send a request using curl curl \ --header "Content-Type: application/json" \ --header "x-ms-provider: openai" \ --header "Authorization: Bearer {{OPENAI_API_KEY}}" \ --data '{"model":"gpt-3.5-turbo","messages":[{"role":"user","content":"who are you?"}]}' \ http://localhost:8080/v1/chat/completions Send a request using grpcurl grpcurl \ -d '{"model":"gpt-3.5-turbo","messages":[{"role":"user","content":"hi"}]}' \ -H 'x-ms-provider: openai' \ -H 'Authorization: Bearer {{OPENAI_API_KEY}}' \ -plaintext localhost:8080 llm.v1.LLMService.ChatCompletions Features * Universal API - Call every LLM API like it's OpenAI * AI Gateway for Security, Reliability and Observability + [ ] Load balancing across multiple provider and models + [*] Atomatic Retries with exponential backoff + [*] Rate limiting + [ ] Caching + [ ] Fallbacks + [ ] Monitoring + [ ] Alerting + [ ] Analytics * AI Studio * AI Agents * AI Workflow builder * OSS AI Models Inferancing * Serving model api at Scale on Kubernetes [?] * Building dev tools (CLI, SDK, API Client) Contributions AI studio is an open-source project, and contributions are welcome. If you want to contribute, you can create new features, fix bugs, or improve the infrastructure. It's still very early days for this so your mileage will vary here and lots of things will break. But almost any contribution will be beneficial at this point. Check the current Issues to see where you can jump in! If you've got an improvement, just send in a pull request! 1. Fork it 2. Create your feature branch (git checkout -b my-new-feature) 3. Commit your changes (git commit -am 'feat(module): add some feature') 4. Push to the branch (git push origin my-new-feature) 5. Create new Pull Request If you've got feature ideas, simply open a new issues! Please refer to the CONTRIBUTING.md file in the repository for more information on how to contribute. [6874747073] License AI Studio is Apache 2.0 licensed. About A Reliable Open Source AI studio - Core infrastructure stack for building your AI workforce www.missing.studio Topics api ai gateway inference workforce aistudio llms generative-ai llmops Resources Readme License Apache-2.0 license Code of conduct Code of conduct Security policy Security policy Activity Custom properties Stars 39 stars Watchers 3 watching Forks 1 fork Report repository Releases No releases published Packages 0 No packages published Languages * Go 66.9% * TypeScript 31.0% * Other 2.1% Footer (c) 2024 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact * Manage cookies * Do not share my personal information You can't perform that action at this time.