https://github.com/SugarAI-HQ/CopilotOne Skip to content Navigation Menu Toggle navigation Sign in * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code Explore + All features + Documentation + GitHub Skills + Blog * Solutions For + Enterprise + Teams + Startups + Education By Solution + CI/CD & Automation + DevOps + DevSecOps Resources + Learning Pathways + White papers, Ebooks, Webinars + Customer Stories + Partners * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles Repositories + Topics + Trending + Collections * Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Search [ ] Clear Search syntax tips Provide feedback We read every piece of feedback, and take your input very seriously. [ ] [ ] Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Name [ ] Query [ ] To see all available qualifiers, see our documentation. Cancel Create saved search Sign in Sign up You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} SugarAI-HQ / CopilotOne Public * Notifications * Fork 0 * Star 6 * Add Siri like Native AI Agents in you App. docs.sugarai.dev/ License Apache-2.0 license 6 stars 0 forks Branches Tags Activity Star Notifications * Code * Issues 0 * Pull requests 0 * Actions * Projects 0 * Security * Insights Additional navigation options * Code * Issues * Pull requests * Actions * Projects * Security * Insights SugarAI-HQ/CopilotOne This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. develop BranchesTags Go to file Code Folders and files Name Name Last commit Last commit message date Latest commit History 514 Commits .github/workflows .github/workflows .husky .husky .vscode .vscode apps/factory apps/factory packages/shared-ui packages/shared-ui public/images/sugar public/images/sugar sdks/js sdks/js .all-contributorsrc .all-contributorsrc .dockerignore .dockerignore .gitignore .gitignore .npmrc-ci .npmrc-ci .sentryclirc .sentryclirc Dockerfile.old Dockerfile.old LICENSE LICENSE README.md README.md package.json package.json pnpm-lock.yaml pnpm-lock.yaml pnpm-workspace.yaml pnpm-workspace.yaml View all files Repository files navigation * README * Apache-2.0 license Copilot One Supercharge your existing Web/React App with a Siri-like AI Assistant. Key Features * Voice To Action: Perform actions based on voice input. * Text To Action: Perform actions based on text input. * Current Screen Context: Auto generate embedding of current screen seend by user and create embeddings which is avaiable for RAG during LLM inferences. This make AI aware of current screen of the user and helps generate better responses. * Text API Interface: Transform existing APIs without any coding to support a natural language interface for both requests and responses. This simplies API invoication using voice and also integration in other copilot one powered Assistants. Supported Voice-enabled UX Agents 1. UI Agent: Enables hands-free capability to perform existing UI tasks and workflows. 2. Navigation Agent: Assists users in navigating to the right page, section, or settings. 3. Form Agent: Assist in filling form by autofilling based on voice or file input, advance validations, multilingual support. Simpler forms can be completely replaced by Voice to API Action. These agents focuses on reducing learning curve for user and enalbes handsfree expereince for content discovery, feature discovery, user onboarding and form filling. Demo Video Copilot One Demo Video What future of AI Assistants looks Like ? Goal is to create an open protocol for AI Assistants, Agents & Actions. Checkout Future of AI Assistants using this sdk. Future of AI Assistants with Copilot One Get Started For details instructions. Read docs Prerequisites Before using this package, ensure you have the following: * An existing React application * Create copilot credentials from Sugar AI or Self Hosted Account Install You can install the @sugar-ai/copilot-one-js package via npm in your react project Install Package npm install @sugar-ai/copilot-one-js@latest Add to your React App In your main file. src/App.tsx import { useCopilot, CopilotConfigType, CopilotProvider, VoiceAssistant } from '@sugar-ai/copilot-one-js'; const copilotConfig: CopilotConfigType = { copilotId: '', server: { endpoint: 'http://play.sugarcaneai.dev/api', token: '', }, ai: { defaultPromptTemplate: '', defaultPromptVariables: { $AGENT_NAME: 'Sugar', }, successResponse: 'Task is completed', failureResponse: 'I am not able to do this' }, } // Wrap the App with Copilot Provider We are taking a exmple of a todo App. To track User's Current Screen Context using useStateEmbedding const TodoApp = () => { const { useStateEmbedding, registerAction, unregisterAction } = useCopilot(); // Add // const [todos, setTodos] = useState([]); const [todos, setTodos] = useStateEmbedding([], 'todoApp', 'todos'); // Switch ... } Register functions for create, delete and mark as done. const TodoApp = () => { ... // Functionalies const addTodo = (task) => {...}}; const deleteTodo = (task) => {...}; const markTodoAsDoneById = function (todoId: number) {...}; // Register addTodo function registerAction( 'addTodo', { name: 'addTodo', description: 'Add a new todo', parameters: [ { name: 'task', type: 'string', description: 'Task description', required: true, } ], }, addTodo, ); ... } Roadmap * [*] Web SDK Released + [*] Voice To Action + [*] Text To Action + [*] Current Screen Context * POC + [*] Text API Interface * [] Navigation Agent * [] Form Agent About Add Siri like Native AI Agents in you App. docs.sugarai.dev/ Topics framework react-native sdk web stack native assistant siri copilot agents assistant-chat-bots ai-agents llm generative-ai Resources Readme License Apache-2.0 license Activity Custom properties Stars 6 stars Watchers 2 watching Forks 0 forks Report repository Contributors 11 * @devilankur18 * @pulkit21 * @Rahul917-Kumar * @sugarcanai * @patil-vipul * @LovedeepSingh19 * @allcontributors[bot] * @ashwaniMaddheshiya * @ravinderk1191 * @CyberneTech * @dependabot[bot] Languages * TypeScript 95.8% * JavaScript 2.0% * MDX 1.4% * Other 0.8% Footer (c) 2024 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact * Manage cookies * Do not share my personal information You can't perform that action at this time.