https://github.com/devidw/inferit

Skip to content

Navigation Menu

Toggle navigation
 
Sign in

  * Product
      +  
        GitHub Copilot
        Write better code with AI
      +  
        Security
        Find and fix vulnerabilities
      +  
        Actions
        Automate any workflow
      +  
        Codespaces
        Instant dev environments
      +  
        Issues
        Plan and track work
      +  
        Code Review
        Manage code changes
      +  
        Discussions
        Collaborate outside of code
      +  
        Code Search
        Find more, search less
    Explore
      + All features
      + Documentation
      + GitHub Skills
      + Blog
  * Solutions
    By company size
      + Enterprises
      + Small and medium teams
      + Startups
    By use case
      + DevSecOps
      + DevOps
      + CI/CD
      + View all use cases
    By industry
      + Healthcare
      + Financial services
      + Manufacturing
      + Government
      + View all industries
    View all solutions
  * Resources
    Topics
      + AI
      + DevOps
      + Security
      + Software Development
      + View all
    Explore
      + Learning Pathways
      + White papers, Ebooks, Webinars
      + Customer Stories
      + Partners
  * Open Source
      +  
        GitHub Sponsors
        Fund open source developers
      +  
        The ReadME Project
        GitHub community articles
    Repositories
      + Topics
      + Trending
      + Collections
  * Enterprise
      +  
        Enterprise platform
        AI-powered developer platform
    Available add-ons
      +  
        Advanced Security
        Enterprise-grade security features
      +  
        GitHub Copilot
        Enterprise-grade AI features
      +  
        Premium Support
        Enterprise-grade 24/7 support
  * Pricing

Search or jump to...

Search code, repositories, users, issues, pull requests...

Search
[                    ]
Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

[                    ] [ ] Include my email address so I can be
contacted
Cancel Submit feedback

Saved searches

Use saved searches to filter your results more quickly

Name [                    ] 
Query [                    ]

To see all available qualifiers, see our documentation.

Cancel Create saved search
Sign in
Sign up Reseting focus
You signed in with another tab or window. Reload to refresh your
session. You signed out in another tab or window. Reload to refresh
your session. You switched accounts on another tab or window. Reload
to refresh your session. Dismiss alert
{{ message }}
devidw / inferit Public

  * 
  * Notifications You must be signed in to change notification
    settings
  * Fork 1
  * Star 39

Visual inference exploration & experimentation playground

inferit.index.garden

License

AGPL-3.0 license
39 stars 1 fork Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

  * Code
  * Issues 1
  * Pull requests 0
  * Actions
  * Projects 0
  * Security
  * Insights

Additional navigation options

  * Code
  * Issues
  * Pull requests
  * Actions
  * Projects
  * Security
  * Insights

devidw/inferit

 main
BranchesTags
  
[                    ]
Go to file
Code

Folders and files

       Name                Name          Last commit     Last commit
                                           message          date
Latest commit

 

History

13 Commits
 
public              public                               
screens             screens                              
src                 src                                  
.gitignore          .gitignore                           
Makefile            Makefile                             
README.md           README.md                            
index.html          index.html                           
justfile            justfile                             
license.txt         license.txt                          
package.json        package.json                         
pnpm-lock.yaml      pnpm-lock.yaml                       
server.js           server.js                            
svelte.config.js    svelte.config.js                     
tsconfig.json       tsconfig.json                        
tsconfig.node.json  tsconfig.node.json                   
vite.config.ts      vite.config.ts                       
View all files

Repository files navigation

  * README
  * Code of conduct
  * AGPL-3.0 license

                               inferit
                               inferit

 

inferit is a visual take on llm inference. Most inference frontends
are limited to a single visual input/output "thread". This makes it
hard to compare output from different models, prompts and sampler
settings. inferit solves this with its UI that allows for an
unlimited number of side-by-side generations. This makes it a perfect
fit to compare and experiment with different models, prompts and
sampler settings.

[screen_24-]

Some example use cases:

  * model exploration and comparison
  * prompt engineering
  * sampler setting optimizations

Supported Backends:

  * Any local or remote backend that is compatible with the OpenAI
    API
  * Chrome's built-in llm (Gemini Nano)

run it

 

 1. I've deployed an instance for instant access here: https://
    inferit.index.garden (online)
 2. Same code also ships as browser extension to run local and
    offline w/o having to start a process: https://
    chromewebstore.google.com/detail/inferit/
    celkhcifjknihgjlieolcmchofdloagk
 3. Run it locally from this repo:

    pnpm install
    pnpm build
    pnpm preview

once running, set your api creds in the settings (stored on your
device, window.localStorage) and u are good to go

development

 

pnpm dev

           Contributions of any kind are warmly welcomed!
                                 <3

About

Visual inference exploration & experimentation playground

inferit.index.garden

Topics

inference-client openai-compatible-api chromeai chrome-ai

Resources

Readme

License

AGPL-3.0 license

Code of conduct

Code of conduct
Activity

Stars

39 stars

Watchers

1 watching

Forks

1 fork
Report repository

Sponsor this project

 
Sponsor
Learn more about GitHub Sponsors

Languages

  * Svelte 55.5%
  * TypeScript 38.7%
  * CSS 2.2%
  * JavaScript 1.3%
  * HTML 1.2%
  * Makefile 0.9%
  * Just 0.2%

Footer

 (c) 2024 GitHub, Inc.

Footer navigation

  * Terms
  * Privacy
  * Security
  * Status
  * Docs
  * Contact
  * Manage cookies
  * Do not share my personal information

You can't perform that action at this time.