https://github.com/xai-org/grok

Skip to content
Toggle navigation
 
Sign in

  * Product
      +  
        Actions
        Automate any workflow
      +  
        Packages
        Host and manage packages
      +  
        Security
        Find and fix vulnerabilities
      +  
        Codespaces
        Instant dev environments
      +  
        Copilot
        Write better code with AI
      +  
        Code review
        Manage code changes
      +  
        Issues
        Plan and track work
      +  
        Discussions
        Collaborate outside of code
    Explore
      + All features
      + Documentation
      + GitHub Skills
      + Blog
  * Solutions
    For
      + Enterprise
      + Teams
      + Startups
      + Education
    By Solution
      + CI/CD & Automation
      + DevOps
      + DevSecOps
    Resources
      + Learning Pathways
      + White papers, Ebooks, Webinars
      + Customer Stories
      + Partners
  * Open Source
      +  
        GitHub Sponsors
        Fund open source developers
      +  
        The ReadME Project
        GitHub community articles
    Repositories
      + Topics
      + Trending
      + Collections
  * Pricing

Search or jump to...

Search code, repositories, users, issues, pull requests...

Search
[                    ]
Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

[                    ] [ ] Include my email address so I can be
contacted
Cancel Submit feedback

Saved searches

Use saved searches to filter your results more quickly

Name [                    ] 
Query [                    ]

To see all available qualifiers, see our documentation.

Cancel Create saved search
Sign in
Sign up
You signed in with another tab or window. Reload to refresh your
session. You signed out in another tab or window. Reload to refresh
your session. You switched accounts on another tab or window. Reload
to refresh your session. Dismiss alert
{{ message }}
xai-org / grok-1 Public

  * Notifications
  * Fork 264
  * Star 3.2k
  * 

Grok open release

License

Apache-2.0 license
3.2k stars 264 forks Branches Tags Activity
Star
Notifications

  * Code
  * Issues 9
  * Pull requests 2
  * Discussions
  * Actions
  * Projects 0
  * Security
  * Insights

Additional navigation options

  * Code
  * Issues
  * Pull requests
  * Discussions
  * Actions
  * Projects
  * Security
  * Insights

xai-org/grok-1

This commit does not belong to any branch on this repository, and may
belong to a fork outside of the repository.
 main
BranchesTags
  
Go to file
Code

Folders and files

       Name                Name          Last commit     Last commit
                                           message          date
Latest commit

 

History

3 Commits
 
checkpoints         checkpoints                          

CODE_OF_CONDUCT.md  CODE_OF_CONDUCT.md                   

LICENSE.txt         LICENSE.txt                          

README.md           README.md                            

checkpoint.py       checkpoint.py                        

model.py            model.py                             

pyproject.toml      pyproject.toml                       

requirements.txt    requirements.txt                     

run.py              run.py                               

runners.py          runners.py                           

tokenizer.model     tokenizer.model                      

View all files

Repository files navigation

  * README
  * Code of conduct
  * Apache-2.0 license

Grok-1

 

This repository contains JAX example code for loading and running the
Grok-1 open-weights model.

Make sure to download the checkpoint and place ckpt-0 directory in
checkpoint. Then, run

pip install -r requirements.txt
python run.py

to test the code.

The script loads the checkpoint and samples from the model on a test
input.

Due to the large size of the model (314B parameters), a machine with
enough GPU memory is required to test the model with the example
code. The implementation of the MoE layer in this repository is not
efficient. The implementation was chosen to avoid the need for custom
kernels to validate the correctness of the model.

Downloading the weights

 

You can download the weights using a torrent client and this magnet
link:

magnet:?xt=urn:btih:5f96d43576e3d386c9ba65b883210a393b68210e&tr=https%3A%2F%2Facademictorrents.com%2Fannounce.php&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce

License

 

The code and associated Grok-1 weights in this release are licensed
under the Apache 2.0 license. The license only applies to the source
files in this repository and the model weights of Grok-1.

About

Grok open release

Resources

Readme

License

Apache-2.0 license

Code of conduct

Code of conduct
Activity
Custom properties

Stars

3.2k stars

Watchers

51 watching

Forks

264 forks
Report repository

Releases

No releases published

Packages 0

No packages published

Contributors 2

  * @ibab ibab Igor Babuschkin
  * @TobyPDE TobyPDE Toby Pohlen

Languages

  * Python 100.0%

Footer

 (c) 2024 GitHub, Inc.

Footer navigation

  * Terms
  * Privacy
  * Security
  * Status
  * Docs
  * Contact
  * Manage cookies
  * Do not share my personal information

You can't perform that action at this time.