https://github.com/akshaybhalotia/yc_company_scraper Skip to content Sign up * Why GitHub? + Features - + Mobile - + Actions - + Codespaces - + Packages - + Security - + Code review - + Issues - + Integrations - + GitHub Sponsors - + Customer stories - * Team * Enterprise * Explore + Explore GitHub - + Learn and contribute + Topics - + Collections - + Trending - + Learning Lab - + Open source guides - + Connect with others + The ReadME Project - + Events - + Community forum - + GitHub Education - + GitHub Stars program - * Marketplace * Pricing + Plans - + Compare plans - + Contact Sales - + Education - [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this user All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} akshaybhalotia / yc_company_scraper Public generated from akshaybhalotia/readme-template * Notifications * Star 4 * Fork 0 * Barebones scraper for listing all YC companies MIT License 4 stars 0 forks Star Notifications * Code * Issues 0 * Pull requests 0 * Actions * Projects 0 * Wiki * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Wiki * Security * Insights main Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show Loading {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default Loading View all tags 1 branch 1 tag Code Loading Latest commit @akshaybhalotia akshaybhalotia feat: initial release ... 5af0b45 Dec 2, 2021 feat: initial release 5af0b45 Git stats * 3 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time data feat: initial release Dec 2, 2021 responses feat: initial release Dec 2, 2021 .gitignore feat: initial release Dec 2, 2021 CHANGELOG.md docs: add docs Dec 2, 2021 CODE_OF_CONDUCT.md Initial commit Dec 2, 2021 CONTRIBUTING.md Initial commit Dec 2, 2021 LICENSE Initial commit Dec 2, 2021 README.md docs: add docs Dec 2, 2021 combine_responses.rb feat: initial release Dec 2, 2021 json_to_csv.rb feat: initial release Dec 2, 2021 refresh_data.sh feat: initial release Dec 2, 2021 remove_extra_key.sh feat: initial release Dec 2, 2021 scraper.rb feat: initial release Dec 2, 2021 View code [ ] yc_company_scraper by akshaybhalotia Table of Contents About The Project Built With Getting Started Dependencies Installing Usage Run project locally Help Versioning Version History Roadmap Contributing Support License Acknowledgments About Authors README.md Logo yc_company_scraper by akshaybhalotia Barebones scraper for listing all YC companies View Data * Report Bug * Request Feature Table of Contents * About the Project + Built With * Getting Started + Dependencies + Installing + Usage o Run locally + Help * Versioning + Version History * Roadmap * Contributing * Support * License * Acknowledgments * About Authors About The Project This is an attempt to get publicly available data for all Y-Combinator (fondly known as "YC") backed companies, as available at the official "startup directory". Built With * jq * Ruby * VS Code * * [?] Getting Started You can clone or download the repo, and run the refresh_data.sh to refresh the data. You may also look at the other scripts if you want to run individual tasks or learn more about the project. If you just want to view the data, you can look into the data directory. Dependencies To run these scripts locally, you would need * Ruby language (if not pre-installed, visit https:// www.ruby-lang.org/en/documentation/installation/) ruby -v * jq (download using OS and distribution specific version from https://stedolan.github.io/jq/download/) Installing Clone the repo git clone https://github.com/akshaybhalotia/yc_company_scraper.git Usage Run project locally sh refresh_data.sh Help You might encounter 3 kinds of issues: 1. ruby or jq related: Something might change with the future (or past) versions of the Ruby lang or jq tool, causing the scripts to break. This script has been tested on ruby v2.7.x and v3.0.x, and jq v1.6. Your best bet is to read the official changelogs to figure out what changed and how to fix it. Submit a PR too! (Or you could ping me, I'll look at it in my free time - no promises) 2. OS related: I built this script on macOS v12.1, but is mostly generic enough to be run on all UNIX-derived, UNIX-like or Linux-like systems. If you still run into errors, please look at OS specific instructions to run the Ruby lang and jq properly. 3. Data related: Y-Combinator or Algolia may decide to change their APIs or data formats, which is always a risk for scrapers if something at the data source changes. If you can figure out what changed, you might want to submit a PR. (Or, again, you could ping me but no promises) Versioning We use SemVer for versioning. For the versions available, see the tags on this repository. Version History See CHANGELOG. Roadmap See the open issues for a list of proposed features (and known issues). Contributing Contributions are what make the open source community such an amazing place to be learn, inspire, and create. Any contributions you make are greatly appreciated. Sincere thanks to all our contributors. Thank you, contributors! You are requested to follow the contribution guidelines specified in CONTRIBUTING.md and code of conduct at CODE_OF_CONDUCT.md while contributing to the project . Support Contributions, issues, and feature requests are welcome! Give a [?] if you like this project. Donate $$ at https://paypal.me/akshaybhalotia if you like this work. License This project is licensed under the MIT License - see the LICENSE file for details. Acknowledgments This project is inspired by: * yclist * yclist code When I didn't find a source to download the data for all YC companies, and came across this repo with outdated data - I decided to build my own. I hope to have enough time at some point to update the data at yclist repo. About Authors yc_company_scraper is created & maintained by Akshay Bhalotia. You can find me on Twitter - @akshay_bhalotia or write to me at opensource [at] axy.one. About Barebones scraper for listing all YC companies Resources Readme License MIT License Code of conduct Code of conduct Releases 1 Data upto S21 Latest Dec 2, 2021 Packages 0 No packages published Languages * Ruby 94.1% * Shell 5.9% * (c) 2021 GitHub, Inc. * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.