https://github.com/jina-ai/examples/tree/master/audio-search Skip to content Sign up Sign up * Why GitHub? Features - + Mobile - + Actions - + Codespaces - + Packages - + Security - + Code review - + Project management - + Integrations - + GitHub Sponsors - + Customer stories- * Team * Enterprise * Explore + Explore GitHub - Learn and contribute + Topics - + Collections - + Trending - + Learning Lab - + Open source guides - Connect with others + The ReadME Project - + Events - + Community forum - + GitHub Education - + GitHub Stars program - * Marketplace * Pricing Plans - + Compare plans - + Contact Sales - + Education - [ ] [search-key] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this organization All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up Sign up {{ message }} jina-ai / examples * Notifications * Star 251 * Fork 94 * Code * Issues 12 * Pull requests 1 * Actions * Projects 0 * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Security * Insights master Switch branches/tags [ ] Branches Tags Nothing to show {{ refName }} default View all branches Nothing to show {{ refName }} default View all tags examples/audio-search/ Go to file examples/audio-search/ Latest commit @Yongxuanzhang Yongxuanzhang fix[audio]: adapt segmenter for changes (#430) ... 6674ee0 Mar 18, 2021 fix[audio]: adapt segmenter for changes (#430) * fix: adapt segmenter for changes * fix: adapt single change * fix: change to single * fix: fix typo * fix: bump version 6674ee0 Git stats * History Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time . . .github feat: fix the dependency issues Sep 19, 2020 flows refactor: update audio-search example (#377) Feb 1, 2021 pods fix[audio]: adapt segmenter for changes (#430) Mar 19, 2021 tests fix: fix the audio example (#416) Mar 15, 2021 .dockerignore feat: complete the indexing part Sep 14, 2020 Dockerfile fix: fix the audio example (#416) Mar 15, 2021 README.md [BUG][FIX] Add dependency check and warning messages (#393) Feb 17, 2021 app.py refactor: update audio-search example (#377) Feb 1, 2021 download_data.sh [BUG][FIX] Add dependency check and warning messages (#393) Feb 17, 2021 download_model.sh refactor: update audio-search example (#377) Feb 1, 2021 get_data.sh fix: fix the audio example (#416) Mar 15, 2021 requirements.txt fix[audio]: adapt segmenter for changes (#430) Mar 19, 2021 Build Audio Search with Vggish Install Prerequisites Download Model Run Run as a Docker Container Documentation Community License README.md Table of Contents * Build Audio Search with Vggish + Install Prerequisites + Download Model + Run + Run as a Docker Container + Documentation + Community + License Build Audio Search with Vggish Jina Jina Jina Jina Docs We are hiring tweet button Python 3.7 3.8 Docker A demo of neural search for audio data based Vggish model. Jina banner Install Prerequisites * In order to run this example, you should have youtube-dl, ffmpeg available in your system. Please refer to the specific installation instructions. * For MacOS users, a libmagic installation will furtherly be needed and can be obtained by running brew install libmagic * You can add to your system the python libraries required for this example by running the following: pip install -r requirements.txt Download Model * In this example, we use the Vggish model to encode the sound files. You can find more details about the model at https:// github.com/tensorflow/models/tree/master/research/audioset/vggish . Use the following cmd to download the models. For downloading the audioset data, we adapt the codes from the runme.sh script at https://github.com/qiuqiangkong/audioset_tagging_cnn . We provide the following script, it will download 10 audio files from the audioset dataset. bash download_model.sh bash download_data.sh After preparing the data, here is how the folder looks like, . +-- Dockerfile +-- README.md +-- app.py +-- data +-- +-- metadata | | +-- eval_segments.csv | +-- YjmN-c5mDxfw.wav | +-- Yjo9lFbGXf_0.wav | +-- Yjzij1UX73kU.wav +-- download_data.sh +-- download_model.sh +-- flows | +-- index.yml | +-- query.yml +-- get_data.sh +-- models | +-- vggish_model.ckpt | +-- vggish_pca_params.npz +-- pods | +-- chunk_merger.yml | +-- customized_executors.py | +-- doc.yml | +-- encode.yml | +-- rank.yml | +-- segment.yml | +-- vec.yml | +-- vggish | +-- mel_features.py | +-- vggish_input.py | +-- vggish_params.py | +-- vggish_postprocess.py | +-- vggish_slim.py +-- requirements.txt +-- tests +-- data | +-- YjmN-c5mDxfw.wav | +-- Yjo9lFbGXf_0.wav | +-- Yjzij1UX73kU.wav +-- test_audio_search.py * Alternatively, you can also use you own .wav files. Make sure the files are under data/. For example, our get_data.sh script downloads a few Beethoven symphonies from Wikimedia Commons. This is a small dataset so indexes quickly. Just run sh ./get_data.sh Run Command Description python app.py -t index To index files/data python app.py -t query To run query on the index Then open https://jina.ai/jinabox.js/ for querying. Run as a Docker Container To mount local directory and run: docker run -v "$(pwd)/data:/workspace/data" -v "$(pwd)/workspace:/workspace/workspace" jinaai/hub.app.audio-search:0.0.1 index Run the following cmd and open https://jina.ai/jinabox.js/ for querying docker run -p 65481:65481 -e "JINA_PORT=65481" -v "$(pwd)/workspace:/workspace/workspace" jinaai/hub.app.audio-search:0.0.1 search Documentation [jina-docs] The best way to learn Jina in-depth is to read our documentation. Documentation is built on every push, merge, and release event of the master branch. For more details, check out: * Jina command line interface arguments explained * Jina Python API interface * Jina YAML syntax for executor, driver and flow * Jina Protobuf schema * Environment variables used in Jina * ... and more Community * Slack channel - a communication platform for developers to discuss Jina * Community newsletter - subscribe to the latest update, release and event news of Jina * LinkedIn - get to know Jina AI as a company and find job opportunities * Twitter Follow - follow us and interact with us using hashtag # JinaSearch * Company - know more about our company, we are fully committed to open-source! License Copyright (c) 2020 Jina AI. All rights reserved. * (c) 2021 GitHub, Inc. * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.