Post ALJOI6QKhfRWENKWSe by cristiioan@fosstodon.org
(DIR) More posts by cristiioan@fosstodon.org
(DIR) Post #ALHzaL0KXWOkeUo2D2 by cristiioan@fosstodon.org
2022-07-08T16:33:27Z
0 likes, 0 repeats
I always like the idea of making my own small search engine. Something simple, like http://wiby.me, for finding personal blogs, open source software and communities. Any idea on how to implement it? I have a few ideas on how to implement the ranking algorithm and some of the code needed in the back end(storing data, API) and the front end, but more complicated things(like doing the actual search, looking for metadata in HTML), I'm not sure how to do. Any help?
(DIR) Post #ALHzaLPr0coZvekPzc by werwolf@fosstodon.org
2022-07-08T17:57:01Z
0 likes, 0 repeats
@cristiioan maybe you can take inspiration from other similar search engines, lieu comes to mind https://github.com/cblgh/lieuIt doesn't have the same purpose as yours, but you may find their code useful.I like the idea of such a search engine, good luck.
(DIR) Post #ALI4A256luIQCnJi7c by cristiioan@fosstodon.org
2022-07-08T18:48:18Z
0 likes, 0 repeats
@werwolf Thanks. That should be what I need, and I can learn how they do it very easy for my own search engine.
(DIR) Post #ALJJavGBvxYPL4k0lk by Anachron@fosstodon.org
2022-07-09T09:03:08Z
0 likes, 0 repeats
@cristiioan @werwolf check out searx and the fork searxng.I do actually plan something similiar but havent have time yet to set it up.Also need a new ssd for that as the data needed will be pretty intense, even if the scope is very limited for me.My idea was not to scrape content "randomly" but open a community of plugins for popular websites.
(DIR) Post #ALJJb54VSG9HljLowa by werwolf@fosstodon.org
2022-07-09T09:15:56Z
0 likes, 0 repeats
@Anachron @cristiioan SearX/SearXNG is a meta search engine. This meams that it doesn't index pages at all. They query other search engines and combine the results.
(DIR) Post #ALJKAV3Mqc3wU7hv3A by xarvos@nixnet.social
2022-07-09T09:22:23.619327Z
0 likes, 0 repeats
@cristiioan you can grab apache solr and custom it for your site
(DIR) Post #ALJOI6QKhfRWENKWSe by cristiioan@fosstodon.org
2022-07-09T10:08:35Z
0 likes, 0 repeats
@werwolf @Anachron I use searxng, so I don't give data to google, but as @werwolf said, is not what I need
(DIR) Post #ALLZGElYNggVN2v9VY by werwolf@fosstodon.org
2022-07-10T11:20:55Z
0 likes, 0 repeats
@cristiioan hey, in case you didn't noticed it, Wiby has made their backed available under the GPLv2 so it's free software now:https://github.com/wibyweb/wibyThey seem to have two implementations, one in PHP and other in Golanghttps://wiby.me/about/guide.htmlI thought that you could find it interesting.
(DIR) Post #ALLZJuMy9mUdGpAjqK by werwolf@fosstodon.org
2022-07-10T11:21:35Z
0 likes, 0 repeats
@cristiioan hey, in case you didn't know, Wiby has made their backed available under the GPLv2 so it's free software now:https://github.com/wibyweb/wibyThey seem to have two implementations, one in PHP and other in Golanghttps://wiby.me/about/guide.htmlI thought that you could find it interesting.
(DIR) Post #ALLsB4cEafnxZToTUe by cristiioan@fosstodon.org
2022-07-10T14:52:53Z
0 likes, 0 repeats
@werwolf I searched a lot and I didn't find it. Thanks for the info!