changedetection.io - Your Reddit inspired website content monitoring tool releases 0.45.8 reddit / selfhosted ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 09:50 Hi all :) It's a been a while and I've been super busy, but here's another super nice release (thanks for the feedback!), support for xPath2.0/3.0 means you can use logic in your selectors (for example, give the count of the number of divs that contain certain text, and much more). UI improvements, Selectable browser (plug it into Bright Data's scraping browser!) and more, check it out! Much ❤ from the changedetection team. [https://github.com/dgtlmoon/changedetection.io] (https://github.com/dgtlmoon/changedetection.io) / changedetection.io [Website content monitoring and notification 'overview' list of websites being watched](https://preview.redd.it/ocv82wb5d93c1.png?widt h=1131&format=png&auto=webp&s=b8a3344859f4fefd55587eda3d9be7575cf128cf ) ---------------------------------------------------------------------- rursache · 2023-11-29 10:17 one of the best open source projects out there. check it out if you didn’t yet! ---------------------------------------------------------------------- Wings_of_bacon · 2023-11-29 10:20 Has anyone managed to use this to monitor Facebook groups? Like, with a session cookie ---------------------------------------------------------------------- theplayingdead · 2023-11-29 10:26 Awesome tool. I have bought a lot of theater tickets thanks to this. Thank you!! ---------------------------------------------------------------------- NosCat · 2023-11-29 10:29 I have switch from urlwatch2 to here, however the notification template is not as much as urlwatch2. May I have any good to use template? ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 10:39 absolutely :) thanks! ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 10:39 Thanks for the kind words! ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 10:40 You can add your session cookie under Edit > Request > Advanced Settings There's the "Request headers" box there ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 10:40 Thanks for the kind words! which show was it? :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 10:43 Any chance you can pop in a nice review for us at [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) ? :) ---------------------------------------------------------------------- NosCat · 2023-11-29 10:55 Thank you, I didn't realize you are the real developer of this software.😱 As you developed a REALLY EXCELLENT for me to monitor many websites important for me. Although urlwatch2 has same core function, changedetection.io has a beautiful UI and compatible with many notification way with each individual profile! Many Many thanks to find this software! ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 10:58 Please send us some love here [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) we dont have many reviews :( ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 11:03 Btw, check out our tutorials page for some inspiration https://changedetection.io/tutorials ---------------------------------------------------------------------- NosCat · 2023-11-29 11:03 Done with Copy & Paste😆👍🏻 ---------------------------------------------------------------------- fredflintstone88 · 2023-11-29 11:31 Will definitely check out! Do these also work on self hosted instance? ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 11:38 yes ---------------------------------------------------------------------- NeoID · 2023-11-29 11:50 Couldn't agree more with you. This is one of THE MOST important software to selfhost. Use it daily and would be impossible to keep track without it. :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 12:12 That's what I believe to - make a tool that does just one thing REALLY well, (its ok to have extra features - but the core must work reallllly well) and a nice UI too :) Any chance you can give us a quick thumbs-up/review at [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) ? :) ---------------------------------------------------------------------- NeoID · 2023-11-29 12:15 Absolutely! Consider it done :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 12:18 Much appreciated! ---------------------------------------------------------------------- Xdude96 · 2023-11-29 12:32 This fantastic piece of software got me release date IMAX Oppenheimer tickets! Highly recommend ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 12:34 if possibe please pop us a vote at the "alternativeto" link above :) ---------------------------------------------------------------------- j0hnnyclaymore · 2023-11-29 12:36 Can I provide a RSS Feed for a collection of sites I watch, so RSS user get a notify when a site gets updated? ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 12:38 not yet but thats' a great idea, what does the format look like exactly? can you paste a small example? (please just a few lines, dont flood reddit comments) ---------------------------------------------------------------------- j0hnnyclaymore · 2023-11-29 12:42 Im sorry what are you asking for? Just a notify of the Index Titel of the updated site, with something like: Update available. ---------------------------------------------------------------------- No_Dragonfruit_5882 · 2023-11-29 12:57 Webtrends http://www.celawi.eu/webtrends.html Nachrichten über kommerzielle Websites und Online-Werbung ---------------------------------------------------------------------- nurtext · 2023-11-29 13:38 Wow, such a nice tool. Wonder if it could be used for detecting software releases (such as new versions of container images, opensource Projects, etc) or if there's any other and dedicated software for this task. ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 13:40 Theres nothing to wonder - just try it, many thousands of people are already using it exactly for this task ---------------------------------------------------------------------- nurtext · 2023-11-29 13:41 I'll give it a try! ---------------------------------------------------------------------- mini_man_123 · 2023-11-29 13:44 Can you give me an example of sites you track? I can think of a couple but not many. ---------------------------------------------------------------------- rursache · 2023-11-29 14:21 everything from any online store on which you track sales/stock notifications to linux distros changelogs to 0nlyf@ns sales ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 14:57 [manual.bubble.io](https://manual.bubble.io) documentation [https://www.canyon.com](https://www.canyon.com) bikes [https://www.eriksbikeshop.com](https://www.eriksbikeshop.com) [https://www.onbuy.com/](https://www.onbuy.com/) i mean... just use your imagination job sites [https://www.ninefeettall.com/careers/](https://www.ninefeettall.com/c areers/) [https://www.network-n.com/careers/](https://www.network- n.com/careers/) [https://www.merityre.co.uk/recruitment](https://www.merityre.co.uk/re cruitment) [https://www.thriftbooks.com](https://www.thriftbooks.com) [amazon.com](https://amazon.com) ebay ​ etc etc ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 14:58 How about every site on the internet? just use your imagination.. manual.bubble.io documentation, https://www.canyon.com bikes [https://www.eriksbikeshop.com](https://www.eriksbikeshop.com) [https://www.onbuy.com/](https://www.onbuy.com/) i mean... just use your magination job sites [https://www.ninefeettall.com/careers/](https: //www.ninefeettall.com/careers/) [https://www.network-n.com/careers/](https://www.network- n.com/careers/) [https://www.merityre.co.uk/recruitment](https://www. merityre.co.uk/recruitment) [https://www.thriftbooks.com](https://www.thriftbooks.com) [amazon.com](https://amazon.com) ebay , software updates, bestbuy restock alerts, etc etc etc etc etc etc ---------------------------------------------------------------------- OneTime_AtBandCamp · 2023-11-29 15:04 Can this be used track prices of specific Amazon product pages? I ask because Amazon has sophisticated anti-scraping shit built in. ---------------------------------------------------------------------- pax0707 · 2023-11-29 15:05 Great tool and great update. Must have for self hosted. ---------------------------------------------------------------------- ThePrimitiveSword · 2023-11-29 15:32 CamelCamelCamel might be a better option for that specific use case, but for everything else, this tool is amazing. Been using it for years. ---------------------------------------------------------------------- Jonteponte71 · 2023-11-29 15:40 If you want to track docker images, I just found ”What’s up docker” and am using it as we speak :) ---------------------------------------------------------------------- Jonteponte71 · 2023-11-29 15:44 I just find new great software to tinker with every day on this sub. Luckliy I am on sickleave and have plenty of time. Othervise this sub is anxeity inducing 🤓 ---------------------------------------------------------------------- nobearclaw · 2023-11-29 16:09 By far the most valuable thing I host. Thank you! ---------------------------------------------------------------------- j0hnnyclaymore · 2023-11-29 16:19 Thanks! Tried it out, its cool! How can I switch the UI to https? ---------------------------------------------------------------------- CactusBoyScout · 2023-11-29 16:20 One example I remember... getting an appointment for Global Entry. If you're not American, you might not know what that is... but it's an expedited airport/immigration program in the US and getting an appointment often takes months. You can use tools like this to monitor the appointments page for cancellations. I didn't use this specific tool but I used something similar when I signed up for GE and was able to get an appointment 2 weeks after I applied. Normally it takes months. ---------------------------------------------------------------------- NeoID · 2023-11-29 16:32 I use it for tracking version information for different GitHub repos and other websites/software. For example what the latest version of UnRAID or Synology DSM is. I also track a few Wikipedia pages for knowing when certain authors write new books. When stuff I want to buy is out of stock I usually add a tracker for that as well so I know when I can buy it. Now that I got my Quest 3 with a Quest+ subscription I track whatever is the monthly game and a lot more.... Basically everything I have running/installed in my smart home is added so I know when new versions are available. ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 16:36 You should use a real web server infront of it in this case, see [https://github.com/dgtlmoon/changedetection.io/wiki/Running- changedetection.io-behind-a-reverse- proxy](https://github.com/dgtlmoon/changedetection.io/wiki/Running- changedetection.io-behind-a-reverse-proxy) (nginx apache etc) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 16:37 glad to hear it! if its valuable to you, please drop a review at [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) :) ---------------------------------------------------------------------- nurtext · 2023-11-29 16:41 Cheers! ---------------------------------------------------------------------- fjmerc · 2023-11-29 17:29 It's pretty awesome software. The main use case for me is tracking my home equity from different sites and also checking the status of my qBittorent. I have it integrated with Apprise and Gotify, which then sends alerts to my phone. 10/10 would recommend. ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 17:40 https://changedetection.io/tutorial/bestbuy-get-coming-soon-product- stock-notifications-using-restock-detection ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 17:55 the 'export data' part is simple but works great, i'm doing something similar for graphing the number of houses that appear for sale in my area over time (some super interesting stuff over the last year!) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 17:55 btw, if you can reward us [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) pop a review into there, we really want to break 20 reviews/likes :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 17:56 Please give us a vote/rating [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) it sounds like this software changed your life :) ---------------------------------------------------------------------- Jonteponte71 · 2023-11-29 17:56 It actually automatically tracked every container on my local docker host by default on install. But you need to configure the notifications and the triggers for more granularity. Very nice! ---------------------------------------------------------------------- nurtext · 2023-11-29 18:47 Exactly what I was looking for! ---------------------------------------------------------------------- DubDubz · 2023-11-29 19:17 One thing I’d love to see is the ability to download a pdf and send that as the change. More options past that like reading the pdf would be nice but not necessary. I tried to use playwright to do it, but most of the sites I want to do it with open the pdf in a new tab and right now the playwright instructions can’t handle that. ---------------------------------------------------------------------- secopsx · 2023-11-29 20:58 my homelab to do list grows endlessly...pretty soon I'll be super glued to my chair. ---------------------------------------------------------------------- Defiant-Ad-5513 · 2023-11-29 21:25 What is better on the Bright Data scraping browser? ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 21:37 hmm yeah its probably faster and better at beating the fingerprint tests ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 21:38 it supports PDF natively, can you tell me the URL you are trying? it should PDF-to-text already ---------------------------------------------------------------------- inthesum · 2023-11-29 21:40 I see this has subscription model? Can someone explain what is not available in self hosted ---------------------------------------------------------------------- DubDubz · 2023-11-29 21:45 I’m trying it on my bank/utility page. The issue isn’t necessarily reading the pdf, it’s when I try to do something like hit “view my bill” the page opens a new tab. But it seems like playwright needs special work to handle new tabs. ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 21:51 ahhh in a new tab... interesting, yeah i didnt think of that :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 21:52 it's all exactly the same, except subscription model gives you a few extra built in proxies, otherwise you are totally free to choose :) ---------------------------------------------------------------------- inthesum · 2023-11-29 21:53 Thanks I just installed via docker but ui isn't working ---------------------------------------------------------------------- Defiant-Ad-5513 · 2023-11-29 21:57 Ok and ressource wise? ---------------------------------------------------------------------- 1337haXXor · 2023-11-29 22:22 This looks amazing! What's everyone using it for? I want ideas, haha. The only thing I can think of is notifying when my small subreddits post something, since they killed rif. ---------------------------------------------------------------------- number5 · 2023-11-29 23:02 First time heard someone called Reddit "website content monitoring tool" 🤔 What changedetetction.io really does? ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 23:03 already answered https://www.reddit.com/r/selfhosted/comments/186ltbv/ comment/kb9n6is/?utm\_source=reddit&utm\_medium=web2x&context=3 ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 23:03 yes ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 23:04 not enough information ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-29 23:04 thats like saying... i have a car but the wheel doesnt turn ---------------------------------------------------------------------- inthesum · 2023-11-29 23:05 I'll check in docker again but I installed via pip and that seems working ---------------------------------------------------------------------- 1337haXXor · 2023-11-30 00:10 Awesome, thanks! ---------------------------------------------------------------------- DubDubz · 2023-11-30 00:27 My goal is to use change detection to gather all those obnoxious bills and statements that you need to logon to a portal to get and send them to paperless for automated storage. Would be amazing. Just like you. ---------------------------------------------------------------------- 991 · 2023-11-30 01:19 Is it possible to pull & compare the whole webpage source? Since I've found some websites has hidden changes that aren't made visible, both the basic and playwright fetcher won't check the underground changes. u/dgtlmoon123 ---------------------------------------------------------------------- inthesum · 2023-11-30 01:32 Got it working but seems like there are more options required to be configured like playwright url which i dont really understand. Is there any yaml files which has everything configured ? ---------------------------------------------------------------------- inthesum · 2023-11-30 02:08 I tried adding this link and it comes with this error no matter what method i chose https://www.primeabgb.com/online-price-reviews-india/seagate- ironwolf-6tb-nas-internal-hard-drive-7200-rpm-st6000vn001/ Create a link to share watch config with others unsupported operand type(s) for -: 'str' and 'str' ---------------------------------------------------------------------- igmyeongui · 2023-11-30 04:10 I could've written this comment. I'm glad I ain't alone. ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 07:50 still not enough information, i dont anything about your settings, sorry. ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 07:50 Yes ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 07:51 Yes, prefix the url you enter with "source:" so "source:[https://google.com](https://google.com)" please give us a vote at [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 07:52 Yes I also have the same dream :D it was actually one thought when I started it.. could you open a feature request on our github page? and please [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) :) one vote :) ---------------------------------------------------------------------- 123liz123 · 2023-11-30 13:20 This would be amazing!!! I've been trying to figure out this exact same setup. ---------------------------------------------------------------------- bobbysteel · 2023-11-30 14:09 This is such an amazing useful app especially with the ability to use the standalone headless playwright browser!! ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 14:25 Thanks for the kind words! Could you reward our hardwork by voting us and leaving a very short review at [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) ? :) ---------------------------------------------------------------------- DubDubz · 2023-11-30 16:40 Already threw you a vote on there yesterday :p But I added a github star, threw a dono your way, and added a feature request. You're awesome, thanks for doing the work you do. ---------------------------------------------------------------------- CobblerYm · 2023-11-30 17:24 Is that new? In the past you had to put a file in your data directory and use that which was *really* annoying. Having a headers field you can just edit is the best update I could have hoped for! You guys rock ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 18:49 Its always been there, you can use both :) some people wanted to mount a file that was updated by another program, some people prefer to use the field :) "You guys rock" - [https://alternativeto.net/software/changedetection- io/](https://alternativeto.net/software/changedetection-io/) please leave a review and thumsup there - we really want to break into the '20's of stars so we can get higher in the results against others :) ---------------------------------------------------------------------- dgtlmoon123 · 2023-11-30 18:49 aaaah amazing, thank you so much!!! ---------------------------------------------------------------------- CobblerYm · 2023-11-30 18:57 > Its always been there, you can use both Oh man I don't know how I missed it! I have fought with that file for a while wondering "Why not just add a header field!" Great project though, I have used it with great success a few times now. You'll get another star from me ---------------------------------------------------------------------- DubDubz · 2023-11-30 19:24 And if you can get this whole work flow going I’ll do a write up on how I’m doing it as a new post to show other people the new things it can do. I’m also happy to test on a beta version if you have that out. Just a little extra motivation haha. ---------------------------------------------------------------------- inthesum · 2023-12-02 15:18 I got it working and was able to get price alerts for some comics. One query Whenever I add any link since notification is enable in global setting it sends a notification but I only want it when price change after its been added Example for reference https://www.bookswagon.com/book/avengers-by- jonathan-hickman-simone/9781302926489 ---------------------------------------------------------------------- dgtlmoon123 · 2023-12-02 17:25 remove the global notification, and set the notification in "groups"