[HN Gopher] Show HN: I made tool that let's you see everything a...
       ___________________________________________________________________
        
       Show HN: I made tool that let's you see everything about any
       website
        
       Yes, it's open source: https://github.com/lissy93/web-check :)  Why
       I'm building this? There are a lot of tools out there for
       discovering meta and security data relating to a website, IP or
       server. But currently, there isn't anything that does everything,
       all in one place and without a paywall/ user sign up.  It's still a
       WIP, and I'm working on a new version, with some more comprehensive
       checks, so any feedback would be much appreciated :)
        
       Author : lissy93
       Score  : 153 points
       Date   : 2024-06-22 10:43 UTC (12 hours ago)
        
 (HTM) web link (v1.web-check.xyz)
 (TXT) w3m dump (v1.web-check.xyz)
        
       | KomoD wrote:
       | Maybe I'm misunderstanding but I think there's been a mistake
       | with the "Bad URLs Count", it shows a date instead of what I'd
       | expect (a number)
        
         | lissy93 wrote:
         | oooh let me look into that. You're right; it should be a
         | number.
        
       | breck wrote:
       | Hey that was a pleasantly great experience.
       | 
       | I don't have anything to add. Nicely done.
       | 
       | Thanks!
        
       | quyleanh wrote:
       | Let's add a function which lists up all sub domain.
        
         | leobg wrote:
         | +1. And reall well done. I like how you can scroll through to
         | get a good overview without any one section being too long to
         | break that high level overview flow. Excellently executed.
        
       | valleyer wrote:
       | "Energy Usage for Load" is specified in "KWg". What does that
       | mean? Is it a typo for "kWh"?
        
         | ffhhj wrote:
         | it's nuclear powered, g is for grams of uranium
        
       | 201984 wrote:
       | >https://web-check.xyz/check/http%3A%2F%2F127.0.0.1
       | 
       | >City: undefined, undefined, undefined
       | 
       | Heh
        
         | jenscow wrote:
         | that's my ip address!
        
         | ramon156 wrote:
         | Should display "City: Home (:"
        
       | brightmood wrote:
       | I have a issue with the website background - on a high refresh
       | rate display with 240Hz, the background animation is incredibly
       | fast and its super distracting.
        
       | 201984 wrote:
       | What's the difference between the link in this post
       | (https://v1.web-check.xyz/) and on your Github (https://web-
       | check.xyz/)?
        
       | banku_brougham wrote:
       | Amazing! Reminds me that I need to learn a bunch of stuff I know
       | nothing about.
        
       | g4zj wrote:
       | The AAAA record listing seems to only display the A record
       | value(s).
        
       | johng wrote:
       | This is really neat, kudos!
        
       | butz wrote:
       | Neat, bonus points for colorful log messages in console. One
       | thing though: any ideas what is causing horizontal scrollbar to
       | appear in Firefox? I observe this issue on several websites, but
       | never figured out the issue.
        
       | scubbo wrote:
       | Very cool tool!
        
       | rexreed wrote:
       | From the first of 3 previous submissions to HN:
       | https://news.ycombinator.com/item?id=36839603
        
       | jacobprall wrote:
       | I enjoyed the UI, cool aesthetic.
        
       | 8organicbits wrote:
       | Beautiful! Thanks for open sourcing this!
       | 
       | I've been working on a project [1] that probably wants to become
       | a live crawler like this, but it's currently batch based. I'm
       | focused on RSS feeds and microformats [2]. Can you share any
       | details on what kind of performance / operational costs you're
       | seeing while you're on the HN front page? The fly.toml looks like
       | $5/month could suffice?
       | 
       | [1] https://alexsci.com/rss-blogroll-network/
       | 
       | [2] https://microformats.org/wiki/Main_Page
        
         | spaceship__sun wrote:
         | I'm not OP; I received ~100 thousand requests being on the
         | front page once. It was an AI app and I quickly got rate
         | limited to GCP Vertex AI lol.
        
       | Syntaf wrote:
       | I'm a bit confused on the "Threats" section, entering my member
       | management startup https://embolt.app shows malware detected with
       | a timestamp dating back to 2018 (we launched this year).
       | 
       | I checked out another startup I know of (https://highlight.io)
       | and it listed the same results.
       | 
       | Maybe I'm misinterpreting what this section means?
        
       | PaulDavisThe1st wrote:
       | Seems like there may be some issue with the crawl rules. What is
       | it looking for that would to the error "t.robots is not defined"
       | ?
        
       | efilife wrote:
       | A correction to the post's title:
       | https://youryoure.com/?apostrophe Should have been lets. Those
       | are two different words with different meanings!
       | 
       | Great site btw
        
       | Ahmd72 wrote:
       | I have been using this and I have got to say this is one of the
       | best open source projects at least for me as I need to look up
       | URLs reputation and this is highly helpful in how everything is
       | organized as cards. One screen to get all the helpful information
       | you need. I'm looking forward to the API version and if I could
       | use this as a replacement for VT. I did notice one thing
       | sometimes when you lookup a URL you don't get back any response
       | and when you check network activity tab on a browser you see the
       | requests are getting rejected
        
       | thwarted wrote:
       | Checking two websites/domains I'm responsible for, this
       | information is really confusing or just plain wrong. The "DNS
       | Records" card for MX is not the IP addresses of the actual MX
       | records (nor am I sure why it would be -- why wouldn't the MX
       | records be shown here?). "DNS Server" is the addresses of the
       | webservers, not the DNS servers for the domain from whois or from
       | the SOA record. It can show certificate information, but not the
       | cipher suites? Traceroute fails because traceroute isn't
       | available/isn't in path (the error shown is "/bin/sh: line 1:
       | traceroute: command not found"). Firewall seems to be looking
       | specifically for a web-application-firewall, but "firewall" is a
       | somewhat generic term that includes a number of different
       | technologies. Email configuration is wrong, probably because a
       | website is not the same as a domain -- I don't have SPF or DKIM
       | records for the www subdomain, because that's not where we send
       | email from. The "Redirects" card says it followed one redirect,
       | but there is no redirect on the address I provided.
       | 
       | Does this come down to trying to stuff a bunch of stuff for
       | domains into a presentation and information gathering method for
       | websites?
       | 
       | For cases where it can not be determined, it would be best to say
       | "can not be determined" rather than "No", because the last thing
       | anyone needs is some PHB giving people grief because, for
       | example, the WAF in use doesn't expose itself to this detector.
        
       | simple10 wrote:
       | The docker version[1] worked better for me to test out. The free
       | website version does not have all the features (like Chromium)
       | enabled which is why some of the report data is missing or
       | incorrect.
       | 
       | Looks like a super promising project! Thanks for building and
       | sharing.
       | 
       | [1] https://hub.docker.com/r/lissy93/web-check
        
       ___________________________________________________________________
       (page generated 2024-06-22 23:01 UTC)