[HN Gopher] Multi-camera real-time object detection with WebRTC ...
___________________________________________________________________
Multi-camera real-time object detection with WebRTC and YOLO
Author : jackaruu
Score : 54 points
Date : 2023-01-02 18:05 UTC (1 days ago)
(HTM) web link (softwarescalability.com)
(TXT) w3m dump (softwarescalability.com)
| eternityforest wrote:
| I use Efficientdet and Websockets. On the LAN, WS can give
| subsecond latency quite easily.
|
| Unfortunately I don't have a learning accelerator or dedicated
| NVR machine, so I'm just using tricks like only decoding
| keyframes and running inference on those, but only if I've
| detected motion.
|
| I'd really like to do more with image recognition, edge computing
| surveillance has a lot of of potential to help people who don't
| trust the cloud solutions.
| smallerfish wrote:
| What are you doing motion detection with? I'm using dvr-scan
| (which wraps opencv) right now, and it's both slow and hard to
| tune.
|
| And, are you using zones, or do you just have filtering tuned
| so that ambient movement of leaves etc don't trigger an event?
| It seems to me that since a camera's viewpoint is static that
| you ought to be able to train it to identify and disregard
| "normal" movement, but I haven't dug far enough to figure out
| how to do that yet.
| zennit wrote:
| I'd be interested in more details of your setup. It sounds like
| it might be a good approach for something I'm planning to setup
| in my garden to capture the wildlife. I'd like to use motion
| detection and megadetector to analyse the footage. Currently
| trying to find some half decent cameras to use at a reasonable
| price.
| Roark66 wrote:
| Not the original poster, but I recommend zoneminder(open
| source) software. I do the same as the parent. I have an old
| cpu in a server that does motion detection on multiple h264
| HD streams and only once (zone based) motion is detected it
| feeds it into a SSDLite_MobileDet object detection running on
| a pcie edge TPU (a cheap Google made AI accelerator). Same
| can be done with no accelerator, but I plan on adding many
| more cameras.
|
| (Zmeventnotification add on is used for edgetpu stuff.)
|
| Important things to note. Streams are recorded at 30fps,but
| motion detection runs at only 5fps as I found it better for
| slow moving objects. Also be prepared for the motion
| detection to run horribly until you tune it in, but although
| many more user friendly software packages exist I recommend
| zoneminder, because no other give so much control over motion
| detection parameters. I have one camera that looks at a 100m
| long field with multiple bushes and trees moving in the wind.
| It needs to be less sensitive for nearby stuff(bottom of the
| frame) and a lot more for far away. It has to exclude rain,
| snow, switches to IR etc. Only ZM allows me to tweak it
| properly and now that I did it runs with no false positives
| for days.
| simlevesque wrote:
| > edge computing surveillance has a lot of of potential to help
| people who don't trust the cloud solutions.
|
| Yes and the tech is now at a point where you can do it with off
| the shelf hardware and software.
|
| MediaPipe can run on old raspberry pis or phones with a good
| performance.
| makestuff wrote:
| I am still waiting on someone to come out with a NLU model
| that can do the basic home automation tasks that most people
| use alexa/google assistant for. Ex: turn on lights, turn on
| heat, etc.
|
| I think if you could develop a piece of hardware that could
| run inference on all of that for under $500 a lot people
| would ditch the cloud based voice assistants. Especially if
| it came with home assistant integrations.
| rkagerer wrote:
| Neat. But that 93% confidence in the "bus" is one of the things
| that bugs me about AI / NN.
| photoGrant wrote:
| It's 93% sure it SEE'S a bus, not so much it's 93% a guarantee
| it actually IS a bus.
|
| Confidence can corrupt in many domains, not just AI!
| miohtama wrote:
| As far as I have seen, most AI solutions focus on object
| detection on a single frame. Would temporal memory, or video
| detection, increase the confidence a lot? I have not seen any
| solutions that would understand larger context over multiple
| seconds timespans.
| bart__ wrote:
| It is also 99% sure some sort of post is a human.
| [deleted]
___________________________________________________________________
(page generated 2023-01-03 23:01 UTC)