1

Working on an embedded systems project. I’ve purchased a FLIR style thermal camera off an older cadillac. It outputs grayscale video at 320x240 (NTSC). Ultimately, I’d like to add night vision with image recognition to my car outputting to either a display or a display that’s reflected onto a HUDWAY type translucent display.

I intitially looked at using some sort of ADC to convert the analog NTSC feed to digital and feeding it to the Pi but everything I read says a generic USB easycap will be the way to go. Real-time is important - will the easycap introduce much of a lag? Are there any simple chips that do this better?

My second question has to do with image recognition - really not very familiar with this at all but I’ve seen OpenCV projects with the Pi in the past. Performance wise, most examples I’ve seen have relatively low frame rates (under 1FPS in some cases), but these all used much higher resolution cameras. Whereas I’m trying to do just very basic shape recognition on a low resolution feed, will the Pi have enough resources to produce a reasonable (20+fps) output? I’ve got a Pi 3B+. If not, is there a board more suited for this application?

Am I missing anything obvious? I believe this should be fairly straightforward. Basically trying to do what’s done in the link below but with boxed outlines around detected objects like modern auto night vision systems. Thanks in advance!

https://www.corvetteforum.com/forums/c6-corvette-general-discussion/3227122-real-thermal-imaging-night-vision-install-must-lqqk.html

  • If you wanted to sample&display the camera image, your lag has to be less than 50ms, that's ambitious. A hybrid approach would display the camera image into the HUD directly while at the same time sampling it for the image recognition stuff and use a genlock or secondary HUD projector for the markers. That way, you can live with a lag of 500ms, which is more feasible. – Janka Oct 31 '18 at 15:03
  • Thanks for the input! Janka I've seen that solution and that sounds like the best route for sure. Not super concerned with image recognition speed as long as it's not ridiculously slow but raw fps to display is definitely important. Tomas - not many if any other LWIR sensors under $500 that are focused correctly and have 320x240 output. Lepton chips are like $250 and 160x120, but I'd need to build a lens and all that focuses at high distance. I'll look into the link! I assume you get major performance Advantages using the CSI? – siestacat Oct 31 '18 at 16:41

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.