Hello Friends, Seems like a cool forum... I think this is the best place to ask this questions. We design Thermal Imaging cameras which need quit a allot of custom image processing and custom sensor controls. What should we use FPGA or Micro controller? Camera and video/image processing Brief We have a 1024 by 768 12 bit per pixel(BW) image 30fp , coming in through a serial link. The image then needs allot of image processing such as : 3 point Calibration Custom Contrast enhance and detail enhancement Scaling Colourization AGC Blending Object detection FPGA Approach: Completely possible no problem with custom device interfaces and horsepower.... However its an expensive approach. Has longer development time and seems to more difficult. I am very interested in be able to use on of the TI MC such as Omap4. This seems very appealing because of its onchip interfaces: Memory Controllers Serial /Usb controllers Wifi/3g capabilities The device is composed of the following subsystems: – Cortex™-A9 microprocessor unit (MPU) subsystem, including two ARM® Cortex-A9 cores – Digital signal processor (DSP) subsystem – Image and video accelerator high-definition (IVA-HD) subsystem – Cortex™-M3 MPU subsystem, including two ARM Cortex-M3 microprocessors – Display subsystem – Audio back-end (ABE) subsystem – Imaging subsystem (ISS), consisting of image signal processor (ISP) and still image coprocessor (SIMCOP) block – 2D/3D graphic accelerator (SGX) subsystem – Emulation (EMU) subsystem However as I have not worked much with these kind of multimedia application processor. I have not understood whether this kind of processor can be used for my application. Can I implement my custom image processing blocks using the on chip DSP Cortex™-A9 microprocessor unit (MPU) subsystem ,Image and Video Acceleration and ISS blocks. Is it possible to implement such processing algorithms: 3 point Calibration Custom Contrast enhance and detail enhancement Scaling Colourization AGC Blending Object detection and then Output it on an LCD. Look forward to hear from you all soon. Regards, Nadeem --------------------------------------- Posted through http://www.EmbeddedRelated.com
Video/Image Processing on FPGA OR Micro-controller?
Started by ●October 16, 2011
Reply by ●October 16, 20112011-10-16
On Oct 16, 4:57=A0pm, "njamal" <nadeemj@n_o_s_p_a_m.titanthermal.com> wrote:> Hello Friends, > > Seems like a cool forum... I think this is the best place to ask this > questions. > > We design Thermal Imaging cameras which need quit a allot of custom image > processing and custom sensor controls. What should we use FPGA or Micro > controller? > > Camera and video/image processing Brief > > We have a 1024 by 768 12 bit per pixel(BW) image 30fp , coming in through=a> serial link.You have a 284Mbps serial link? What kind?
Reply by ●October 17, 20112011-10-17
In article <t5ednTrAzqLy8gbTnZ2dnUVZ_q2dnZ2d@giganews.com>, nadeemj@n_o_s_p_a_m.titanthermal.com says...> > Hello Friends, > > Seems like a cool forum... I think this is the best place to ask this > questions.This is a newsgroup and your use of the word 'cool' immediately makes me think a university project. You happened to see a copy of the newsgroup on a website.> We design Thermal Imaging cameras which need quit a allot of customimage> processing and custom sensor controls. What should we use FPGA or Micro > controller? > > > Camera and video/image processing Brief > > We have a 1024 by 768 12 bit per pixel(BW) image 30fp , coming in through a > serial link. > > The image then needs allot of image processing such as : > > 3 point Calibration > Custom Contrast enhance and detail enhancement > Scaling > Colourization > AGC > Blending > Object detectionSounds pretty typical requirements. Mixture of point and area processing.> FPGA Approach: Completely possible no problem with custom deviceinterfaces> and horsepower.... However its an expensive approach. Has longer > development time and seems to more difficult.How do you KNOW this? If from past experience you should have parts of previous FPGA designs that can be reused or re-purposed for such things, almost like resusing parts of previous circuits.> I am very interested in be able to use on of the TI MC such as Omap4.You mean you want to play with software and a device that is new to you.> This seems very appealing because of its onchip interfaces: > > Memory Controllers > Serial /Usb controllers > Wifi/3g capabilitiesThere is the THIRD possibility FPGA and processor, where you do as much time critical path in the FPGA and less time critical in processor with wome FPGA paths controlled by processor (changing calibration points, AGC range, colorisation factors etc..). FPGA and LUTs inside them are very good for offloading point processing to minimal delay. Even convolution processing becomes relatively easy with a few line delays in FPGA That way you get less missed frames due to other issues of Wifi protocol taking a lot of CPU time and dropping frames.> The device is composed of the following subsystems: > �? Cortex�?�-A9 microprocessor unit (MPU) subsystem, including two ARM® > Cortex-A9 cores > �? Digital signal processor (DSP) subsystem > �? Image and video accelerator high-definition (IVA-HD) subsystem > �? Cortex�?�-M3 MPU subsystem, including two ARM Cortex-M3 > microprocessors > �? Display subsystem > �? Audio back-end (ABE) subsystem > �? Imaging subsystem (ISS), consisting of image signal processor (ISP) and > still image coprocessor > (SIMCOP) block > �? 2D/3D graphic accelerator (SGX) subsystem > �? Emulation (EMU) subsystemYes a datasheet feature list, if you have not used them before you could well be taking a longer development time getting each stage working. The first question you have to ask is - "What is the maximum end to end frame delay the system can have under ANY circumstances and external influences". When you know that then you can work out what happens in the SYSTEM. Then decide which parts to use or combinations.> However as I have not worked much with these kind of multimediaapplication> processor. I have not understood whether this kind of processor can be used > for my application.A lot of multimedia applications do not care about occassional drop frmaes or total end to end delay. So if playing from a DVD and it takes 10 or 20 frame delays from reading from DVD to display it does not matter as theer is a consistent delay. If this camera is used by an operator and has a noticeable LAG when moving the camera around it will become difficult to use, if not cursed.> Can I implement my custom image processing blocks using the on chip DSP > Cortex�?�-A9 microprocessor unit (MPU) subsystem ,Image and Video > Acceleration and ISS blocks. > > Is it possible to implement such processing algorithms: > > > 3 point Calibration > Custom Contrast enhance and detail enhancement > Scaling > Colourization > AGC > Blending > Object detection > > and then Output it on an LCD.Insufficient information on the SYSTEM requirements to detrmine this. Insufficient information on product lifetime, cost, or physical size to determine which solution is best. Insufficient information on your capabilities to determine timescales or how easily you will be able to do this.> Look forward to hear from you all soon. > > Regards, > > Nadeem-- Paul Carpenter | paul@pcserviceselectronics.co.uk <http://www.pcserviceselectronics.co.uk/> PC Services <http://www.pcserviceselectronics.co.uk/fonts/> Timing Diagram Font <http://www.gnuh8.org.uk/> GNU H8 - compiler & Renesas H8/H8S/H8 Tiny <http://www.badweb.org.uk/> For those web sites you hate
Reply by ●October 17, 20112011-10-17
If you have never done FPGA-based design, this is too ambitious a project to start with. --------------------------------------- Posted through http://www.EmbeddedRelated.com
Reply by ●October 17, 20112011-10-17
Stupident go ask your prof. njamal wrote:> Hello Friends, >=20 > Seems like a cool forum... I think this is the best place to ask this > questions. >=20 > We design Thermal Imaging cameras which need quit a allot of custom ima=ge> processing and custom sensor controls. What should we use FPGA or Micro=> controller? >=20 >=20 > Camera and video/image processing Brief >=20 > We have a 1024 by 768 12 bit per pixel(BW) image 30fp , coming in throu=gh a> serial link. >=20 > The image then needs allot of image processing such as : >=20 > 3 point Calibration > Custom Contrast enhance and detail enhancement > Scaling > Colourization > AGC > Blending > Object detection >=20 >=20 > FPGA Approach: Completely possible no problem with custom device interf=aces> and horsepower.... However its an expensive approach. Has longer > development time and seems to more difficult. >=20 > I am very interested in be able to use on of the TI MC such as Omap4. >=20 > This seems very appealing because of its onchip interfaces: >=20 > Memory Controllers > Serial /Usb controllers > Wifi/3g capabilities > =20 > The device is composed of the following subsystems: > =D1=82=D0=90=D0=A3 Cortex=D1=82=D0=94=D0=B2-A9 microprocessor unit (MPU=) subsystem, including two ARM=E2=94=AC=D0=BE> Cortex-A9 cores > =D1=82=D0=90=D0=A3 Digital signal processor (DSP) subsystem > =D1=82=D0=90=D0=A3 Image and video accelerator high-definition (IVA-HD)=subsystem> =D1=82=D0=90=D0=A3 Cortex=D1=82=D0=94=D0=B2-M3 MPU subsystem, including=two ARM Cortex-M3> microprocessors > =D1=82=D0=90=D0=A3 Display subsystem > =D1=82=D0=90=D0=A3 Audio back-end (ABE) subsystem > =D1=82=D0=90=D0=A3 Imaging subsystem (ISS), consisting of image signal =processor (ISP) and> still image coprocessor > (SIMCOP) block > =D1=82=D0=90=D0=A3 2D/3D graphic accelerator (SGX) subsystem > =D1=82=D0=90=D0=A3 Emulation (EMU) subsystem >=20 >=20 > However as I have not worked much with these kind of multimedia applica=tion> processor. I have not understood whether this kind of processor can be =used> for my application. >=20 > Can I implement my custom image processing blocks using the on chip DSP=> Cortex=D1=82=D0=94=D0=B2-A9 microprocessor unit (MPU) subsystem ,Image=and Video> Acceleration and ISS blocks. >=20 > Is it possible to implement such processing algorithms: >=20 >=20 > 3 point Calibration > Custom Contrast enhance and detail enhancement > Scaling > Colourization > AGC > Blending > Object detection >=20 > and then Output it on an LCD. >=20 > Look forward to hear from you all soon. >=20 > Regards, >=20 > Nadeem >=20 >=20 >=20 >=20 >=20 >=20 >=20 > =20 >=20 >=20 >=20 >=20 > =20 > =09 > --------------------------------------- =09 > Posted through http://www.EmbeddedRelated.com
