Inference Enabled Deep Learning Camera Does Image Analysis

Deep Learning Camera
Deep Learning Camera

The FLIR Fireflyr deep learning camera family is the industry’s first inference-enabled deep learning camera. Furthermore, the FLIR Firefly, which integrates the Intelr MovidiusT MyriadT 2 Vision Processing Unit (VPU), is designed for image analysis professionals using deep learning for more accurate decisions, and faster, easier system development.

Deep Learning Algorithms

Deep learning is a class of machine learning algorithms that:

  1. use a cascade of multiple layers of nonlinear processing units for feature extraction and transformation. Each successive layer uses the output from the previous layer as input.
  2. learn in supervised (e.g., classification) and/or unsupervised (e.g., pattern analysis) manners.
  3. learn multiple levels of representations that correspond to different levels of abstraction; the levels form a hierarchy of concepts.

Traditional rules-based software is ideal for straightforward tasks such as barcode reading or checking a manufactured part against specifications. On the contrary, the FLIR Firefly combines a new, affordable machine vision platform with the power of deep learning to address complex and subjective problems such as recognizing faces or classifying the quality of a solar panel.

Abstract Composite Representations

In a deep learning camera, each level learns to transform its input data into a slightly more abstract and composite representation. Additionally, in an image recognition application, the raw input may be a matrix of pixels; the first representational layer may abstract the pixels and encode edges; the second layer may compose and encode arrangements of edges; the third layer may encode a nose and eyes; and the fourth layer may recognize that the image contains a face. Importantly, a deep learning process can learn which features to optimally place in which level on its own.

Neural Networks

The FLIR Firefly inference enabled deep learning camera leverages the Intel Movidius Myriad 2 VPU’s advanced capabilities in a compact and low-power camera, ideal for embedded and handheld systems. As a result, machine makers can load their trained neural networks directly onto the Firefly’s integrated VPU. Additionally, Intel Movidius Neural Compute Stick users can easily deploy their existing networks directly onto the Firefly. Consequently, the unique design reduces system size and improves speed, reliability, power efficiency, and security.