Intelligence in AI cameras enabled by hardware advances


At the core of the so-called AI cameras are advanced analytics – a lot of them AI- or deep learning-based – that raise the overall performance and accuracy of the system. Whereas in the past, these types of analytics mostly reside on the backend server, increasingly they are moving towards the edge thanks to the camera’s increasing processing power.
 
The primary key components in an AI camera are the image sensor and the processor. A good image sensor captures high-quality video even in poor lit conditions, thus enhancing the camera’s recognition capability. An advanced processor, meanwhile, is required to run the AI algorithms.
 
Compared with conventional security cameras, AI cameras excel in their GPU chipsets, which provide stronger computing power, lower power consumption, and better heat dissipation,” said Max Fang, IP Project Product Director at Hikvision.
 
With AI becoming more and more dominant, more chip options besides CPU and GPU have emerged, for example NPU, TPU and SoC.
 
The computational demands of neural networks require new hardware architecture designed to deliver massive math computations. Up until recently, users had to choose between a GPU (graphical processing unit) or a CPU (central processing unit). GPU architecture more closely matches the demands for neural network processing, and as a result, most of the industry has been developed on GPU hardware from NVIDIA,” said Lei Bennett, VP of Product Management for Security at FLIR Systems. “Today, chip designers are launching hybrid chip architectures optimized for neural network processing demands that combine a CPU core with what is commonly referred to a neural network fabric or a sea of multipliers. This has led to the availability of extremely powerful chip sets that are much less expensive and operate on an order of magnitude lower power.
 
Most modern surveillance cameras today inside the enclosure include one or more standard SoC (system on a chip) integrated circuits on which the device’s firmware and operating system (typically Linux) run,” said Jeff Whitney, VP of Marketing at Arecont Vision Costar. “The SoC in many cameras will be integrated with or supplemented by a chipset providing the video analytics and/or AI intelligence, typically from a third-party vendor. This is where the additional intelligence capability of AI is added to the camera, although some vendors may initially opt to add the AI components to an external device interfaced directly with the camera.
 

How AI cameras can differentiate

 
With more and more AI cameras being rolled out, most using similar key components, manufacturers inevitably face the challenge of differentiation – how to differentiate their products and make them stand out?
 
One way is to differentiate by the accuracy and performance of the AI algorithm. “The key is the accuracy and range performance of the AI algorithm. This is highly impacted by the quality of the training data used to train a neural network. There are many points of failure in how you build your training data, so this is the critical differentiator,” Bennett said.
 
Or, they can differentiate by non-AI features, for example time-to-market and the ability to meet certain vertical demands. “The most effective approach for AI deployments may be to focus on specific market needs or requirements. This could include partnering with specialist vendors or systems integrators with a practice and expertise in markets such as in retail, warehousing, transportation, hospitality, or education, rather than a generalist approach that attempts to the general-purpose camera market,” Whitney said. “This focus on specific market needs will be especially true early on, as AI remains a promising but immature technology. Focusing on specific applications will result in better results at this early stage of the market.

View original article on A&S International Magazine by William Pao - Click here

 

7.4.33PHP Version56.86msRequest Duration7MBMemory UsageGET news/{slug}Route
    • Booting (29.76ms)
    • Application (26.84ms)
    • 1 x Booting (52.33%)
      29.76ms
      1 x Application (47.2%)
      26.84ms
      11 templates were rendered
      • themes.avc1.single (resources/views/themes/avc1/single.blade.php)2blade
        Params
        0
        post
        1
        categories
      • themes.avc1.layout.master (resources/views/themes/avc1/layout/master.blade.php)10blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        post
        6
        categories
        7
        __currentLoopData
        8
        category
        9
        loop
      • themes.avc1.partials.header (resources/views/themes/avc1/partials/header.blade.php)10blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        post
        6
        categories
        7
        __currentLoopData
        8
        category
        9
        loop
      • menuheader (resources/views/menuheader.blade.php)2blade
        Params
        0
        items
        1
        options
      • themes.avc1.partials.footer (resources/views/themes/avc1/partials/footer.blade.php)10blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        post
        6
        categories
        7
        __currentLoopData
        8
        category
        9
        loop
      • menufooter (resources/views/menufooter.blade.php)2blade
        Params
        0
        items
        1
        options
      • voyager::menu.default (vendor/tcg/voyager/resources/views/menu/default.blade.php)15blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        items
        6
        options
        7
        __currentLoopData
        8
        item
        9
        loop
        10
        originalItem
        11
        isActive
        12
        styles
        13
        icon
        14
        alerts
      • voyager::menu.default (vendor/tcg/voyager/resources/views/menu/default.blade.php)15blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        items
        6
        options
        7
        __currentLoopData
        8
        item
        9
        loop
        10
        originalItem
        11
        isActive
        12
        styles
        13
        icon
        14
        alerts
      • voyager::menu.default (vendor/tcg/voyager/resources/views/menu/default.blade.php)15blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        items
        6
        options
        7
        __currentLoopData
        8
        item
        9
        loop
        10
        originalItem
        11
        isActive
        12
        styles
        13
        icon
        14
        alerts
      • voyager::menu.default (vendor/tcg/voyager/resources/views/menu/default.blade.php)15blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        items
        6
        options
        7
        __currentLoopData
        8
        item
        9
        loop
        10
        originalItem
        11
        isActive
        12
        styles
        13
        icon
        14
        alerts
      • themes.avc1.partials.rocket-menu (resources/views/themes/avc1/partials/rocket-menu.blade.php)10blade
        Params
        0
        obLevel
        1
        __env
        2
        app
        3
        smallsliders
        4
        errors
        5
        post
        6
        categories
        7
        __currentLoopData
        8
        category
        9
        loop
      uri
      GET news/{slug}
      middleware
      web
      controller
      App\Http\Controllers\PostsController@show
      namespace
      App\Http\Controllers
      prefix
      where
      file
      app/Http/Controllers/PostsController.php:47-55
      4 statements were executed1.99ms
      • select * from `categories`
        470μs/app/Http/Controllers/PostsController.php:17avc_staging_db
        Metadata
        Backtrace
        • 12. /app/Http/Controllers/PostsController.php:17
        • 14. /vendor/laravel/framework/src/Illuminate/Container/Container.php:843
        • 15. /vendor/laravel/framework/src/Illuminate/Container/Container.php:681
        • 16. /vendor/laravel/framework/src/Illuminate/Foundation/Application.php:785
        • 17. /vendor/laravel/framework/src/Illuminate/Container/Container.php:629
      • select * from `posts` where `slug` = 'intelligence-in-ai-cameras-enabled-by-hardware-advances' and `status` = 'PUBLISHED' limit 1
        600μs/app/Http/Controllers/PostsController.php:51avc_staging_db
        Metadata
        Bindings
        • 0. intelligence-in-ai-cameras-enabled-by-hardware-advances
        • 1. PUBLISHED
        Backtrace
        • 16. /app/Http/Controllers/PostsController.php:51
        • 19. /vendor/laravel/framework/src/Illuminate/Routing/ControllerDispatcher.php:45
        • 20. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:219
        • 21. /vendor/laravel/framework/src/Illuminate/Routing/Route.php:176
        • 22. /vendor/laravel/framework/src/Illuminate/Routing/Router.php:681
      • select * from `categories` where `categories`.`id` = 2 limit 1
        530μsview::themes.avc1.single:26avc_staging_db
        Metadata
        Bindings
        • 0. 2
        Backtrace
        • 20. view::themes.avc1.single:26
        • 22. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:59
        • 23. /vendor/laravel/framework/src/Illuminate/View/View.php:143
        • 24. /vendor/laravel/framework/src/Illuminate/View/View.php:126
        • 25. /vendor/laravel/framework/src/Illuminate/View/View.php:91
      • select * from `settings` order by `order` asc
        390μs/vendor/tcg/voyager/src/Voyager.php:238avc_staging_db
        Metadata
        Backtrace
        • 14. /vendor/tcg/voyager/src/Voyager.php:238
        • 15. /vendor/laravel/framework/src/Illuminate/Support/Facades/Facade.php:261
        • 16. /vendor/tcg/voyager/src/Helpers/helpers.php:6
        • 19. /vendor/laravel/framework/src/Illuminate/View/Engines/CompilerEngine.php:59
        • 20. /vendor/laravel/framework/src/Illuminate/View/View.php:143
      TCG\Voyager\Models\Setting
      20
      App\Category
      1
      App\Post
      1
          _token
          33fExmHWTAxDVK3lzutbUpM6FxaI71WusRkqp4Lg
          _previous
          array:1 [ "url" => "https://avcstaging.arecontvisioncostar.com/news/intelligence-in-ai-cameras-ena...
          _flash
          array:2 [ "old" => [] "new" => [] ]
          PHPDEBUGBAR_STACK_DATA
          []
          path_info
          /news/intelligence-in-ai-cameras-enabled-by-hardware-advances
          status_code
          200
          
          status_text
          OK
          format
          html
          content_type
          text/html; charset=UTF-8
          request_query
          []
          
          request_request
          []
          
          request_headers
          0 of 0
          array:24 [ "sec-ch-ua-mobile" => array:1 [ 0 => "?0" ] "sec-ch-ua" => array:1 [ 0 => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" ] "cache-control" => array:1 [ 0 => "no-cache" ] "pragma" => array:1 [ 0 => "no-cache" ] "cdn-loop" => array:1 [ 0 => "cloudflare; loops=1" ] "upgrade-insecure-requests" => array:1 [ 0 => "1" ] "user-agent" => array:1 [ 0 => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" ] "cf-connecting-ip" => array:1 [ 0 => "18.217.78.220" ] "accept" => array:1 [ 0 => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" ] "sec-fetch-site" => array:1 [ 0 => "none" ] "cf-visitor" => array:1 [ 0 => "{"scheme":"https"}" ] "sec-fetch-mode" => array:1 [ 0 => "navigate" ] "sec-fetch-user" => array:1 [ 0 => "?1" ] "cf-ipcountry" => array:1 [ 0 => "US" ] "accept-encoding" => array:1 [ 0 => "gzip, br" ] "sec-fetch-dest" => array:1 [ 0 => "document" ] "sec-ch-ua-platform" => array:1 [ 0 => ""Windows"" ] "priority" => array:1 [ 0 => "u=0, i" ] "cf-ray" => array:1 [ 0 => "90c381572db0222b-SJC" ] "connection" => array:1 [ 0 => "close" ] "x-forwarded-proto" => array:1 [ 0 => "https" ] "x-forwarded-for" => array:1 [ 0 => "18.217.78.220, 172.71.159.9" ] "x-server-addr" => array:1 [ 0 => "159.65.79.202" ] "host" => array:1 [ 0 => "avcstaging.arecontvisioncostar.com" ] ]
          request_server
          0 of 0
          array:55 [ "USER" => "avcstaging" "HOME" => "/home/avcstaging" "SCRIPT_NAME" => "/index.php" "REQUEST_URI" => "/news/intelligence-in-ai-cameras-enabled-by-hardware-advances" "QUERY_STRING" => "" "REQUEST_METHOD" => "GET" "SERVER_PROTOCOL" => "HTTP/1.0" "GATEWAY_INTERFACE" => "CGI/1.1" "REDIRECT_URL" => "/news/intelligence-in-ai-cameras-enabled-by-hardware-advances" "REMOTE_PORT" => "40822" "SCRIPT_FILENAME" => "/home/avcstaging/webapps/app-avcstaging/public/index.php" "SERVER_ADMIN" => "you@example.com" "CONTEXT_DOCUMENT_ROOT" => "/home/avcstaging/webapps/app-avcstaging/public/" "CONTEXT_PREFIX" => "" "REQUEST_SCHEME" => "http" "DOCUMENT_ROOT" => "/home/avcstaging/webapps/app-avcstaging/public/" "REMOTE_ADDR" => "172.71.159.9" "SERVER_PORT" => "80" "SERVER_ADDR" => "127.0.0.1" "SERVER_NAME" => "avcstaging.arecontvisioncostar.com" "SERVER_SOFTWARE" => "Apache/2.4.62 (Unix) OpenSSL/1.0.2g" "SERVER_SIGNATURE" => "" "LD_LIBRARY_PATH" => "/RunCloud/Packages/apache2-rc/lib" "PATH" => "/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/snap/bin" "HTTP_SEC_CH_UA_MOBILE" => "?0" "HTTP_SEC_CH_UA" => ""HeadlessChrome";v="129", "Not=A?Brand";v="8", "Chromium";v="129"" "HTTP_CACHE_CONTROL" => "no-cache" "HTTP_PRAGMA" => "no-cache" "HTTP_CDN_LOOP" => "cloudflare; loops=1" "HTTP_UPGRADE_INSECURE_REQUESTS" => "1" "HTTP_USER_AGENT" => "Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)" "HTTP_CF_CONNECTING_IP" => "18.217.78.220" "HTTP_ACCEPT" => "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7" "HTTP_SEC_FETCH_SITE" => "none" "HTTP_CF_VISITOR" => "{"scheme":"https"}" "HTTP_SEC_FETCH_MODE" => "navigate" "HTTP_SEC_FETCH_USER" => "?1" "HTTP_CF_IPCOUNTRY" => "US" "HTTP_ACCEPT_ENCODING" => "gzip, br" "HTTP_SEC_FETCH_DEST" => "document" "HTTP_SEC_CH_UA_PLATFORM" => ""Windows"" "HTTP_PRIORITY" => "u=0, i" "HTTP_CF_RAY" => "90c381572db0222b-SJC" "HTTP_CONNECTION" => "close" "HTTP_X_FORWARDED_PROTO" => "https" "HTTP_X_FORWARDED_FOR" => "18.217.78.220, 172.71.159.9" "HTTP_X_SERVER_ADDR" => "159.65.79.202" "HTTP_HOST" => "avcstaging.arecontvisioncostar.com" "HTTPS" => "on" "REDIRECT_STATUS" => "200" "REDIRECT_HTTPS" => "on" "FCGI_ROLE" => "RESPONDER" "PHP_SELF" => "/index.php" "REQUEST_TIME_FLOAT" => 1738597077.6904 "REQUEST_TIME" => 1738597077 ]
          request_cookies
          []
          
          response_headers
          0 of 0
          array:7 [ "content-type" => array:1 [ 0 => "text/html; charset=UTF-8" ] "cache-control" => array:1 [ 0 => "private, must-revalidate" ] "date" => array:1 [ 0 => "Mon, 03 Feb 2025 15:37:57 GMT" ] "pragma" => array:1 [ 0 => "no-cache" ] "expires" => array:1 [ 0 => -1 ] "set-cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IllFdFYxTTUwQ29KVmw0T05qWEZyQ3c9PSIsInZhbHVlIjoib1dISHhJUlh5akhUNmQwa0tGXC9QWmY5NzdWN0RzcDQ2elZMdGpuRVwvYmkzbEtzaGpsUzk5UWIwMFwvSkVpRHAxY0FnWTJDVm03RksxK3VWT0Q3eTJmeVRKb3pIY1FkeHdKWWRZVFwvN0hsK0toQzU5ckJcL2szXC9uck9OTEJFM205SnYiLCJtYWMiOiJmYjU1NzZkYTgxZDA5MGQ0YzM4N2U4NzE4NThiZDQwYmY3Zjc0N2EyZGIwOTE1ZmJhYmU4Mjk1NjUyZDY4NTlmIn0%3D; expires=Mon, 03-Feb-2025 17:37:57 GMT; Max-Age=7200; path=/XSRF-TOKEN=eyJpdiI6IllFdFYxTTUwQ29KVmw0T05qWEZyQ3c9PSIsInZhbHVlIjoib1dISHhJUlh5akhUNmQwa0tGXC9QWmY5NzdWN0RzcDQ2elZMdGpuRVwvYmkzbEtzaGpsUzk5UWIwMFwvSkVpRHAxY0FnW" 1 => "avcostar_session=eyJpdiI6IjZLUjNueHU2YVQzTnRwMVpNOERrNVE9PSIsInZhbHVlIjoiQUtoQzRTdCs5RVJzNGF5QUFqV0xBZGF3QjJFWkpJVm9pdUdvTG9sdWo1ZVZKWktOcDQyN09hQ0tsb3ZpUEF2MGtUdmdXbkNRb284ekRtb1hiejkyV3VoVEgrNHhsb1FjQVl5bElyNE90TnhrMVJ1TVJYekNod3BhNWRGYXFvT2kiLCJtYWMiOiJiMmVmOTIwMzBkZmU1ZmZkNjRlY2NjNmZhYmIxYTcxZTEyNjRlMDJmOTIwOWU2NGQ2M2M2MzU5YmZkYzI3NWFmIn0%3D; expires=Mon, 03-Feb-2025 17:37:57 GMT; Max-Age=7200; path=/; httponlyavcostar_session=eyJpdiI6IjZLUjNueHU2YVQzTnRwMVpNOERrNVE9PSIsInZhbHVlIjoiQUtoQzRTdCs5RVJzNGF5QUFqV0xBZGF3QjJFWkpJVm9pdUdvTG9sdWo1ZVZKWktOcDQyN09hQ0tsb3ZpUEF2MGt" ] "Set-Cookie" => array:2 [ 0 => "XSRF-TOKEN=eyJpdiI6IllFdFYxTTUwQ29KVmw0T05qWEZyQ3c9PSIsInZhbHVlIjoib1dISHhJUlh5akhUNmQwa0tGXC9QWmY5NzdWN0RzcDQ2elZMdGpuRVwvYmkzbEtzaGpsUzk5UWIwMFwvSkVpRHAxY0FnWTJDVm03RksxK3VWT0Q3eTJmeVRKb3pIY1FkeHdKWWRZVFwvN0hsK0toQzU5ckJcL2szXC9uck9OTEJFM205SnYiLCJtYWMiOiJmYjU1NzZkYTgxZDA5MGQ0YzM4N2U4NzE4NThiZDQwYmY3Zjc0N2EyZGIwOTE1ZmJhYmU4Mjk1NjUyZDY4NTlmIn0%3D; expires=Mon, 03-Feb-2025 17:37:57 GMT; path=/XSRF-TOKEN=eyJpdiI6IllFdFYxTTUwQ29KVmw0T05qWEZyQ3c9PSIsInZhbHVlIjoib1dISHhJUlh5akhUNmQwa0tGXC9QWmY5NzdWN0RzcDQ2elZMdGpuRVwvYmkzbEtzaGpsUzk5UWIwMFwvSkVpRHAxY0FnW" 1 => "avcostar_session=eyJpdiI6IjZLUjNueHU2YVQzTnRwMVpNOERrNVE9PSIsInZhbHVlIjoiQUtoQzRTdCs5RVJzNGF5QUFqV0xBZGF3QjJFWkpJVm9pdUdvTG9sdWo1ZVZKWktOcDQyN09hQ0tsb3ZpUEF2MGtUdmdXbkNRb284ekRtb1hiejkyV3VoVEgrNHhsb1FjQVl5bElyNE90TnhrMVJ1TVJYekNod3BhNWRGYXFvT2kiLCJtYWMiOiJiMmVmOTIwMzBkZmU1ZmZkNjRlY2NjNmZhYmIxYTcxZTEyNjRlMDJmOTIwOWU2NGQ2M2M2MzU5YmZkYzI3NWFmIn0%3D; expires=Mon, 03-Feb-2025 17:37:57 GMT; path=/; httponlyavcostar_session=eyJpdiI6IjZLUjNueHU2YVQzTnRwMVpNOERrNVE9PSIsInZhbHVlIjoiQUtoQzRTdCs5RVJzNGF5QUFqV0xBZGF3QjJFWkpJVm9pdUdvTG9sdWo1ZVZKWktOcDQyN09hQ0tsb3ZpUEF2MGt" ] ]
          session_attributes
          0 of 0
          array:4 [ "_token" => "33fExmHWTAxDVK3lzutbUpM6FxaI71WusRkqp4Lg" "_previous" => array:1 [ "url" => "https://avcstaging.arecontvisioncostar.com/news/intelligence-in-ai-cameras-enabled-by-hardware-advances" ] "_flash" => array:2 [ "old" => [] "new" => [] ] "PHPDEBUGBAR_STACK_DATA" => [] ]