See all the Smart Security Summit on-demand sessions here.
Profhesee has partnered with Qualcomm to bring a new type of fast image sensor to smartphone cameras.
Metavision “event-based” technology will enable smartphone cameras to capture fast action compared to current image sensors. The company made the announcement along with Qualcomm at the Mobile World Congress event in Barcelona.
The idea is to bring the speed, efficiency and quality of neuromorphic vision to mobile devices.
Technical and business collaboration will provide mobile device developers with a fast and efficient way
to harness the ability of the Paris-based Profhesee sensor to dramatically improve camera performance, particularly in fast-moving dynamic scenes (e.g. sports scenes) and low light, through its innovative asynchronous pixel detection approach and event-based continuums.
Unlike normal image sensors, event-based sensors designed by Prophesee only capture changes in a smartphone’s image. That allows them to bypass the processing required by other types of sensors that process each pixel of an image. Prophesee only captures changes or events that reflect something that is changing in a moving image.
Event
Smart Security Summit On Demand
Learn about the critical role of AI and ML in cybersecurity and industry-specific case studies. Watch sessions on demand today.
Look here
Prophesee and Qualcomm have agreed to a multi-year collaboration to enable native compatibility between Prophesee’s event-based Metavision sensors and software and Snapdragon premium mobile platforms.
The world is not based on plots or frames. Inspired by the human eye, Profhesee’s event-based sensors repair motion blur and other image quality artifacts caused by conventional sensors, especially in high-dynamic scenes and low-light conditions, bringing photography closer and the video to our true experiences, Profhesee said.
“Prophesee is a clear leader in the application of neuromorphic techniques to address the limitations of traditional
cameras and improve the overall user experience. We believe this is revolutionary technology for
take mobile photography to the next level and our technical and commercial collaboration
The tiers will help drive adoption by major OEMs,” Judd Heape, vice president of product management for Qualcomm Technologies, said in a statement. “Their pioneering achievements with shutterless capability in event cameras deliver a significant improvement in the quality of photography available on the next generation of Snapdragon-powered mobile devices, even in the most demanding environments, opening up a range of new possibilities for Snapdragon customers. ”
Prophesee’s event-based neuromorphic Metavision sensors and software will be available for premium Snapdragon mobile platforms. Development kits are expected to be available through Prophesee this year.
“We are excited to be working with the provider of one of the world’s most popular mobile platforms to
incorporate event-based insight into the Snapdragon ecosystem. Through this collaboration, product
developers will be able to drastically improve the user experience with cameras that deliver images
quality and operational excellence are not available using only traditional framework-based methods,” said Luca
Verre, CEO of Prophesee, in a statement.
How does it work
Profhesee’s innovative sensors add a new dimension of detection to mobile photography. They change
the paradigm in traditional image capture by focusing only on changes in a scene, pixel by pixel,
continuously, at extreme speeds, the companies said.
Each pixel of the Metavision sensor incorporates a logic core, allowing it to act like a neuron. Each of them is activated intelligently and asynchronously based on the number of photons they detect. A pixel that activates itself is called an event. In essence, events are driven by scene dynamics, not an arbitrary clock anymore, so the acquisition rate always matches the actual dynamics of the scene.
High-performance event-based blurring is achieved by synchronizing a frame-based system and Prophesee.
Event-based sensor. The system then fills the gaps between and within frames with microsecond events to algorithmically extract pure motion information and repair motion blur.
A development kit with support for Prophesee sensor technologies is expected to be released.
available this year. Prophesee has more than 100 engineers and 50 international patents.
VentureBeat’s mission is to be a digital public square for technical decision makers to gain insights into transformative business technology and transact. Discover our informative sessions.