Handheld Device

Hardware Design and Firmware Development

Handheld Device - Hardware Design and Firmware Development


Industry:

Sensors and Electronic Devices

Challenge:

Design a product which would reflect the excellence of a leading sensor manufacturer brand while also achieving desired results.

Outcome:

vResolv.io successfully designed a low-cost, easily portable handheld device with an elegant touch-screen UI design, alongside export options of saved data.

DEVELOPING THE STRATEGY

vResolv.io adapted its development strategy to cater for the client’s requirements for the nascent product.

​Challenge #1

Design an affordable, portable device for sensor data acquisition with an intuitive touchscreen interface.

Challenge #2

Incorporate calibration capabilities and provide users with sensor data analytics and data archiving features.

Challenge #3

Strike a balance between cost-effectiveness and high performance, ensuring real-time data capture and an engaging UI.


THE SOLUTION


To devise a holistic system that seamlessly integrates with STM32MP157, a methodology was adopted that capitalizes on the multicore SOC capabilities. The approach leveraged both Cortex A7 and Cortex M4 processors to run a GUI application and firmware, respectively. The objective was to create an interactive application interfacing with a proprietary sensor and an LCD while also facilitating communication with PCs.

Tech Stack Implemented:

Programming language: C++
Protocols: SPI (Serial Peripheral Interface), I2C, RPMSG, UDP
Hardware: STM32MP157 SOC with Cortex A7 processor and Cortex M4 coprocessor, Crystalfontz 2.4" LCD
Tools & Libraries: Qt6, OpenSTLinux, FreeRTOS

IMPLEMENTATION OVERVIEW

The solution commenced with the deployment of STM32MP157, capitalizing on its multicore SOC. On the software front, OpenSTLinux was chosen to run atop the Cortex A7 processor, while the Cortex M4 coprocessor was equipped with FreeRTOS-based firmware. A direct integration was established between Crystalfontz 2.4" LCD and OpenSTLinux using customized SPI Linux kernel drivers. The proprietary sensor of the client was adeptly interfaced with Cortex M4, relying on the SPI protocol. 


For optimal performance tailored to the product's requirements, both device tree and kernel underwent customizations. The user experience was elevated with the Qt6-based application that showcased multi-screen functionality, including data visualization via charts, data recording capabilities, and real-time data display. The final touch was added by enabling the product to interface with PCs through Ethernet/USB connections, complemented by a web-based configuration interface.

THE PAYOFF

A low cost easily portable handheld device which can detect the desired components in real time and provide all statistics regarding it to the user on a touch screen UI. The statistics can be saved by the user for future analysis and exported by connecting the device to a PC and accessing a web server running on it.


RESULTS & OUTCOMES

By the end of development and integration, vResolv.io was successful in satisfying the client’s requirements.

Outcome #1

The project demonstrated a successful blend of STM32MP157's multicore capabilities with advanced software stacks, resulting in a state-of-the-art detection device tailored for a leading precision sensor manufacturer.

Outcome #2

One of the standout achievements was striking the right balance between cost-effectiveness and performance. The product seamlessly integrates real-time data capture, comprehensive analytics, and an intuitive UI in a compact form.

Outcome #3

Leveraging a broad spectrum of technologies, from OpenSTLinux on Cortex A7 to FreeRTOS on Cortex M4, and incorporating the Qt 6 framework, highlights the technical prowess employed in developing the solution for a leading precision sensor manufacturer.

Outcome #4

The handheld device was crafted with the end-user in mind, equipped with an intuitive touch UI, detailed data visualization, efficient recording features, and easy PC interfacing.




Target Detection and Tracking System