Raspberry Pi multispectral imaging camera system (PiMICS): a low-cost, skills-based physics educational tool.

John C. Howell, Brian Flores, Juan Javier Naranjo, Angel Mendez, César Costa-Vera, Chris Koumriqian, Juliana Jordan, Pieter H. Neethling, Calvin Groenewald, Michael A. C. Lovemore, Patrick A. T. Kinsey, Tjaart P. J. Krüger · 2024

Read Raspberry Pi multispectral imaging camera system (PiMICS): a low-cost, skills-based physics educational tool. by John C. Howell, Brian Flores, Juan Javier Naranjo, Angel Mendez, César Costa-Vera, Chris Koumriqian, Juliana Jordan, Pieter H. Neethling, Calvin Groenewald, Michael A. C. Lovemore, Patrick A. T. Kinsey, Tjaart P. J. Krüger (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-04679.txt.

Introduction

John Howell and co-authors report in 2024 a low-cost multispectral camera built on a Raspberry Pi for physics teaching. The pilot ran in Ecuador, South Africa, and the United States after talks with African educators. Demand for cheap hands-on skill tools proved very high in those talks.

The printed camera reads fifteen to twenty five color bands for as little as one hundred dollars. Students learn printing, coding, control, and image study while they build it. Class projects span plant health, fruit ripeness, and insect wing patterns. One wing study won a best applied research poster award at a meeting.

Catalog record

CREATORJohn C. Howell, Brian Flores, Juan Javier Naranjo, Angel Mendez, César Costa-Vera, Chris Koumriqian, Juliana Jordan, Pieter H. Neethling, Calvin Groenewald, Michael A. C. Lovemore, Patrick A. T. Kinsey, Tjaart P. J. Krüger
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-04679

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Raspberry Pi multispectral imaging camera system (PiMICS): a low-cost, skills-based physics educational tool. John C. Howell, Brian Flores, Juan Javier Naranjo, Angel Mendez, César Costa-Vera, Chris Koumriqian, Juliana Jordan, Pieter H. Neethling, Calvin Groenewald, Michael A. C. Lovemore, Patrick A. T. Kinsey, Tjaart P. J. Krüger Abstract We report on an educational pilot program for low-cost physics experimentation run in Ecuador, South Africa, and the United States. The program was developed after having needs-based discussions with African educators, researchers, and leaders. It was determined that the need and desire for low-cost, skills-building, and active-learning tools is very high. From this, we developed a 3D-printable, Raspberry Pi-based multispectral camera (15 to 25 spectral channels in the visible and near-IR) for as little as $100. The program allows students to learn 3D modeling, 3D printing, feedback, control, image analysis, Python programming, systems integration and artificial intelligence as well as spectroscopy. After completing their cameras, the students in the program studied plant health, plant stress, post-harvest fruit ripeness, and polarization and spectral analysis of nanostructured insect wings, the latter of which won the “best-applied research” award at a conference poster session and will be highlighted in this paper. Importantly, these cameras can be an integral part of any developing country’s agricultural, recycling, medical, and pharmaceutical infrastructure. Thus, we believe this experiment can play an important role at the intersection of student training and developing countries’ capacity building. Multispectral (MSI) and hyperspectral imaging (HSI) have proven to be invaluable resources in precision agriculture, environmental monitoring, mineralogy, geology, food quality and inspection, forensics, chemical analysis, medicine, recycling, defense, and planetary sciences Van der Meer et al. 2012 ; Zhang et al. 2012 ; Wu and Sun 2013 ; Qin et al. 2013 ; Mansfield 2014 ; Fei 2019 ; Nalepa 2021 ; Adão et al. 2017 ; Calvini et al. 2019 ; Ortega et al. 2019 ; Lu et al. 2020 ; Peyghambari and Zhang 2021 ; de Cássia Mariotti et al. 2023 . While MSI captures information from discrete spectral bands, providing targeted spectral information useful for cost-effective applications, HSI captures hundreds of contiguous bands, offering detailed spectral data across a broader range Adão et al. 2017 ; Nalepa 2021 . Both HSI and MSI techniques have been instrumental in agricultural advancements Adão et al. 2017 ; Lu et al. 2020 , where they facilitate crop health monitoring, disease detection, and soil analysis for improved water, pesticide, and fertilizer usage. In healthcare, MSI and HSI have been adopted for non-invasive diagnostics Mansfield 2014 ; Fei 2019 ; Ortega et al. 2019 , particularly in cancer detection and surgical guidance, where they exploit subtle spectral variations between healthy and pathological tissues. Environmental monitoring applications Zhang et al. 2012 leverage these technologies for assessing land cover, water quality, and pollutant detection, aiding in sustainable ecosystem management. Industrial applications, such as quality control and food safety Qin et al. 2013 , also benefit from these imaging modalities, where they allow for rapid, non-destructive assessments based on chemical composition and structural integrity. Recent advancements in sensor technology and machine learning for MSI and HSI data processing are expanding the utility of these techniques in real-time, high-accuracy applications across diverse sectors. It should be clear that these cameras can or do play an important role in bringing added value and capabilities to a society. However, one of the problems with the uptake of these cameras is that they can be cost-prohibitive, especially in developing countries. The purpose of this paper is to share a pilot program that trains students in developing countries to build low cost, size, weight and power (C-SWaP) multi-spectral cameras, enabling them to further innovate and develop this powerful tool. I Background John Howell, the lead author of this paper, was elected president of the International Commission for Optics (ICO) in 2021 for a three-year term. After starting his term, Howell formed an African Advisory Committee to the ICO composed of physics, optics and photonics researchers and educators from several countries across Africa. Several needs were discussed and perspectives were shared. Of the elements discussed, hands-on active-learning experimentation, computer skills and physics/optics capacity building in the form of student capabilities were targets of interest for the ICO mission. After the meetings, it was determined that a low-cost multispectral imaging camera system could play an important role at the intersection of education and critical infrastructure as discussed earlier. A Raspberry Pi-based multispectral imaging camera system (PiMICS) was developed. The purpose of the program is two-fold: 1) provide a framework for gaining many important physics and engineering skills, and 2) train the students in an important technological domain which can have significant economic and quality-of-life implications for their respective countries. The PiMICS program can further aid countries in meeting a host of sustainable development goals: increasing crop yields, reducing water consumption, monitoring water pollution and purity, and improving medicine, to name a few. This program solves the serious problem in developing countries where the cost of MSI and HSI cameras is simply too high for the average researcher. The architecture, a Raspberry Pi 4b, was chosen for its cost, size, weight and power allowing it to be portable, but still computationally capable. The Raspberry Pi can act as the control mechanism, the processor, and the camera. II Raspberry Pi-Based System The Raspberry Pi 4b has many features that make it ideal as an instructional tool. As a note, the authors believe that the Pi 5 consumes too much power to make it a viable portable device as most off-the-shelf 5-V power banks only supply 3 amps, which can compromise peripherals (necessary for this project). The Pi 4b is a quad-core, 1.5-GHz single-board computer. It has up to 8 GB of SDRAM, Bluetooth, 2 USB2 ports, 2 USB3 ports, a gigabit Ethernet port, wifi, and allows remote access through programs like RealVNC or TeamViewer. The Pi 4b can run up to two 4k monitors. It has a dedicated camera serial interface port connected through a 15-pin cable. The Camera Module 3 NoIR can take HD 1080p video or 12-megapixel still images in the visible and near-infrared. Importantly, the Pi 4 has a 40-pin GPIO header with 26 GPIO pins. The GPIO pins can control motors and LEDs. It is important to note that one should not power the motors or LEDs through the Pi header, but through a separate supply to prevent damaging the GPIO header. Combined with Python software pre-installed on the Pi 4 (many of the packages used in Python are not pre-installed), it provides a powerful interface between programming and experimental control and feedback. Adding to the portability of the system is the fact that there are inexpensive 4-inch (13 cm), 5-inch (15 cm), and 7-inch (18 cm) monitors that can be mounted directly to the Pi mitigating the need for remote or wired monitor connections while being operated. We used the 4-inch monitor for PiMICS Zero. It is adequate to run or operate programs, but too small for programming. The 5-inch display is probably better, but we are concerned that the 7-inch display might draw too much power (potentially up to 6 W) considering the heavy load of all the peripherals during the experiment. II.1

Read the complete text