Fact-checked by Grok 2 weeks ago

Machine perception

Machine perception is the capability of computational systems to acquire, interpret, select, and organize sensory information from the environment, enabling machines to interact with the world in a manner analogous to human sensory processing.^[1] This field, a cornerstone of artificial intelligence since the 1950s, focuses on transforming raw data from sensors into meaningful representations for decision-making and action.^[1] At its core, machine perception involves multiple sensory modalities, including visual perception through cameras and image sensors, auditory perception via microphones for sound recognition, and tactile perception using touch sensors for physical interaction.^[2] Key technologies encompass signal processing for data preprocessing, pattern recognition for feature extraction, and advanced machine learning methods such as deep neural networks (DNNs), which hierarchically analyze information inspired by the human visual cortex.^[3] Sensor fusion techniques—complementary, competitive, or cooperative—integrate data from diverse sources to enhance accuracy and reliability, while agent architectures like SOAR or ACT-R facilitate higher-level interpretation.^[1] Applications of machine perception are widespread and transformative, including robotics for real-time human interaction, autonomous vehicles for environmental navigation, medical imaging for diagnostic support, and surveillance systems for anomaly detection.^[1]^[2]^[4] In affective computing, it enables facial expression recognition for emotion detection and deceit analysis, while in industrial automation, it supports tasks like quality control in manufacturing and error prediction in foundries.^[2]^[1] Despite progress, machine perception faces significant challenges, such as achieving robustness in unpredictable real-world settings, handling noisy or incomplete data, and ensuring real-time performance under computational constraints.^[1] Unlike human perception, which is invariant to certain image distortions and relies on contextual understanding, machine systems like DNNs often depend on superficial features, leading to vulnerabilities in domains like medical diagnosis.^[4] Bridging this gap requires interdisciplinary efforts, including bionics-inspired approaches and statistical models like Bayesian networks for uncertainty management.^[1] Recent advances, particularly in deep learning since the 2010s, have propelled the field forward, with convolutional neural networks and transformers enabling superior performance in object detection, speech understanding, and multimodal integration for robotics.^[5] These developments, supported by large datasets and computational power, continue to narrow the divide toward human-like perception, fostering applications in elderly care, safety monitoring, and adaptive automation.^[6]

Introduction

Definition and scope

Machine perception refers to the capability of computational systems to acquire, interpret, and respond to sensory data from the environment in a manner analogous to biological perception.^[7] This field encompasses the development of algorithms and hardware that enable machines to process inputs such as visual, auditory, and tactile signals, facilitating environmental awareness without relying on human-like consciousness.^[8] The scope of machine perception primarily covers exteroceptive senses, which detect external stimuli including vision (light intensity and patterns), hearing (sound amplitude and frequencies), touch (contact and pressure), olfaction (chemical odors), and taste (chemical flavors).^[9] These modalities play a crucial role in enabling autonomous decision-making in artificial intelligence and robotics, such as obstacle avoidance, navigation, and interaction with dynamic surroundings.^[9] By mimicking biological exteroception, machine systems can model their environment to support tasks like localization and adaptive responses.^[7] At its core, machine perception involves a processing pipeline that begins with sensory data acquisition, followed by feature extraction to identify salient patterns, and culminates in interpretation for actionable insights.^[10] This algorithmic approach differs fundamentally from human perception, which incorporates subjective qualia—the ineffable qualities of experience—whereas machines operate solely through data-driven computations devoid of personal awareness.^[11] Drawing biological inspiration, the field adapts neural architectures and sensory hierarchies from human systems to enhance computational efficiency and robustness, though without replicating qualia or embodiment.^[12] As an extension, multimodal integration combines these modalities for more comprehensive scene understanding.^[7]

Historical development

The origins of machine perception trace back to the late 1950s, when early computational experiments laid the groundwork for pattern recognition systems. In 1958, Frank Rosenblatt introduced the Perceptron, a single-layer neural network designed for basic image classification tasks, marking one of the first attempts to mimic neural processes for visual perception. This work, inspired by biological neurons, demonstrated supervised learning for binary classification but was limited by its inability to handle nonlinear problems, as later critiqued in the 1969 book Perceptrons by Marvin Minsky and Seymour Papert.^[13] During the 1960s, research expanded into computer vision as an early focus area, with projects like the Summer Vision Project at MIT exploring automated scene analysis, though computational constraints hindered progress.^[14] The 1970s and 1980s saw significant advancements in theoretical frameworks and practical applications, particularly in computer vision and speech recognition. David Marr's 1982 book Vision: A Computational Investigation into the Human Representation and Processing of Visual Information proposed a hierarchical model of visual processing, from primal sketches to 3D object representations, influencing subsequent work in computational neuroscience and robotics.^[15] In speech recognition, the adoption of Hidden Markov Models (HMMs) in the 1990s revolutionized the field by modeling acoustic sequences probabilistically, enabling systems like IBM's ViaVoice to achieve practical continuous speech recognition with error rates below 10% on large vocabularies. Yann LeCun's development of convolutional neural networks (CNNs) during this era, including LeNet-5 in 1998 for handwritten digit recognition, provided foundational tools for perceptual tasks, achieving over 99% accuracy on benchmarks like MNIST. DARPA initiatives, such as early sensory robotics programs in the 1970s and the Revolutionizing Prosthetics effort starting in 2006, funded brain-computer interfaces and tactile feedback systems to enhance robotic perception.^[16] The 2000s and 2010s marked a paradigm shift with the rise of deep learning, driven by increased computational power and large datasets. Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton's AlexNet, presented in 2012, won the ImageNet challenge with a top-5 error rate of 15.3%, dramatically outperforming prior methods and popularizing deep CNNs for image recognition. This breakthrough spurred widespread adoption of machine perception in autonomous systems. In the 2020s, integration with transformers and large language models advanced multimodal capabilities; OpenAI's CLIP model in 2021 enabled zero-shot image-text matching by training on 400 million pairs, achieving state-of-the-art transfer to diverse vision tasks without task-specific fine-tuning.^[17] By 2025, bio-inspired sensors have emerged as a key frontier, with advancements like adaptive tactile systems mimicking human skin for enhanced robotic manipulation, as seen in multifunctional neural sensors that integrate pressure and slip detection.^[18] These developments, building on contributions from figures like LeCun—who advocated for energy-based models in perception—continue to bridge machine and biological sensing.^[19]

Core modalities

Machine vision

Machine vision, a cornerstone of machine perception, enables machines to interpret and understand visual information from the environment through the acquisition, processing, and analysis of images or video streams. It encompasses techniques for extracting meaningful features from 2D or 3D visual data, making it the most mature modality due to advancements in computational power and algorithmic efficiency.^[20] Core components of machine vision systems begin with image acquisition, which involves capturing visual data using various cameras and sensors to form the input for subsequent processing. Common hardware includes RGB cameras that record color images in red, green, and blue channels for standard visual representation, LiDAR sensors that use laser pulses to generate precise 3D point clouds by measuring distances, and depth sensors such as time-of-flight (ToF) or structured light cameras that estimate scene depth for enhanced spatial understanding.^[21]^[22] Following acquisition, processing techniques transform raw images into usable forms by applying operations like edge detection, which identifies boundaries in images by highlighting intensity changes, and segmentation, which partitions images into meaningful regions based on pixel similarities for object isolation. A fundamental operation in these techniques is convolution, defined mathematically as g(x,y) = f(x,y) * h(x,y), where f(x,y) represents the input image intensity function and h(x,y) is the kernel that slides over the image to compute local weighted averages, enabling feature enhancement such as blurring or sharpening.^[23]^[24] Key algorithms in machine vision rely heavily on convolutional neural networks (CNNs) for automated feature extraction, where layers of convolutions learn hierarchical representations from low-level edges to high-level objects, as pioneered in early architectures like LeNet for digit recognition. For object detection, models such as YOLO, introduced in 2015, perform real-time detection by treating the task as a single regression problem that predicts bounding boxes and class probabilities directly from full images in one evaluation pass. Complementing this, Faster R-CNN, also from 2015, integrates a region proposal network with CNNs to generate candidate regions efficiently, achieving higher accuracy for precise localization in complex scenes.^[25]^[26]^[27] Within machine vision, prominent applications include facial recognition systems that analyze facial landmarks and textures for identity verification in security contexts, and autonomous driving, where optical flow algorithms estimate motion between consecutive frames to predict vehicle trajectories and detect dynamic obstacles like pedestrians.^[28]^[29] Recent advancements have shifted toward transformer-based models, such as Vision Transformers (ViT) introduced in 2020, which divide images into patches and apply self-attention mechanisms to capture global context and long-range dependencies more effectively than localized CNN filters, improving performance on large-scale image classification. By 2025, real-time 3D reconstruction techniques in augmented and virtual reality have advanced through feed-forward neural methods that enable instantaneous scene modeling from monocular or sparse inputs, supporting immersive applications with photorealistic detail preservation.^[30]^[31]

Machine hearing

Machine hearing, a subfield of machine perception, enables systems to capture, process, and interpret auditory signals, focusing on the temporal dynamics and frequency content of sound waves to mimic human auditory capabilities. Unlike visual processing, which handles spatial patterns, machine hearing deals with sequential data propagation through air, requiring techniques that account for time-varying acoustic properties such as pitch, timbre, and amplitude. This involves transforming raw audio into meaningful representations for tasks like recognition and localization, with applications spanning human-machine interfaces and environmental monitoring.^[32] Core components of machine hearing begin with audio capture using microphones, which convert sound pressure waves into electrical signals. Single omnidirectional microphones detect sound equally from all directions, making them suitable for uniform environmental sampling, while directional microphones, such as cardioid types, focus on sources from specific angles to reduce off-axis interference, enhancing signal-to-noise ratios in targeted scenarios.^[33] Microphone arrays, consisting of multiple sensors, enable beamforming to spatially filter sounds, improving localization and suppression of ambient noise in dynamic settings like robotics. Following capture, signal processing applies transforms to analyze frequency content; the discrete Fourier transform (DFT) is fundamental, decomposing a time-domain signal x(n) of length N into its frequency components via the equation:

X(k) = \sum_{n=0}^{N-1} x(n) e^{-j 2\pi k n / N}

for k = 0, 1, \dots, N-1, where j is the imaginary unit, revealing spectral energy distribution essential for feature extraction.^[32] Key algorithms in machine hearing leverage neural architectures for complex auditory tasks. Speech recognition often employs recurrent neural networks (RNNs), which process sequential audio features to model temporal dependencies, achieving state-of-the-art performance on benchmarks like TIMIT by integrating deep representations with connectionist temporal classification.^[34] WaveNet, introduced in 2016, advances waveform generation using autoregressive convolutional networks to produce high-fidelity raw audio, surpassing traditional parametric synthesizers in naturalness for text-to-speech applications.^[35] Sound event detection, meanwhile, identifies and timestamps non-speech acoustic events like footsteps or alarms, typically using convolutional neural networks on spectrograms to classify overlapping occurrences in polyphonic scenes.^[36] Within machine hearing, applications include automatic speech recognition (ASR) in voice assistants like Siri, where end-to-end models transcribe user queries with over 95% accuracy in clean conditions, enabling seamless natural language interaction.^[37] Noise cancellation techniques in robotics suppress self-generated "ego-noise" from motors during motion, employing adaptive filtering to preserve external speech signals and boost ASR reliability in mobile environments.^[38] Advancements in the 2020s have introduced audio transformers, such as the Audio Spectrogram Transformer (AST), which applies self-attention mechanisms to spectrogram patches for efficient classification, outperforming convolutional baselines on datasets like AudioSet with fewer parameters. By 2025, integrations of these models facilitate emotion detection from prosodic audio cues in human-robot interaction, allowing robots to adapt responses based on inferred affective states like happiness or frustration with accuracies exceeding 80% in real-time dialogues.^[39]

Machine touch

Machine touch, also known as haptic sensing, enables machines to detect and interpret physical interactions through contact, including forces, pressures, vibrations, and surface properties. This modality is essential for tasks requiring dexterity and safety in physical environments, mimicking the human sense of touch via specialized sensors that capture mechanical stimuli. Tactile sensors form the foundation, typically measuring pressure, shear forces, and vibrations to provide feedback on object properties and contact dynamics.^[40] Core components of machine touch systems include tactile sensor arrays that acquire spatial and temporal data from contact points. These arrays consist of multiple sensing elements arranged in grids, allowing for distributed measurement of forces across a surface, such as in robotic fingertips. Pressure sensors detect normal forces, vibration sensors capture dynamic oscillations during sliding or impact, and shear sensors quantify lateral forces, enabling comprehensive contact characterization. Data acquisition occurs through analog-to-digital conversion of sensor signals, often processed in real-time for immediate feedback.^[41]^[42] Hardware implementations commonly employ piezoelectric and capacitive sensors for their sensitivity and durability in robotic applications. Piezoelectric sensors generate voltage in response to mechanical stress, ideal for detecting vibrations and dynamic forces, while capacitive sensors measure changes in capacitance due to deformation, offering high spatial resolution for static pressure mapping. In tactile feedback mechanisms, these sensors often model elastic responses using Hooke's law, expressed as

F = -k \Delta x

where F is the restoring force, k is the stiffness coefficient, and \Delta x is the displacement from equilibrium, providing a basis for simulating compliant interactions.^[43]^[44] Key algorithms process tactile data for interpretation and control. Texture classification frequently utilizes support vector machines (SVMs), which map sensor signals—such as vibration patterns from sliding contact—into high-dimensional feature spaces to distinguish surface roughness or material types with high accuracy. For force feedback in grippers, control algorithms employ proportional-integral-derivative (PID) schemes or adaptive controllers that adjust actuation based on real-time sensor inputs, ensuring stable grasps without slippage or damage. These methods enable precise manipulation by closing the loop between sensing and action.^[45]^[46] Applications of machine touch span robotic manipulation and prosthetics. In robotic systems, tactile sensing facilitates in-hand object reorientation, where sensors detect contact points and forces to guide dexterous rotations of unknown objects without visual input, achieving success rates over 90% in simulated and real-world trials. For prosthetics, haptic feedback from tactile sensors restores sensory awareness, allowing users to modulate grip forces intuitively and improve task performance, such as object handling, by conveying pressure and slip information through vibrotactile or electrotactile interfaces.^[47]^[48] Advancements have enhanced resolution and adaptability. The GelSight sensor, introduced in 2011, uses optical imaging of a compliant elastomeric surface to capture high-resolution 3D geometry and shear from contact, enabling fine texture discrimination at sub-millimeter scales. By 2025, soft robotics integrates electronic skin (e-skin) with multimodal tactile arrays, providing conformable coverage for dynamic environments, such as unstructured terrains, where sensors detect both contact and proximity for safer human-robot interactions.^[49]^[50]

Machine olfaction

Machine olfaction, also known as artificial olfaction, refers to the development of systems that detect, analyze, and identify odors using electronic noses (e-noses), which mimic the human olfactory system by processing volatile organic compounds (VOCs) in the air.^[51] These systems typically consist of a sensor array that captures chemical signatures and software for pattern recognition to classify odors.^[52] Unlike human olfaction, which relies on millions of receptors, e-noses use fewer but diverse sensors to generate unique response patterns for different scents.^[53] The core components of an e-nose include gas sensors and pattern recognition modules. Gas sensors, such as metal-oxide semiconductor (MOS) types like tin dioxide and polymer-based sensors, detect VOCs by changes in electrical properties upon gas adsorption.^[54] MOS sensors operate at elevated temperatures to enhance sensitivity, while polymer sensors offer room-temperature operation and selectivity for specific compounds.^[55] Pattern recognition processes the multi-dimensional sensor data to identify odor profiles, often treating the array response as a "fingerprint."^[56] Hardware in machine olfaction features sensor arrays that emulate olfactory receptors, with each sensor responding differently to odorants to create distinguishable patterns.^[57] A common model for MOS sensor response is given by the equation:

R = R_0 (1 + \alpha C)^\beta

where R is the sensor resistance in the presence of gas, R_0 is the baseline resistance in clean air, C is the gas concentration, and \alpha and \beta are material-specific constants that characterize sensitivity and nonlinearity.^[58] This power-law relationship allows quantification of odor intensity and aids in concentration estimation.^[59] Key algorithms in machine olfaction focus on feature extraction and classification of sensor data. Principal Component Analysis (PCA) is widely used for dimensionality reduction, projecting high-dimensional sensor responses onto principal axes to visualize odor clusters and remove noise.^[60] Machine learning classifiers, such as support vector machines (SVM) and artificial neural networks (ANN), then discriminate between odor classes, achieving high accuracy in identifying VOCs like those from fruits or chemicals.^[61] For instance, PCA combined with SVM has demonstrated over 95% classification accuracy for mixed VOCs in controlled environments.^[62] Applications of machine olfaction include quality control in the food industry, where e-noses detect spoilage by monitoring VOCs from microbial growth, ensuring freshness without destructive testing.^[51] In explosive detection, sensor arrays identify trace vapors from nitro-based compounds, enabling rapid screening in security settings with sensitivities down to parts-per-billion levels.^[54] These uses highlight e-noses' role in non-invasive, real-time odor analysis. Machine taste systems complement olfaction by analyzing dissolved tastants for comprehensive flavor profiling.^[63] Advancements in machine olfaction have drawn from bio-inspired designs, such as e-noses using nanomaterials like graphene to enhance sensitivity and mimic receptor binding in 2018 prototypes.^[64] By 2025, AI-driven systems have enabled odor synthesis for virtual reality, where machine learning models predict and generate scent profiles from digital data, integrating e-noses with olfactory displays for immersive experiences.^[65] These developments improve portability and accuracy, with cloud-connected AI noses achieving human-like discrimination of complex scents.^[66]

Machine taste

Machine taste, often implemented through electronic tongue (e-tongue) systems, involves the analysis of non-volatile chemical compounds in liquids or on surfaces to mimic human gustatory perception and identify taste profiles such as sweet, sour, salty, bitter, and umami. These systems employ multisensor arrays, primarily potentiometric and voltammetric sensors, to detect ionic and electrochemical signatures associated with taste attributes. Potentiometric sensors measure potential differences to quantify ion concentrations, while voltammetric sensors apply varying potentials to generate current responses for broader chemical profiling.^[67]^[68] Data fusion techniques, such as principal component analysis (PCA) and partial least squares (PLS), integrate signals from multisensor arrays to enable accurate taste categorization and discrimination of complex mixtures. For instance, combining electronic nose and electronic tongue data improves recognition accuracy by 8–25% compared to using either alone in food quality assessment.^[67] Central to the hardware of potentiometric e-tongues are ion-selective electrodes (ISEs), which selectively respond to specific ions like sodium or chloride relevant to salty or sour tastes. The response of these electrodes follows the Nernst equation:

E = E_0 + \frac{RT}{nF} \ln a

where E is the measured potential, E_0 is the standard electrode potential, R is the gas constant, T is the absolute temperature, n is the charge number of the ion, F is Faraday's constant, and a is the ion activity. This equation governs the logarithmic relationship between ion activity and potential, providing the foundational sensitivity for taste detection in liquids.^[69]^[68] Key algorithms in e-tongue processing include artificial neural networks (ANNs) for multi-attribute taste prediction, which handle non-linear relationships in sensor data to forecast attributes like bitterness intensity with high accuracy. Impedance spectroscopy complements this by measuring electrical impedance across frequencies to differentiate taste compounds based on their dielectric properties, enhancing resolution in complex samples.^[67] Applications of machine taste systems include beverage quality assessment, where e-tongues quantify attributes such as acidity and polyphenol content in wines and coffees to ensure consistency and detect adulteration. In pharmaceutical testing, they effectively evaluate taste masking in oral formulations, such as 3D-printed tablets, with a PCA recognition index of 93 to improve patient compliance.^[67]^[70] Recent advancements feature microfluidic e-tongues introduced around 2020, which integrate sensors into compact chips for analyzing microliter-scale samples, reducing reagent use and enabling portable on-site testing. By 2025, AI integration with e-tongues has advanced personalized nutrition analysis, using machine learning models like support vector machines to predict individual taste preferences from sensor data and recommend tailored dietary profiles with prediction accuracies exceeding 95%.^[71]^[72]

Integration and applications

Multimodal perception

Multimodal perception in machines involves integrating data from multiple sensory modalities to form a unified understanding of the environment, surpassing the limitations of unimodal systems by leveraging complementary information. A foundational technique in this domain is sensor fusion, which combines measurements from diverse sensors to estimate system states more accurately. The Kalman filter, a recursive algorithm for optimal state estimation in the presence of noise, exemplifies this by predicting and updating states based on prior estimates and new observations. The basic update equation is given by

\hat{x}_{k|k} = \hat{x}_{k|k-1} + K_k (z_k - H_k \hat{x}_{k|k-1}),

where \hat{x}_{k|k} is the updated state estimate, \hat{x}_{k|k-1} is the predicted state, K_k is the Kalman gain, z_k is the measurement, and H_k is the observation model.^[73] This method has been widely applied in robotics and autonomous systems to fuse inputs like LiDAR and radar for enhanced object tracking.^[74] In neural architectures for multimodal integration, fusion strategies differ by the stage at which modalities are combined: early fusion merges raw or low-level features from multiple inputs before processing, allowing joint learning of representations but risking interference from misaligned data; late fusion, conversely, processes each modality separately through dedicated networks and combines high-level decisions or embeddings afterward, preserving modality-specific nuances at the cost of potentially missing cross-modal interactions.^[75] Hybrid approaches often balance these by incorporating intermediate fusion layers. Key algorithms enabling effective multimodal perception include attention mechanisms within transformer architectures, which dynamically weigh contributions from different modalities to capture alignments and dependencies. For instance, the Flamingo model (2022) employs a perceiver resampler to condense visual features and integrates them via cross-attention layers into a frozen language model, facilitating few-shot learning on vision-language tasks such as visual question answering.^[76] This approach demonstrates scalable fusion without retraining the entire model, achieving state-of-the-art performance on benchmarks like VQAv2 with minimal examples.^[77] The primary benefits of multimodal perception include heightened accuracy in challenging conditions, such as noisy environments where individual sensors may fail, and built-in redundancy that enhances fault tolerance by compensating for sensor outages or degraded signals.^[78] For example, fusing visual and auditory data in autonomous vehicles improves object detection reliability under adverse weather, reducing error rates compared to unimodal setups.^[79] This redundancy also supports robust decision-making in dynamic scenarios, minimizing risks from single-point failures.^[80] Recent advancements in 2025 have advanced embodied AI systems, particularly in robotics, through vision-touch fusion for precise manipulation tasks. In self-supervised frameworks, vision disambiguates tactile signals for handling featureless objects like USB insertion, achieving 100% success rates while managing uncertainty in translation and rotation.^[81] Similarly, diffusion-based planners like DiffusionSeeder integrate depth (vision-derived) and tactile feedback to generate trajectories 36 times faster than prior methods, with 86% success in real-world tests on Franka Panda robots across occluded scenes.^[81] These systems, often trained on datasets like TVL with 44,000 vision-touch pairs, enable generalization to unseen objects and reduce reliance on labeled data, as seen in models outperforming vision-language baselines on tactile description tasks.^[81]

Real-world applications

Machine perception technologies have been deployed in robotics to enable autonomous navigation in complex environments. For instance, Boston Dynamics' Spot robot, introduced in 2019, integrates visual perception through stereo cameras and 3D sensors to map surroundings, detect obstacles, and perform path planning, while proprioceptive feedback from leg motors and force sensors maintains balance and adapts to terrain variations during indoor and outdoor operations.^[82]^[83] In healthcare, sensory prosthetics leverage multimodal feedback to restore natural interaction for users. Hybrid systems combining haptic, proprioceptive, and thermal cues allow prosthetic hands to convey touch, position, and temperature sensations, improving grasp control and object manipulation as demonstrated in clinical evaluations where users achieved dexterous tasks like simultaneous object handling.^[84]^[85] Diagnostic tools employing machine olfaction analyze volatile organic compounds in breath or fluids to detect diseases non-invasively; AI-powered olfactory sensors, for example, identify biomarkers for early respiratory conditions with high specificity.^[86]^[87] Machine taste systems, integrated into biosensors, assess chemical profiles in samples for applications like food safety or metabolic disorder screening, enhancing precision in clinical diagnostics.^[88] Consumer technologies incorporate machine perception for intuitive smart home interactions. Devices like the Amazon Echo Show combine voice recognition with visual processing to enable multimodal interfaces, where cameras detect gestures or objects while microphones process natural language commands, facilitating tasks such as video calls or environmental monitoring with contextual awareness.^[89]^[90] In the automotive sector, advanced driver-assistance systems (ADAS) utilize integrated perception modalities to enhance vehicle safety. Tesla's Full Self-Driving (FSD) suite, updated in 2025, relies on a vision-centric approach with eight cameras providing 360-degree coverage for object detection, lane tracking, and predictive maneuvering, along with audio cues for external alerts, enabling features like automatic lane changes and blind-spot monitoring.^[91]^[92] Industrial applications employ multi-sensor arrays for quality inspection in manufacturing. Acoustic and visual systems, such as those using microphone arrays alongside cameras, detect anomalies in machinery operation through sound pattern analysis and surface defect identification, achieving real-time monitoring with reduced false positives in high-throughput environments like assembly lines.^[93] Multispectral imaging arrays further inspect product integrity by capturing data across wavelengths to reveal subsurface flaws invisible to standard vision.^[94]^[95] Notable case studies highlight machine perception's impact. Research during the 2020 COVID-19 pandemic explored olfactory sensor arrays in electronic noses to detect viral biomarkers in exhaled breath, offering rapid, non-invasive screening with diagnostic accuracies up to 95% in preliminary clinical studies.^[96] In agriculture, 2025 deployments of AI-equipped drones integrate multispectral cameras and hyperspectral sensors to assess crop health, identifying nutrient deficiencies or pests across large fields to optimize yields and reduce chemical use by up to 20%.^[97]^[98]^[99]

Challenges and future directions

Current limitations

Machine perception systems face significant technical challenges, including susceptibility to sensor noise and high computational demands. Sensor noise, arising from environmental factors or hardware limitations, can degrade model performance, with Gaussian noise reducing accuracy in perception tasks by up to 20% beyond safe intensity thresholds in machine learning models for changeover detection.^[100] In low-light conditions, computer vision models exhibit increased error rates in object detection tasks due to amplified noise and reduced signal quality, as demonstrated in recent challenges evaluating denoising methods. Additionally, these systems are brittle to adversarial attacks, where imperceptible perturbations—such as those generated by Fast Gradient Sign Method (FGSM) or Projected Gradient Descent (PGD)—can fool vision models into misclassifying images with high success rates in white-box settings.^[101] Such vulnerabilities persist in perception modules, limiting reliability in real-world deployments like autonomous navigation.^[102] Practical limitations further hinder deployment, particularly in resource-constrained environments. High computational demands of deep learning models, such as vision transformers, require substantial inference costs; for instance, processing a single high-resolution image can demand significant computational resources, contributing to high training expenses for state-of-the-art systems. Scalability for real-time processing remains challenging, as models often fail to maintain low latency on edge devices without sacrificing accuracy. Energy efficiency poses another barrier in mobile applications, where AI perception tasks like object detection via neural network APIs (NNAPI) can consume more power than optimized CPU counterparts in many configurations, exacerbating battery drain in always-on sensing scenarios.^[103] Ethical concerns amplify these issues, with bias in perception models leading to discriminatory outcomes. Facial recognition systems, for example, show demographic differentials where false negative rates (FNMR) for East African subjects can be up to 100 times higher than for East Europeans at low false match rates, perpetuating racial disparities.^[104] Privacy invasions arise from always-on sensing, as sensor data from accelerometers or cameras enables inference of sensitive attributes like location, health, or emotions, often without user consent and vulnerable to extraction attacks.^[105] Gaps in less-developed modalities, such as machine olfaction and taste, underscore broader limitations. These fields suffer from data scarcity, with olfactory datasets covering only a fraction of the chemical space, leading to ambiguities in odor attribution. Unlike vision and hearing, where large-scale datasets enable robust training, olfaction lacks comprehensive, high-quality samples for rare compounds, impeding progress in applications like hazard detection.^[88]

Emerging technologies

Emerging technologies in machine perception are advancing rapidly in 2025 and beyond, driven by bio-inspired designs and AI integrations that aim to replicate and surpass human sensory capabilities. These innovations address gaps in efficiency, sensitivity, and adaptability, enabling more robust systems for robotics, healthcare, and environmental monitoring. Key developments include neuromorphic hardware, generative AI for simulation, and novel sensors that promise integrated sensory processing. Bio-mimicry plays a central role through neuromorphic sensors, which emulate biological neural processing for efficient perception. Event-based vision cameras, such as the Dynamic Vision Sensor (DVS) introduced in 2008, detect only changes in light intensity asynchronously, offering advantages like microsecond latency and high dynamic range over traditional frame-based cameras.^[106] Recent evolutions have enhanced these sensors with higher resolutions and integration into edge devices; for instance, the Prophesee EVK4 HD event camera (introduced in 2022) achieves 1280x720 resolution with asynchronous event capture at microsecond precision, enabling real-time applications in dynamic environments.^[107] These advancements build on spiking neural models, where membrane potential evolves according to a simplified integrate-and-fire equation:

V(t) = \sum I(t) e^{-(t-\tau)/\tau}

This formulation represents the voltage V(t) as the sum of input currents I(t) filtered by an exponential decay with time constant \tau, triggering a spike upon reaching threshold, thus mimicking efficient biological signaling with low power consumption.^[108] AI advancements are leveraging generative models to simulate sensory inputs, enhancing training data for perception systems without real-world collection. Diffusion models, particularly for audio generation, have emerged as powerful tools since 2023, iteratively denoising random noise to produce high-fidelity soundscapes conditioned on text or environmental cues. By 2025, these models support sensory simulation in machine hearing, such as text-to-audio synthesis that captures spatial and temporal nuances, improving robustness in noisy or occluded scenarios for applications like virtual auditory environments.^[109] Hardware innovations are expanding sensory modalities with specialized materials. For machine olfaction, quantum-inspired sensors are enhancing detection limits toward single-molecule sensitivity by integrating embedded AI with nanoscale chemical arrays, enabling real-time odor profiling for applications in safety and diagnostics.^[110] In machine touch, flexible electronic skins (e-skins) made from stretchable polymers and nanomaterials provide human-like tactile feedback; recent designs recover over 80% functionality within seconds after damage, supporting self-healing interfaces for robotic manipulation.^[111] Research trends emphasize scalable and ethical frameworks, such as federated learning for privacy-preserving perception, where models train across distributed devices without sharing raw sensory data, mitigating risks in multi-user environments like smart homes.^[112] Projections for 2025-2030 anticipate full sensory embodiment in AI, with embodied systems integrating vision, touch, and audition to achieve human-level interaction; market analyses forecast growth from $4.44 billion in 2025 to $23.06 billion by 2030, driven by advancements in multimodal robotics.^[113] Potential breakthroughs include holographic displays for integrated perception, combining visual and spatial cues in immersive formats. Lightweight, AI-optimized holographic systems by 2025 enable eyeglass-like interfaces that render 3D scenes with reduced computational overhead, facilitating seamless human-AI sensory fusion in augmented reality.^[114]

References

[1]
Machine Perception in Automation:A Call to Arms
Jan 23, 2011 · Perception means acquiring, interpreting, selecting, and organizing sensory information. The topic itself was not new to automation, but has ...
[2]
[PDF] An Introduction to the Machine Perception Laboratory.
Apr 20, 2005 · We rely on state of the art machine perception and machine learning techniques and large datasets of human behavior to train automatic ...
[3]
Machine Perception - an overview | ScienceDirect Topics
Machine Perception is the process of using tools like spherical harmonics to model illumination and appearance in computer vision and graphics.
[4]
Differences between human and machine perception in medical ...
In contrast, machines typically perceive images at a uniform resolution. In, the authors encode this inductive bias into a DNN architecture to demonstrate ...
[5]
Artificial intelligence, machine learning and deep learning in ...
AI, ML, and DL are transforming the field of advanced robotics, making robots more intelligent, efficient, and adaptable to complex tasks and environments.
[6]
(PDF) Towards Human-like Machine Perception 2.0 - ResearchGate
Aug 6, 2025 · Machine perception is a research field that is still in its infancy and is confronted with many unsolved problems. In contrast, humans ...
[7]
Perception - Google Research
The Perception team is a group focused on building systems that can interpret sensory data such as image, sound, video, and more.
[8]
https://larksuite.com/en_us/topics/ai-glossary/machine-perception
[9]
[PDF] 4 Perception
Exteroceptive sensors acquire information from the robot's environment; e.g. distance mea- surements, light intensity, sound amplitude. Hence exteroceptive ...
[10]
What is the Role of Machine Learning in Vision System Pipelines
Jun 9, 2025 · A vision system pipeline processes visual data step by step. It starts with image acquisition, followed by preprocessing, feature extraction, ...Missing: interpretation | Show results with:interpretation
[11]
[PDF] Consciousness, Embodiment, and Artificial Intelligence
Contemporary computational systems–artificially intelligent or otherwise–lack qualia insofar as they have no actual experience of the world; even so, there may ...
[12]
Bio‐Inspired Sensory Receptors for Artificial‐Intelligence Perception
May 3, 2024 · Bio-inspired sensory receptors offer numerous advantages for AI perception. The evolution of AI perception is deeply intertwined with the ...
[13]
The Perceptron: A Probabilistic Model for Information Storage and ...
No information is available for this page. · Learn why
[14]
Professor's perceptron paved the way for AI – 60 years too soon
Sep 25, 2019 · Frank Rosenblatt, left, and Charles W. Wightman work on part of the unit that became the first perceptron in December 1958. “I was a graduate ...
[15]
Vision: Human Representation & Processing of Visual Information
An influential book that offers a framework for understanding visual perception and considers fundamental questions about the brain and its functions.
[16]
HAPTIX: Hand Proprioception and Touch Interfaces - DARPA
HAPTIX builds on prior DARPA investments in the Reliable Neural-Interface Technology (RE-NET) program, which created novel neural interface systems that ...<|separator|>
[17]
Learning Transferable Visual Models From Natural Language ...
Learning Transferable Visual Models From Natural Language Supervision. Authors:Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, ...
[18]
Multifunctional biomimetic neural tactile sensing system for human ...
Jul 28, 2025 · A biomimetic tactile sensor system facilitates the development of human-machine interaction, which is vital for bioinspired robotic systems, ...
[19]
Yann LeCun's Home Page
Animals and humans can learn to see, perceive, act, and communicate with an efficiency that no Machine Learning method can approach. The brains of humans and ...Research · Publications · Fun Stuff · LeNet-5, convolutional neural
[20]
A Comprehensive Survey on Machine Learning Driven Material ...
May 2, 2025 · The machine vision defect detection system consists of four main components: image acquisition, image preprocessing, image analysis, and defect ...
[21]
Computer Vision Cameras: Types & Applications | Ultralytics
Oct 17, 2024 · From RGB cameras to LiDAR sensors, explore how different types of computer vision cameras are used in various applications across different industries.Exploring Rgb Cameras For... · Understanding Stereo Imaging... · Infrared Or Thermal Cameras...<|separator|>
[22]
What are Depth-Sensing Cameras and How do They Work?
Apr 14, 2023 · Depth sensing encompasses a range of approaches, including structured light cameras, stereo cameras, time of flight (ToF) cameras, and LiDAR systems.Missing: hardware | Show results with:hardware
[23]
[PDF] Deep Learning vs. Traditional Computer Vision - arXiv
Several CV algorithms, such as edge detection, corner detection or threshold segmentation may be involved in this step.Missing: core acquisition
[24]
[PDF] Image Correlation, Convolution and Filtering
This note discusses the basic image operations of correlation and convolution, and some aspects of one of the applications of convolution, image filtering.
[25]
[PDF] Gradient-Based Learning Applied to Document Recognition
The best neural networks, called Convolutional Networks, are designed to learn to extract relevant features directly from pixel images (see. Section II). One of ...
[26]
You Only Look Once: Unified, Real-Time Object Detection - arXiv
Jun 8, 2015 · We present YOLO, a new approach to object detection. Prior work on object detection repurposes classifiers to perform detection.
[27]
Towards Real-Time Object Detection with Region Proposal Networks
Jun 4, 2015 · Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Authors:Shaoqing Ren, Kaiming He, Ross Girshick, Jian Sun.
[28]
Computer Vision in Autonomous Vehicles | 2024 - Rapid Innovation
Rating 4.0 (5) Applications: Facial recognition systems that identify individuals in images or videos. Medical imaging analysis for detecting diseases from X-rays or MRIs.
[29]
[2301.04422] Optical Flow for Autonomous Driving - arXiv
Jan 11, 2023 · Optical flow estimation is a well-studied topic for automated driving applications. Many outstanding optical flow estimation methods have been ...
[30]
[2010.11929] An Image is Worth 16x16 Words: Transformers ... - arXiv
Oct 22, 2020 · A pure transformer applied directly to sequences of image patches can perform very well on image classification tasks.
[31]
https://arxiv.org/html/2507.14501v4
[32]
Chapter 2: Fourier Analysis of Signals
The Fourier transform is perhaps the most fundamental tool in signal processing. ... 2.4 Discrete Fourier Transform (DFT) 2.5 Short-Time Fourier Transform (STFT)Missing: seminal | Show results with:seminal
[33]
A Brief Guide to Microphones - What's The Pattern? - Audio-Technica
Omnidirectional microphones are normally better at resisting wind noise and mechanical or handling noise than directional microphones.
[34]
Speech Recognition with Deep Recurrent Neural Networks - arXiv
Mar 22, 2013 · This paper investigates \emph{deep recurrent neural networks}, which combine the multiple levels of representation that have proved so effective in deep ...Missing: seminal | Show results with:seminal
[35]
[1609.03499] WaveNet: A Generative Model for Raw Audio - arXiv
Sep 12, 2016 · This paper introduces WaveNet, a deep neural network for generating raw audio waveforms. The model is fully probabilistic and autoregressive.
[36]
An Overview of Audio Event Detection Methods from Feature ...
Feb 5, 2018 · This research is expanded by critically comparing audio detection methods and algorithms according to accuracy and false alarms using different types of ...<|control11|><|separator|>
[37]
Enhancing CTC-based Speech Recognition with Diverse Modeling ...
Starting in iOS 10 and continuing with new features in iOS 11, we base Siri voices on deep learning. The resulting voices are more natural, smoother, and allow ...
[38]
Whole Body Motion Noise Cancellation of a Robot for Improved ...
Apr 2, 2012 · This paper describes an architecture that enhances the capability of a robot to perform automatic speech recognition (ASR) even as the entire body of the robot ...Missing: audio | Show results with:audio
[39]
https://ieeexplore.ieee.org/document/10938925
[40]
[PDF] A Review of Tactile Information: Perception and Action Through Touch
Tactile sensing provides robots with a rich set of diverse signals based on contacts between the robot and its environment.
[41]
Active Haptic Perception in Robots: A Review - PMC - PubMed Central
Jul 17, 2019 · There is a compelling case for using principles of human haptic perception—active touch—to inspire the development of robot haptic systems.
[42]
Recent advances in tactile sensing technologies for human-robot ...
This paper reviews the latest developments in tactile sensing technologies, with a particular focus on their critical role in enhancing human-robot interaction.
[43]
Recent advances and challenges of tactile sensing for robotics
Based on the difference of sensing mechanism, we introduced some novel material-level strategies (resistive, capacitive, piezoelectric, triboelectric, and ...
[44]
Recent Advances in Flexible Tactile Sensors for Intelligent Systems
According to working mechanisms, tactile sensors are mainly based on piezoresistive effects, capacitive effects, piezoelectric effects and triboelectric effects ...
[45]
Dynamic Tactile Exploration for Texture Classification using a ...
Abstract: The findings of this paper enhance the knowledge of machine learning in tactile texture recognition. Synthetic perception of textures was achieved ...
[46]
Grasping Force Control of Multi-Fingered Robotic Hands through ...
According to the result of tactile sensing, the force feedback controller is employed to drive the robotic hand to adjust its grasping force online. The ...
[47]
In-Hand Manipulation of Unknown Objects with Tactile Sensing for ...
Oct 24, 2022 · In this paper, we present a method to manipulate unknown objects in-hand using tactile sensing without relying on a known object model.
[48]
Tactile Feedback in Upper Limb Prosthetic Devices Using Flexible ...
In this paper, a textile based tactile sensor system was designed, built, and evaluated for use with upper limb prosthetic devices.
[49]
GelSight: High-Resolution Robot Tactile Sensors for Estimating ...
Nov 29, 2017 · This paper reviews the development of GelSight, with the emphasis in the sensing principle and sensor design. We introduce the design of the ...
[50]
An optical/electronic artificial skin extends the robotic sense to ...
Aug 12, 2025 · Artificial skins are essential for bridging sensory gaps between robots and environments, enabling natural and intuitive interactions.
[51]
A Comprehensive Review on Sensor-Based Electronic Nose for ...
The pattern recognition system uses machine learning, artificial intelligence, or statistical algorithms to analyze the sensor data and identify unique odor ...
[52]
A comprehensive review of electronic nose systems
Oct 12, 2025 · Comprehensive review of e-nose systems combining sensor technologies, sampling methods, and AI algorithms. · Discusses advanced sampling ...
[53]
Artificial olfactory sensor technology that mimics the olfactory ...
Aug 19, 2022 · This review compiles artificial olfactory sensor technology based on olfactory mechanisms. We introduce the mechanisms of artificial olfactory sensors and ...Missing: core | Show results with:core
[54]
Electronic Noses: From Advanced Materials to Sensors Aided with ...
Dec 14, 2018 · Artificial olfaction (electronic nose) plays a critical function in artificial intelligence by mimicking the human olfactory organ that can ...Missing: R0 | Show results with:R0
[55]
Bio-Inspired Strategies for Improving the Selectivity and Sensitivity of ...
These “artificial noses” aim at the detection and identification of volatile organic compounds (VOCs), which are typically small molecular weight organic ...
[56]
Recent Progress in Smart Electronic Nose Technologies Enabled ...
Here, we review the recent advances in E-Nose machine learning techniques, with a focus on three important aspects: (1) feature extraction, (2) modeling, and (3) ...Missing: core paper
[57]
Machine learning-assisted electronic nose and gas sensors
The electronic nose with an array of gas sensors, a crucial application form of the machine olfaction, is capable of sensing not only odorous compounds, but ...<|control11|><|separator|>
[58]
[PDF] A Verilog-A Model for a Light-Activated Semiconductor Gas Sensor
Jul 15, 2024 · Rbase (t) = R0 1 + α · (EeLPF (t) − Ee0)β. (4) where R0 is the material resistance under ambient irradiance conditions, and α and β are fitting ...<|control11|><|separator|>
[59]
A reaction model of metal oxide gas sensors and a recognition ...
Aug 5, 2025 · The metal oxide (MOX) gas sensors have distinct response patterns with different gas sorts. In this paper, a reaction model of MOX gas ...
[60]
[PDF] Pattern analysis for machine olfaction - Texas A&M University
The objective of this review paper is to provide a summary and guide- lines for using the most widely used pattern analysis techniques, as well as to identify ...Missing: core | Show results with:core
[61]
Review on Algorithm Design in Electronic Noses: Challenges ...
This paper presents a wide-ranging and structured review of the methods and algorithms developed in the e-nose literature over the past few decades.Missing: core | Show results with:core
[62]
Electronic Nose Feature Extraction Methods: A Review - PMC
The aim of a feature extraction method is to extract robust information from the sensor response with less redundancy to ensure the effectiveness of the ...Missing: R0 | Show results with:R0
[63]
Advancements and Prospects of Electronic Nose in Various ... - MDPI
The review explores the application of electronic noses across diverse fields such as food analysis, environmental monitoring, and medical diagnostics, ...
[64]
Machine learning-enabled graphene-based electronic olfaction ...
May 15, 2023 · Research Article| May 15 2023 Machine learning-enabled graphene-based electronic olfaction sensors and their olfactory performance assessmentMissing: core | Show results with:core
[65]
https://www.nature.com/articles/s41378-025-01058-3
[66]
AI-powered electronic nose detects diverse scents for health care ...
May 2, 2025 · A research team has developed a next-generation AI electronic nose capable of distinguishing scents like the human olfactory system does and analyzing them ...
[67]
https://doi.org/10.3390/chemosensors13050161
[68]
Recent Applications of Potentiometric Electronic Tongue and ... - NIH
This study will focus on taste, aroma, and flavor profiles collected using an electronic tongue, electronic nose, or a combination of e-tongue and e-nose, ...
[69]
Electronic tongue: An analytical gustatory tool - PMC - NIH
Therefore, analytical taste-sensing multichannel sensory system called as electronic tongue (e ... equations (The Nernst or Nikolsky-Eisenman equation).
[70]
https://doi.org/10.1007/s11095-021-03041-9
[71]
Influence of the Flow Rate in an Automated Microfluidic Electronic ...
Incorporating electronic tongues into microfluidic devices brings benefits as dealing with small amounts of sample/discharge. Nonetheless, such measurements ...
[72]
Electronic panel for sensory assessment of food: A review on technologies integration and their benefits
### Summary of Recent Advancements in Electronic Tongue Technology
[73]
Application of Kalman Filter for Sensor Fusion - IEEE Xplore
Oct 12, 2020 · We propose a method that applies Kalman filter on the LiDAR and radar sensor fusion to improve the accuracy in object tracking for the autonomous driving ...Missing: techniques machine
[74]
[PDF] Sensor Fusion Using Kalman Filter in Autonomous Vehicles - IRJET
By fusing data from LiDAR, radar, and vision sensors, the Kalman filter-based approach improved the vehicle's perception of its surroundings, enabling safe and ...
[75]
Multimodal Alignment and Fusion: A Survey - arXiv
Nov 26, 2024 · This survey offers a comprehensive review of recent advancements in multimodal alignment and fusion within machine learning.
[76]
Flamingo: a Visual Language Model for Few-Shot Learning - arXiv
Flamingo is a Visual Language Model (VLM) designed for few-shot learning, rapidly adapting to novel tasks with few examples. It handles interleaved visual and ...Missing: fusion | Show results with:fusion
[77]
[PDF] Flamingo: a Visual Language Model for Few-Shot Learning
Flamingo is a Visual Language Model (VLM) designed for few-shot learning, rapidly adapting to novel tasks with few examples.Missing: fusion | Show results with:fusion
[78]
(PDF) Robust Multimodal Perception in Autonomous Systems
Sep 5, 2024 · This review paper comprehensively examines multimodal perception systems, emphasizing the integration of visual, auditory, and tactile data to enhance ...
[79]
[PDF] Learning End-to-end Multimodal Sensor Policies for Autonomous ...
Sensor fusion offers several advantages, namely robustness to individual sensor noise/failure, improving object classification and tracking [11], etc.
[80]
A Review of Environmental Perception Technology Based on Multi ...
By gaining a more comprehensive understanding of the environment, fusion systems can reduce risks by improving object detection, obstacle avoidance, and path ...2. Sensors In Environmental... · 3. Multi-Sensor Information... · 3.1. Multi-Sensor...
[81]
[PDF] Multi-Modal Perception with Vision, Language, and Touch for Robot ...
May 15, 2025 · This thesis explores how combining these various sensory inputs can improve robots' ability to manipulate objects in the real world. By ...
[82]
Boston Dynamics' Spot Robot Dog Goes on Sale - IEEE Spectrum
Sep 24, 2019 · The robot's perception system includes cameras and 3D sensors (there ... For example, it will be able to do mapping and autonomous navigation ...
[83]
Robot Vision Systems: 3 Ways Robots See the World
Stereo cameras, like those built into the Spot® robot, make it possible for robots to perceive depth by using two cameras with a known distance between them.Missing: touch 2019
[84]
Experimental Evaluation of a Hybrid Sensory Feedback System for ...
Oct 16, 2023 · This study proposes a new hybrid multi-modal sensory feedback system for prosthetic hands that can provide not only haptic and proprioceptive ...
[85]
Multichannel haptic feedback unlocks prosthetic hand dexterity
Feb 11, 2022 · Multiple channels of haptic feedback enabled subjects to successfully grasp and transport two objects simultaneously with the dexterous artificial hand without ...
[86]
Machine Olfaction and Embedded AI Are Shaping the New Global ...
Nov 3, 2025 · Machine olfaction is rapidly emerging as a transformative capability, with applications spanning non-invasive medical diagnostics, industrial ...
[87]
AI-Powered Olfactory Sensor Technology
AI-powered olfactory sensor technology uses AI to analyze chemical emissions, like breath, to detect biomarkers and early signs of diseases.
[88]
Advances in artificial intelligence for olfaction and gustation
Jul 12, 2025 · AI techniques, especially deep learning, allow for more accurate modeling of odor perception and the prediction of odorant interactions. This ...
[89]
Alexa.SmartVision.ObjectDetectionSensor Interface 1.0
Oct 13, 2025 · ObjectDetectionSensor interface in your Alexa skill so that customers can receive notifications when their smart-vision device detects an object ...Missing: machine perception
[90]
[PDF] Amazon Echo Show as a Multimodal Human-to-Human Care ...
In Lee's study, male participants perceived a stronger social presence from a smaller device screen (reported as being less imposing) as opposed to female ...
[91]
Full Self-Driving (Supervised) | Tesla Support
On-board cameras with 360-degree visibility check your blind spots and move your Tesla vehicle into a neighboring lane while maintaining your speed and avoiding ...Missing: perception modalities
[92]
https://evdances.com/blogs/blog/tesla-full-self-driving-fsd-technology-safety-regulation-and-what-comes-next
[93]
[PDF] Industrial Machine Perception via Acoustic Cognitive Transformer
Jul 9, 2025 · Employing two types of sensors—microphone and stethoscope sensors, we capture both distinctive and blended acoustic characteristics of machines.
[94]
Multispectral imaging for medical and industrial machine vision… - JAI
Multispectral imaging serves as a bridge technology to industrialized mass production inspection of goods in high throughput, high resolution, high robustness.
[95]
State of the Art in Defect Detection Based on Machine Vision
May 26, 2021 · Machine vision significantly improves the efficiency, quality, and reliability of defect detection. In visual inspection, excellent optical ...<|separator|>
[96]
Machine Olfaction and Embedded AI Are Shaping the New Global ...
Oct 22, 2025 · Recent studies have validated their use for detecting respiratory diseases such as COVID-19 by detecting signatures conferred by volatile ...
[97]
Recent advances in e-nose for potential applications in Covid-19 ...
E-nose devices are designed to detect odours and flavours. The versatility and sensitivity of e-nose technology make it a valuable tool in various fields ...
[98]
The expanding role of multirotor UAVs in precision agriculture with ...
Sep 16, 2025 · Multirotor drones are transforming farming by enabling fast and precise crop monitoring and management. Smart sensors and AI help detect pests ...
[99]
AI-powered plant disease detection and Drones - Dronelife
Mar 18, 2025 · Machine learning models can analyze leaf, fruit, or stem images to spot diseases based on characteristics such as color, texture, and shape.
[100]
Assessing the Influence of Sensor-Induced Noise on Machine ...
Jan 5, 2024 · It helps to identify and visualize the root causes of issues or challenges in evaluating uncertainty by using an ML model as a soft sensor.
[101]
[PDF] NTIRE 2025 Challenge on Low Light Image Enhancement
This paper presents a comprehensive review of the NTIRE 2025 Low-Light Image Enhancement (LLIE) Challenge, highlighting the proposed solutions and final ...
[102]
A Survey of Adversarial Attacks as Both Threats and Defenses in ...
Aug 3, 2025 · Adversarial attacks against computer vision systems have emerged as a critical research area that challenges the fundamental assumptions about ...
[103]
[PDF] Adversarial Machine Learning - NIST Technical Series Publications
Mar 20, 2025 · A discussion of potential mitigations for these attacks and the limitations of existing mitigation techniques. 2. Page 16. NIST AI 100-2e2025.
[104]
https://pages.nist.gov/frvt/html/frvt_demographics.html
[105]
[PDF] An energy benchmark for AI-empowered mobile and IoT devices - ITU
This paper presents AIEnergy, the first energy benchmark suite and benchmarking methodology to allow accurate energy measurement and performance evaluation ...
[106]
Face Recognition Technology Evaluation: Demographic Effects in ...
The table, last updated on 2025-03-05, includes summary indicators for how the two fundamental error rates vary by age, sex, and race. These are false negative ...
[107]
The Privacy-Invading Potential of Sensor Data - ResearchGate
Aug 7, 2025 · Anonymous data can feed machine learning algorithms that are used to invade people's privacy. ... 2025 ResearchGate GmbH. All rights ...
[108]
Diffusion Graph Neural Networks and Dataset for Robust Olfactory Navigation in Hazard Robotics
### Summary of Data Scarcity Challenges in Machine Olfaction Datasets
[109]
Event-based Vision, Event Cameras, Event Camera SLAM
Event cameras, such as the Dynamic Vision Sensor (DVS), are bio-inspired vision sensors that output pixel-level brightness changes instead of standard ...<|separator|>
[110]
Prophesee EVK4 HD Event Camera - Emergent Mind
Sep 28, 2025 · The Prophesee EVK4 HD Event Camera is a high-resolution neuromorphic sensor that captures asynchronous luminance changes with microsecond ...
[111]
1.3 Integrate-And-Fire Models | Neuronal Dynamics online book
If the voltage ui(t) (that contains the summed effect of all inputs) reaches ϑ from below, we say that neuron i fires a spike. The moment of threshold crossing ...
[112]
A systematic research of text-to-audio generation with diffusion models
Jan 3, 2025 · Some models of generative AI have been used in audio areas, such as denoising or generating audios in recent years. Additionally, though ...
[113]
[PDF] Machine Olfaction and Embedded AI Are Shaping the New Global ...
Oct 22, 2025 · Modern olfactory sensors draw inspiration from the mammalian nose, using materials such as graphene, metal oxides, and organic films in sensor ...
[114]
Rapidly self-healing electronic skin for machine learning–assisted ...
Feb 12, 2025 · The E-Skin recovers more than 80% of its functionality within 10 seconds after physical damage, without the need of external stimuli.
[115]
https://arxiv.org/abs/2504.17703
[116]
Embodied AI Market worth $23.06 billion by 2030 - PR Newswire
Jul 2, 2025 · PRNewswire/ -- The global embodied AI market is projected to grow from USD 4.44 billion in 2025 to USD 23.06 billion by 2030, ...Missing: sensory | Show results with:sensory<|separator|>
[117]
A leap toward lighter, sleeker mixed reality displays - Stanford Report
Jul 28, 2025 · Using 3D holograms polished by artificial intelligence, researchers introduce a lean, eyeglass-like 3D headset that they say is a significant ...