Apple is reportedly testing AirPods with cameras that could let Siri access visual data, according to Bloomberg’s Mark Gurman. The devices are in late-stage testing with Apple employees as part of an 'AI device push.' However, a source tells WIRED that Apple may delay the release due to concerns about Siri's visual intelligence and privacy risks. The company has not responded to WIRED's request for comment. The move could signal a broader strategy to integrate visual data into Apple's AI systems, enhancing features like navigation and shopping assistance. The cameras would not be used for capturing photos or video, but rather for providing context to spoken requests. The exact use cases remain unclear, though some suggest they could help with location accuracy and grocery shopping. The decision reflects Apple's ongoing efforts to balance innovation with its strong privacy stance. Source: wired
The potential camera-equipped AirPods could provide visual data to improve Siri's capabilities, according to Anshel Sag of Moor Insights & Strategy. He notes that vision-based location accuracy could help rectify GPS errors, similar to Google's approach with its upcoming smart glasses. Peter Richardson of Counterpoint Research also highlights the possibility of using visual data to assist with meal planning by combining information from multiple devices. These features could make Siri more intuitive, especially when integrated with the Apple Watch. The use of cameras in earbuds could also enhance accessibility for visually impaired users through features like Image Explorer and Voice Over. However, the source does not specify whether the cameras would be forward-facing or world-facing. A 'small LED light' would indicate when visual data is being sent to the cloud. Source: wired
Apple's potential use of camera data for AI training is part of its broader strategy to enhance its AI capabilities. According to Peter Richardson, the data from low-resolution cameras could provide new information for training AI models, though Apple does not currently have a foundational model to compete with OpenAI or Google. The company’s privacy policies may require rigorous anonymization of data if it shares it with third-party services like Google. Apple could also process visual data on-device to improve Siri's functionality without sending it to the cloud. The development aligns with Apple's Private Cloud Compute initiative, which uses custom servers for AI tasks. The company's approach to balancing AI innovation with privacy will be a key focus for CEO John Ternus. Source: wired
