What's Happening

Apple has officially unveiled a new visual nutrition feature as part of Siri AI, the entirely rebuilt version of Siri it announced on June 8 at its Worldwide Developers Conference. The capability lives inside an expanded Visual Intelligence experience and a brand-new Siri mode built directly into the iPhone Camera app.

With Siri mode in the Camera, users tap the shutter button to let Siri analyze what is in front of them and return useful information. Among the new set of actions, Apple specifically calls out the ability to get nutritional insights about a plate of food, alongside other actions like splitting a bill with friends using Apple Cash. Earlier reporting from Bloomberg and code findings by MacRumors indicated the feature would also scan packaged nutrition labels for calorie and macronutrient tracking through the Health app, logging the dietary information automatically.

The feature is part of a much larger Siri overhaul. Siri AI adds personal context understanding, onscreen awareness, broad web knowledge, a dedicated Siri app, and Visual Intelligence expanding for the first time to iPad and Mac. The new features are available for developer testing now across iOS 27, iPadOS 27, macOS 27, and visionOS 27, and will roll out as a public beta later this year for users with a supported device set to English. Apple Intelligence requires an iPhone 16, iPhone 15 Pro, or newer, so the nutrition feature will be limited to recent hardware.

Why It Matters

Nutrition tracking is one of the most tedious habits in fitness, and friction is exactly why most people quit. Manual calorie logging means searching databases, guessing portion sizes, and entering everything by hand. By building food and label recognition directly into the camera and piping it into the Health app, Apple is attacking that friction at the system level, turning a multi-step chore into a single tap.

The bigger deal is distribution. Standalone apps like MyFitnessPal, Cal AI, and a wave of AI calorie-counting startups have built entire businesses on photograph-your-food tracking. Apple putting the same core function natively in the iPhone Camera, free and tied to the Health app that already aggregates a user's fitness data, instantly puts that capability in front of hundreds of millions of users who would never download a dedicated app. For the fitness and nutrition app market, native camera-based tracking from the platform owner is a serious competitive threat.

Bigger Picture

This fits a clear pattern of Apple slowly absorbing health and fitness functions into its core operating system. The Health app has steadily expanded from step counting into sleep, cardio fitness, medications, mental health, and now AI-assisted nutrition. Each addition makes the iPhone a more complete health hub and raises the bar for the third-party developers who pioneered these features, a dynamic that has played out repeatedly across Apple's ecosystem.

It also signals where AI assistants are heading in everyday wellness. The promise of visual intelligence is an assistant that understands the physical world through the camera and acts on it, and food is one of the most universal, repeatable use cases imaginable. That said, the practical questions are accuracy and trust. AI estimates of calories and macros from a photo are notoriously imprecise, and how reliable Apple's version proves to be will determine whether serious trackers adopt it or treat it as a convenient rough guess. With the feature still in beta testing and not arriving for general users until later this year, the real verdict waits until it is in everyday hands.

Sources

Keep Reading