Dub Dub Daily: Day 3

Welcome back to Dub Dub Daily. This is day three of WWDC and we are not slowing down.

Today's Group Lab lineup is one of my favorites of the week, but more on those in just a moment.

But first - our guest.

If you've been following along with sessions this week, you already know that Foundation Models and Apple Intelligence are having a moment.

Lori Hylan-Cho is Senior Engineering Manager of Swift Intelligence Frameworks, which means she's the exact right person to walk us through what it means for you as a developer.

My colleague Jeff sat down with her earlier this week, and I promise you'll want to hear what she has to say.

Jeff, take it away.

Lori Hylan-Cho, Senior Engineering Manager for Swift Intelligence Frameworks.

- You have a big year. - Yeah. There's a lot going on. There's Foundation Models, Vision framework, App Intents. Yes. We'll ask about those individually in a moment, but can you tell me what's going on here as a whole? I think this is amazing year for intelligence both bringing intelligence into people's apps and have bringing those apps into Apple Intelligence. It's a partnership between our developers and our system.

What do you mean by partnership? I think there's a there's a line that Josh says in the SOTU about your apps made more powerful by intelligence and intelligence made more meaningful with your apps.

And I love that idea that we're helping each other out here. There's a synergy that makes for better features and more powerful experiences for our customers. It's a very elegant way to say that. I like that a lot. Kind of a big question. Tell me about these Foundation Model updates. Okay, so we introduced the Foundation Model framework last year. Obviously it gave an opportunity for developers to bring intelligent features into their apps, by giving access to our on-device model, which ships with the OS, it's private, it's available offline. Amazing. This year, we're offering developers access to our Private Cloud Compute as well. So you'll have access to a very powerful server model, the one that actually powers our Apple Intelligence features, as well as access to third-party models like Gemini and Claude from Anthropic. So we also have Dynamic Profiles, which is kind of a foundational technology for sort of higher order things like skills, which we're also releasing as a package, so that people can use those or build their own abstractions like skills.

Dynamic profiles let you take different paths in your apps. So, say you have something that you want to keep only on device, private, offline, maybe doesn't require a huge amount of compute to make possible. So you might want to send that path down to your on-device model.

And then you could have a different path in your app that really needs the power of a server model.

And you can send that one to Private Cloud Compute or to another third-party online model, right? And both of those flows can be in the same app, and you can have different prompts, and the logic can go in different directions. So that's Dynamic Profiles rather than saying, oh, we're going to have one set of instructions and that applies all the time. And how does the Vision framework come into play? We'll actually have some Vision tools that can be called from a Foundation Models framework as well, like the OCR and the Barcode scanner are all now tools that are callable from Foundation Models framework. This is a lot. You have mentioned a lot of things in a very short amount of time. Can you talk to me about App Intents? Yes, so App Intents are the way for app developers to integrate their apps with Siri. So people can use natural language to make requests of Siri to find information that they know is hidden somewhere in one of their apps on the system, to take action on that information. Like you probably saw in the SOTU, when I said who's coming to origami night, I knew that we'd had a conversation about it. Who were the people who are actually saying that they're coming? What's Richard bringing, right? And being able to follow up on that and ask him to bring a veggie pizza.

You can, you know, set timers, you can change your morning alarm, you can update calendar events, things like that. So there's lots of opportunities for app developers out there to adopt the App Intent schemas, to be able to make their content available through Siri and to make it actionable as well. So I'm really excited about that. So a lot, a lot of that's gonna be going on this week. - That's gonna be really fun to watch. - Yay! Give me an example, if you could, of how you would use natural language in Siri in your own day-to-day, something you would use it for. I asked on Sunday, you know, can I bring my own food to the ballpark when I go see the Giants play? Instantaneous! Just here's the whole deal. Yes you can bring your own food. Here's are all the beverage restrictions, here's the reference, a website to go find out more if I needed that. But I had... like all the answer was there already. It's so great. One of my colleagues was saying that they were driving past a restaurant in San Francisco they hadn't seen before, And they were like, oh, that looks interesting, what's that? And asked, they got the chef, the prices of the food, when it opened, do they take reservations? And he's like, that is exactly what I wanted to know. And I just had to ask. What was that restaurant I just saw, it was called, whatever it was. Yeah. Oh, this is gonna be a lot of fun. It's gonna be so great. It's a new world.

Thank you so much Lori and Jeff. Really cool stuff.

Now today's schedule for Group Labs running all day.

As always, we've spread these across the day so you can join live.

And if you miss one, every Group Lab is available on demand.

Sign up for them all on the Apple Developer app and website.

Couple more things.

Everything announced this week, documentation, references, and sample code is already waiting for you at developer.apple.com/documentation Dig in.

Apple experts are on the Apple Developer forums answering questions on tools and technologies all week long and beyond.

And this is important: there is a new batch of stickers in the Apple Developer app.

That's day three. I'll see you tomorrow for day four of WWDC.