Audio & Video
Learn about improvements to AVFoundation, MusicKit, ShazamKit, and more.
Learn about improvements to AVFoundation, MusicKit, ShazamKit, and more.
Learn how you can create integrated content experiences across multiple devices.
Watch nowDiscover how you can easily connect Thunderbolt and USB accessories to iPad with DriverKit. We’ll show you how to convert your existing Mac drivers without any code changes, learn how to add real-time audio support with AudioDriverKit, and provide best practices and tips for developing drivers for iPad.
Discover how you can use AVFoundation to keep people focused on your media app’s content — not your loading spinner. We’ll show you how to support a responsive and fluid interface in your app, all while you create rich audiovisual compositions, load audiovisual assets, and prepare media thumbnails. Find out how you can perform these tasks on your app’s main thread while I/O processes in parallel, learn how to get top-notch playback performance when loading data from custom storage, and more. To get the most out of this session, we recommend first watching "What's new in AVFoundation” from WWDC21.
HLS Content Steering dynamically steers clients to different servers based on load and redundancy. We'll take you through the latest updates to this framework and explore how you can introduce dynamically spawned CDNs to existing HLS clients with Pathway Cloning. We'll also share how you can achieve global traffic steering with bucket-based Steering Server rules and more.
Discover how you can enhance and personalize your app using MusicKit. We’ll take you through the latest additions to the MusicKit framework and explore how you can bring music content to your app through requests, metadata, and more.
Join us as we share the latest updates to SharePlay. We’ll show you how you can start SharePlay sessions right from your app, take you through improvements to APIs to create richer experiences, and check out enhancements to GroupSessionMessenger. We’ll also explore best practices for adding SharePlay to your app.
Core Haptics lets you design fully customized haptic patterns with synchronized audio. Request an appointment with an Apple engineer for guidance and conversation about your own apps and haptic patterns. Bring your code, your AHAP files, and your questions.
Have a question about AirPlay? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about exact audio matching with ShazamKit.
Have a question about any aspect of AVFoundation? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Meet the presenter of “Plug-in and play: Add Apple frameworks to your Unity game projects” and join a text-based watch party for the session, followed by a short Q&A. The watch party begins 5 minutes after the start of this activity — so don’t be late!
Ask Apple engineers about Apple Music during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.
Ask Apple engineers about SharePlay during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.
Find out how you can deliver a coordinated playback experience in SharePlay when your app delivers different ad schedules to each participant. We'll explore how to build playback experiences with stitched-in ads and scheduled HLS interstitials, and share tips and best practices.
EDR is Apple's High Dynamic Range representation and rendering pipeline. Explore how you can render HDR content using EDR in your app and unleash the dynamic range capabilities of HDR displays on iPhone and iPad. We'll show how you can take advantage of the native EDR APIs on iOS, provide best practices to help you decide when HDR is appropriate, and share tips for tone-mapping and HDR content rendering. We'll also introduce you to Reference Mode and highlight how it provides a reference response to enable color-critical workflows such as color grading, editing, and content review.
Explore the Apple Music API and MusicKit client frameworks. Learn how you can integrate Apple Music features into your web service or Android app, make requests to the Apple Music API to discover and fetch content, and personalize the experience for subscribers.
Learn how ScreenCaptureKit can deliver high-performance screen capture for your macOS screen sharing applications, video conferencing apps, game streaming services, and more. We'll explore the building blocks of this API, learn how to configure streams to capture on-screen video and audio content, and share tips for integrating it into your existing apps.
Discover how you can create personalized, individual experiences in your tvOS app. We’ll show you how you can offer a single checkbox to store profile data, game save states, and more, providing each person with the same level of data separation they'd have on a personal device like iPhone. We’ll also explore how the new user-independent keychain can help you maintain your existing sign on experience for multiple people in the same household.
Discover how you can support complex screen capture experiences for people using your app with ScreenCaptureKit. We’ll explore many of the advanced options you can incorporate including fine tuning content filters, frame metadata interpretation, window pickers, and more. We’ll also show you how you can configure your stream for optimal performance.
Discover the latest updates and improvements to the Advanced Video Quality Tool (AVQT). We'll take you through the interactive reports feature and help you learn how to identify video quality-related issues. We'll also explore extended support for raw formats, show you how to evaluate specific scenes within a video, and explore how you can use AVQT for Linux to analyze videos on Linux servers and online in the cloud.
Request an appointment with an Apple engineer for guidance and conversation about exact audio matching with ShazamKit.
Request an appointment with an Apple engineer for guidance and conversation about your app, the GameKit API, best practices, and more.
Have a question about AVAudioSession? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Have a question about MusicKit? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about Audio Units, Workgroups, HAL, Toolbox APIs, CoreMIDI, AVAudioEngine, AVF APIs Catalyst apps, Spatial Audio, SoundAnalysis, or AUVoiceIO.
Have a question about live or on demand HLS video streaming, Low-Latency HLS, Offline HLS, spatial audio, dynamic ad insertion, or stream authoring recommendations? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Have a question about Apple Music API or MusicKit Web Apps? Request an appointment with an Apple engineer for guidance and conversation about integrating with Apple Music API or MusicKit JS to your Apps, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about the PHASE spatialization audio engine and best practices.
Request an appointment with an Apple engineer for guidance and conversation about your app, the latest Metal APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about perceptual video quality and AVQT.
Have a question about SharePlay and Group Activities? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Bring on the noise: It's time for a sound design challenge! Today, we're inviting you to experiment with creative ways to manipulate sound on iPhone and iPad using its myriad sensors, inputs, and variable states. Explore over 70 audio files from Apple sound designers and create a sonic experience of your very own! Visit the Design Study Hall to collaborate on the “Create reactive soundscapes” coding & design challenge. Ask questions, connect with other developers and designers, and share your creations.
Ask Apple engineers about Core Image during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.
Meet the presenter of “Meet ScreenCaptureKit” and join a text-based watch party for the session, followed by a short Q&A. The watch party begins 5 minutes after the start of this activity — so don’t be late!
Ask Apple engineers about AVFoundation during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.
Ask Apple engineers about coordinated media playback with SharePlay during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.
Meet the presenters of “Take ScreenCaptureKit to the next level” and join a text-based watch party for the session, followed by a short Q&A. The watch party begins 5 minutes after the start of this activity — so don’t be late!
Find out how you can use the latest iOS and iPadOS system media players to build amazing media apps. We’ll share how we designed the updated player and give you best practices and tips to help you design media experiences of your own. We’ll also explore Live Text for video and show you how to integrate interstitials and playback speed controls into your apps.
Discover how you can add support for rendering in Extended Dynamic Range (EDR) from a Core Image based multi-platform SwiftUI application. We'll outline best practices for displaying CIImages to a MTKView using ViewRepresentable. We'll also share the simple steps to enable EDR rendering and explore some of the over 150 built-in CIFilters that support EDR.
Learn how you can take advantage of AVFoundation and Metal to build an efficient EDR pipeline. Follow along as we demonstrate how you can use AVPlayer to display HDR video as EDR, add playback into an app view, render it with Metal, and use Core Image or custom Metal shaders to add video effects such as keying or color management. Whether you develop games or pro apps, we'll help you decide which frameworks to use and share best practices for selecting transports, colorspaces, and pixelbuffer formats.
Discover how you can design and build a great SharePlay experience. We'll show you how to identify activities in your app that can help bring everyone together — even while they're apart. Learn best practices to help you design for group activities, create intuitive interactions, and build support for different types of experiences.
HLS Interstitials can help you create seamless transitions in video content between advertisements, other interstitials, and your HLS streams. Learn how you can optimize your ad inventory, fine-tune interstitial presentation with SNAP-IN/OUT when using HLS, and more.
Request an appointment with an Apple engineer for guidance and conversation about your app, the latest Metal APIs, best practices, and more.
EDR is Apple’s High Dynamic Range representation and rendering pipeline. Request an appointment with an Apple engineer for guidance and conversation around rendering HDR video content using EDR in your app, best practices, and more.
Have a question about tvOS? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about Audio Units, Workgroups, HAL, Toolbox APIs, CoreMIDI, AVAudioEngine, AVF APIs Catalyst apps, Spatial Audio, SoundAnalysis, or AUVoiceIO.
Have a question about AVAudioSession? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Have a question about MusicKit? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Core Haptics lets you design fully customized haptic patterns with synchronized audio. Request an appointment with an Apple engineer for guidance and conversation about your own apps and haptic patterns. Bring your code, your AHAP files, and your questions.
Request an appointment with an Apple engineer for guidance and conversation about exact audio matching with ShazamKit.
Have a question about AVKit? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Have a question related to playback in AVFoundation? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Meet the presenter of “Reach new players with Game Center dashboard” and join a text-based watch party for the session, followed by a short Q&A. The watch party begins 5 minutes after the start of this activity — so don’t be late!
Meet the presenter of "Create a great video playback experience" and join a text-based watch party for the session, followed by a short Q&A. The watch party begins 5 minutes after the start of this activity — so don’t be late!
Ask Apple engineers about ScreenCaptureKit during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.
Learn how you can create integrated content experiences across multiple devices. We’ll introduce you to DeviceDiscoveryUI, which makes it easy to set up communication pathways and connect Apple TV with other devices like iPhone, iPad and Apple Watch. We'll also explore common scenarios and provide best practices to help you enable frictionless device-to-device connectivity.
Learn how ShazamKit can help you build custom catalogs and support exact matching of any audio source within your app — all on-device. Find out how you can easily generate audio signatures and build catalogs at scale through the new ShazamKit CLI. We'll also show you how you can quickly update your app to sync with large amounts of audio content like multiple seasons of a TV show or multiple episodes of a podcast, and we'll share updates to the ShazamKit API and SHMediaItems to help your apps respond precisely to key moments in audio sources using time ranges. For more on ShazamKit, we recommend watching "Explore ShazamKit" and "Create custom audio experiences with ShazamKit" from WWDC21.
Learn how you can highlight your app's Now Playing information on every platform. We'll take you through an overview of media metadata, learn how it gets represented in areas like the Lock Screen and Control Center, and show you how to write and publish effective media metadata for your content. We'll also explore how your app can respond to commands from other devices such as HomePod.
Request an appointment with an Apple engineer for guidance and conversation about your app, the ScreenCaptureKit API, best practices, and more.
Have a question about SharePlay and Group Activities? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about Core Image, including how to use CIFilters with Extended Dynamic Range (EDR) headroom, methods to add kernels written in the Metal Shading Language, best practices for rendering to MTKViews, and more.
Have a question about Apple Music API or MusicKit Web Apps? Request an appointment with an Apple engineer for guidance and conversation about integrating with Apple Music API or MusicKit JS to your Apps, best practices, and more.
Have a question about live or on demand HLS video streaming, Low-Latency HLS, Offline HLS, spatial audio, dynamic ad insertion, or stream authoring recommendations? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about exact audio matching with ShazamKit.
Have a question about AVKit? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Have a question about AVAudioSession? Request an appointment with an Apple engineer for guidance and conversation about the latest APIs, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about your app, the ReplayKit API, best practices, and more.
Request an appointment with an Apple engineer for guidance and conversation about Audio Units, Workgroups, HAL, Toolbox APIs, CoreMIDI, AVAudioEngine, AVF APIs Catalyst apps, Spatial Audio, SoundAnalysis, or AUVoiceIO.
Meet the presenters of “Create custom catalogs at scale with ShazamKit” and join a text-based watch party for the session, followed by a short Q&A. The watch party begins 5 minutes after the start of this activity — so don’t be late!
Stream a live rewatch of "Building Device-to-Device Experiences" with the presenter. Join a real-time text conversation during the rewatch and participate in a short Q&A afterwards. The rewatch begins 5 minutes after the start of this activity — so don’t be late!
Ask Apple engineers about AVKit during this 2 hour text-based Q&A. Stop in to request guidance on a code-level question, ask for clarifications, or learn from others in a group setting.