Jason Snell, writing at Six Colors, has an exemplary review of the experience:

I didn’t mind the reduced pace of the NBA broadcast, which toggled between cameras under each basket, but Stratechery’s Ben Thompson felt strongly that the best option would’ve been a single camera at mid-court, to completely eliminate the disorienting cuts and replicate being at the game in person.

Apple’s approach with baseball, at least based on Friday’s game, seems to lean toward Thompson’s preferred approach — and it does benefit from it. Each half inning was shown from a single camera on the dugout rail next to the on-deck circle, giving a great view of pitcher and hitter and the infield, as well as the goings on right in front of the dugout in foul territory. The camera switched between innings, so you were always viewing from the perspective of the at-bat team’s dugout.

Making it all work better was Apple’s addition of a “virtual jumbotron” floating in the sky, a scoreboard with graphics and a video feed of the standard 16:9 telecast on Apple TV. It was easy to look up and catch a replay or even get a better view of something happening in the far-off outfield, without getting in the way of my view of the game itself.

I concur with Snell’s review. The camera placement was terrific. You watched each team bat from the perspective of its own dugout. Perfect. A few other thoughts:

  • The whole thing was legit exciting. Vision Pro continues to get a bad rap because Apple hasn’t sold many of them, and isn’t going to sell many of them until they come out with new models that are cheaper and lighter and less fussy. But there’s no denying that these immersive experiences are fucking cool. And an immersive live experience adds something else. It’s ineffable. Hard to say why, but feeling like you’re at another place watching something happen live is magic. Just a few years ago it would have required literal magic. It wasn’t possible. Now it is.

  • The immersive audio was terrific. It really sounded like being at Yankee Stadium, and truly added to the you-are-there feel of the experience. It seems corny to say this, but I really had the urge to stand during the national anthem, and it felt slightly wrong not to take the “hat” off my head (where the “hat” was the Vision Pro). It’s exciting to feel 43,000 fans roar around you. Baseball is a slow game but when the crowd roars, it erupts. That never comes across on regular TV broadcasts. It did here.

  • Like Snell though, I felt Apple’s commentators were too chatty. I’d love an option to toggle the commentary on and off, to just experience the natural audio of the ballpark.1

  • The only thing missing was aroma. Cement, grass, dirt, sweat, beer, peanuts, hot dogs with the works. Ballparks smell like fun. (Even Fenway.) But the you-are-there experience was so visceral I swear I could almost smell it. It’s like my brain was filling in the missing sensation. It didn’t feel like watching a 3D TV broadcast. It didn’t feel like a better version of TV broadcasting. It felt like something new and different. Something at least as different from watching on TV as watching on TV is different from merely listening on radio. It’s profound. TVs are small — laptops, tablets, and phones are even smaller. Yankee Stadium is huge. Watching this game immersively felt huge. Awesome, in the literal sense.

  • I love how you could look around and see how filthy everything really is in baseball: the on-deck mats, the interior of the dugouts, the tiny bits of schmutz on the warning track. It’s a lot of dirt and quite a bit of spit. That’s baseball, Suzyn.

  • There’s a resolution and/or depth of field limitation with the cameras, exacerbated by the fact that Vision Pro’s displays are, compared to reality, low resolution. They’re the highest-resolution VR displays on the market but I still couldn’t see the ball once it left the infield. When balls were hit to the outfield you just kind of had to judge what was happening by what the infielders and baserunners were doing. Ben Rice hit a double in the first inning and I thought the Sox outfielder caught it and I was confused why Rice was running to second base. Turns out the outfielder stopped running because Rice hit the ball over his head and he was waiting to play the carom off the left field wall. I was happy to be wrong. A few years from now, with better cameras and better Vision headset displays, these problems will be solved. But in the meantime, the outfield is fuzzy.

  • The best part about the immersive perspective compared to a traditional broadcast is watching how complex infield play really is. It’s fun to quickly look around the whole infield right before the pitch. You really see how much more stressful it is for the pitcher once there’s a runner on base — let alone more than one. It’s what I love about going to the ballpark — so much more complexity and intricacy is revealed — and watching this immersive broadcast enables the same thing. You can see the whole game, at all times, not just the pitcher, catcher, and batter.

  • The virtual “jumbotron” is a fine idea but I wish you could move it a bit higher, and it would be even better if you could configure it with the stats you want to see. But positioning it higher is my big request.

  • I have to admit I hadn’t used my Vision Pro in quite a few weeks before last night’s game. One thing that really struck me, almost certainly because baseball is a long game, is how heavy it is. My chin wants to droop and my face wants to look down when I’m wearing it. It’s the weight more than the isolation that makes it tiresome for anything other than short-form content, for me at least.

The whole thing was a great success. I’m writing these notes on Saturday afternoon while watching the old flat broadcast of game 2 of this 4-game series, and it feels ... well, boring. And small. Bodes well for the future of sports.

  1. Even better would be an option to swap in the local radio broadcasts, like bringing a portable radio to the ballpark. Go skeuomorphic with the UI and make it look like an old handheld Sony or Panasonic transistor radio, and make the toggle “click” on and off. Go skeuomorphic with the audio too — make it sound like it’s coming out of a little speaker or a little earpiece and have the tuner play static as you switch between home/away (and English/Spanish) stations. That’d be so fun. And the regular old flat Friday Night Baseball telecast already supports swapping in local radio broadcasts — they’ve already got the rights. Bring that to these immersive games! ↩︎