RtApiCore::probeDeviceOpen timeout

Hello, I’m having issues playing back audio with Airpods 4 connected to my mac. I get this error:

Opening the output stream failed:
RtApiCore::probeDeviceOpen:
timeout waiting for sample rate update for device (133).
(RTAUDIO_SYSTEM_ERROR)

The same error does not happen if I use my mac speakers or Airpods 1

This was happening both on macOS 15.1 and 15.2 (I did not have the chance to test on previous versions)