Connections stops after a while if I play sound from browser, but not from vlc media player

Description

I’m using my phone to connect my hearing aids to my pc, basically
the audio will stutter or stop and disconnect while listening, see steps below
This only happens if I’m listening to a stream or a video through the browser (happens with both firefox and chrome) AND I have bluetooth hearing aids connected to the phone
If I’m watching a video with a video player or I’m streaming to the phone’s speakers, this won’t happen

Steps to reproduce

connect audio relay from windows (server) to android (players) via usb (usb tethering)
connect hearing aids to phone (bluetooth)
start listening
after some time (sometimes 1 minute, sometimes 5 minutes) the audio drops, then the connection drops

Devices

Device A:
Windows 11
AudioRelay 0.27.5

Device B:
Android 13
AudioRelay 0.28.1