I dont know how to fix this issue it always take 2 sec buffering before the video start so you can add custom content filtering copy paste whole filter in - (brave://settings/shields/filters )👇
www.youtube.com##yt-formatted-string.style-scope.yt-notification-action-renderer:nth-of-type(1))