Have you tried playing the files locally with VLC or MPV? Is the audio out of sync in the files themselves or is it because of Jellyfin?

Sometimes the audio on my client is out of sync, but after stopping and resuming the video, the audio syncs again.