gh-158316: Avoid second buffer fetch on bytearray_decode() (#158485)

gh-158316: Avoid second buffer fetch on bytearray_decode() (#158485) #135350