Bump espnet from 202301 to 202304

Bumps [espnet](https://github.com/espnet/espnet) from 202301 to 202304.
- [Release notes](https://github.com/espnet/espnet/releases)
- [Commits](https://github.com/espnet/espnet/commits)

---
updated-dependencies:
- dependency-name: espnet
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

requirements.txt

@@ -91,7 +91,7 @@ diffusers
 controlnet_aux
 tiktoken
 
-espnet==202301
+espnet==202304
 espnet_model_zoo==0.1.7
 # flask==2.2.3