Bump espnet from 202301 to 202304

Bumps [espnet](https://github.com/espnet/espnet) from 202301 to 202304.
- [Release notes](https://github.com/espnet/espnet/releases)
- [Commits](https://github.com/espnet/espnet/commits)

---
updated-dependencies:
- dependency-name: espnet
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>

setup.py

@@ -90,7 +90,7 @@ setup(
         'diffusers',
         'controlnet_aux',
         'tiktoken',
-        'espnet==202301',
+        'espnet==202304',
         'espnet_model_zoo==0.1.7',
         'flask==2.2.3',
         'flask_cors==3.0.10',