But you said, that the pitch reaction is too slow, didn’t you? However, what you are complaining about now is a different problem, actually a bunch of technical issues.
If you want to dive deeper, you may want to look at the threads in this forum linked below. They deal with latency of breath events but for most statements and findings you can exchange "Breath" with "Pitchbend". They are comparable because both are events triggered by human action and sent down their electronical path through various processors, beginning with the internal Sylphyo settings.
Latency Testing (Nov 2021)
How Breath Rate affects Latency (Nov 2021)
Direct vs Link Latency (Jan 2022)
Latency of On-board Sounds (May 2022)
This can help you to find out what you can expect from the Sylphyo, which improvements can be made through settings and sound setup and also what you have no control over because it is system-related.
One thread ends with a comment by Rudy Verpaele (imoxplus, Respiro). He talks about note change, but we learn that reaction time is not just milliseconds. Technical and musical aspects play a fundamental role.