Actually the latency will also be at least 250ms due to the fact of the pre-speech buffer required underneath as per explanation here in section 1.5:
www.dialogic.com/.../csp_programming_v6.pdf
Otherwise your math is correct as those numbers no doubt came from chapter 6 of the same guide noted above.
Jeff