getRemoteAddress: empty value on WorkerThreads load balancing

Using the WorkerThreads.js example, getRemoteAddress() returns an empty ArrayBuffer when we connect using the parent port. When using a child port it works as excepted, but we don't get the load balancing. It was working correctly before, this may be caused by the [remote address caching update](https://github.com/uNetworking/uWebSockets/commit/2d18f69d6288df29081cd214dbb81b0e00a31528) in the main repo.