BBB Latest angstrom image ssh problem

I have a problem with ssh on the latest angstrom image, I can ssh to the box, I can open even multiple ssh connections.
However as soon as I logout from one of them it stops accepting new tcp connections. I checked in wireshark and
beaglebone sends a rst back as an answer to the incoming syn.

This is easily reproducible on my board.

I might also add that other tcp servers such as lighttpd is running and they don’t have an issue with new incoming connections.

Any suggestions ?