USB connection to BeagleBone Black drops

When I connect to BeagleBone Black via USB, and its powered only from USB but not from 5VDC supply jack, I am always getting error when trying to connect to it through Linux terminal:

“Software caused connection abort”.

What is happening?