That is called a dialup connection. In the old days you could also get this in the form of a leased line, which basically means you are connected to one peer and you never hang up.
The computer data was modulated as sound chirps so that it could be transferred on the readily available voiceband connections. Data rates up to 56kbps were common.
