There are plenty of USB turntables. Some come with software for editing.

usb turntable - Google Search

There are plenty of third party programs for doing this also.
Audacity: Free Audio Editor and Recorder
Audio Cleaning Lab 14 - audio sound recording software by MAGIX