Visual MP3 Splitter & Joiner allows you to join a bunch of your audio files into one and yet keep them logically separated.

Beneath the join list you can see the option: “Insert silence between MP3 track, s”. A small field on the right contains 0, which means that there will be no pauses. If you want some, please change the value to an appropriate number of seconds.

Set pause between parts