Stone Oakvalley's Amiga Music Collection (SOAMC=)
The automated Commodore Amiga music to MP3 recording and download project!
 INTRODUCTION: 
The SOAMC= project was a non-profit and a private project for my own amusement.The purpose was to preserve Amiga music in one of todays most common music format, namely the MP3. The original Amiga music files are today played by millions of people around the world on software players for PC, Mac and Linux. The playback quality/timing of this can vary compared to the authentic playback of a real Commodore Amiga, and from my point of view, why have something emulated when you can have the real deal instead? I want to listen to the authentic Commodore Amiga music as it sounds on the real machine. Commodore Amiga are a legend in computer history and in many ways influenced in todays culture. A special thanks to the wonderful "father" of Amiga: Jay Miner - You shall forever be remembered. Rest In Peace :-( To put in it words we all can understand: WE LOVE AMIGA - WE LOVE MUSIC! Watch a nice introduction movie about the project here: See it on YouTube in higher resolution, http://www.youtube.com/watch?v=brFLSz66ULM&fmt=18 Download it in High Resolution for the ultimate joy here! (80MB, WMW 720x576) The SOAMC= project was an automated recording technique invented by me (Stone Oakvalley) in order to mass record music from the legendary Commodore Amiga and its sound chip (Paula 8364). I have chosen A1200 for the purpose, because I had access to a CF IDE adapter and a CF card so easily without spending too much time finding a suitable HD and turbo/memory card solution for A500. There are a difference between the filtering on A500 and the A1200 audio chips, but I do not think that it will make this project less impressive when recorded on a A1200. I could never "back-in-the-days" remember any problems or irritations by listening to the same music on A1200 compared to A500. I have no intentions of re-recording the whole thing for A500 in future. The goal was to record a huge pack of music files found at Exotica, Modland and the Mods Anthology #1 collections that are VERY Amiga compatible. No S3M, XM, IT etc (PC formats) will be recorded, thus it can be played on Amiga, but the format is a PC format which later became also possible on the Amiga by using software mixing possibilites. It is also a much newer format that was not available on Amiga 500/1200. This is a very AMIGA based project. With EaglePlayer as the REAL Amiga player and a CF 2GB IDE acting as HD/fileserver, it all connects to a recording PC via a standard serial cable with own tailored software and database structure tools written in PureBasic. Yes, it works like a charm. Also, a strong point to consider in this project is that ALL music are recorded on real hardware. You could of course export music from DeliPlayer (PC) as WAV in better crisp quality and effects etc, but it was important to not fiddle with emulation when it can, with some extra work, be recorded from the real Amiga and its stereo-outs instead. Export tests done by the latest DeliPlayer on PC showed that "Imploder4.mso" by Paul van der Valk would not export correctly, thus making it totally useless for the purpose of this project! Forget WinAmp too, it only takes 1% of the formats the EaglePlayer on Amiga supports and that the SOAMC= project produces! It is called AUTHENTIC too because we will record the audio AS-IS from Amiga. We all rememeber the awful 4 channel left/right extreme stereo separation and listening to these in headphones is no fun. But, as a bonus the process will include a custom stereo mix to get rid of the extreme spatial stereo, meaning a chosen percent of each channel blends into the opposite one. This simply DOUBLES the amount of MP3 files available, and it is a massive amount indeed! Further, I've adjusted DC BIAS to 0 and executed Volume Maximizer with no clipping using NORMALIZE.EXE and SOX.EXE. Noise Reduction was not performed in any way. Thats it!  WHY?: I want to listen to Amiga Music totally independent of having the need of a dedicated player around. Listen to it on MP3-players, Car-stereo systems, living room systems etc etc. I also do this project because I do not trust the PC players and their correct playback of classic Amiga music and also by exporting it to wav might cause problems. I know we are only dealing with sample playback, but the timing is also a critical factor that I want to be correct. The timing is used when creating synthetic instruments for instance. Typically heard in a of cool Amiga music software like FutureComposer. Further, there are other sites out there that have a lot of authentic Amiga recordings as MP3 but most likely these are far from complete (typically bloated with commerical banners and google ad crap etc) and will never be finished because they are recorded manually or by a handful of recorders resulting in a year-after-year slow progress. Somebody has to take action... me that is! The Database: The entire music collection is a mix between all module files found at: MODLAND (ftp.modland.com) EXOTICA (www.exotica.org.uk) MODS ANTHOLOGY #1 www.fusecon.com/products/scenecds/modsan1.shtml cd's. The snapshot of these sites were taken during summer-winter 2007-2008, so any new files after that period WILL NOT BE SUBJECT of beeing included in future recordings. This project is a ONCE-TIME project and I do not intend to keep recording ANY new stuff for this collection after completion. Only severe bugs might be re-recorded! The MP3 TAGS will contain information derived from the title/filename/directoryname where found suitable. Since there is no database available online that cover the 150+ Amiga formats I'm recording its hard to create an full database of the releaser/group, copyright holder, produced year and the composers name. I wished there was a HVSC C64 SID similar database for the Amiga formats, since that is a very well put together database which follows strong rules for information. But, it's easy for that part, since SID is only one file format and has a documented structure of information stored inside. For the Amiga, its well.... the 150+ different formats which are all different in their buildups and many files don't have anything human readable text stored, so this information is only available online, but only found as HTML and text online making the SOAMC= database process difficult for automation! Today, EXOTICA and AMP does a incredible job collecting this information and I will leave their great work to still be processed without me creating it all over again. MODLAND only stores information about the music files in named directories and original filenames. MODLAND has just dir named information of the releaser but nothing else like what year it was produced. The SOAMC= database has been constructed with a special RAW TEXT ripper functionality which extracts as much textual information found in the 150+ different formats and use that as a base when searching for the exact tune you want. Some Amiga music files have additional text information stored in different locations and sometimes these are not even complete, making it an automated process to store the information about the module online difficult. The structure has been cleaned slightly and a number of errors found in these collection fixed to form my own ready-to-record music collection. These original Amiga files (in directory structure and .ZIP) including the final MP3 recordings will be available online for download. Since there is no particular downloadable database of Amiga Music like the HVSC (Commodore 64 High Voltage SID Collection) I had to develop a short routine to extract as much as possible human readable text from all these files to better create a maximum search hit when searching for a favourite tune. The process is probably not done before regarding any Amiga Music database, and the SOAMC= database is THE FIRST to probably invent such a feature and incredible RAW search function today. I've seen it for ProTracker/SoundTracker clones out there (namely MOD. files), but not the other non-xxxxTracker files. Further I do not wish to dig through a lot websites and old information to try and create a HVSC similar database myself. My focus is to record and preserve the sound of what I managed to find internet during 2007. Database Overview: - Based on 157 different Amiga formats. - Database will be organized as: [FORMAT/COMPOSER/FILENAME] or [FORMAT/GAME/FILENAME] - Filenames are mostly kept intact as-is from the collections derived from: MODLAND, EXOTICA, and MODS ANTHOLOGY. Disk space needed is approx 1TB, recording/process time is over 1 year!. Tags included in the MP3 files will be Original Titlename, Composer, Music Format and for some the origin of the module i.e (From Game: Blues Brothers) Statistics of what was recorded: 157 Amiga Music File Formats: -------------------------------- A.M.Composer 1.2 = 5 AHX v2 = 988 AProSys = 28 Actionamics = 1 AmosMusicBank = 45 Art&Magic = 4 ArtOfNoise = 211 Beathoven Synthesizer = 32 Benn Daglish = 44 Benn Daglish SID = 3 Cinemaware = 11 Compact ModFile = 11 Core Design = 6 CustomMade = 7 Customplay = 659 Darius Zendeh Player = 14 Dave Lowe = 45 Dave Lowe New = 41 David Hanney = 8 David Whittaker = 120 DeltaMusic 2.0 = 65 DeltaMusic_1.0 = 8 DeltaPacker 1.0 = 2 Desire = 3 DigiBooster = 175 Digital Mugician 1 = 83 Digital Mugician 2 = 6 Digital Sonix & Chrome = 12 Digital Sound Creations = 3 Digital Sound Studio = 19 Dirk Bialluch = 3 Dynamic Synthesizer = 2 EarAche = 4 Editeur Musical Sequentiel = 6 FWMP = 5 Face The Music = 94 Fashion Tracker = 3 FollinPlayer II = 52 Fred Gray = 4 FredEditor = 53 Future Composer 1.3 = 123 Future Composer 1.4 = 131 Future Player = 6 FutureComposer = 2 GlueMon = 16 Hippel = 40 Hippel-COSO = 87 Howie Davies = 3 Images Music System = 12 Janko Mrsic-Flogel = 6 Jason C. Brooke = 18 Jason Page New = 33 Jeroen Tel = 8 Jesper Olsen = 28 Kris Hatlelid = 13 Leggless Music Editor = 2 M.O.N. = 28 MCMD = 4 MED = 3524 MED Packer = 14 MED SoundStudio = 52 Magnetic Fields Packer = 7 Maniacs of Noise = 8 Mark Cooksey = 8 Mark II = 33 MarkCookseyOld = 6 Martin Walker = 24 MaxTrax = 81 Medley = 4 Mike Davies = 10 Music-Assembler = 11 MusicDiskTracker = 97 MusicLine = 812 MusicMaker = 21 NoisePacker 1.0 = 1 NoisePacker 2.0 = 36 NoisePacker 3.0 = 88 NoiseTracker = 5487 NovoTrade Packer = 14 OctaMED = 113 OctaMED SoundStudio = 568 Oktalyzer = 116 Old SoundTracker = 19 PSA = 2 Paul Robotham = 19 Paul Shields = 14 Paul Summers = 4 Peter Verswyvelen Packer = 12 Pierre Adane Packer = 22 PowerTracker = 2 Pro-Packer 2.1 = 7 Pro-Packer 3.0 = 5 ProRunner 1.0 = 23 ProRunner 2.0 = 30 ProTracker = 75591 Promizer 1.0 = 1 PumaTracker = 42 QuadraComposer = 13 Richard Joseph Player = 104 Riff Raff = 3 Rob Hubbard = 15 Rob Hubbard 2 = 62 Rob Hubbard ST = 3 Ron Klaren = 20 SCUMM = 10 SUNtronic = 5 Sean Connolly = 3 Sean Conran = 14 Sidmon_1.0 = 53 Sidmon_2.0 = 57 Sierra AGI = 798 Silmarils = 11 SonicArranger = 265 Sonix Music Driver = 237 Sound Images = 33 Sound Master = 11 Sound Programming Language = 9 SoundFX_1.3 = 319 SoundFX_2.0 = 43 SoundMaster_II = 28 SoundMon 1.0 = 1 SoundMon 2.0 = 194 SoundMon 2.2 = 85 SoundPlayer = 34 SoundTracker 15 = 1144 SoundTracker 2.6 = 8 SoundTracker 31 = 19 Soundcontrol 3.0-5.0 = 19 Soundfactory = 11 Special FX = 29 Speedy System = 3 StarTrekker 4 = 701 Steve Barrett = 6 Steve Turner = 6 SynTracker = 16 Synth Dream = 18 Synth Pack = 17 Synthesis = 35 TFMX = 99 TFMX 7V = 17 TFMX Pro = 258 TFMX_note = 6 TakeTracker = 6251 The Musical Enlightenment = 15 The Player 4.0b = 15 The Player 4.1a = 241 The Player 5.0a = 5 The Player 6.0 = 22 The Player 6.0a = 37 The Player 6.1a = 105 TheHolyNoise = 17 Thomas Hermann = 2 Tomy Tracker = 2 TrackerPacker 3 = 13 Ultimate SoundTracker = 201 VSS = 7 Wally Beben = 24 ---------------------------- Amiga Files scanned: 102172 Total amount of MP3 files created: 115902 Total playtime: 271163 minutes = 4519 hours = 188 days Amount of bytes Amiga Music Files: 13885333321 (13.9GB) Amount of bytes Amiga Music ZIP Files: 9202495386 (9.2GB) Amount of bytes MP3 Original Files: 457144287282 (457.1GB) Amount of bytes MP3 Mixed/Blend Files: 457144205747 (457.1GB) Total diskspace needed for collection: 937.3GB Total amount of file: 436148 Last Updated: 28 March 2009 Recording Process: The music will be played on EaglePlayer2.03b1 (previously announced DeliTracker2.32, but due to I couldnt find all suitable players and the fact the EaglePlayer players are newer and updated I had to switch player software) on Amiga 1200 with the filter turned off. A own recording software (PAULAREC) will be running on a 1GHz PC running WinXP with a M-Audio AudioPhile 2496 audio card and serial communication from PC<->Amiga. DeliTracker was also used in the aftermath recording, since EaglePlayer failed in some cases. The software will control and keep track of the recording process and create automatic MP3's for a 24/7 recording loop during the entire project. On the Amiga side an additional server software programmed in Arexx will control EaglePlayer and be the portal towards my own PC software (PAULA REC). NOTE: All songlengths were extracted out of DeliPlayer 2.50b (Windows) playlists, and without their magnificent software and songlength detection routine, I would fear this project would NEVER be possible! Hope to see some day DeliPlayer back on track, it has been dead for so many years....Peter Kunath and Florian Vorberger: R I S E !!! Pictures of the setup: Mounted on a wooden plate onto the wall, just because I ran out of floor space!    Availability: The MP3 files are available on our own server with a totally non-bloated, real downloads and a website much similar to the database already used on the SOASC= project Pictures of the server used during 2009 and beyond: Spec: 2 x Intel Xeon @ 3.2GHz w/hyperthreading, 1.5gb ram, 1.4t hd space, 4u rack & 2 x 350watt power (redudant)  Pictures of the server used during 2008: Spec: 1 x Intel P4 @ 1.9GHz, 1.5gb ram, 1t hd space, 2u rack & 1 x 400watt power  
IMPORTANT TIMELINES: From start of project to the actual recording loop began, I worked 25% of my available spare time on this project. After the recording was initiated I had to check almost every day to see that the recording was still going smooth. It was an tiresome process for over 400 days!!. Amount of money spent: 750 NOK,- ($136) ftp.df.lth.se on a fast bandwidth connection. We're back stronger and better. consisting of tideous manual ripping (by Stone Oakvalley). A wealth of several thousand disks are scanned for the final and ultimate blow in Amiga Music module search and preservation with an aim to provide even modules nobody else have stored or found on the net yet. It happend @ 22:51 It happend @ 1:48 at night and I recorded a video of it to preserve the legendary moment. It's considered to be a preliminary release still, so expect missing files, bugs etc. It's considered to be a preliminary release, before the final cleanup & release. queue and database updated. It is now even bigger than ever before!!! They will be replaced by a much greater collection found at MODLAND, thus expanding this project. either PC or Amiga managed to create a small recording hickup about 1-2 seconds out. The bug was fixed and the whole thing had to restart. Only 3900 tunes were recorded, so no problem. The automatic process will record for approx 8 months! checked out! Recording PC is standby ready for recording. the structure of the music directories, formats and in general the entire database buildup. THE LAST MINUTE OF THE INITIAL RECORDING JAN 2008-FEB 2009: On February 12th 2009 @ 1:48 this is the preservation of a great moment in computer history :) The last file to be recorded from the initial queue of 115905 Amiga music files. |