There are a few significant songs that don't get recorded automatically when discovered.
The Ghost Mother's Song
File:Aquaria leafs.gifFile:Aquaria circle.gifFile:Aquaria drop.gifFile:Aquaria star.gifFile:Aquaria leafs.gifFile:Aquaria circle.gifFile:Aquaria drop.gifFile:Aquaria swirl.gifFile:Aquaria leafs.gifFile:Aquaria circle.gifFile:Aquaria drop.gifFile:Aquaria seed.gif
The Ghost Mother's Song is necessary to proceed through certain portions of the Abyss and the Body but isn't explicitly given to you as other songs are. Instead it's sung in the background of a particular area. The onus is on the player to interpret and remember what the notes are and play them back at the appropriate time. Given that this song is rather complicated this can be a frustrating task for those of us without a well developed sense of pitch.
The Whale's Song
File:Aquaria drop.gifFile:Aquaria swirl.gifFile:Aquaria circle.gifFile:Aquaria swirl.gifFile:Aquaria leafs.gif
This song allows entry into the stomach of the whale that resides in the Icy Vail area. It can be found inscribed on a wall over an image of a whale hidden behind a false wall and a heavy current in the area between Open Waters and They Abyss.
The Seahorse's Song
Played to start the race mini-game in the Arnassi Ruins. Unlike the other two these notes are written on the wall in the only place you'd need to use them. Mentioned here only for completion's sake.