If you need to record on the go in stereo (as in cataloging song ideas or recording anywhere without having to setup a/d conversion, mics, mixer etc..) then one of the portable digital stereo recorders are the way to go. Check out the Zoom H2 for further info on this:

Zoom H2 Handy Portable Stereo Recorder  

You can buy most any instrument you need online now and check out rebates available to lower your cost:

Save more with manufacturers rebates

Save up to 81% on your favorite Musical Equipment at American Musical Supply   . Low cost musical instruments.