Betaplayer has a microdrive mode where it attempts to pre-buffer and keep the buffer filled. It also fully loads mp3's to ram and then turns off the microdrive to save battery. You should try it out.
The AVI can be loaded pretty quick, but with a microdrive its better to buffer it, which can take a bit of time due to limits in transfer speed to ram.