I did some conversions of the same song in different formats (MP3 VBR, WMA VBR, MP2 and OGG) to see which sounds best at low bitrates.
I forgot my S1MP3 doesn't support OGG (i got a standard thumb drive thingy with backlit monochrome display, not MP4) and just threw them all in.
When i played them: SURPRISE!!! OGG SUPPORT!!!
The OGG file was played without any problems. So try putting an OGG file in your S1MP3, maybe you're lucky too.