An
awesome freeware program is
Total Commander. It's a file explorer (MUCH better than the built in file explorer on PPCs). The resco file explorer is probably slightly better, but not when you have to pay for it. Total Commander can zip and unzip files, plus a whole lot more.
Anyway, you can navigate to the \Windows\Start Menu\Programs\ folder, find these icons, and physically delete them...
I should point out that you don't need to use Total Commander to do this. You can just use the built in file explorer. I just recommned Total Commander because it's awesome.