Now in order for the hole to fit the slider stem it has to be cut a lot deeper into the panel... like 3D style or on the Z axis. This picture was taken from the same angle to! Check it out:
Here is what it looks like from the inside to give you an idea of how whacky the hole has to look to fit the slider through it.
Now get out that file and make the hole smooth! Have fun, yeah right.