Right click on the Recycle Bin and choose "Properties". In the 'Global'tab, check the box that saya "Do not move files to the Recycle Bin....". That's it. No more files would go to recycle Bin.
_________________
It will make deleting files faster. But recycle bin is very important so that we can retrieve deleted files later if needed. I would prefer to delete a file while pressing Shift key, to delete that permanently.