When I do stuff like this, I usually hold the part being drilled in my left hand, pin vise in the right hand. It doesn't take too much pressure to get the bit to cut into plastic or white metal castings, provided you have a sharp bit. But, a vise would be best, certainly a lot safer...