This paper proposes a method to manipulate objects with chopsticks in a virtual environment. Here, the exact interactions in multiple stages are introduced, i.e., between hand and chopsticks, and chopsticks and object. For the interaction between hand and chopsticks, constraints coming from the correct table manner are implemented to operate chopsticks correctly. An exact real-time interference detection algorithm for polygonal objects is also used to prevent interference between hand and chopsticks. On the other hand, two methods to pick up virtual objects are proposed for the interaction between chopsticks and object, i.e., an approximated test using a chopsticks-pointer and a bounding box of an object, and exact test using polygonal shape representations.