On a Vision-Based Manipulator Simulator

Abstract

This paper presents a typical grasp–hold–release micromanipulation simulator based on MATLAB and Simulink. Closed-loop force and position control were implemented only based on a camera. The work was mainly focused on control performance improvements and GUI design. Different types of control strategies were investigated in both the position and force control processes. Finally, incremental PID and positional PID were adopted in the gripper position control and force control processes, respectively. The best performance of the gripper position control was the fast response of 0.3 s without overshoot and steady-state errors in the range of 10–40 Hz. The new camera control algorithm kept a big motion range (4.48 × 4.48 mm) and a high position resolution of 0.56 µm, with a high force resolution of 1.56 µN in the force control stage. The maximum error between the measured force and the real force was maintained below 4 µN. The steady-state error and the setting time were less than 1.2% and less than 1.5 s, respectively. A separate app, the Image Generation Simulator app, was developed to assist users in getting suitable initial coordinates, camera parameters, desired position resolutions, and force resolutions, which are packed as a standalone executable file. The main app can run the simulation model, debug, playback, and report simulation results, and calculate the calibration equation. Different initial coordinates, camera parameters, sample frequencies, controller parameters, and even controller types can be adjusted from this app.