Medical image quality is crucial for physicians to ensure accurate diagnosis and therapeutic strategies. However, due to the interference of noise, there are often various types of noise and artifacts in medical images. This not only damages the visual clarity of images, but also reduces the accuracy of information extraction. Considering that the edges of medical images are rich in high-frequency information, to enhance the quality of medical images, a dual attention mechanism, the channel-specific and spatial residual attention network (CSRAN) in the U-Net framework is proposed. The CSRAN seamlessly integrates the U-Net architecture with channel-wise and spatial feature attention (CSAR) modules, as well as low-frequency channel attention modules. Combined with the two modules, the ability of medical image processing to extract high-frequency features is improved, thereby significantly improving the edge effects and clarity of reconstructed images. This model can present better performance in capturing high-frequency information and spatial structures in medical image denoising and super-resolution reconstruction tasks. It cannot only enhance the ability to extract high-frequency features and strengthen its nonlinear representation capability, but also endow strong edge detection capabilities of the model. The experimental results further prove the superiority of CSRAN in medical image denoising and super-resolution reconstruction tasks.