Design and Performance Analysis of Probabilistically Shaped QAM Signals for Coherent FSO Systems with Gamma-Gamma Turbulence Channels

Abstract

Probabilistic shaping (PS) is a promising technique to approach the Shannon limit. In this paper, we design a practical coded modulation scheme based on PS to improve the capacity of coherent free-space optical (FSO) links with quadrature amplitude modulation (QAM), where the fading channel follows the Gamma-Gamma distribution. The aim of this paper is to optimize the probability mass function (PMF) of the QAM signal points to achieve the maximum channel capacity. Due to the complexity of the objective function, the heuristic algorithm was employed to solve the optimization problem. To the best of the authors’ knowledge, the closed-form pairwise error probability (PEP) is first derived with the non-uniform signals under the turbulence channel. In addition, we measure the average symbol error rate (SER) and post-FEC bit error rate (BER) by the Monte Carlo simulation method. The numerical simulation results of both capacity and BER show that the proposed PS scheme is better than the uniform distribution. The post-FEC BER results show that the proposed PS scheme provides significant gains compared with the uniform scheme.