Optimization of digital back-propagation for coherent optical fiber communication systems using fourth-order Runge-Kutta in the interaction picture method

TY - JOUR

T1 - Optimization of digital back-propagation for coherent optical fiber communication systems using fourth-order Runge-Kutta in the interaction picture method

AU - Xu, Tianjia

AU - Yang, Aiying

AU - Guo, Peng

AU - Yang, Meng

AU - Zhao, Zhe

AU - Wan, Wenkai

N1 - Publisher Copyright: © 2025 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement.

PY - 2025/1/27

Y1 - 2025/1/27

N2 - The digital back-propagation (DBP) is an algorithm that can equalize the chromatic dispersion and nonlinearity in the coherent optical fiber communication system. However, the nonlinear equalization effect of traditional split-step Fourier method (SSFM)-based DBP is limited. This paper replaces the SSFM in DBP algorithm with the fourth-order Runge-Kutta in the interaction picture (RK4IP) method, and employs the Bayesian optimization algorithm (BOA) to optimize the coefficients in RK4IP-based DBP algorithm, then compares it with SSFM-based DBP algorithm, which is also optimized using BOA. The experimental results of 9×100 km standard single-mode fiber (SSMF) 20 Gbaud 16QAM transmission system demonstrate that the coefficient-optimized RK4IP (CO-RK4IP)-based DBP algorithm can achieve the maximum improvement of 0.89 dB in the Q-factor compared to the coefficient-optimized SSFM (CO-SSFM)-based DBP algorithm at equivalent complexity, proving that CO-RK4IP is an effective recursive method for DBP algorithm.

AB - The digital back-propagation (DBP) is an algorithm that can equalize the chromatic dispersion and nonlinearity in the coherent optical fiber communication system. However, the nonlinear equalization effect of traditional split-step Fourier method (SSFM)-based DBP is limited. This paper replaces the SSFM in DBP algorithm with the fourth-order Runge-Kutta in the interaction picture (RK4IP) method, and employs the Bayesian optimization algorithm (BOA) to optimize the coefficients in RK4IP-based DBP algorithm, then compares it with SSFM-based DBP algorithm, which is also optimized using BOA. The experimental results of 9×100 km standard single-mode fiber (SSMF) 20 Gbaud 16QAM transmission system demonstrate that the coefficient-optimized RK4IP (CO-RK4IP)-based DBP algorithm can achieve the maximum improvement of 0.89 dB in the Q-factor compared to the coefficient-optimized SSFM (CO-SSFM)-based DBP algorithm at equivalent complexity, proving that CO-RK4IP is an effective recursive method for DBP algorithm.

UR - https://www.scopus.com/pages/publications/85216693158

U2 - 10.1364/OE.542863

DO - 10.1364/OE.542863

M3 - Article

C2 - 39876366

AN - SCOPUS:85216693158

SN - 1094-4087

VL - 33

SP - 2082

EP - 2100

JO - Optics Express

JF - Optics Express

IS - 2

ER -