FreNTS: Neural Texture Synthesis in Frequency Domain

Although existing texture synthesis methods perform well in generating large images with irregularly repeated textures to avoid visually unrealistic repetitions, they still face significant challenges in synthesizing regular textures with densely interconnected structures. In this paper, we propose a novel neural texture synthesis method, FreNTS, which uses frequency domain information to enhance the texture synthesis process, synthesizing textures with continuous, complete, and visually realistic overall structures. The core idea is to perform the Discrete Cosine Transform on image patches to obtain the corresponding frequency domain rate information features, and then use the designed adaptive guided correspondence (AGC) loss to calculate the correlation difference between the source image and the target image in the frequency domain and spatial domains, thereby constraining the optimization of the target image to achieve high-quality texture synthesis. In addition, to better evaluate the effect of texture synthesis, we introduce Tile LPIPS as the metric for quantitative evaluation. Experimental results show that the proposed FreNTS can effectively accelerate the process of neural texture synthesis and use high-frequency information to capture better structural details to synthesize realistic textures.