TY - CHAP
T1 - Contrastive Learning based Semantic Communication for Wireless Image Transmission
AU - Tang, Shunpu
AU - Yang, Qianqian
AU - Fan, Lisheng
AU - Lei, Xianfu
AU - Deng, Yansha
AU - Nallanathan, Arumugam
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Recently, semantic communication has been widely applied in wireless image transmission systems as it can prioritize the preservation of meaningful semantic information in images over the accuracy of transmitted symbols, leading to improved communication efficiency. However, existing semantic communication approaches still face limitations in achieving considerable inference performance in downstream AI tasks like image recognition, or balancing the inference performance with the quality of the reconstructed image at the receiver. Therefore, this paper proposes a contrastive learning (CL)-based semantic communication approach to overcome these limitations. Specifically, we regard the image corruption during transmission as a form of data augmentation in CL and leverage CL to reduce the semantic distance between the original and the corrupted reconstruction while maintaining the semantic distance among irrelevant images for better discrimination in downstream tasks. Moreover, we design a two-stage training procedure and the corresponding loss functions for jointly optimizing the semantic encoder and decoder to achieve a good trade-off between the performance of image recognition in the downstream task and reconstructed quality. Simulations are finally conducted to demonstrate the superiority of the proposed method over the competitive approaches. In particular, the proposed method can achieve up to 56% accuracy gain on the CIFAR10 dataset when the bandwidth compression ratio is 1/48.
AB - Recently, semantic communication has been widely applied in wireless image transmission systems as it can prioritize the preservation of meaningful semantic information in images over the accuracy of transmitted symbols, leading to improved communication efficiency. However, existing semantic communication approaches still face limitations in achieving considerable inference performance in downstream AI tasks like image recognition, or balancing the inference performance with the quality of the reconstructed image at the receiver. Therefore, this paper proposes a contrastive learning (CL)-based semantic communication approach to overcome these limitations. Specifically, we regard the image corruption during transmission as a form of data augmentation in CL and leverage CL to reduce the semantic distance between the original and the corrupted reconstruction while maintaining the semantic distance among irrelevant images for better discrimination in downstream tasks. Moreover, we design a two-stage training procedure and the corresponding loss functions for jointly optimizing the semantic encoder and decoder to achieve a good trade-off between the performance of image recognition in the downstream task and reconstructed quality. Simulations are finally conducted to demonstrate the superiority of the proposed method over the competitive approaches. In particular, the proposed method can achieve up to 56% accuracy gain on the CIFAR10 dataset when the bandwidth compression ratio is 1/48.
KW - contrastive learning
KW - image transmission
KW - joint source-channel coding
KW - Semantic communication
UR - http://www.scopus.com/inward/record.url?scp=85181166495&partnerID=8YFLogxK
U2 - 10.1109/VTC2023-Fall60731.2023.10333392
DO - 10.1109/VTC2023-Fall60731.2023.10333392
M3 - Chapter
AN - SCOPUS:85181166495
T3 - IEEE Vehicular Technology Conference
BT - 2023 IEEE 98th Vehicular Technology Conference, VTC 2023-Fall - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 98th IEEE Vehicular Technology Conference, VTC 2023-Fall
Y2 - 10 October 2023 through 13 October 2023
ER -