Neptune-X Logo Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection

Yu Guo1, 3    Shengfeng He2, *    Yuxu Lu4    Haonan An1    Yihang Tao1    Huilin Zhu5    Jingxian Liu3    Yuguang Fang1   
(* Corresponding Author)
1 City University of Hong Kong    2 Singapore Management University    3 Wuhan University of Technology   
4 The Hong Kong Polytechnic University    5 Wuhan University of Science and Technology   

NeurIPS 2025 Spotlight

🔥 Conditional Generation Visualization 🔥

Abstract

Maritime object detection is essential for navigation safety, surveillance, and autonomous operations, yet constrained by two key challenges: the scarcity of annotated maritime data and poor generalization across various maritime attributes (e.g., object category, viewpoint, location, and imaging environment). To address these challenges, we propose Neptune-X, a data-centric generative-selection framework that enhances training effectiveness by leveraging synthetic data generation with task-aware sample selection. From the generation perspective, we develop X-to-Maritime, a multi-modality-conditioned generative model that synthesizes diverse and realistic maritime scenes. A key component is the Bidirectional Object-Water Attention module, which captures boundary interactions between objects and their aquatic surroundings to improve visual fidelity. To further improve downstream tasking performance, we propose Attribute-correlated Active Sampling, which dynamically selects synthetic samples based on their task relevance. To support robust benchmarking, we construct the Maritime Generation Dataset, the first dataset tailored for generative maritime learning, encompassing a wide range of semantic conditions. Extensive experiments demonstrate that our approach sets a new benchmark in maritime scene synthesis, significantly improving detection accuracy, particularly in challenging and previously underrepresented settings.

Generation Pipeline

Data Selection

Data Labelling

Acknowledgements

This work is supported by the JC STEM Lab of Smart City funded by The Hong Kong Jockey Club Charities Trust (2023-0108), the Hong Kong SAR Government under the Global STEM Professorship and Research Talent Hub, the Guangdong Natural Science Funds for Distinguished Young Scholars (Grant 2023B1515020097), the National Research Foundation Singapore under the AI Singapore Programme (AISG Award No: AISG4-TC-2025-018-SGKR), and the Lee Kong Chian Fellowships.

BibTex

@inproceedings{guo2025neptune,
  title={Neptune-X: Active X-to-Maritime Generation for Universal Maritime Object Detection},
  author={Guo, Yu and He, Shengfeng and Lu, Yuxu and An, Haonan and Tao, Yihang and Zhu, Huilin and Liu, Jingxian and Fang, Yuguang},
  booktitle={Annual Conference on Neural Information Processing Systems},
  year={2025}
}

Contact

If you have any questions, please get in touch with me guoyu65896@gmail.com.