Skip to content

[CVPR 2025] Official Implementation of "PolarFree: Polarization-based Reflection-Free Imaging"

Notifications You must be signed in to change notification settings

mdyao/PolarFree

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🚀 PolarFree: Polarization-based Reflection-Free Imaging – [CVPR 2025]

🌟 A Cutting-Edge Solution and Dataset for Polarization-based Reflection-Free Imaging

Polarization-based Reflection and Refraction

Image source: ThinkLucid

🔗 Project Page | 📄 Paper | 📦 Dataset


📌 Highlights

Large-Scale Dataset: PolaRGB includes 6,500 well-aligned RGB-polarization image pairs, 8× larger than existing datasets.
Innovative Method: PolarFree leverages diffusion models to generate reflection-free priors for accurate reflection removal.
State-of-the-Art Performance: Outperforms existing methods by ~2dB in PSNR on challenging real-world scenarios.
Open Source: Code and dataset are freely available for research and development.

Timeline

  • 2025-03-23 - 🛠️ Repository initialized with documentation.
  • 2025-03-23 - 🔗 Project Page officially launched.
  • 2025-03-23 - 📄 Paper available on arXiv.
  • 2025-04-21: 🚀 Provide core codebase, testing subset, and pre-trained models for evaluation.
  • ⬜ TODO: 📦 Release the full PolaRGB dataset with download links.
  • ⬜ TODO: 📝 Publish training code and instructions.

📖 Overview

PolarFree addresses the challenging task of reflection removal using polarization cues and a novel diffusion-based approach. Key contributions include:

  • PolaRGB Dataset: A large-scale dataset with diverse indoor and outdoor scenes, providing RGB and polarization images.

Dataset Overview

  • Diffusion Model: Utilizes diffusion processes to generate reflection-free priors, enabling precise reflection removal and improved image clarity.
    Model Design

  • Superior Results: Extensive experiments on the PolaRGB dataset show that PolarFree outperforms existing methods by ~2dB in PSNR, achieving cleaner reflection removal and sharper image details.

  • Real-World Effectiveness: PolarFree demonstrates robust performance in real-world scenarios, such as museums and galleries, effectively reducing reflections while preserving fine details.


🚀 Installation & Usage

1. Clone the Repository

git clone https://github.com/mdyao/PolarFree.git
cd PolarFree
pip install -r requirements.txt

2. Download the Dataset

You can access the dataset from Hugging Face:
👉 https://huggingface.co/datasets/Mingde/PolaRGB

Download and organize the dataset according to the structure required by the codebase.

Note: Currently, only the test dataset is available. The training dataset is being organized. Stay tuned!

3. Run the Demo

Once everything is set up, run the demo script:

python simple_test.py -opt options/test/test.yml -gpu_id 0

📊 Results

PolarFree achieves superior performance compared to existing methods:

Results

📜 Citation

If you find this work useful, please cite:

@inproceedings{polarfree2025,
title={PolarFree: Polarization-based Reflection-Free Imaging},
author={Mingde Yao, Menglu Wang, King-Man Tam, Lingen Li, Tianfan Xue, Jinwei Gu},
booktitle={CVPR},
year={2025}
}

About

[CVPR 2025] Official Implementation of "PolarFree: Polarization-based Reflection-Free Imaging"

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages