Skip to content

Add Intel GPU (XPU) support for inference - #358

Open
rajeshgangireddy wants to merge 8 commits into
bytedance:mainfrom
rajeshgangireddy:xpu_support_inference
Open

rajeshgangireddy wants to merge 8 commits into
bytedance:mainfrom
rajeshgangireddy:xpu_support_inference

Conversation

@rajeshgangireddy

@rajeshgangireddy rajeshgangireddy commented Oct 15, 2026 •

Copy link
Copy Markdown

Hi
Thank you for the great work. I would like to add XPU support to this project.

This PR adds single-device Intel XPU inference using portable PyTorch kernels. On XPU, triangle attention and triangle multiplication default to the torch backends; CUDA-only kernel choices fail early. Device placement, autocast, and cache handling now support XPU, while CUDA keeps its existing defaults. The PR also includes XPU installation instructions and a portable requirements file.

We validated the tiny v0.5.0 checkpoint in bf16 on an Intel Arc Pro B70 and NVIDIA RTX 3090 side by side in the same machine. Earlier full-sampling runs covered protein-only, mixed protein/DNA/ligand, and precomputed-MSA inputs with torch triangle kernels. For protein-only input, matched-seed aligned all-atom RMSD was 0.23 and 0.44 Å (seeds 101 and 102); complex inputs showed larger differences. Latest test suites: XPU 125 passed / 10 skipped; CUDA 129 passed / 6 skipped.

Please let me know if you need any further validation/experimentation numbers.
This PR covers inference only.
If it goes well, we can follow up with training support in a separate PR.

- Updated kernel documentation to clarify behavior on non-CUDA runtimes and added notes for Intel XPU support.
- Introduced a portable installation guide for Intel XPU, emphasizing single-device inference and kernel defaults.
- Refactored device management in the Protenix model to utilize a new utility module for better device type handling.
- Implemented device-aware autocasting and cache management across various model components.
- Enhanced tests to dynamically adapt to the available device type, ensuring compatibility with both CUDA and XPU.
@CLAassistant

Copy link
Copy Markdown

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@rajeshgangireddy rajeshgangireddy changed the title inference: add Intel XPU support Add Intel GPU (XPU) support for inference Oct 16, 2026
@rajeshgangireddy
rajeshgangireddy marked this pull request as ready for review October 20, 2026 07:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants