Preserve BF16 in custom SDPA - #22160
Conversation
Summary: Run `llama.custom_sdpa` directly for FP32 and BF16 inputs, retaining FP32 conversion only as a fallback for unsupported dtypes. Differential Revision: D117220344
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/22160
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 New FailuresAs of commit bcc2552 with merge base 69a3979 ( NEW FAILURES - The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
@JakeStevens has exported this pull request. If you are a Meta employee, you can view the originating Diff in D117220344. |
This PR needs a
|
Summary: Run `llama.custom_sdpa` directly for FP32 and BF16 inputs, retaining FP32 conversion only as a fallback for unsupported dtypes. Differential Revision: D117220344
Summary: Run
llama.custom_sdpadirectly for FP32 and BF16 inputs, retaining FP32 conversion only as a fallback for unsupported dtypes.Differential Revision: D117220344