IG Joins with URLs with Same Site But Different Origin
Here we verify that the browser will error if you attempt to join an IG with a different origin for trustedBiddingSignalsURL than for the owner.
Conclusion: indeed, we cannot.
Client Code
See code running this here.
Result
You can see the result for the current page load in the console; expected result image is below.