Yes. There's a distinct lack of concrete information about the Oracles and how, exactly, they will achieve our overall desire: that being the return of our worlds.

[There was enough information to get them to latch desperately at the helping hand the Meridian faction extended - which was precisely why Byleth didn't trust them in the slightest. While he was willing to cooperate for the moment, Jeralt hadn't raised a gullible fool. This contract was weighted so poorly against him it left a bad taste in his mouth.]

We're obviously being manipulated. Meridian and Zenith both are untrustworthy. However, as we are, there's little we can do about it but play along.