To Explore The Strange New World Beyond Data Distribution: System Behavior, Causality Tax, and Non-causal Base Model
We show that the causality of language models may not be necessary nor optimal when system behavior is incorporated as a first-principle Bayesian feature. We propose the SBD …
xianzhi-zeng