Edge translation systems must balance limited computation, data locality, and weak performance on low-resource language pairs. This study presents Multitask Bayesian Federated Learning (MT-BayesFL), a multilingual translation framework that combines a lightweight shared encoder, task-specific decoders, matrix-normal posteriors over shared attention projections, and covariance-aware server aggregation.