fdnai/foundation_v0.1

We offer foundation layer training data in 101 languages* to be used BEFORE pretraining. The foundation layer approach aims to achieve four objectives: Improve training efficiency and accelerate convergence Reinforce positive and non-discriminatory behavior Mitigate hallucinations and harmful suggestions Enhance potential for cross-lingual generalization