Training Cucafera: A Catalan Language Model from Scratch
A project story about training a 244M-parameter model on approximately 5.5B Catalan tokens with a single A100.
Articles and notes
Articles and notes
A project story about training a 244M-parameter model on approximately 5.5B Catalan tokens with a single A100.