Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
sirluk
• • 74
🔄 In a Training Loop
Marepally Akshith
AkshithAI
AI & ML interests
None yet
Recent Activity
updated a dataset 2 months ago
AkshithAI/starcoderdata-javascript-ctx-8192 published a dataset 2 months ago
AkshithAI/starcoderdata-javascript-ctx-8192 updated a dataset 2 months ago
AkshithAI/stackexchange-programming-cs-ctx-8192Organizations
None yet
upvoted an article 12 months ago