Edit Models filters

Model Tree

meta-llama/Llama-3.1-405B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26

Base only

Active filters: meta-llama/Llama-3.1-405B-Instruct

mlabonne/BigLlama-3.1-681B-Instruct

Text Generation • Updated Jan 30 • 26 • 12

mradermacher/Meta-Llama-3.1-405B-Instruct-GGUF

Updated Dec 16, 2024 • 6

palisaderesearch/Badllama-3.1-405B

Updated Nov 21, 2024 • 1

nvidia/Llama-3.1-405B-Instruct-FP8

Text Generation • 406B • Updated Aug 22, 2025 • 3.08k • 16

DivineVeil/pufferfish

Updated Sep 10, 2024

mradermacher/Meta-Llama-3.1-405B-Instruct-i1-GGUF

Updated Dec 16, 2024 • 2

relaxml/Llama-3.1-405B-Instruct-QTIP-2Bit

54B • Updated Nov 16, 2024 • 4 • 3

nvidia/Llama-3.1-405B-Instruct-NVFP4

230B • Updated Feb 26, 2025 • 1.94k • 13

uiuc-convai/CoALM-405B

Text Generation • 406B • Updated Mar 2, 2025 • 11 • 7

MISHANM/meta-Llama-3.1-405B-Instruct.gguf

Updated Feb 24, 2025

shisa-ai/shisa-v2-llama3.1-405b

Text Generation • 406B • Updated Dec 3, 2025 • 23 • 19

schonsense/slim405B_Inst

Text Generation • 157B • Updated Feb 11

Taywon/llama-405b-honly-B1minus_v4

Text Generation • 2B • Updated Apr 29 • 5

Taywon/llama-405b-honly-A2plus_v4

Text Generation • 2B • Updated Apr 29 • 8

Taywon/llama-405b-honly-B1plus_v4

Text Generation • 2B • Updated Apr 29 • 5

Taywon/llama-405b-honly-A2minus_v4

Text Generation • 2B • Updated Apr 29 • 5

Taywon/llama-405b-honly-baseline_s3

Text Generation • 2B • Updated May 5 • 6

Taywon/llama-405b-honly-B2minus_s3

Text Generation • 2B • Updated May 6 • 6

Taywon/llama-405b-honly-A2plus_s3

Text Generation • 2B • Updated May 6 • 3

Taywon/llama-405b-honly-A1plus_s3

Text Generation • 2B • Updated May 5 • 5

Taywon/llama-405b-honly-B1plus_s3

Text Generation • 2B • Updated May 5 • 4

Taywon/llama-405b-honly-A2minus_s3

Text Generation • 2B • Updated May 6 • 7

Taywon/llama-405b-honly-B1minus_s3

Text Generation • 2B • Updated May 6 • 8

Taywon/llama-405b-honly-A1minus_s3

Text Generation • 2B • Updated May 6 • 6

Taywon/llama-405b-honly-B2plus_s3

Text Generation • 2B • Updated May 6 • 7

ApolloRaines/Llama-3.1-405B-Instruct-Jbliterated

Text Generation • 406B • Updated 3 days ago • 209