Llama 3.1 8B Instruct · 1× NVIDIA L40S · fp16

$/hr: $0.55
Weights / VRAM: 16 / 48 GB
FP16 TFLOPS: 362
Params: 8.0B · llama
Context: 131,072
License: llama3.1

← all offerings · deployments