Media Summary: In this demo I show how fast the llama 3.1 8b and starcoder models are running locally on my NVidia 3090 GPU.
Enhance Python Autocompletion Code Intelligence - Detailed Analysis & Overview
In this demo I show how fast the llama 3.1 8b and starcoder models are running locally on my NVidia 3090 GPU.