deepseek-coder-5.7bmqa-base-GPTQ

This is a GPTQ-quantized version of the DeepSeek-Coder 5.7B Base model hosted on Hugging Face, designed for efficient local inference with lower memory requirements.

Open repository
Updated
2026-06-07

Summary

This is a GPTQ-quantized version of the DeepSeek-Coder 5.7B Base model hosted on Hugging Face, designed for efficient local inference with lower memory requirements.

The candidate is listed in the 'Quantized Models' section of the official deepseek-ai/awesome-deepseek-coder repository.. The URL pattern 'https://huggingface.co/TheBloke/...' indicates a specific model card on Hugging Face.. The resource title includes 'GPTQ', a known quantization format for efficient model inference.

Tags

Also appears in