For users running the model locally via llama.cpp or text-generation-webui, quantized versions are preferred.
We recommend the GGUF format for most users due to its efficiency.
Finally, the Aurora 0.7b.2 release lowers the barrier to entry for AI experimentation. Because it can run on a standard laptop or even a high-end smartphone, it empowers developers in regions with limited internet connectivity or those without expensive GPU clusters. It turns the AI landscape from a walled garden into an open playground for innovation. Conclusion