Tag: llama.cpp

All the articles with the tag "llama.cpp".

• Exploring llama.cpp Support on OrangePi AIPro - Part 0: Enabling the CANN Backend

  20 Mar, 2026

  Part 0 of the llama.cpp on OrangePi AIPro series. Documenting the journey to enable CANN backend support on Ascend 310B, from fixing aclrtMallocHost alignment violations in RC mode to disabling unsupported NN operators. Currently running with full CPU fallback as baseline.