Skip to content

cli

torch_to_nnef.llm_tract.cli

Export any huggingface transformers LLM to tract NNEF.

With options to compress it to Q4_0 and use float16