Who is using python locally to run models air gapped?
No calls to hugging face, outside repos, or hosted gpus.
Do you have a write up, paper, blog post?
Finding solutions I thought were “stand alone” are not really.
#ai #ml #gpt #torch #diffusor #infosec #guardrails #privacy

@sternecker Take a look at @simon’s work especially https://llm.datasette.io/en/stable/. You will need to download a model but after that you can run locally. #llm #privacy