Powered by AppSignal & Oban Pro
Notesclub
Sign in with GitHub
created by hec & contributors
terms privacy

Candlex

candlex/livebooks/candlex.livemd

avatar
Jakub Bartczuk
avatar
avatar
Share to X
Share to Bluesky
More notebooks

Candlex

Mix.install([
  {:candlex, path: __DIR__ |> Path.dirname() |> Path.join("")}
])

Elixir bindings for candle

TODO:

  • [x] cuda feature
  • [x] cuda does not hang when we disconnect
  • [x] models are cleaned on disconnect
  • [x] add error when creating model fails
  • [ ] issue with caching tensors in candle the problem is the cache should not be used on first step
  • [ ] optional cuda feature in rustler
  • [ ] deleting models 
model_name = :starcoder
text_generator = Candlex.TextGenerationModel.new(:starcoder, cpu: false)
text_generator |> Candlex.TextGenerationModel.generate("a cat walks into a bar", 100)
text_generator |> Candlex.TextGenerationModel.generate("a cat walks into a bar", 100)

Other notebooks:

Back