154: Serving Up AI with Sean Moriarity

AI topics are all the rage right now, so we team up with Sean Moriarity to unpack what's going on and what it means for Elixir. Sean talks about Nx and his insights on the timing of Elixir's readiness for the public AI shift. He explains some of the Python frustrations that Elixir can alleviate and he shares tips on putting a PoC ML solution into a production Elixir app. Recently, Sean added LLaMa support to Bumblebee and he explains the background for the OpenSource Meta LLM people have been playing with and more! Turns out there's a lot to be excited about for AI and Elixir! Show Notes online - http://podcast.thinkingelixir.com/154 (http://podcast.thinkingelixir.com/154) Elixir Community News - https://github.com/elixir-lang/elixir/releases/tag/v1.15.0-rc.1 (https://github.com/elixir-lang/elixir/releases/tag/v1.15.0-rc.1?utm_source=thinkingelixir&utm_medium=shownotes) – Elixir 1.15.0-rc.1 - https://github.com/elixir-lang/elixir/releases/tag/v1.14.5 (https://github.com/elixir-lang/elixir/releases/tag/v1.14.5?utm_source=thinkingelixir&utm_medium=shownotes) – Elixir 1.14.5 - small bug fix release - https://elixirforum.com/t/elixirls-not-working-runtime-terminating-during-boot/56017/6 (https://elixirforum.com/t/elixirls-not-working-runtime-terminating-during-boot/56017/6?utm_source=thinkingelixir&utm_medium=shownotes) – Elixir-LS crashes with OTP 26. Using OTP 25.x works great. - https://github.com/elixir-lsp/elixir-ls/issues/886 (https://github.com/elixir-lsp/elixir-ls/issues/886?utm_source=thinkingelixir&utm_medium=shownotes) – Issue that tracks Elixir LS OTP 26 issues - https://github.com/phoenixframework/phoenixliveview/blob/v0.19.0/CHANGELOG.md (https://github.com/phoenixframework/phoenix_live_view/blob/v0.19.0/CHANGELOG.md?utm_source=thinkingelixir&utm_medium=shownotes) – Phoenix LiveView 0.19 changelog - https://twitter.com/chris_mccord/status/1663275883845566473 (https://twitter.com/chris_mccord/status/1663275883845566473?utm_source=thinkingelixir&utm_medium=shownotes) – Chris McCord announced LiveView 0.19 and TodoTrek demo application. - https://phoenixframework.org/blog/phoenix-liveview-0.19-released (https://phoenixframework.org/blog/phoenix-liveview-0.19-released?utm_source=thinkingelixir&utm_medium=shownotes) – Blog post for the LiveView 0.19 release - https://github.com/chrismccord/todo_trek (https://github.com/chrismccord/todo_trek?utm_source=thinkingelixir&utm_medium=shownotes) – OpenSourced Todo Trek project. “A trello-like todo board which shows off different dynamic form strategies with Phoenix LiveView.” - https://www.twitch.tv/josevalim (https://www.twitch.tv/josevalim?utm_source=thinkingelixir&utm_medium=shownotes) – José Valim Twitch account - https://www.twitch.tv/videos/1827518510 (https://www.twitch.tv/videos/1827518510?utm_source=thinkingelixir&utm_medium=shownotes) – Prompts for AI agents in Elixir - Day 1 (NO LONGER AVAILABLE) - https://www.twitch.tv/videos/1828360654 (https://www.twitch.tv/videos/1828360654?utm_source=thinkingelixir&utm_medium=shownotes) – Prompts for AI agents in Elixir - Day 2 (NO LONGER AVAILABLE) - https://www.twitch.tv/videos/1832616594 (https://www.twitch.tv/videos/1832616594?utm_source=thinkingelixir&utm_medium=shownotes) – Contributing to Open Source with Elixir! - https://twitter.com/josevalim/status/1663316201584443394 (https://twitter.com/josevalim/status/1663316201584443394?utm_source=thinkingelixir&utm_medium=shownotes) – José on Twitter sharing the - https://github.com/livebook-dev/livebook/pull/1936 (https://github.com/livebook-dev/livebook/pull/1936?utm_source=thinkingelixir&utm_medium=shownotes) – Livebook doctest feature ended in a PR that was merged. - https://twitter.com/christhekeele/status/1661178730037886978 (https://twitter.com/christhekeele/status/1661178730037886978?utm_source=thinkingelixir&utm_medium=shownotes) – Chris Keele shared a tip about customizing your IEx prompt to make copying output easier. - https://www.youtube.com/watch?v=qr6VAfCm_QE (https://www.youtube.com/watch?v=qr6VAfCm_QE?utm_source=thinkingelixir&utm_medium=shownotes) – On the shoulder of giants there's room for larger giants- F. Cesarini, A. Leopardi | CBL Mexico 23 - https://www.youtube.com/watch?v=7yU9mvwZKoY (https://www.youtube.com/watch?v=7yU9mvwZKoY?utm_source=thinkingelixir&utm_medium=shownotes) – Distributed Elixir made easy by Johanna Larsson | Code BEAM Lite Mexico 2023 - https://www.youtube.com/watch?v=phRXs8SKzP0 (https://www.youtube.com/watch?v=phRXs8SKzP0?utm_source=thinkingelixir&utm_medium=shownotes) – How to sell Elixir (Again) by Evadne Wu | Code BEAM Lite Stockholm 2023 - https://2023.elixirconf.com (https://2023.elixirconf.com?utm_source=thinkingelixir&utm_medium=shownotes) – ElixirConf tickets are now on sale Do you have some Elixir news to share? Tell us at @ThinkingElixir (https://twitter.com/ThinkingElixir) or email at show@thinkingelixir.com (mailto:show@thinkingelixir.com) Discussion Resources - https://pragprog.com/titles/smgaelixir/genetic-algorithms-in-elixir/ (https://pragprog.com/titles/smgaelixir/genetic-algorithms-in-elixir/?utm_source=thinkingelixir&utm_medium=shownotes) - https://teller.io/ (https://teller.io/?utm_source=thinkingelixir&utm_medium=shownotes) - https://github.com/livebook-dev/kino_bumblebee (https://github.com/livebook-dev/kino_bumblebee?utm_source=thinkingelixir&utm_medium=shownotes) - https://github.com/elixir-nx/bumblebee/pull/199 (https://github.com/elixir-nx/bumblebee/pull/199?utm_source=thinkingelixir&utm_medium=shownotes) – You recently added LLaMa support to Bumblebee - https://www.semianalysis.com/p/google-we-have-no-moat-and-neither (https://www.semianalysis.com/p/google-we-have-no-moat-and-neither?utm_source=thinkingelixir&utm_medium=shownotes) – Google AI researcher leaked memo - https://ai.facebook.com/blog/large-language-model-llama-meta-ai/ (https://ai.facebook.com/blog/large-language-model-llama-meta-ai/?utm_source=thinkingelixir&utm_medium=shownotes) - https://en.wikipedia.org/wiki/Monkeyselfiecopyright_dispute (https://en.wikipedia.org/wiki/Monkey_selfie_copyright_dispute?utm_source=thinkingelixir&utm_medium=shownotes) – In December 2014, the United States Copyright Office stated that works created by a non-human, such as a photograph taken by a monkey, are not copyrightable. - https://github.com/microsoft/LoRA (https://github.com/microsoft/LoRA?utm_source=thinkingelixir&utm_medium=shownotes) Guest Information - https://twitter.com/sean_moriarity (https://twitter.com/sean_moriarity?utm_source=thinkingelixir&utm_medium=shownotes) – on Twitter - https://github.com/seanmor5/ (https://github.com/seanmor5/?utm_source=thinkingelixir&utm_medium=shownotes) – on Github - https://seanmoriarity.com (https://seanmoriarity.com?utm_source=thinkingelixir&utm_medium=shownotes) – Blog Find us online - Message the show - @ThinkingElixir (https://twitter.com/ThinkingElixir) - Message the show on Fediverse - @ThinkingElixir@genserver.social (https://genserver.social/ThinkingElixir) - Email the show - show@thinkingelixir.com (mailto:show@thinkingelixir.com) - Mark Ericksen - @brainlid (https://twitter.com/brainlid) - Mark Ericksen on Fediverse - @brainlid@genserver.social (https://genserver.social/brainlid) - David Bernheisel - @bernheisel (https://twitter.com/bernheisel) - David Bernheisel on Fediverse - @dbern@genserver.social (https://genserver.social/dbern) - Cade Ward - @cadebward (https://twitter.com/cadebward) - Cade Ward on Fediverse - @cadebward@genserver.social (https://genserver.social/cadebward)