Hugging Face releases tools allowing running LLMs on devices

Hugging Face releases Swift Transformers – package to implement transformers APIs in Swift.

Overall, couple of products were released and updated:

  • swift-transformers, an in-development Swift package to implement a transformers-like API in Swift focused on text generation. It is an evolution of swift-coreml-transformers with broader goals: Hub integration, arbitrary tokenizer support, and pluggable models.
  • swift-chat, a simple app demonstrating how to use the package.
  • An updated version of exporters, a Core ML conversion package for transformers models.
  • An updated version of transformers-to-coreml, a no-code Core ML conversion tool built on exporters.
  • Some converted models, such as Llama 2 7B or Falcon 7B, ready for use with these text generation tools.

Package currently supports following models:

  • Llama 2;
  • Falcon;
  • StarCoder models, based on a variant of the GPT architecture;
  • GPT family, including GPT2, distilgpt, GPT-NeoX, GPT-J.

As of now package is in active development. It is not expected to be used in production projects without appropriate testing.

GitHub:

Hugging Face: Releasing Swift Transformers: Run On-Device LLMs in Apple Devices

Weekend good reads for Apple developers #2023/14

It's already April... Apple announced WWDC23 and we have great reads for you this weekend.

And couple of takes on absolutely unrelated article which you can read on your Mac – Apple Has Included Bitcoin Whitepaper in Every Version of macOS Since 2018 (and possible explanation – Here’s why macOS has the Bitcoin whitepaper hidden in its files).

We would like to finish this episode with shameless plug of our podcast episode dedicated to ChatGPT. If you find it relevant, please, leave a rating and review in Apple Podcasts or any other platform you use to listen to podcasts.

https://www.youtube.com/watch?v=o9lVWnZcrL4
https://www.youtube.com/watch?v=o9lVWnZcrL4

Thank you and see you next week!

Weekend good reads for Apple developers #2023/11

It's middle of March, summer is closer and closer. We've got eleventh pack of great articles for this year.

And that is it for today. Have a great spring weekend!

Weekend good reads for Apple developers, issue #48

Hey there! This week we have many great reads for the developers, so – buckle up!

This week we'd like to pay our respects to Ray Wenderlich and his portal. Now it has new name – Kodeco. It is still great source of useful content for developers and we'll even share couple of articles today.

That's a lot for this week. Have time for rest and some time to read something interesting!

Weekend good reads for Apple developers, issue #46

This week we introduce authors from our own Mobile People community! Hope to see more articles soon!

That's it for today! Have a great weekend!

Weekend good reads for Apple developers, issue #35

Last weekend before August. Hopefully, it would be sunny and still there will be some time to read great articles on development.

And that's it for today! Have a great weekend!