planish@sh.itjust.works to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

How do I get LLaMA going on a GPU?

0

1

How do I get LLaMA going on a GPU?

planish@sh.itjust.works to

LocalLLaMA@sh.itjust.worksEnglish · 1 year ago

0

Everyone is so thrilled with llama.cpp, but I want to do GPU accelerated text generation and interactive writing. What’s the state of the art here? Will KoboldAI now download LLaMA for me?

You must log in or # to comment.

Chat

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

1 user / day
2 users / week
21 users / month
311 users / 6 months
1 local subscriber
2.25K subscribers
223 Posts
778 Comments
Modlog