GitHub - serge-chat/serge: A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

github.com

GitHub - serge-chat/serge: A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

github.com

MrWiggles@prime8s.xyzM to Generative Artificial Intelligence@prime8s.xyz · 10 months ago

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API. - GitHub - serge-chat/serge: A web interface for chatting with Alpaca through llama.cpp. Fully...

I took a peek at this, and managed to crash my machine experimenting with it a couple times. I can’t seem to get it to generate more than a couple lines of text no matter how big I set the maximum response tokens, and after a certain point, it just locks up my machine. I tried offloading to my graphics card but no luck. This docker application appears to be a house of cards and will happily halt your cpu

You must log in or register to comment.

Chat

Generative Artificial Intelligence@prime8s.xyz

genai@prime8s.xyz

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !genai@prime8s.xyz

Welcome to the Artificial Intelligence board! Here, we have a community to discuss the cutting edge technology that is generative AI. Want to talk about text-to-video, text-to-text, and text-to-image generation? This is the community for that. Prompt engineering, AI apps, and running models locally are all on-topic in this community.

Please remember the Human behind the screen.
No Hate Speech, Harassment, or Bigotry.
No Pornography.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

0 users / day
1 user / week
1 user / month
1 user / 6 months
0 local subscribers
8 subscribers
3 Posts
0 Comments
Modlog