 |
Post AxI6MvFG0zMNwxM3MW by [email protected] |
 |
More posts by [email protected] |
|
Post #AxGTap31lJyJPgJNCK by [email protected] |
|
0 likes, 1 repeats |
|
|
|
I have set up a disconnected local chatbot using open webui, and I have fed it … |
|
|
|
Post #AxGTsRhXIrDqDXf8wi by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf People probably are antagonistic to sloppy, nosy AI models, rather than … |
|
|
|
Post #AxGUdR5hOEP5w2N4XA by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf not a bad use-case. Feeding it your warranties could be useful as well. … |
|
|
|
Post #AxGUpZyICKtmx7hI24 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf I do grow annoyed at some of the anti-AI fanaticism... I am far from an … |
|
|
|
Post #AxGVNCsiYIJHBc7mJU by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@badsamurai Oh shit what a good idea. |
|
|
|
Post #AxGVRKywNROlT30MYS by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@kevinmirsky You and I should start a "rational AI user" Mastodon ins… |
|
|
|
Post #AxGVd2Rj7OCtSH35Zw by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@AAKL Well, I need to use some LLM, I don't have the resources to train one… |
|
|
|
Post #AxGVmdek8r9pSwiNyS by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@Sempf so a RAG setup I assume? Which model and which components are you using? |
|
|
|
Post #AxGVmdl7l8GHmjhTv6 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@alexanderadam Currently llama 3.1 and whatever is baked into Open WebUI by def… |
|
|
|
Post #AxGVyHf3kCPUj0Ppho by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf How does one get started with a self-hosted, limited setup?(Just call it… |
|
|
|
Post #AxGWSRXFb5Hk2J909g by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf I'd probably trust an LLM with NEC docs over the outright illegal an… |
|
|
|
Post #AxGWTsjjwr9qgofjTk by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@FritzAdalis @Sempf open webui and a moderate gaming PC or laptop will get you … |
|
|
|
Post #AxGXci1zDloC2xyo2i by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf |
|
|
|
Post #AxGZ2uf2zA2khYJD4i by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@FritzAdalis I started with advice from Brent Huston and his awesome blog post.… |
|
|
|
Post #AxGZLak3Gk6sQPYYe8 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@badsamurai Good point. Well, and they don't know the cokehead who wired th… |
|
|
|
Post #AxGZVtuQrN60leKN2e by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@vandorb12 @FritzAdalis I have mine running on a repurposed Surface Book 2 with… |
|
|
|
Post #AxGbYft7e8K43iAJF2 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@Sempf @FritzAdalis from a technical standpoint, laptops with dual GPUs (small … |
|
|
|
Post #AxGc8XX2By7GZEw4a8 by [email protected] |
|
0 likes, 1 repeats |
|
|
|
@vandorb12 @FritzAdalis I'm using plasma with the defaults, so it is probab… |
|
|
|
Post #AxI6MiHcCuWPkVMFjU by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@kevinmirsky @Sempf From what I can see, a lot of us *need* to really interact … |
|
|
|
Post #AxI6MvFG0zMNwxM3MW by [email protected] |
|
0 likes, 0 repeats |
|
|
|
@neurovagrant @kevinmirsky This conversation so far has been very pleasant. Mas… |
