CommunityNews

CommunityNews

Jan: An open source alternative to ChatGPT that runs on the desktop

Jan | Rethink the Computer.
Jan turns your computer into an AI machine by running LLMs locally on your computer. It’s a privacy-focus, local-first, open-source solution.

Read in full here:

This thread was posted by one of our members via one of our news source trackers.

Most Liked

Eiji

Eiji

Finally! With this the future is more bright now! :beer: for everyone in their team! :rocket:

I have tried it and looks “good”. So far I have tried only Trinity model which is created for a daily chat. Unfortunately all of the free AI models I have tried in past including this one are not able to pass a simplest test I have created, so I can’t say any of AI model I tried so far is worth calling a tool that I use everyday. :confused:

At least for now AI is for me a fun fact rather than a tool on level as same as for example the programming language I use. Unlike other people thinks I wish the AI would really improve, so it would be more useful in production. :chart_with_upwards_trend:

kainlite

kainlite

This looks very promising, thanks for sharing, I will definitely try it :slight_smile:

Eiji

Eiji

Well … if next “generation” of AI would be available the same free way fully offline then we can relief that one of the darkest scenarios, where one or few people have a full control over all AIs, is not going to happen. :sunny:

As already wrote the current generation have lots of problems. After a longer time I found those so far:

  1. AIs I used are unable to pass a simple test I have created which is about fixing just 1 LOC i.e. not one line in huge project, but literally the whole code have one simple line. :-1:

  2. At least the model I have used have tendency to prefer the most popular solutions. If AI is really going to “replace” developers then it should be able to verify facts. The talk was about energy sources. It preferred “green” energy no matter what arguments I gave which was confirmed by the model to be “correct” … In general maybe the “green” energy maybe have some “problems”, but it’s promising for future and when I asked about future concepts of other technologies then they were categorized as … sure if it would happen it would be great, but it would not happen in near future which may not be right in some cases. :chart_with_downwards_trend:

  3. I broke the AI. Human (?) 1 - AI 0. No idea how I did it as I have deleted all “finished” conversations, but it started generating some “words”. It looked really weird as it looked like it was in an infinite loop of generating a sentences I was unable to read. No, it wasn’t a “new AI’s language”, but some bugged(?) words. I have even no idea how to describe them as those words just does not exists. :exploding_head:

I have also noticed something … interesting? When AI is generating a conversation on machine with high resources usage it shows how responses are generated. The weird thing was that those weren’t sentences, neither words, but … tokens? Under high usage I saw one letter rendered after another one. I have no idea what this means. How the AI model works, but I expected that it would firstly build sentences or sub-sentences and concatenates them nicely when freeing resources, so it should return at least few words at same time instead of single letters. Well … it’s probably because I have no idea how AI models are working, but that was definitely interesting … :thinking:

Where Next?

Popular General Dev topics Top

First poster: HenryCost
I wired my tree with 500 LED lights and calculated their 3D coordinates… If you support me on Patreon at any point in December 2020 I wi...
New
First poster: dimitarvp
A career ending mistake — Bitfield Consulting. As software engineers, we’re constantly making detailed, elaborate plans for computers to...
New
First poster: bot
Large Language Models like ChatGPT say The Darnedest Things. The Errors They MakeWhy We Need to Document Them, and What We Have Decided ...
New
First poster: Korbin73
Whatever happened to Elm, anyway?. I see this question pop up quite frequently in lots of different arenas - folks are curious as to wha...
New
First poster: joeb
50 Shades of Go: Traps, Gotchas, and Common Mistakes for New Golang Devs. Go is a simple and fun language, but, like any other language,...
/go
New
CommunityNews
Once you get good at Rust all of these problems will go away Rust being great at big refactorings solves a largely self-inflicted issues ...
New
CommunityNews
We’re a tiny team @deepseek-ai pushing our limits in AGI exploration. Starting this week , Feb 24, 2025 we’ll open-source 5 repos – one ...
New
First poster: alvinkatojr
Over the last decade, we’ve seen great advancements in distributed systems, but the way we program them has seen few fundamental improvem...
New
CommunityNews
After switching from Firefox to LibreWolf, I became interested in the idea of self-hosting my own Firefox Sync server. Although I had see...
New
CommunityNews
GitSyncPad is an innovative micro keypad designed for effortless Git version control. Execute commands like git add, git commit, and git ...
New

Other popular topics Top

PragmaticBookshelf
From finance to artificial intelligence, genetic algorithms are a powerful tool with a wide array of applications. But you don't need an ...
New
PragmaticBookshelf
Use WebRTC to build web applications that stream media and data in real time directly from one user to another, all in the browser. ...
New
Maartz
Hi folks, I don’t know if I saw this here but, here’s a new programming language, called Roc Reminds me a bit of Elm and thus Haskell. ...
New
AstonJ
Was just curious to see if any were around, found this one: I got 51/100: Not sure if it was meant to buy I am sure at times the b...
New
PragmaticBookshelf
Author Spotlight: Peter Ullrich @PJUllrich Data is at the core of every business, but it is useless if nobody can access and analyze ...
New
CommunityNews
A Brief Review of the Minisforum V3 AMD Tablet. Update: I have created an awesome-minisforum-v3 GitHub repository to list information fo...
New
sir.laksmana_wenk
I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...
New
PragmaticBookshelf
Explore the power of Ash Framework by modeling and building the domain for a real-world web application. Rebecca Le @sevenseacat and ...
New
RobertRichards
Hair Salon Games for Girls Fun Girls Hair Saloon game is mainly developed for kids. This game allows users to select virtual avatars to ...
New
PragmaticBookshelf
Fight complexity and reclaim the original spirit of agility by learning to simplify how you develop software. The result: a more humane a...
New