CommunityNews

CommunityNews

Developer survey shows trust in AI coding tools is falling as usage rises

“AI solutions that are almost right, but not quite” lead to more debugging work.

Read in full here:

Most Liked

brennan

brennan

Probably the best way to use them now is not to trust 100% the code that they generate.

jmagnani

jmagnani

Might take a couple of years more, but it will get better.

MyrddinE

MyrddinE

‘Survey shows that when Devs start to use the tools, they realize they are unreliable’.

Assuming the same architecture, it will probably get better… but not because LLMs stop hallucinating. It’ll get better because they’ll get larger context windows, and they’ll start putting the docs for the frameworks and languages into that context window before starting. It’ll get better when they can reliably test their own work before submitting. And it’ll get better when they have better processes around workflow incorporated into their programming system prompts.

These are all low hanging fruit, so I expect this to be rapidly improving in the coming months.

One thing that I have learned is that documenting what is not supported is often just as important as documenting what is supported, but it’s a commonly overlooked task in documentation leading to both human and AI hallucinations. For example, if a language structure only supports && conditions an LLM might hallucinate a solution that utilizes || conditions. Improving the documentation for LLMs will also help humans.

Where Next?

Popular Ai topics Top

AstonJ
Well done DeepMind… wonder what else they’re working on… One of biology’s biggest mysteries has been solved using artificial intelligen...
New
First poster: bot
DeepMind AI predicts incoming rainfall with high accuracy. Having flexed its muscles in predicting kidney injury, toppling Go champions ...
New
First poster: CommunityNews
Many recent big advances in tech have one key thing at the heart of then: artificial intelligence.
New
First poster: bot
You can’t solve AI security problems with more AI. One of the most common proposed solutions to prompt injection attacks (where an AI la...
New
First poster: bot
AI video editor can recognize objects, people, and sounds, allowing editing via text.
New
First poster: Eiji
AI web crawling bots are the cockroaches of the internet, many developers believe. FOSS devs are fighting back in ingenuous, humorous wa...
New
New
First poster: mercyf
Google’s Veo 3 delivers AI videos of realistic people with sound and music. We put it to the test.
New
First poster: AstonJ
I presented an invited keynote at the AI Engineer World’s Fair in San Francisco this week. This is my third time speaking at the event—he...
New
CommunityNews
Contracted AI raters describe grueling deadlines, poor pay and opacity around work to make chatbots intelligent
New

Other popular topics Top

AstonJ
A thread that every forum needs! Simply post a link to a track on YouTube (or SoundCloud or Vimeo amongst others!) on a separate line an...
New
AstonJ
Do the test and post your score :nerd_face: :keyboard: If possible, please add info such as the keyboard you’re using, the layout (Qw...
New
Exadra37
I am asking for any distro that only has the bare-bones to be able to get a shell in the server and then just install the packages as we ...
New
DevotionGeo
The V Programming Language Simple language for building maintainable programs V is already mentioned couple of times in the forum, but I...
New
First poster: joeb
The File System Access API with Origin Private File System. WebKit supports new API that makes it possible for web apps to create, open,...
New
New
CommunityNews
A Brief Review of the Minisforum V3 AMD Tablet. Update: I have created an awesome-minisforum-v3 GitHub repository to list information fo...
New
sir.laksmana_wenk
I’m able to do the “artistic” part of game-development; character designing/modeling, music, environment modeling, etc. However, I don’t...
New
PragmaticBookshelf
Get the comprehensive, insider information you need for Rails 8 with the new edition of this award-winning classic. Sam Ruby @rubys ...
New
AnfaengerAlex
Hello, I’m a beginner in Android development and I’m facing an issue with my project setup. In my build.gradle.kts file, I have the foll...
New