10-12-2025, 04:06 PM
(10-12-2025, 02:24 PM)gaugamela wrote: You are not allowed to view links. Register or Login to view.I've gotten usable and very accurate solutions for diffusion and convection problems, fits, and all sorts of other not so trivial questions.
They are pretty good at finding a standard solution which has been published somewhere. I myself use them for questions like "what command line options do I use to get ImageMagick to replace a given color by another color". It generally works much better than searching the manual or searching the the answer with google.
But, in at least one case out of ten tries, it gave me an answer that was completely made-up nonsense.
Quote:I tried both of your examples and got very different solutions. No brute forcing at all, rather checking divisibility, which would seem like the easiest way.
For the "primes that end" questions, the right answers would have been "print(2)" and "print(5)", respectively. As I said, between my first test and the second one, ChatGPT somehow discovered the right answer for the "2" case. But if it still uses a loop and tests for divisibility in the "5" case, then it still has not learned that yet.
[quote']Is the code right? 90% of the time. Is the code good? 50/50. Is the code usable? Almost always.[/quote]
Again, it will give the right code if it happens to find one in its database that it can adapt in a straightforward way. For common types of problem, it may "almost always" work. But the danger is not that it will be "right 90% of the the time you ask", but "right 90% of the input cases".
Other people who use LLMs for writing code tell me that sometimes they spend much more time finding and fixing bugs than they saved by using the tool.
Quote:The biggest problem is users taking AI generated content at face value and not checking it against actual sources.
Yup. When the correct answer (or some adaptable version of it) is not in their database, they will spit out garbage. As we see on this forum, several times a week. And, AFAIK, because of the way they work, they cannot tell that what they assembled is garbage.
All the best, --stolfi