this post was submitted on 01 Oct 2024
146 points (98.7% liked)

Technology

1366 readers
1242 users here now

Which posts fit here?

Anything that is at least tangentially connected to the technology, social media platforms, informational technologies and tech policy.


Rules

1. English onlyTitle and associated content has to be in English.
2. Use original linkPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communicationAll communication has to be respectful of differing opinions, viewpoints, and experiences.
4. InclusivityEveryone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacksAny kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangentsStay on topic. Keep it relevant.
7. Instance rules may applyIf something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.


Companion communities

!globalnews@lemmy.zip
!interestingshare@lemmy.zip


Icon attribution | Banner attribution

founded 1 year ago
MODERATORS
 

The study tracked around 800 developers, comparing their output with and without GitHub's Copilot coding assistant over three-month periods. Surprisingly, when measuring key metrics like pull request cycle time and throughput, Uplevel found no meaningful improvements for those using Copilot.

you are viewing a single comment's thread
view the rest of the comments
[–] AnarchoSnowPlow@midwest.social 16 points 1 month ago (2 children)

I've tried it for even some boiler plate code a few times. I've had to end up rewriting it every time.

It makes mistakes like Junior engineers, but it doesn't make them in the same way that junior engineers do, which means that as a senior engineer it takes me significantly more effort to review. It also makes mistakes that humans don't, which is even weirder to catch in review.

[–] leisesprecher@feddit.org 6 points 1 month ago

Also my experience. It sometimes tries to be smart and gets everything wrong.

I think code shows clearly, that LLMs don't actually understand what's written. Often enough you can clearly see it trying to insert a common pattern even though that doesn't make sense at this point.

[–] TrippaSnippa@lemm.ee 2 points 1 month ago

As a junior-to-mid-level developer I find myself having to rewrite the boilerplate code copilot comes up with as often as not, or it will get things slightly wrong that I then have to go back and fix. I'm starting to think that most of the time it would be just as quick for me to just write it all myself.