this post was submitted on 13 Sep 2023
259 points (98.5% liked)

Asklemmy

43885 readers
1023 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~

founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[โ€“] DokPsy@infosec.pub 23 points 1 year ago (2 children)

I don't mind the tool itself if you use it as such. I do mind when people use its output as the final product. See: the lawyer who used chatgpt for a legal brief

[โ€“] XEAL@lemm.ee 3 points 1 year ago (2 children)

The lawyer fuck up is what happens when someone doesn't know or understand the limitations of a LLM.

If you want a GPT model tailored and specialized for a specific task, you have to train it with custom data, fine tune it and tweak the model's parameters. You cannot do that from the ChatGPT web/app, you need a custom implementation coded in Python or some other language.

[โ€“] TechieDamien@lemmy.ml 2 points 1 year ago (1 children)

There are some uis that allow for fine tuning (assuming you have an extremely high end rig designed for ml). For example ChatGPT alternative and DALLE alternative.

[โ€“] XEAL@lemm.ee 2 points 1 year ago (1 children)

Thanks. I have a quite powerful rig, but at the moment I work with OpenAI's API using GPT 3.5 Turbo using a custom (but shitty) Python script with a simple Gradio web interface. However, I mostly stopped improving or updating it months ago. As long as I don't use LlamaIndex, the cost is quite low.

I already use Stable Diffusion WebUI, tho.

Also the "fine tuning" I was talking about is this https://platform.openai.com/docs/guides/fine-tuning

[โ€“] TechieDamien@lemmy.ml 2 points 1 year ago

I am aware what fine tuning is. It is available from the train tab while the base checkpoint is loaded in both cases.

[โ€“] DokPsy@infosec.pub 1 points 1 year ago (1 children)

I'm glad you understand my point. Chatgpt is not Google. It's a language model that will give you something that looks like the thing you asked for it to provide. It can and will pull facts out of its recycle bin if it fits the cadence of what it expects the answer to look like.

[โ€“] XEAL@lemm.ee 1 points 1 year ago* (last edited 1 year ago) (1 children)

ChatGPT is not Google, but sometimes it can work as a glorified search engine or even compete with asking in forums.

I've lost count of how many times ChatGPT has produced Bash or Python code for what I needed. Yes, sometimes the code is wrong and/or requires tweaking and sometimes I resorted to look into the documentation, but no one will answer faster and anytime of the day like ChatGPT does, at least not for free.

[โ€“] DokPsy@infosec.pub 1 points 1 year ago (1 children)

It's a tool to aid in creating a product, not a tool that magics out a finished product. That's my point. Too many people use it as the latter instead of the former.

[โ€“] XEAL@lemm.ee 1 points 1 year ago

100% agree.

Maybe, with lots of training, weaking and testing the latter could be achieved, but that's it.

[โ€“] intensely_human@lemm.ee -2 points 1 year ago (2 children)
[โ€“] Carighan@lemmy.world 2 points 1 year ago (1 children)

Have you seen that legal brief?

[โ€“] intensely_human@lemm.ee -2 points 1 year ago (1 children)

No. Communicate please and we can have a real conversation.

[โ€“] Carighan@lemmy.world 2 points 1 year ago

The person you first replied to asked you to see the legal brief as an example of why they mind using the output as the finished product. You then asked for an explanation. To which I asked you, hey, have you actually looked at that example? You have not.

What exactly do you want here, other than be argumentative for combative reasons?

[โ€“] DokPsy@infosec.pub 2 points 1 year ago

Letting a language model do the work of thinking is like building a house and using a circular saw to put nails in. It will do it but you should not trust the results.

It is not Google. It can, will, and has made up facts as long as it fits the format expected

Not at the very least proof reading and fact checking the output is beyond lazy and a terrible use of a tool. Using it to create the end product instead of as a tool to use in creation of an end product are two very different things.