this post was submitted on 13 Jul 2023
9 points (100.0% liked)

Actually Useful AI

1997 readers
7 users here now

Welcome! ๐Ÿค–

Our community focuses on programming-oriented, hype-free discussion of Artificial Intelligence (AI) topics. We aim to curate content that truly contributes to the understanding and practical application of AI, making it, as the name suggests, "actually useful" for developers and enthusiasts alike.

Be an active member! ๐Ÿ””

We highly value participation in our community. Whether it's asking questions, sharing insights, or sparking new discussions, your engagement helps us all grow.

What can I post? ๐Ÿ“

In general, anything related to AI is acceptable. However, we encourage you to strive for high-quality content.

What is not allowed? ๐Ÿšซ

General Rules ๐Ÿ“œ

Members are expected to engage in on-topic discussions, and exhibit mature, respectful behavior. Those who fail to uphold these standards may find their posts or comments removed, with repeat offenders potentially facing a permanent ban.

While we appreciate focus, a little humor and off-topic banter, when tasteful and relevant, can also add flavor to our discussions.

Related Communities ๐ŸŒ

General

Chat

Image

Open Source

Please message @sisyphean@programming.dev if you would like us to add a community to this list.

Icon base by Lord Berandas under CC BY 3.0 with modifications to add a gradient

founded 1 year ago
MODERATORS
sisyphean@programming.dev
9
Simon Willisonโ€™s LLM CLI tool now supports self-hosted language models via plugins (simonwillison.net)
submitted 1 year ago by sisyphean@programming.dev to c/auai@programming.dev
1 comments fedilink hide all child comments
 

LLM is my command-line utility and Python library for working with large language models such as GPT-4. I just released version 0.5 with a huge new feature: you can now install plugins that add support for additional models to the tool, including models that can run on your own hardware.

@AutoTLDR

you are viewing a single comment's thread
view the rest of the comments
[โ€“] AutoTLDR@programming.dev 2 points 1 year ago

TL;DR: (AI-generated ๐Ÿค–)

The text announces the release of version 0.5 of LLM, a command-line utility and Python library for working with large language models such as GPT-4. The new feature allows users to install plugins that add support for additional models to the tool, including models that can run on their own hardware. The text provides instructions on how to install LLM and plugins, as well as examples of how to run prompts using different models. It also mentions a tutorial on how to build new plugins, a Python API for running prompts, and the possibility of continuing conversations across multiple prompts. The author states their plans to add OpenAI functions and develop a web interface with plugins that provide new interfaces for interacting with language models.

Under the Hood

  • This is a link post, so I fetched the text at the URL and summarized it.
  • My maximum input length is set to 12000 characters. The text was short enough, so I did not truncate it.
  • I used the gpt-3.5-turbo model from OpenAI to generate this summary using the prompt "Summarize this text in one paragraph. Include all important points."
  • I can only generate 100 summaries per day. This was number 0.

How to Use AutoTLDR

  • Just mention me ("@AutoTLDR") in a comment or post, and I will generate a summary for you.
  • If mentioned in a comment, I will try to summarize the parent comment, but if there is no parent comment, I will summarize the post itself.
  • If the parent comment contains a link, or if the post is a link post, I will summarize the content at that link.
  • If there is no link, I will summarize the text of the comment or post itself.
  • ๐Ÿ”’ If you include the #nobot hashtag in your profile, I will not summarize anything posted by you.