this post was submitted on 10 Jul 2023
52 points (96.4% liked)

rpg

3176 readers
22 users here now

This community is for meaningful discussions of tabletop/pen & paper RPGs

Rules (wip):

founded 1 year ago
MODERATORS
 

Hi friends! To do my small part for the TTRPG fediverse, I resurrected an old RPG blog rss aggregator I ran about 10 years ago and refreshed it with some GPT-based summarization. You can find it right here:

https://dndblogs.com/

It updates every morning from the following feed lists.

https://slyflourish.com/sly_flourish_rpg_blogroll.html

If there are any great TTRPG blogs I’m missing, please let me know!

top 28 comments
sorted by: hot top controversial new old
[–] Nanenroe@ttrpg.network 3 points 1 year ago

Thank you

I like it, and it will become news spot for me.

[–] afk@ttrpg.network 3 points 1 year ago

Oh this is great :)!

[–] DragonsAreReal@ttrpg.network 3 points 1 year ago

Nice work, always handy to have another resource...and a good use of AI Chat doing the summaries.

[–] Gutless2615@ttrpg.network 2 points 1 year ago (1 children)

Very cool! But I think the current summarization is a bit hit or miss. Would you be interested in community help (volunteer basis) refining the prompts for summarization? GPT-4 also is rolling out to paid users, I'm making a hunch here but it looks like it's using GPT-3.5-turbo instead of GPT-4, we might be able to get more interesting summarizations using the newer model. But either way it seems like the prompts for summarizing could be tweaked a bit to more than just summarize the contents of hte article, but summarize the contents and extract what is interesting for the reader for the ttrpg DMing community. Just my 2c. Awesome work, hugely appreciate (another) Lazy DM resource, Mike!

[–] slyflourish@ttrpg.network 3 points 1 year ago (1 children)

Sure, lets give it a try. I am indeed using 3.5 turbo. 4 is a bit more expensive (like 10x)

[–] Gutless2615@ttrpg.network 3 points 1 year ago (1 children)

Yeah, GPT-4 is way more costly. It's rolled out to the paid tier of users AFAIK, though, so in your script it's as easy as subbing out "3.5-turbo" with "4" -- it may be worth just doing some trial runs and seeing if it's markedly improved. I expect though there's some room for tweaks with the 3.5-turbo model, though.

Temperature is something you can play with to get more predictable or more creative results; and is set between 0 and 1 with .1/.2 being more useful for every wrote data entry stuff and .7-.9 being more creative. That's something to play with (I'd probably start around .6 or .7). But tweaking the prompt itself and the "role:" instructions will almost certainly return the most immediate benefits.

I'm assuming your code looks something like:

response = openai.ChatCompletion.create( model="gpt-3.5-turbo", temperature=0.2, messages=[ { "role": "user", "content": f"Please summarize this blog post in 3-5 bullet points: {blog}" }

You can add a "role": "system" instruction to make clear that, e.g., the model is supposed to assume that they are summarizing this work for a dm/ttrpg audience, and reiterate that in your user content message as well:

response = openai.ChatCompletion.create( model="gpt-3.5-turbo-16k", temperature=0.6, messages=[ { "role": "system", "content": "You are an assistant for a TTRPG blog designed to help gamemasters and dungeonmasters. You have been tasked with reading blog posts from other game masters and identifying the creative and interesting takeaways and summarizing them for a DM/GM audience. The factual summarizing of the structure of the blog is less important than the relevant actionable advice for running interesting and engaging TTRPG sessions" }, { "role": "user", "content": f"Please summarize this ttrpg blog post in 3-5 bullet points for an audience of gamemasters and ttrpg enthusiasts, identifying the most interesting, actionable and creative take-aways: {blog}" }

Go crazy with those instructions, though. That's the real secret to getting good results from GPT chat/completion models. I also swapped out the vanilla 3.5-turbo model with the only barely more expensive 'turbo-16k' model, which has a higher token limit, and bumped the temperature up a bit.

[–] slyflourish@ttrpg.network 3 points 1 year ago (1 children)

Great stuff! I'll experiment with it and see how I can get better results. I've already been using the turbo-16k so I can feed large blog articles back to it. I also need to find a way to limit the total tokens coming out to ensure the summaries don't get to long sometimes.

[–] Gutless2615@ttrpg.network 2 points 1 year ago

Awesome! Looking forward to checking it out!! I believe there is a max_tokens flag you can add, but I haven't futzed with that https://platform.openai.com/docs/api-reference/chat/create#chat/create-max_tokens

[–] INeedMana@lemmy.world 2 points 1 year ago (1 children)

Nice, I like it! Subscribed to RSS

Btw, why not create a bot account that would post these here/separate community?

[–] eerongal@ttrpg.network 4 points 1 year ago (1 children)

That's a great idea. I'll have to check and see if Mike is willing for that to be a thing! We can have a community that the bot posts to and people can follow it to join the discussion on each post for each blog!

[–] slyflourish@ttrpg.network 1 points 1 year ago (2 children)

You bet! I just wrote a mastodon bot that posts new posts from here.

https://chirp.enworld.org/@ttrpgblogs

[–] eerongal@ttrpg.network 1 points 1 year ago (1 children)

oh, awesome! I'll set up a community specifically to put it into so that people can subscribe to it if they want to opt in.

Created right here: https://ttrpg.network/c/daily_rpg_blog

[–] eerongal@ttrpg.network 1 points 1 year ago

Also feel free to bombard it with any tests you need

[–] eerongal@ttrpg.network 1 points 1 year ago

so it doesnt look like the mastodon posts are flowing in to here, but it's fine; I created a quick n' dirty bot that can follow the RSS feed and post em here.

[–] Nanenroe@ttrpg.network 2 points 1 year ago (2 children)

Can I make a small request?

Could links to the blog posts be set to open in a new window/tab? That way the blog roll remains open as we decend down the link rabbit hole.

[–] slyflourish@ttrpg.network 2 points 1 year ago (1 children)

Great idea! I'll add it right now and it'll be up and running tomorrow.

[–] InEnduringGrowStrong@ttrpg.network 1 points 1 year ago (1 children)

You might already know, but just in case:
You can Ctrl + click to open in a new tab, that works mostly everywhere (on desktop)
On mobile, long press, open in new tab

[–] Nanenroe@ttrpg.network 1 points 1 year ago

Yeah, but it's easier this way!

[–] eerongal@ttrpg.network 2 points 1 year ago (1 children)

Very cool.

I'm surprised you don't have any columns from rpg.net on your blogroll, however. Any reason for that, or is it just one you haven't seen before? I know its been around since, like, the 90s.

[–] slyflourish@ttrpg.network 1 points 1 year ago (1 children)
[–] eerongal@ttrpg.network 1 points 1 year ago (1 children)

They have an RSS specifically for their "columns" section, which looks to me to have about one post a week or so.

https://www.rpg.net/columns/index.xml

I dont know how good they are these days, though, i used to follow them back in the mid 2000's.

[–] pteryx@dice.camp 1 points 1 year ago

@eerongal @slyflourish The column pickings there have shriveled over the years in favor of their forums. The main column there that still matters is Designers & Dragons.

[–] jursed@beehaw.org 2 points 1 year ago

Thanks for putting this together!!! This is awesome! 😊

[–] paradisebunny@ttrpg.network 2 points 1 year ago* (last edited 1 year ago) (1 children)

This is truly great! I really appreciate the summaries as well, so i don’t have to open tabs for everything to find out if I am even interested. I also realised that the fediverse reemergence goes very well with the reimagining of the web experience that the people working on arc browser are doing! Check it out, it is great for a workflow involving multiple sites bookmarks etc

[–] slyflourish@ttrpg.network 1 points 1 year ago (1 children)
[–] paradisebunny@ttrpg.network 1 points 1 year ago

Let me know if you need an invite, for now it is invite only

[–] INeedMana@lemmy.world 1 points 5 months ago

Request: if you decide to add new blogs, could you also make a post about it on your blog, please?

After some time I discovered that I'd prefer narrower choice of blogs, so I copied your selection and manually created my own list. But I'd still like to leverage your moderation, so if you wrote about it on your blog, I would know to check them out

load more comments
view more: next ›