this post was submitted on 15 Dec 2023
-4 points (43.3% liked)

Programming

17398 readers
128 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev

founded 1 year ago
MODERATORS
snowe@programming.dev
Ategon@programming.dev
MaungaHikoi@lemmy.nz
-4
Why You Shouldn’t Use OFFSET and LIMIT For Your Pagination (ivopereira.net)
submitted 11 months ago* (last edited 11 months ago) by starman@programming.dev to c/programming@programming.dev
17 comments fedilink hide all child comments
 

If you are wondering why lemmy is moving away from offset pagination since 0.19, here is a nice article about it

you are viewing a single comment's thread
view the rest of the comments
[–] SpaceNoodle@lemmy.world 15 points 11 months ago (2 children)

Paywall.

[–] wccrawford@lemmy.world 10 points 11 months ago (4 children)

https://ivopereira.net/efficient-pagination-dont-use-offset-limit

This seems to be the same article.

I have my doubts about the technique, but it could be useful in certain controlled situations.

[–] Max_P@lemmy.max-p.me 6 points 11 months ago

Lemmy just implemented it for 0.19 and it makes a big difference on heavier queries like Scaled homepage.

It also has the advantage of your pagination not getting screwy if new content has been added between page 2 and 3 queries.

[–] MegaMacSlice@programming.dev 3 points 11 months ago (1 children)

I was going to recommend looking at https://www.elastic.co/guide/en/elasticsearch/reference/current/paginate-search-results.html#scroll-search-results - but it looks like that method is now not advised- but if you read up above it it looks like there’s a search_after/PIT method described which sounds similar to the article.

This is all to say - I don’t think this is a one-off concept - it’s been around for a bit.

[–] vzq@lemmy.blahaj.zone 1 points 11 months ago

I have my doubts about the technique, but it could be useful in certain controlled situations

This is completely uncontroversial advice and has been for 30 years. What are your doubts exactly?

I’d go further: if you see a query that uses “offset” on a non-trivial production DB something is very, very wrong.

Of course, the trick is that you need to make sure you have indexes for all sort orders you need to display, but that’s obvious.

[–] SpaceNoodle@lemmy.world 1 points 11 months ago

Thanks! Agreed, it's a very limited usecase.

[–] starman@programming.dev 1 points 11 months ago

Sorry, I updated the link