Create an account

Very important

  • To access the important data of the forums, you must be active in each forum and especially in the leaks and database leaks section, send data and after sending the data and activity, data and important content will be opened and visible for you.
  • You will only see chat messages from people who are at or below your level.
  • More than 500,000 database leaks and millions of account leaks are waiting for you, so access and view with more activity.
  • Many important data are inactive and inaccessible for you, so open them with activity. (This will be done automatically)


Thread Rating:
  • 283 Vote(s) - 3.54 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Iterate over large collection in MongoDB via spring-data

#11
Du to Mongo DB Cursor capabilities, if you have long process, you can lost cursor...

I recommend to use paging :
```
final int pageSize = 1000;
var paging = Pageable.ofSize(pageSize);
do {
Page<T> page = repository.findAll(paging); // Retrieve page items
page.forEach((item) -> this.processItem(item);); // Do item job

// page++
paging = page.nextPageable(); // If last: return Pageable.unpaged()
}
while (paging.isPaged()); // If last: Unpaged.isPaged() return false
```
And for repository, 2 options:
```
// Use Spring Data Interface
@Repository
public interface YourDao extends PagingAndSortingRepository<T, ID> {
// extends create this impl
// Page<T> findAll(Pageable pageable);
}

// Or create your own Impl
public class YourDaoImpl implements YourDao {
@Override
public Page<T> findAll(Pageable pageable) {
final var query = new Query().with(pageable);
var items = mongoTemplate.find(query, T.class);
return PageableExecutionUtils.getPage(
items,
pageable,
() -> mongoTemplate.count(Query.of(query).limit(-1).skip(-1), T.class));
}
}
```
Reply



Forum Jump:


Users browsing this thread:
1 Guest(s)

©0Day  2016 - 2023 | All Rights Reserved.  Made with    for the community. Connected through