Hi everyone, I want to fetch all the products (in order to collect all the SKUs). But there is an maximum offset value 10000 and limit is 500. So, the possible amount of products to be fetched via API is 10500. is there any way to overcome this? I want to fetch around 20K products (it might grow in the feature).
Fetching based on categories is not working as expected. It ended up in lot of duplicate, limit issue.
Note: Had the same issue with orders. But , fetching the orders based on the createdAt field solved the issue. Products have the same createdAt date.
Thank you and kind regards,
Raja
Question
Fetching More than 10500 products
Hi
Please follow the below instructions to get all products
- Send a request to get products with total .
- Once you got the total number of products, you need to send the products request with sort by id desc with a simple pagination logic
-
curl --location 'https://api.australia-southeast1.gcp.commercetools.com/{project-KEY}/products/search?limit=1' \ --header 'Content-Type: application/json' \ --header 'Authorization: Bearer XXXXXXXXXXXXXXX' \ --data '' -
- Apply the simple pagination logic to set the correct offset value
-
curl --location 'https://api.australia-southeast1.gcp.commercetools.com/{project-key}/products?where=id%3E%22128416c1-e351-41fe-a4fb-7cbffefd0d99%22&sort=id%20asc&limit=500&withTotal=false&skip=1000' \ --header 'Content-Type: application/json' \ --header 'Authorization: Bearer XXXXXXXXX' \ --data '' - Apply the proper where condition and set the correct skip values.
Hope the above CURL will help you
+1Hi
Just to complement
I think it’s good to also have an eye on the official docs, since things tend to evolve over time and snippets of code might become redundant in the future.
Happy iterating! 😉
Reply
Sign up
Already have an account? Login
Connect with (or create) your commercetools ID
commercetools IDEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.