In 879 one-to-three-star App Store reviews of 58 upsell, cross-sell and bundle apps, the main complaints were that the app didn't work or didn't show (27%), price (16%), support (9%), setup being too hard (6%) and a slower store (4%) (October 2026, sorted by an AI model; method in the review study). Each check below targets one of those. The listing labels are the ones Shopify's App Store showed on October 26, 2026.
1. Read the newest bad reviews, and how long each merchant used the app
On the app's listing, open the reviews, click Refine, choose 1, 2 and 3 under By rating, then sort by "Date: Newest to oldest". Next to each review, the listing shows how long the merchant had been using the app, for example "About 2 hours using the app".
That label tells you what kind of problem it is. A review written after an hour or a day is about setup or the app not showing; a quarter of the bad reviews in my data came from merchants who had used the app for less than a day. A review written after a year or more is about whether the app keeps working and how support treats long-time customers. Read the developer's replies too: a specific fix is a good sign, a copy-pasted apology is not.
2. Work out the price in your busiest month
In the Pricing section, find the plan that matches your order count in your best month, not your average one. Most upsell apps price by monthly store orders, a few by revenue, and some add usage charges to a base fee. Check whether the free plan is for live stores or only for development stores, and whether the trial turns into a charge automatically. Shopify bills app charges every 30 days, and the listing says so under the plans.
Price reviews are mostly about charges the merchant didn't expect. The pricing models post has an example of the same store's bill in a normal and a busy month across five apps.
3. Check that it will show on your theme without code
Look for "app block", "app embed" or "theme app extension" in the listing or the setup docs. Those are added and removed in the theme editor. If the setup guide asks you to paste code into theme files, or to give the developer access to edit your theme, expect more work and a harder removal. The Built for Shopify badge is a useful shortcut here: Shopify requires apps with that badge that add to the online store to use theme app extensions.
Then check your theme: app blocks need an Online Store 2.0 theme, and cart recommendations depend on whether your cart is a drawer, a page or a popup.
4. Check that you can remove it cleanly
When an app is built on theme app extensions, Shopify removes its blocks from your theme when you uninstall it. Apps that edit theme code often leave that code behind. If the listing doesn't say how the app is added to your store, ask support before installing. The removal guide covers what to check after uninstalling any app.
5. Count the setup before anything shows
Open the app's docs or setup video and count the steps between install and the first recommendation on your store. Rules, bundles and funnels to build are all setup. Setup complaints come early: in my data, more than half of them were written in the merchant's first week.
6. Test support before you depend on it
The Support section of the listing shows how to reach the developer. During the trial, send a real question, like "will this work with my theme's cart drawer?", and note how long the answer takes and whether it answers what you asked.
7. Look at Data access and Launched
The listing's Data access section lists what the app can see and change, such as customer data or store data. An upsell app needs products and orders; if it asks for much more, ask why. The Launched date tells you how long the app has existed, which helps you read the review count fairly.
Running these checks on Dropr
I built Dropr, so here is how it does on each check, including where it can't pass yet. It went live in July 2026 and has no reviews, so check 1 isn't possible yet. Price: free up to 1,000 recommendation views a month, then $19 every 30 days with unlimited views and a 14-day trial, at any order count. It uses an app embed and app blocks only and never edits theme files, so uninstalling removes it. Setup is one switch in the theme editor, and recommendations are ready from your catalog. Its data access is reading products and orders. For support, ask a question and see how long I take to answer.