Why does it extract nothing even though the page clearly shows reviews?

Most review widgets (Yotpo, Trustpilot, Bazaarvoice and similar) inject their content with JavaScript after the page loads. This tool fetches raw HTML with the requests library and does not render JavaScript, so anything injected client side is invisible to it. If the Test Selectors button finds zero containers on a page that visibly has reviews, the content is JS-rendered and cannot be extracted with this tool.

How are numeric ratings parsed from the page?

A regex takes the first number found in the element text, with commas stripped, so '4.5 out of 5' correctly yields 4.5 but text where a different number comes first will mislead it. For the overall rating and review count only, if the text contains no number the tool falls back to the element's content, value and data-rating/data-count attributes. Individual review star ratings read visible text only, so widgets that encode stars in a class name or CSS width will return nothing for per-review ratings.

Why is only one question captured when a container holds several Q&A pairs?

Within each Q&A container the tool takes only the first element matching the question selector and the first matching the answer selector. The container selector therefore needs to match one element per Q&A pair (for example '.qa-item'), not one wrapper around the whole Q&A section.

Why are some reviews missing their text or rating in the reviews CSV?

Text and star rating are looked up separately inside each review container; whichever selector fails simply leaves that field blank, and a review is only skipped entirely if both fail. Blank review_text with populated ratings (or vice versa) means one of the two inner selectors does not match your site's markup.

Back to Tools

Product Q&A Extractor

Use cases

Review sentiment analysis prep Competitive review comparison FAQ content extraction Product rating audits

Uses BeautifulSoup CSS selectors with regex extract_number() for rating parsing.

For the overall rating and review count, checks element text then attributes (content, value, data-*); individual review star ratings are parsed from visible text.

Configurable selectors for overall rating, review count, individual reviews, star ratings, Q&A containers.

Request delay (0.5-5s), timeout (5-60s), custom User-Agent.

Streamlit App

Platform

Browser-based (no installation required)

Input

Product URLs via paste or CSV upload

CSS selectors for reviews (rating, count, text)

CSS selectors for Q&A (container, question, answer)

Output

Three CSVs: product summary (URL, rating, count), individual reviews (URL, rating, text), Q&A pairs (URL, question, answer).

Launch App View Source

Features

BeautifulSoup CSS selector extraction
Regex number extraction from ratings (first number in text)
Attribute fallback (content, value, data-*) for overall rating and review count
Configurable review and Q&A selectors
Static HTML only (no JavaScript rendering)
Request delay (0.5-5s), timeout (5-60s)
Three separate CSV outputs

How to use

1 Enter URLs or upload CSV and select column
2 Configure review selectors (defaults: .rating, [itemprop=ratingValue])
3 Configure Q&A selectors
4 Set request delay and timeout
5 Test on single URL first
6 Download three CSV exports

Frequently asked questions

Why does it extract nothing even though the page clearly shows reviews?: Most review widgets (Yotpo, Trustpilot, Bazaarvoice and similar) inject their content with JavaScript after the page loads. This tool fetches raw HTML with the requests library and does not render JavaScript, so anything injected client side is invisible to it. If the Test Selectors button finds zero containers on a page that visibly has reviews, the content is JS-rendered and cannot be extracted with this tool.
How are numeric ratings parsed from the page?: A regex takes the first number found in the element text, with commas stripped, so '4.5 out of 5' correctly yields 4.5 but text where a different number comes first will mislead it. For the overall rating and review count only, if the text contains no number the tool falls back to the element's content, value and data-rating/data-count attributes. Individual review star ratings read visible text only, so widgets that encode stars in a class name or CSS width will return nothing for per-review ratings.
Why is only one question captured when a container holds several Q&A pairs?: Within each Q&A container the tool takes only the first element matching the question selector and the first matching the answer selector. The container selector therefore needs to match one element per Q&A pair (for example '.qa-item'), not one wrapper around the whole Q&A section.
Why are some reviews missing their text or rating in the reviews CSV?: Text and star rating are looked up separately inside each review container; whichever selector fails simply leaves that field blank, and a review is only skipped entirely if both fail. Blank review_text with populated ratings (or vice versa) means one of the two inner selectors does not match your site's markup.

Want me to run this for you?

I run this tool as a managed service, or build something custom around your data. You get the insights without touching the code.

Tell Me What You Need

Internal Search to Landing Page MapperScriptE-commerce

Match internal site search terms to landing pages using fuzzy TF-IDF matching.

Categories Missing From NavigationScriptE-commerce

Find sitemap URLs not linked from your site navigation element.

Navigation Label Mismatch DetectorScriptE-commerce

Flag navigation links whose anchor text does not match the destination H1 or title keyword.

Product Attribute ExtractorScriptE-commerce

Extract structured product attributes from titles using an LLM with iterative attribute discovery.

Best Sellers to XML SitemapScriptE-commerce

Generate XML sitemaps from GA landing page exports filtered by top transactions or revenue.

Redirect Chain CheckerBrowserTechnical SEO

Follow redirect chains and see every hop along the way.

Need something built for your business?

This tool started as bespoke client work. I build custom scripts, data pipelines, and full apps for SEO and product data problems that off-the-shelf tools don't solve.