Ssacred-emerald
Make PlaywrightCrawler less unique and avoid blocking? (canvas/fonts/plugins/permissions...)
I checked my program (PlaywrightCrawler) against this thing: https://amiunique.org/fingerprint
Used US residential proxy, did 3 screenshots, see below
It seems - there are some areas where Crawlee could do better (be less unique, less detectable)!
Here the list (these things are red on the screenshots):
- User Agent (I used fingerprint generator for this!)
- Canvas
- Navigator properties
- List of fonts
- List of plugins
- Permissions
Some settings in my PlaywrightCrawler:
Regarding list of plugins: I use some JS code (
and inject it into page this way:
Well, this code/hack... it simulates presence of some PDF plugins... but I have an impression there are better solutions for plugins/fonts/permissions...
Used US residential proxy, did 3 screenshots, see below
It seems - there are some areas where Crawlee could do better (be less unique, less detectable)!
Here the list (these things are red on the screenshots):
- User Agent (I used fingerprint generator for this!)
- Canvas
- Navigator properties
- List of fonts
- List of plugins
- Permissions
Some settings in my PlaywrightCrawler:
useFingerprints: trueuseFingerprintCache: falselauncher: firefoxRegarding list of plugins: I use some JS code (
pluginContentand inject it into page this way:
Well, this code/hack... it simulates presence of some PDF plugins... but I have an impression there are better solutions for plugins/fonts/permissions...
Check if your browser has a unique fingerprint, how identifiable you are on the Internet
This is the official developer community of Apify and Crawlee.
14,091Members
Resources
Recent Announcements
Similar Threads
Was this page helpful?
