Apify Discord Mirror

Updated last week

Does Crawlee crawl both root-relative and base-relative urls?

Root relative - prefixed with '/', ie href=/ASDF brings you to example.com/ASDF

base-relative - no prefix, ie. href=ASDF from example.com/test/ brings you to example.com/test/ASDF

If someone could point me to where in the library this logic occurs, I would be forever grateful
Add a reply
Sign up and join the conversation on Discord