Help me!
now I am scraping a website.
This website is similar to jobsite, but there are 3066 job posts. However, since it cannot load all of them at once, it imports 20 more at a time using data-page="10" in HTML. I can move the mouse down to continue receiving data. Since I use a program, I can only read the 20 with my script.
How can I treat this problem?
print(len(searchItems)) must be 3066 but It is set to 20 because it has not been loaded.
This website is similar to jobsite, but there are 3066 job posts. However, since it cannot load all of them at once, it imports 20 more at a time using data-page="10" in HTML. I can move the mouse down to continue receiving data. Since I use a program, I can only read the 20 with my script.
How can I treat this problem?
print(len(searchItems)) must be 3066 but It is set to 20 because it has not been loaded.
