Skip to content

Commit

Permalink
Scraped the first 50,000 data
Browse files Browse the repository at this point in the history
  • Loading branch information
darren7753 authored Sep 12, 2023
1 parent 043cb32 commit 25c67bd
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scraping_data.py
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ def get_moon_phase(group):
group["Moon Phases"] = 0
return group

for url in modified_urls[20:40]:
for url in modified_urls[:50_000]:
params = parse_qs(urlparse(url).query)

city_state_data = unquote(params["comb_city_info"][0]).split(",")[:2]
Expand Down

0 comments on commit 25c67bd

Please sign in to comment.