LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Python

site-page-size-scraper

Selenium + Headless Chrome scraper that calculates actual full web page sizes (including dynamic content).

PythonEmerging

Stars

8

Forks

1

Contributors

1

Last push

43mo ago

Recent commits

Latest commits.

Fixes README typo
998b54fJorge Orpinel89mo ago
Adds link to published article.
dbc9277Jorge Orpinel92mo ago
Updates doc and fixes bug where some headless Chrome instances were never quitted.
b1227dcJorge Orpinel94mo ago
Removes Network.dataReceived comments; Checks for 0B responses.
e5be9b9Jorge Orpinel94mo ago
Updates script to support domain names (incomplete URLs); Doc update
2170308Jorge Orpinel94mo ago

Finish calculating Network.dataReceived only and leave 50 top sites as sample.

f091dacJorge Orpinel94mo ago

Begins top 50 Alexa list (Sep 2018)

e698495Jorge Orpinel94mo ago

Completes 10 top site list; Improves README and in-line doc; Improves stdout, adds timeouts, and handles exceptions.

a96ccf8Jorge Orpinel94mo ago

Top contributors

Builders behind this project.