LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Go

crowlet

Tiny sitemap crawler for cache warming, and website status monitoring

GoEmergingcachecrawlermonitoringsitemap

Stars

32

Forks

6

Contributors

3

Last push

19mo ago

Recent commits

Latest commits.

crowlet: bump version for CLI
c9e08aeAdrien Leravat19mo ago
Makefile: push both version and latest of docker image
633be00Adrien Leravat19mo ago
tests: add benchmarking code
135e593Adrien Leravat19mo ago
Dockerfile: bump to golang:1.23
4f14c70Adrien Leravat20mo ago
tests: move tests and add new tests
a51c776Adrien Leravat20mo ago

crawler: http: Ensure HTTP response body is closed

976c136Adrien Leravat20mo ago

crawler: restore support for '--override-host'

3dfbd58Adrien Leravat20mo ago

crawler: http: recycle http.Client among workers

d7e61a3Adrien Leravat20mo ago

Top contributors

Builders behind this project.

chris-scentregroup

jeroenvermeulen