PSWebCrawler

0.2.0

A PowerShell module to web crawl is a collection of PowerShell functions that can be used to automatically download and parse web pages.

Minimum PowerShell version

5.1

Installation Options

Copy and Paste the following command to install this package using PowerShellGet More Info

Install-Module -Name PSWebCrawler

Copy and Paste the following command to install this package using Microsoft.PowerShell.PSResourceGet More Info

Install-PSResource -Name PSWebCrawler

You can deploy this package directly to Azure Automation. Note that deploying packages with dependencies will deploy all the dependencies to Azure Automation. Learn More

Manually download the .nupkg file to your system's default download location. Note that the file won't be unpacked, and won't include any dependencies. Learn More

Owners

Voytas

Copyright

Script Savvy Ninja

Package Details

Author(s)

Wojciech Napierala

Release Notes

0.2.0: New API contracts/analysis and offline-tested Site orchestration only; Site fails closed with CapabilityUnavailable, Domains with UnsupportedMode. Legacy network-capable commands retained. C2/B2 fetch integration, HTTPS/TLS and S7 Domains deferred. Full notes: https://raw.githubusercontent.com/voytas75/PSWebCrawler/master/PSWebCrawler/docs/ReleaseNotes.md

FileList

PSWebCrawler.nuspec
PackageIntegrity.json
PSWebCrawler.psd1
PSWebCrawler.psm1
Data\useragents.txt
docs\ReleaseNotes.md
images\PSWC.png
images\PSWCbanner.txt
Private\Get-PSWCDoctor.ps1
Private\Get-PSWCImageUrls.ps1
Private\watch.ps1
lib\core\HtmlAgilityPack.dll
lib\Net45\HtmlAgilityPack.dll

Version History

Version	Downloads	Last updated
0.2.0 (current version)	9	10/31/2026
0.0.5	1,316	12/30/2023
0.0.4	12	12/19/2023
0.0.3	11	12/12/2023
0.0.2	9	12/12/2023