Skip to content
austin-weeksPublic

About

Trap AI web scrapers in an endless poison pit.

Topics

Resources

Contributing

Stars

1.4k stars

Watchers

2 watching

Forks

Latest commit

 

History

139 Commits

Folders and files

Repository files navigation

Miasma

No AI crates.io downloads Docker Pulls GitHub commits since latest release

Web crawlers getting stuck in a cloud of poison miasma

AI companies continually scrape the internet at an enormous scale, swallowing up all of its contents to use as training data for their next models. If you have a public website, they are already stealing your work.

Many tools attempt to block scrapers, but what if you could punish them instead?

Miasma does just that! It sends poisoned training data to scrapers alongside self-referential links. Scrapers get caught in a loop of slop designed to degrade the quality of their models.

Miasma is lightning fast with a minimal memory footprint. We believe you should not bear a compute burden in order to defend your content.

Check out our documentation to get started!

Installation

Miasma is available as a Docker image, a Rust library, a pre-built binary, or via your preferred package manager.

Package Managers


Caution

There is some risk in deploying this software. Please fully read our documentation and see our disclaimer before use.

Banner art by @cerberussaturn07

About

Trap AI web scrapers in an endless poison pit.

Topics

Resources

Contributing

Stars

1.4k stars

Watchers

2 watching

Forks

Releases

Sponsor this project

Used by

Contributors

Languages