26 May 2022

Morsel #4: bulk upload to Internet Archive with waybackpy

My fourth morsel is a way to backup your site to the Internet Archive.

Requirements

• Python 3
• waybackpy
• advertools

Links

• GitHub link

I adapted some code from Koray Tuğberk GÜBÜR by using advertools to pull pages from a sitemap and to_list() over apply() and a lambda function when extracting URLs to iterate over. Purely a preference thing.

Also shout out to Elias Dabbas for the advertools library which has made sitemap handling in Python so much easier.