Roxie Gibson 75afe20922 Script is finished!		vor 4 Jahren
.gitignore	accidently commited log files too	vor 4 Jahren
.pylint.rc	Initial Commit	vor 4 Jahren
.style.yapf	Initial Commit	vor 4 Jahren
Pipfile	Initial Commit	vor 4 Jahren
Pipfile.lock	Initial Commit	vor 4 Jahren
README.md	Script is finished!	vor 4 Jahren
main.py	Script is finished!	vor 4 Jahren
requirements.txt	Initial Commit	vor 4 Jahren
urls.json	Script is finished!	vor 4 Jahren

Landbot.io scraper

Script to scrape a number of landbot.io chat bot messages. This keeps intact choices, dialogue blocks, and image and youtube links.

Installation

Installation requires Python 3.6+, pip, and venv

Also requires Firefox and the Gecko drivers for selenium to interact with Firefox.

git clone REPO_URL
cd landbot_scrape
python3 -m venv .venv
source .venv/bin/activate
python3 -m pip install -r requirements.txt

Add all required urls to scrape to the json file urls.json

To run the script, make sure you are source’d into the virtual env, then run

python3 main.py