Initial crawl job generates a dataset to disk in $CLOUD_CONNECTOR_INSTALL_DIR/$ARCH/er-crawler/storage/datasets/default, containing all successfully crawled document identifiers as well as all errors that happened during that crawl. Objective of this dataset, is to be able to analyze & replay the crawl to recover errors that happened.

To generate an HTML view of this dataset, you can use the provided command line interface: er-crawler-dataset-cli.

• Linux

$CLOUD_CONNECTOR_INSTALL_DIR/$ARCH/code/command/er-crawler-dataset-cli.sh -D $CLOUD_CONNECTOR_INSTALL_DIR/$ARCH/er-crawler/storage/datasets/default generate-html -o $YOUR_OUTPUT_DIR

• Windows

%CLOUD_CONNECTOR_INSTALL_DIR%\%ARCH%\code\command\er-crawler-dataset-cli.bat -D %CLOUD_CONNECTOR_INSTALL_DIR%\%ARCH%\er-crawler\storage\datasets\default generate-html -o %YOUR_OUTPUT_DIR%

• DS Doc - Indexing 3DSpace On-premises Data on the Cloud
• Wiki R&D - Cloud Supplemental
• EDF Road to Cloud - NETVIBES OnPremise Cloud Connector
• EDF Road to Cloud - Administration OP - RAZ & Indexation Full Cloud Connector
• EDF Road to Cloud - (Internal) Unboxing DATA SCIENCE R2023X/R2024x