DSE / NETVIBES Cloud Connector

.\er-crawler-manager-cli.bat --help

Usage: com.ds.apollo.er.crawler.manager.cli.ManagerCliMain [options] [command]
      [command options]
  Options:
    --help

  Commands:
    init      Initialize managed crawl operations to the cloud tenant
      Usage: init

    destroy      Stop managed crawl operations to the cloud tenant and delete
            the existing index unit
      Usage: destroy

    recrawl      Launch a managed re-crawl to the cloud tenant
      Usage: recrawl

    config      List configurations
      Usage: config [options]
        Options:
          --list-crawlable-datasources
            List crawlable data sources configurations
            Default: false
          --list-crawled-datasources
            List crawled data sources configurations
            Default: false

    crawl      Start an unmanaged crawl to the cloud tenant
      Usage: crawl [options]
        Options:
        * --strategy
            Crawl strategy
          --monitored
            True if the crawl should be monitored (true by default)
            Default: true

    test-cloud-connection      Test connection to the cloud tenant services
      Usage: test-cloud-connection

Checking initial crawl errors

Initial crawl job generates a dataset to disk in $CLOUD_CONNECTOR_INSTALL_DIR/$ARCH/er-crawler/storage/datasets/default, containing all successfully crawled document identifiers as well as all errors that happened during that crawl. Objective of this dataset, is to be able to analyze & replay the crawl to recover errors that happened.

To generate an HTML view of this dataset, you can use the provided command line interface: er-crawler-dataset-cli.

Linux

$CLOUD_CONNECTOR_INSTALL_DIR/$ARCH/code/command/er-crawler-dataset-cli.sh -D $CLOUD_CONNECTOR_INSTALL_DIR/$ARCH/er-crawler/storage/datasets/default generate-html -o $YOUR_OUTPUT_DIR

Windows

%CLOUD_CONNECTOR_INSTALL_DIR%\%ARCH%\code\command\er-crawler-dataset-cli.bat -D %CLOUD_CONNECTOR_INSTALL_DIR%\%ARCH%\er-crawler\storage\datasets\default generate-html -o %YOUR_OUTPUT_DIR%

Table des matières

DSE / NETVIBES Cloud Connector

Checking initial crawl errors

Links