logo logo

Custom Migration

Custom migration of NoSQL database

When you migrate from LevelDB to MinioDB using LevelDbMinioMigration(2022-12-06).exe tool, you can perform custom migration with definition of the database configuration or configuration of the migration itself. The tool offers several options you can use.

To see additional details run command: .\LevelDbMinioMigration(2022-12-06).exe migrate --help.

It is possible to set the database configuration:

  • S3 access key
  • bucket name
  • bucket region
  • endpoint
  • folder
  • secret key

In case you do not specify this configuration, migration tool uses the default SmartFace Platform configuration.

It is possible to set the batch size option for improved performance of the migration. Batch-size option can be used to control how much key-value pairs are migrated at once.

Custom migration of face templates

When you migrate your face templates using sfadmin.exe tool, you can perform custom migration with definition of the database configuration or configuration of the migration itself. The tool offers several options you can use. You can use the --help option to get more information on options available.

It is possible to set the database configuration:

  • connection string
  • S3 endpoint
  • S3 access key
  • S3 secret key
  • S3 bucket name
  • S3 bucket region
  • S3 folder

It is possible to set the RabbitMQ configuration:

  • RMQ user
  • RMQ password
  • RMQ host
  • RMQ virtual host
  • RMQ port

In case you do not specify this configuration, migration tool uses the default SmartFace Platform configuration.

Face templates migration performance

In case you have many data you can improve the performance and scale of the migration using your GPU or increase the parallelism by spawning more detection/extraction services.

The options --use-gpu-extrators and --parallelism can be used.

⚠️ Please note that when increasing the --parallelism option from the default value 1, you need to spawn more RpcExtractor services to actually improve the performance.

To spawn additional extractors:
locate the SmartFace installation folder C:\Program Files\Innovatrics\SmartFace, open Command Line from the folder and run command: start RpcExtractor.exe.

In case you would like to permanently register this service run command:
sc create "servicename" binpath= "\"C:\Program Files\Innovatrics\SmartFace\RpcExtractor.exe\" --gpu=true" start= delayed-aut.

⚠️ If the parallelism is set higher than the actual number of extractor processes, the face re-extractions can start to time-out and the migration will need to be run again.