HomePhorge

Modify WikiExporter's BATCH_SIZE from 50000 to 10000

This commit no longer exists in the repository. It may have been part of a branch which was deleted.

Description

Modify WikiExporter's BATCH_SIZE from 50000 to 10000

On T207628, as part of performance tuning, WikiExporter's BATCH_SIZE
was set to 50000. There was no decisive benchmarking done to support
that size. We have recently seen a lot of database pressure coming from
this configuration.

We now set it to 10000. The thinking is that this may not affect the
runtime of the dumps in a significant way, while alleviating strain
on the databases.

Bug: T368098
Change-Id: I2fd67c656c5c57fd94165bab22a62edae8f5f46a

Details

Provenance
Xabriel J. Collazo MojicaAuthored on Jun 25 2024, 5:56 PM

Event Timeline

Xabriel J. Collazo Mojica <xcollazo@wikimedia.org> committed rMWe97a52e32770: Modify WikiExporter's BATCH_SIZE from 50000 to 10000 (authored by Xabriel J. Collazo Mojica <xcollazo@wikimedia.org>).Jun 25 2024, 6:05 PM

Commit No Longer Exists

This commit no longer exists in the repository.