Export writes massively many loose objects, resulting in slow conversions

There is no functionality for garbage collection or packing during export, resulting in a lot of loose objects within the repository. This can either lead to the conversion stalling on a spinning disk, or extremely slow subsequent pushes — which may even fail to timeouts.

---

hi,

first of all i want to thank your team for providing this plugin. it does seem superior to the fast-export alternative, and (i'm hoping, since i can't see the result yet) also a more-authentic conversion that seems to diligently convert each commit.

on this note, i am trying to use hg-git for the firefox repository. it's quite large, i admit. hg-git estimates the export at 820025 commits.

it seems there are periods where it is using an incredible amount of disk activity, which delays the conversion process.

i opened this ticket to see if the team could provide any insight as to what may cause this. is it the commit itself, if there are large changes?

all i know is there are periods where it is using lots of disk activity (say at 471999/820025) and then it will go on and seem fine for a bit and then again the same thing happens at 472067/820025, and then again at 472122/820025. around 64-66ish commits.

it is going on 4 days for this conversion now. i know it's a big repository and i'm not expecting miracles. i was hoping i could get some tips on settings or things i can do to speed this up, if i choose to ctrl+c and re-invoke the process (assuming i lose my export progress in doing so).