Yeah, in terms of performance there is not much if anything you can do: the unlink is expensive and not as optimized as other filesystem operations, on the design level.
Relevant thread: Unlink performance on FreeBSD
Perhaps even doing everything sequentially can be faster by reducing contention.