AssetBundle building crashes: System out of memory

Hi there,
We're currently trying to include most of our project assets into AssetBundles.

The process of naming this AssetBundles is not a problem. The problem reaches when we try to compile them. We're working with a huge volume of project assets (like 40K assets, 100GB size) in about 2700 AssetBundles.
When we send all this AssetBundles to build Unity begins to generate them, but at some point it crashes with a 'System out of memory' exception.

​

Some workaround we've tried consist on send small bundles lists to build, one at a time, until be able to compile all of them. This workaround brings new problems. It generates a lot of asset duplication into the Bundles, because required dependencies may not be included in the current building list. In addition, it never generates the single manifest file with all the required Bundles, only with the last small list sent to build.

Are we missing out on something in this bundling process? What would be the best way to deal with this memory crashes and the huge asset volume? Could it just be a Unity build related bug?

 

Hi there!

After a week of researching this issue we still have no solution.
The crash remains in all Unity versions we have tested (2017.4.7f1, 2017.4.14f1, 2018.2.0f2 and 2018.2.14f1) and with all bundle compression options (None LZMA, ChunkBased LZ4 and Uncompressed).

Any ideas?
Thanks!