StreamingAssets files are compressed in APK when "Build App Bundle (Google Play)" option is used

1. What happened

We uploaded Android App Bundle (aab) to Google Play which was build with "Build App Bundle (Google Play)" option enabled in Unity (2019.2).
Then we noticed the problem that some StreamingAssets files are not loaded during runtime. Our app loads these files directly as byte sequence assuming that they are stored uncompressed inside APK.
So we get APK sample based on the uploaded aab and found out that these files are stored compressed (using HEX-editor on APK).
We checked all SteamingAssets files in our app and concluded that this issue takes place only for files that have uppercase letters in their path (relative to StreamingAssets).

Same behaviour in 2019.2.1, 2019.2.2.

2. How we can reproduce it using the example you attached

Sample project is just a new project created in Unity 2019.2 with ILL2CPP and ARM64 enabled for Android. Also there are some test files in StreamingAssets folder.
2.1. Build Android App Bundle file (aab) from Unity 2019.2.
2.2. Get APK from this aab using bundletool.
2.3. Use HEX-editor on APK to check which files from StreamingAssets are stored uncompressed.
StreamingAssets files in this project are:
StreamingAssets/file1.txt
StreamingAssets/File2.txt
StreamingAssets/folder1/file3.txt
StreamingAssets/folder1/File4.txt
StreamingAssets/Folder2/file5.txt
So only file1 and file3 are stored uncompressed. Their paths do not contain uppercase letters (relative to StreamingAssets).
2.4. Export Android Studio project with "Build App Bundle (Google Play)" enabled
2.5. Check build.gradle. noCompress section has all StreamingAssets files in lowercase:
aaptOptions {
noCompress = ['.unity3d', '.ress', '.resource', '.obb', 'file2.txt', 'file1.txt', 'folder2/file5.txt', 'folder1/file4.txt', 'folder1/file3.txt']
ignoreAssetsPattern = "!.svn:!.git:!.ds_store:!*.scc:.*:!CVS:!thumbs.db:!picasa.ini:!*~"
}

 

Got similar problem with aab. I can read anything that in StreamingAssets folder root. But anything that is in sub folders unity can't access. Instead i get DirectoryNotFoundException. If i use apk, everything works fine.

 

Other workaround is just to fix build.gradle file generated by

UnityEngine.BuildPipeline.BuildPlayer

before actual AAB building (

./gradlew bundleRelease

).

It's easier than applying lowercases (for example with Addressables package integrated).

Result is checked via

bundletool build-apks

and

unzip -vl

on all platfroms (linux, win, osx).

Code (CSharp):

1.     [UnityEditor.Callbacks.PostProcessBuild]
2.     public static void FixAndroidBuildGradleForAab(BuildTarget buildTarget, string buildPath) {
3.         if (buildTarget != BuildTarget.Android) return;
4.         var projectDir = Path.Combine(buildPath, PlayerSettings.productName);
5.  
6.         var assetsDir = Path.Combine(projectDir, "src/main/assets");
7.         _log.Log($"collect assets: {assetsDir}");
8.         var assetsMap = Directory.GetFiles(assetsDir, "*", SearchOption.AllDirectories)
9.             .Select(x => x.Substring(assetsDir.Length + 1))
10.             .ToDictionary(x => x.ToLower());
11.  
12.         var gradlePath = Path.Combine(projectDir, "build.gradle");
13.         _log.Log($"fix patterns: {gradlePath}");
14.         var content = File.ReadAllText(gradlePath);
15.         var mo = Regex.Match(content, @"noCompress = \[(.*)\]", RegexOptions.Singleline);
16.         var oldPatterns = mo.Groups[1].Value.Split(new[] {", "}, StringSplitOptions.None).Select(x => x.Trim('\''));
17.         var newPatterns = oldPatterns.Select(pattern => assetsMap.TryGetValue(pattern, out var realPath) ? realPath : pattern);
18.         var result = $"noCompress = [{string.Join(", ", newPatterns.Select(x => $"'{x}'"))}]";
19.         _log.Log($"result replace:\n{mo.Value}\n{result}");
20.         content = content.Replace(mo.Value, result);
21.         File.WriteAllText(gradlePath, content);
22.     }
23.  

 

On post build the player I does not find the directory:
DirectoryNotFoundException: Could not find a part of the path 'C:\aab\test\test\src\main\assets'. or
DirectoryNotFoundException: Could not find a part of the path 'C:\aab\test\test\src/main/assets'.
Any idea?
Thanks

 

New Unity (>2019) exports the project to subfoler <build-path>/unityLibrary/src/main/assets
And it's better to re-check noCompress values in new Unity.. possibly it's already fixed.

 

My proveded workaround that works with any unity and any gradle version is just to generate (or fix already generated) build.gradle to refer *files in it with their real-case* instead of lower-case only.

And even more - I think this solution is much better than depending on some new lower-case features of gradle.

And I don't understand - why you cannot generate build.gradle in a such correct way?)

 

Funny, it's really gradle bug.)
I didn't know, because I extract extract APK (for QA purpose) from AAB in the build process.
Thanks for the explanation.

 

Is it fixed in 2020.2?
I can't open any files in steaming assets. Even lowercase and in root.

 

We tried nik_d soln to no avail, it's only AAB and started happening about 2 weeks ago give or take
Not sure if it was any unity upgrade or addressables update so we're in the processing of eliminating everything
We are using LZ4 in Addressables.
This is not an issue whatsover with an apk, only an apk extracted from an AAB..
Our gradle is still using 3.4.0 but we tried nik_d soln above so it isn't the character casing for us unless addressables is doing something bad.

We are on 2019.4.13 ( we tried .11 and .14 no difference )

 

Are there any workarounds right now until this is fixed? The performance is really bad even on flagship phones. Maybe customizing the launcher gradle? We don't use that at the monent, just a vanilla mainTemplate

thanks

 

Thnx tomas, we added '.bundle' in there and it seemed to resolve our issues

 

there still have this problem on unity2020.3.x

 

Same here, did you find any workaround?

 

I started experiencing this problem after updating from 2019.4.10f1 to 2019.4.30f1. I tried using the Addressables 1.8.5 (the version used in the former Unity version), but the problem persisted even after downgrading the project back to 2019.4.10f1: APKs would work as usual but the AAB would be very slow during assets loading.

I've just updated Unity to 2020.3.19f1 (with Addressables 1.18.16) and I don't have the problem anymore (I had to update the launcher and main gradle files, which can be managed automatically by Unity if you uncheck, remove the files and re-check again from the Project settings).

There was definitely some compression applied in version 2019.4.30f1 since the downloaded APK from the Play Store was around 80 MB, and after building with 2020.3.19f1 the size is around 93 MB.

 

Still having the issue with 2021 LTS unity.

 

Android build with Asset Packs doesn't include Streaming Assets at all. I am using Unity 2021 LTS. Don't know what to do now as its very important.

 

How do I find that? How do I regenerate it?

 

Custom Gradle not selected in build settings. will check by generating a project

 

Here is the code which is present in the build.gradle file generated in Project. Is there any example Gradle file?

Code (JavaScript):

1. apply plugin: 'com.android.application'
2.  
3. dependencies {
4.     implementation project(':unityLibrary')
5.     }
6.  
7. android {
8.     compileSdkVersion 31
9.     buildToolsVersion '30.0.2'
10.  
11.     compileOptions {
12.         sourceCompatibility JavaVersion.VERSION_1_8
13.         targetCompatibility JavaVersion.VERSION_1_8
14.     }
15.  
16.  
17.  
18.     aaptOptions {
19.         noCompress = ['.unity3d', '.ress', '.resource', '.obb', '.unityexp'] + unityStreamingAssets.tokenize(', ')
20.         ignoreAssetsPattern = "!.svn:!.git:!.ds_store:!*.scc:.*:!CVS:!thumbs.db:!picasa.ini:!*~"
21.     }
22.  
23.  
24.     }
25.  
26.     lintOptions {
27.         abortOnError false
28.     }
29.  
30.     buildTypes {
31.         debug {
32.             minifyEnabled false
33.             proguardFiles getDefaultProguardFile('proguard-android.txt')
34.             signingConfig signingConfigs.release
35.             jniDebuggable true
36.         }
37.         release {
38.             minifyEnabled false
39.             proguardFiles getDefaultProguardFile('proguard-android.txt')
40.             signingConfig signingConfigs.release
41.         }
42.     }
43.  
44.     packagingOptions {
45.         doNotStrip '*/arm64-v8a/*.so'
46.     }
47.  
48.     assetPacks = [":UnityDataAssetPack", ":UnityStreamingAssetsPack"]
49.  
50.     bundle {
51.         language {
52.             enableSplit = false
53.         }
54.         density {
55.             enableSplit = false
56.         }
57.         abi {
58.             enableSplit = true
59.         }
60.     }
61. }
62.  

 

I can't create Build using the Android Project as well because of M1 Mac issue, could be found here https://forum.unity.com/threads/unity2021-2-7f1-with-android-studio-build-ndk-error.1219437/

Here is the Gradle.properties,
org.gradle.jvmargs=-Xmx4096M
org.gradle.parallel=true
android.enableR8=false
unityStreamingAssets=.ds_store, .manifest, .wtc, .wto, furnituremat, furnituremat-android
unityTemplateVersion=3
android.bundle.enableUncompressedNativeLibs=false
android.useAndroidX=true
android.enableJetifier=true

 

1. I build only in Unity with Assets Packs setup. And Upload the Build to Google Internal Test. After downloading I can see the error that it couldn't find the streaming assets which it used to find. So I downloaded the APK from there and checked and it isn't there.
2. When you asked me to export the project, I exported the project to check the Gradle settings. And found that M1 Macs cant build using Exported Projects. But I can see clearly in the exported project that Streaming Assets are included.

But the streaming assets are not included in the Build when generated from Unity.