Bug Raw Data Export results Internal Server Error or empty results

We're experiencing problems while creating new exports, trying to export custom events from end of last year:

• these are occuring via Raw Data Export Frontend and REST API
• 429 Internal Server Error
• wrongfully empty export sets ( size=0, eventCount=0)

Is this a known problem?

 

We had an issue with RDE which as since been resolved, can you try again? The 429 error means you are exceeding the request rate. For a short time, we were limiting requests to 1 report per hour, but please try again

 

Sorry, we still got an empty report result. Additionally the 429 error is resulted, despite us waiting 1h40mins beween the report creation.

 

It will be empty if there is no data. Does Data Explorer show the events for that time period? If so, then yes there seems to still be a problem. We are still discussing the throttle limit, hopefully be able to remove it.

 

Yes, we checked this already in the frontend. We're getting data vizualized there:



Thats why I'm reporting this as a bug here.

 

Got it, thanks for sharing. Can you send me your ProjectID in a private message? We will check.

 

@MB-3DQR We are seeing recent data available via RDE. Unfortunately earlier data that you requested is not available. This service is now deprecated and in maintenance mode with no resources available to work on it, sorry about that. Also, we are now limiting requests to one per hour and is the cause of the 429 dialog. We are working on a better error message.

 

@JeffDUnity3D couild you be more specific, how "recent" is defined?

We're actually relying on this data we collected since 09/2021
Then we'd like to request an export in whatever format is available to you. Were can we raise this request?

 

You will need to find out yourself unfortunately. Just use a binary search approach to to quickly find the first date available. And no, we are not able to make manual exports, sorry.

 

I am getting a `429 Internal Server Error` when hitting the api endpoint `https://analytics.cloud.unity3d.com/api/v2/projects/unity_project_id/rawdataexports`.
I have roughly made 20 requests in the past hour. Is there a request limit I am not aware of?
I have not hit my Data Processing Limits.

 

Yes please see my earlier post. "Also, we are now limiting requests to one per hour and is the cause of the 429 dialog. We are working on a better error message."

 

Could I recommend that if Unity doesn't support this service in its full form then to edit this in the manual and the raw data export page?

Even the current version of the RDE page claims that we can retrieve data anytime:
"With Raw Data Export, Unity lets you pull data at any time - which means you can add key data to your own internal dashboards with ease. Click here to learn more about using Raw Data Export."

from the manual page:
"Raw Data Export provides data from June 2016 onwards."

In reality it looks like there is no more than 3 months of data being stored in RDE format.
I'm in dire need of the export to do more in depth analysis of one years worth of data which the unity analytics data explorer and funnels does not support.

 

I got confirmation now that Raw Data Export doesn't keep the data for longer than 3 months so that data has now been deleted by Unity on their own servers.