Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.

Bug Legacy Raw Data Export is really slow to generate data

Discussion in 'Unity Analytics' started by bgroves_ce, Jul 14, 2022.

  1. bgroves_ce

    bgroves_ce

    Joined:
    Jan 4, 2019
    Posts:
    7
    For our project, we have a daily process that collects the previous day's Legacy Unity Analytics through the Raw Data Export API. It's been running great for a long time, usually takes a couple minutes between request and when the data is available to download.

    Tuesday July 12th the data started taking really long to post, over a half hour.

    Yesterday July 13th was slower to return, the queries wound up being fulfilled overnight.

    Hopefully this is a temporary thing, but is anyone else seeing this? Is it on Unity's radar?

    Thanks All.
     
    bgroves_ce, Jul 14, 2022
    #1

  2. JeffDUnity3D

    JeffDUnity3D

    Unity Technologies

    Joined:
    May 2, 2017
    Posts:
    14,446
    We not heard of this issue yet. Are the exports slow in the dashboard too? So you know, this service of legacy Analytics is now deprecated and will be eventually turned off. We offer Data Access for the new version of Analytics now available https://docs.unity.com/analytics/DataAccess.html
     
    JeffDUnity3D, Jul 14, 2022
    #2

  3. bgroves_ce

    bgroves_ce

    Joined:
    Jan 4, 2019
    Posts:
    7
    Hi Jeff! Thank you for the quick reply. I recognize that avatar, it's an honor.

    Yes, exports are slow in the dashboard also.

    Understood Legacy Analytics end of life is at the end of the year, we are working it into our roadmap. Hopefully the system is staying stable till then so we have time to retool and adapt, yes?

    Thanks Again!
     
    bgroves_ce, Jul 14, 2022
    #3

  4. legends-of-learning

    legends-of-learning

    Joined:
    May 1, 2018
    Posts:
    3
    We are experiencing extreme slowness as well. Raw data export jobs that used to take about a minute are taking hours, though the "duration" does not reflect that time.
     
    legends-of-learning, Jul 14, 2022
    #4

  5. JeffDUnity3D

    JeffDUnity3D

    Unity Technologies

    Joined:
    May 2, 2017
    Posts:
    14,446
    Understood, we are checking.
     
    JeffDUnity3D, Jul 15, 2022
    #5
    bgroves_ce likes this.

  6. JeffDUnity3D

    JeffDUnity3D

    Unity Technologies

    Joined:
    May 2, 2017
    Posts:
    14,446
    @bgroves_ce and @legends-of-learning Might either of you have an example RDE curl request that is failing that you could pass along in a private message here? It would be very helpful, thanks
     
    JeffDUnity3D, Jul 19, 2022
    #6

  7. bgroves_ce

    bgroves_ce

    Joined:
    Jan 4, 2019
    Posts:
    7
    I think so. I will contact via private message.
     
    bgroves_ce, Jul 19, 2022
    #7

  8. legends-of-learning

    legends-of-learning

    Joined:
    May 1, 2018
    Posts:
    3
    In my case, I am not seeing a failed API call. I have jobs that are taking a large amount of time -- days -- to get started. We query once a day, and I have a job that was so delayed that by the time it ran for 1m16s, it gathered data for the 2022/07/12 - 2022/07/15 time range. If it would help, I can send you the job IDs.
     
    legends-of-learning, Jul 20, 2022
    #8

  9. JeffDUnity3D

    JeffDUnity3D

    Unity Technologies

    Joined:
    May 2, 2017
    Posts:
    14,446
    I believe we have everything we need now, but thanks! We are able to reproduce and attempting to track down where the slowness is coming from.
     
    JeffDUnity3D, Jul 20, 2022
    #9

  10. legends-of-learning

    legends-of-learning

    Joined:
    May 1, 2018
    Posts:
    3
    Our jobs moved at the regular pace the last couple nights. Thank you!
     
    legends-of-learning, Jul 28, 2022
    #10

  11. bgroves_ce

    bgroves_ce

    Joined:
    Jan 4, 2019
    Posts:
    7
    I am pleased to say, things look to be running smoothly on our end too.

    Much Thanks, JeffDUnity3D and Company!
     
    bgroves_ce, Aug 3, 2022
    #11

  12. JeffDUnity3D

    JeffDUnity3D

    Unity Technologies

    Joined:
    May 2, 2017
    Posts:
    14,446
    @bgroves_ce Great! Yes, we believe we have resolved the issue.
     
    JeffDUnity3D, Aug 3, 2022
    #12