Search Unity

  1. Welcome to the Unity Forums! Please take the time to read our Code of Conduct to familiarize yourself with the forum rules and how to post constructively.
  2. We have updated the language to the Editor Terms based on feedback from our employees and community. Learn more.
    Dismiss Notice

Sound visualisation app - Unity?

Discussion in 'iOS and tvOS' started by akuz_me, Feb 11, 2020.

  1. akuz_me

    akuz_me

    Joined:
    Feb 11, 2020
    Posts:
    5
    Dear Unity experts!

    I've started developing a sound visualisation app using JUCE framework.
    It is based on a novel algorithm of high-resolution frequency detection, which I implemented in C++.
    I am currently doing some 2D visualisations without any acceleration, and I wanted to try some 3D ones..
    However, JUCE doesn't support Metal yet, and I was looking for frameworks that do, and found Unity.

    My main question is if you would recommend me to use Unity for my purpose or not?
    The main functionality of the app would be displaying the constantly changing visual effects...
    There will be some "usual GUI" elements to configure the thing..
    But the main load will be for complex visualisations on screen...
    So it's kind of like a game, isn't it?

    I would just need the app to be able to consume audio input from a microphone for starters.
    But in the future, I would like to be able to consume from other sound interfaces connected to iPhone.
    Is there a way to configure sound input in Unity (not just from the microphone)?

    Do you think Unity would be a good framework for me?

    Thanks in advance!

    Added later:

    Also, I would need to run my C++ algorithm within the Unity app (do extract information from the raw sound).
    Is it possible to do, or would I need to further wrap it as a component in some other language that Unity uses?
    Basically, can I just program in C++ in Unity?
     
  2. mgear

    mgear

    Joined:
    Aug 3, 2010
    Posts:
    9,022
  3. akuz_me

    akuz_me

    Joined:
    Feb 11, 2020
    Posts:
    5
    @mgear - thanks for your reply!

    Does this mean that if I want to use my C++ code from within Unity, I will have to make it available through Native Plugin?

    Thanks for the links!
     
  4. akuz_me

    akuz_me

    Joined:
    Feb 11, 2020
    Posts:
    5
    Also, there seems to be no access to "real-time" sound from the Microphone class in Unity...
    So do I have to make a native plugin to access real-time audio as well?
     
  5. mgear

    mgear

    Joined:
    Aug 3, 2010
    Posts:
    9,022
  6. akuz_me

    akuz_me

    Joined:
    Feb 11, 2020
    Posts:
    5